Quinn, D. M., & Kim, J. S. (2017). Scaffolding fidelity and adaptation in educational program implementation: Experimental evidence from a literacy intervention. American Educational Research Journal , 54 (6), 1187-1220. Publisher's VersionAbstract
In a common approach for scaling up effective educational practice, schools adopt evidence-based programs to be implemented with fidelity. An alternative approach assumes that programs should be adapted to local contexts. In this randomized trial of a reading intervention, we study a scaffolded sequence of implementation in which schools first develop proficiency by implementing the program with fidelity before implementing structured adaptations. We find evidence supporting the scaffolded sequence: A fidelity-focused approach promoted learning and instructional change more so for teachers inexperienced with the intervention, while a structured adaptive approach was more effective for teachers experienced with the intervention. Students benefited more from the structured adaptive approach but only when their teacher had prior experience with the fidelity-focused version.
Quinn, D. M., & Kim, J. S. (2017). Experimental effects of program management approach on teachers’ professional ties and social capital. Educational Evaluation and Policy Analysis. Publisher's VersionAbstract
Theory and empirical work suggest that teachers’ social capital influences school improvement efforts. Social ties are prerequisite for social capital, yet little causal evidence exists on how malleable factors, such as instructional management approaches, affect teachers’ ties. In this cluster-randomized trial, we apply a decision-making perspective to compare a literacy intervention managed under a “fidelity-focused” approach, in which teachers were expected to implement researcher-designed procedures faithfully, versus a “structured adaptive” approach, in which teachers collaboratively planned program adaptations. In the short term, the adaptive approach increased teachers’ accessing of intervention-related social capital, but decreased their accessing of social capital unrelated to the intervention. Short-term effects varied based on participants’ role in the intervention. No group differences were found on social capital measures one year later, suggesting that the structured adaptive approach did not make teachers more likely to form ties that would be useful outside of the intervention.
Cooc, N., & Kim, J. S. (2017). Peer influence on children’s reading skills: A social network analysis of elementary school classrooms. Journal of Educational Psychology , 109 (5), 727-740. Publisher's VersionAbstract
Research has found that peers influence the academic achievement of children. However, the mechanisms through which peers matter remain underexplored. The present study examined the relationship between peers’ reading skills and children’s own reading skills among 4,215 total second- and third-graders in 294 classrooms across 41 schools. One innovation of the study was the use of social network analysis to directly assess who children reported talking to or seeking help from and whether children who identified peers with stronger reading skills experienced higher reading skills. The results indicated that children on average identified peers with stronger reading skills and the positive association between peer reading skills and children’s own reading achievement was strongest for children with lower initial levels of reading skills. The study has implications for how teachers can leverage the advantages of peers via in-class activities.
Kim, J. S., Burkhauser, M. A., Quinn, D. M., Guryan, J., Kingston, H. C., & Aleman, K. (2017). Effectiveness of structured teacher adaptations to an evidence-based summer literacy program. Reading Research Quarterly , 52 (4), 443–467. Publisher's VersionAbstract

The authors conducted a cluster-randomized trial to examine the effectiveness of structured teacher adaptations to the implementation of an evidence-based summer literacy program that provided students with (a) books matched to their reading level and interests and (b) teacher scaffolding for summer reading in the form of end-of-year comprehension lessons and materials sent to students’ homes in the summer months. In this study, 27 high-poverty elementary schools (75–100% eligibility for free or reduced-price lunch) were matched by prior reading achievement and poverty level and randomly assigned to one of two implementation conditions: a core treatment condition that directly replicated implementation procedures used in previous experiments, or a core treatment with structured teacher adaptations condition. In the adaptations condition, teachers were organized into grade-level teams around a practical improvement goal and given structured opportunities to use their knowledge, experience, and local data to extend or modify program components for their students and local contexts. Students in the adaptations condition performed 0.12 standard deviation higher on a reading comprehension posttest than students in the core treatment. An implementation analysis suggests that fidelity to core program components was high in both conditions and that teachers in the adaptations condition primarily made changes that extended or modified program procedures and activities in acceptable ways. Adaptations primarily served to increase the level of family engagement and student engagement with summer books. These results suggest that structured teacher adaptations may enhance rather than diminish the effectiveness of an evidence-based summer literacy program.

Kim, J. S., Hemphill, L., Troyer, M., Thomson, J. M., Jones, S. M., LaRusso, M., & Donovan, S. (2016). Engaging struggling adolescent readers to improve reading skills. Reading Research Quarterly. Publisher's VersionAbstract
This study examined the efficacy of a supplemental, multicomponent adolescent reading intervention for middle school students who scored below proficient on a state literacy assessment. Using a within-school experimental design, the authors randomly assigned 483 students in grades 6–8 to a business-as-usual control condition or to the Strategic Adolescent Reading Intervention (STARI), a supplemental reading program involving instruction to support word-reading skills, fluency, vocabulary, and comprehension, and peer talk to promote reading engagement and comprehension. The authors assessed behavioral engagement by measuring how much of the STARI curricular activities students completed during an academic school year, and collected intervention teachers’ ratings of their students’ reading engagement. STARI students outperformed control students on measures of word recognition (Cohen’s d = 0.20), efficiency of basic reading comprehension (Cohen’s d = 0.21), and morphological awareness (Cohen’s d = 0.18). Reading engagement in its behavioral form, as measured by students’ participation and involvement in the STARI curriculum, mediated the treatment effects on each of these three posttest outcomes. Intervention teachers’ ratings of their students’ emotional and cognitive engagement explained unique variance on reading posttests. Findings from this study support the hypothesis that (a) behavioral engagement fosters struggling adolescents’ reading growth, and (b) teachers’ perceptions of their students’ emotional and cognitive engagement further contribute to reading competence.
Kim, J. S., Guryan, J., White, T. G., Quinn, D. M., Capotosto, L., & Kingston, H. C. (2016). Delayed effects of a low-cost and large-scale summer reading intervention on elementary school children’s reading comprehension. Journal of Research on Educational Effectiveness , 9 (1), 1-22 . Taylor & Francis. Publisher's VersionAbstract
To improve the reading comprehension outcomes of children in high-poverty schools, policymakers need to identify reading interventions that show promise of effectiveness at scale. This study evaluated the effectiveness of a low-cost and large-scale summer reading intervention that provided comprehension lessons at the end of the school year and stimulated home-based summer reading routines with narrative and informational books. We conducted a randomized controlled trial involving 59 elementary schools, 463 classrooms, and 6,383 second and third graders and examined outcomes on the North Carolina End-of-Grade (EOG) reading comprehension test administered nine months after the intervention, in the children’s third- or fourth-grade year. We found that on this delayed outcome, the treatment had a statistically significant impact on children’s reading comprehension, improving performance by .04 SD(standard deviation) overall and .05 SD in high-poverty schools. We also found, in estimates from an instrumental variables analysis, that children’s participation in home-based summer book reading routines improved reading comprehension. The cost-effectiveness ratio for the intervention compared favorably to existing compensatory education programs that target high-poverty schools.
Lynch, K., & Kim, J. S. (2016). Effects of a summer mathematics intervention for low-income children. Educational Evaluation and Policy Analysis. Publisher's VersionAbstract
Prior research suggests that summer learning loss among low-income children contributes to income-based gaps in achievement and educational attainment. We present results from a randomized experiment of a summer mathematics program conducted in a large, high-poverty urban public school district. Children in the third to ninth grade (N = 263) were randomly assigned to an offer of an online summer mathematics program, the same program plus a free laptop computer, or the control group. Being randomly assigned to the program plus laptop condition caused children to experience significantly higher reported levels of summer home mathematics engagement relative to their peers in the control group. Treatment and control children performed similarly on distal measures of academic achievement. We discuss implications for future research.
Capotosto, L., & Kim, J. S. (2016). Literacy discussions in low-income families: The effect of parent questions on fourth graders’ retellings. First Language , 36 (1), 50-70 . SAGE Publications. Publisher's VersionAbstract
This study examines the effects of four types of reading comprehension questions – immediate, non-immediate, summary, and unanswerable questions – that linguistically diverse and predominantly low-income parents asked their fourth graders on children’s text retellings. One-hundred-twenty (N = 120) parent and child dyads participated in a home visit study in which they talked about narrative and informational texts. Moderation analyses indicated that immediate questions and non-immediate questions had a more positive effect on student retellings of an informational text and a narrative text, respectively, for less proficient than more proficient readers. These findings suggest that parents may be able to help their children, particularly less proficient readers, with text memory and text comprehension by asking specific types of questions.
Guryan, J., Kim, J. S., & Park, K. S. (2016). Motivation and incentives in education: Evidence from a summer reading experiment. Economics of Education Review , 55, 1-20. Publisher's VersionAbstract
Policymakers and economists have expressed support for the use of incentives in educational settings. In this paper, rather than asking whether incentives work, we focus on a different question: For whom and under what conditions do incentives work? This question is particularly important because incentives’ promise relies on the idea that they might take the place of some cognitive failing or set of preferences that otherwise would have led students to make choices with large long-term benefits. In this paper, we explore whether that is the case. In the context of a summer reading program called Project READS, we test whether responsiveness to incentives is positively or negatively related to the student's baseline level of motivation to read. As a part of the program, elementary school students are mailed books weekly during the summer. We implemented this book-mailing program as a randomized experiment with three treatment arms. Students in the first treatment arm were mailed books as a part of the standard Project READS program. Students in the second treatment arm were mailed books as a part of Project READS, and were also offered an incentive to read the books they were mailed. Students in the third experimental group served as a control and were given books after posttesting occurred in the fall. We find that, if anything, more motivated readers are more responsive to incentives to read, suggesting that to the extent that incentives are effective, they may not effectively target the students whose behavior they are intended to change
White, T. G., Kim, J. S., Kingston, H. C., & Foster, L. (2014). Replicating the effects of a teacher-scaffolded voluntary summer reading program: The role of poverty. Reading Research Quarterly , 49 (1), 5-30. Publisher's VersionAbstract

A randomized trial involving 19 elementary schools (K–5) was conducted to replicate and extend two previous experimental studies of the effects of a voluntary summer reading program that provided (a) books matched to students’ reading levels and interests and (b) teacher scaffolding in the form of end-of-year comprehension lessons. Matched schools were randomly assigned to implement one of two lesson types. Within schools, students were randomly assigned to a control condition or one of two treatment conditions: a basic treatment condition replicating procedures used in the previous studies or an enhanced treatment condition that added teacher calls in the summer. During summer vacation, students in the treatment conditions received two lesson books and eight books matched to their reading level and interests. Overall, there were no significant treatment effects, and treatment effects did not differ across lesson type. However, there was a significant interaction between the treatment conditions and poverty measured at the school level. The effects of the treatments were positive for high-poverty schools (Cohen ’ s d = .08 and .11, respectively), defined as schools where 75–100% of the students were receiving free or reduced-price lunch ( FRL ). For moderate poverty schools (45–74% FRL ), the effects of the treatments were negative (Cohen ’ s d = −.11 and −.12, respectively). The results underscore the importance of looking at patterns of treatment effects across different contexts, settings, and populations.

Kim, J. S., & Quinn, D. M. (2013). The effects of summer reading on low-income children’s literacy achievement from kindergarten to grade 8: A meta-analysis of classroom and home interventions. Review of Educational Research , 83 (3), 386-431. Publisher's VersionAbstract
This meta-analysis reviewed research on summer reading interventions conducted in the United States and Canada from 1998 to 2011. The synthesis included 41 classroom- and home- based summer reading interventions, involving children from kindergarten to Grade 8. Compared to control group children, children who participated in classroom interventions, involving teacher-directed literacy lessons, or home interventions, involving child-initiated book reading activities, enjoyed significant improvement on multiple reading outcomes. The magnitude of the treatment effect was positive for summer reading interventions that employed research-based reading instruction and included a majority of low-income children. Sensitivity analyses based on within-study comparisons indicated that summer reading interventions had significantly larger benefits for children from low-income backgrounds than for children from a mix of income backgrounds. The findings highlight the potentially positive impact of classroom- and home-based summer reading interventions on the reading comprehension ability of low- income children.
Olson, C. B., Kim, J. S., Scarcella, R., Kramer, J., Pearson, M., van Dyk, D. A., Collins, P., et al. (2012). Enhancing the interpretive reading and analytical writing of mainstreamed English learners in secondary school: Results from a randomized field trial using a cognitive strategies approach. American Educational Research Journal , 49 (2), 323-355. Publisher's VersionAbstract
In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook. Pathway teachers learned how to use an on-demand writing assessment to help mainstreamed English learners understand, interpret, and write analytical essays. In Year 2, treatment effects were replicated on an on-demand writing assessment (d = .67) and showed evidence of transfer to improved performance on a standardized writing test (d = .10). The results underscore the efficacy of a cognitive strategies reading/writing intervention for mainstreamed ELs in the secondary grades.
Kim, J. S., Capotosto, L. C., Hartry, A., & Fitzgerald, R. (2011). Can a mixed-method literacy intervention improve the reading achievement of low-performing elementary school students in an after-school program? Results from a randomized controlled trial of READ 180 Enterprise. Educational Evaluation and Policy Analysis , 33 (2), 183-201. Publisher's VersionAbstract
This article describes an independent evaluation of the READ 180 Enterprise intervention designed by Scholastic, Inc. Despite widespread use of the program with upper elementary through high school students, there is limited empirical evidence to support its effectiveness. In this randomized controlled trial involving 312 students enrolled in an after-school program, we generated intention-to-treat (ITT) and treatment-on-the-treated (TOT) estimates of the program’s impact on several literacy outcomes of fourth, fifth, and sixth graders reading below proficiency on a state assessment at baseline. READ 180 Enterprise students outperformed control group students on vocabulary (d = .23) and reading comprehension (d = .32), but not on spelling and oral reading fluency. We interpret the findings in light of the theory of instruction underpinning the READ 180 Enterprise intervention.
Kim, J. S., Olson, C. B., Scarcella, R., Kramer, J., Pearson, M., van Dyk, D., Collins, P., et al. (2011). A randomized experiment of a cognitive strategies approach to text-based analytical writing for mainstreamed Latino English language learners in grades 6-12. Journal of Research on Educational Effectiveness , 4 (3), 231-263. Publisher's VersionAbstract
This study reports year 1 findings from a multi-site cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English Language learners (ELLs) in 9 middle schools and 6 high schools. 103 English teachers were stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners’ English language development. Pathway teachers participated in 46 hours of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = .35) and the California Standards Test in English Language Arts (d = .07).
Kim, J. S., & White, T. G. (2011). Solving the problem of summer reading loss. The Phi Delta Kappan , 92 (7), 64-67. Publisher's Version
White, T. G., & Kim, J. S. (2010). Can silent reading in the summer reduce socioeconomic differences in reading achievement? In E. H. Hiebert & D. R. Reutzel (Ed.), Revisiting Silent Reading: New Directions for Teachers and Researchers (pp. 67-94) . Newark, DE, International Reading Association. Publisher's VersionAbstract
This chapter addresses an important issue for education policymakers and practitioners in the United States. The question we ask is whether socioeconomic differences in reading achievement can be reduced by programs that encourage silent reading in the summer months.1 In the years following school entry, children of low socioeconomic status (SES) lose ground in reading relative to their high-SES counterparts. This widening achievement gap may be largely the result of different rates of learning during the summer months (e.g., Alexander, Entwisle, & Olson, 2001; Cooper, Nye, Charlton, Lindsay, & Greathouse, 1996; Heyns, 1978). Even small differences in summer learning can accumulate across years resulting in a substantially greater achievement gap at the end of elementary school than was present at the beginning (Alexander, Entwisle, & Olson, 2004; see also Borman & Dowling, 2006; Lai, McNaughton, Amituanai- Toloa, Turner, & Hsiao, 2009).
Kim, J. S., Samson, J. F., Fitzgerald, R., & Hartry, A. (2010). A randomized experiment of a mixed-methods literacy intervention for struggling readers in grades 4 to 6: Effects on word reading efficiency, reading comprehension and vocabulary, and oral reading fluency. Reading and Writing: An Interdisciplinary Journal , 23 (1), 1109-1129. Publisher's VersionAbstract
The purpose of this study was (1) to examine the causal effects of READ 180, a mixed- methods literacy intervention, on measures of word reading efficiency, reading comprehension and vocabulary, and oral reading fluency and (2) to examine whether print exposure among children in the experimental condition explained variance in posttest reading scores. A total of 294 children in Grades 4 to 6 were randomly assigned to READ 180 or a district after-school program. Both programs were implemented four days per week over 23 weeks. Children in the READ 180 intervention participated in three 20-minute literacy activities, including (1) individualized computer-assisted reading instruction with videos, leveled text, and word study activities, (2) independent and modeled reading practice with leveled books, and (3) teacher- directed reading lessons tailored to the reading level of children in small groups. Children in the district after-school program participated in a 60-minute program in which teachers were able to select from 16 different enrichment activities that were designed to improve student attendance. There was no significant difference between children in READ 180 and the district after-school program on norm-referenced measures of word reading efficiency, reading comprehension, and vocabulary. Although READ 180 had a positive impact on oral reading fluency and attendance, these effects were restricted to children in Grade 4. Print exposure, as measured by the number of words children read on the READ 180 computer lessons, explained 4% of the variance in vocabulary and 2% of the variance in word reading efficiency after all pretest reading scores were partialed out.
Kim, J. S. (2010). Summer reading summer not: How Project READS can advance equity . Arlington, VA, The Mid-Atlantic Equity Center, The George Washington University Center for Equity and Excellence in Education. Publisher's VersionAbstract
This paper has three goals. First, it describes the broader research on summer reading loss. Second, it discusses how research and development efforts informed the key components of Project READS (Reading Enhances Achievement During Summer), a scaffolded voluntary summer reading intervention for children in grades 3 to 5. The second part of the paper also describes results from four randomized experiments, which provide rigorous evidence on the efficacy of the READS logic model. Third, it concludes with a checklist to guide districts and schools interested in implementing and evaluating a scaffolded voluntary summer reading program like Project READS.
Gersten, R., Dimino, J., Jayanthi, M., Kim, J. S., & Santoro, L. E. (2010). Teacher Study Group: Impact of the professional development model on reading instruction and student outcomes in first grade classrooms. American Educational Research Journal , 47 (3), 694-739. Publisher's VersionAbstract
Randomized field trials were used to examine the impact of the Teacher Study Group (TSG), a professional development model, on first grade teachers’ reading comprehension and vocabulary instruction, their knowledge of these areas, and on the comprehension and vocabulary achievement of their students. The multi-site study was conducted in three large urban school districts from three states. A total of 81 first grade teachers and their 468 students from 19 Reading First schools formed the analytic sample in the study. Classrooms observations of teaching practice showed significant improvements in TSG schools. TSG teachers also significantly outperformed control teachers on the teacher knowledge measure of vocabulary instruction. Confirmatory analysis of student outcomes indicated marginally significant effects in oral vocabulary.
Kim, J. S., & Guryan, J. (2010). The efficacy of a voluntary summer book reading intervention for low-income Latino children from language minority families. Journal of Educational Psychology , 102 (1), 20-31. Publisher's VersionAbstract

The effects of a voluntary summer reading intervention with and without a parent training component were evaluated with a sample of low-income Latino children from language minority families. During the last month of fourth-grade, 370 children were pretested on a measure of reading comprehension and vocabulary and randomly assigned to (1) a treatment group in which children received 10 self-selected books during summer vacation, (2) a family literacy group in which children received 10 self-selected books and were invited with their parents to attend 3 2- hour summer literacy events, and (3) a control group. Although children in the treatment group and family literacy group reported reading more books than the control group, there was no significant effect on reading comprehension and vocabulary. Recommendations for improving the efficacy of the intervention are discussed, including efforts to improve the match between reader ability and the readability of texts and the instructional goals of the family literacy events.