The Impact of Vocabulary Instruction on Passage-Level Comprehension of School-Age Children: A Meta-Analysis

Abstract

A meta-analysis of vocabulary interventions in grades pre-K to 12 was conducted with 37 studies to better understand the impact of vocabulary on comprehension. Vocabulary instruction was found to be effective at increasing students' ability to comprehend text with custom measures (d = 0.50), but was less effective for standardized measures (d = 0.10). When considering only custom measures, and controlling for method variables, students with reading difficulties (d = 1.23) benefited more than three times as much as students without reading problems (d = 0.39) on comprehension measures. Gains on vocabulary measures, however, were comparable across reading ability. In addition, the correlation of vocabulary and comprehension effects from studies reporting both outcomes was modest (r = .43).     

Exploring the Value Added of a Guided,Silent Reading Intervention: Effects on Struggling Third-Grade Readers’ Achievement

ABSTRACT

The authors’ purpose was to explore the effects of a supplementary, guided, silent reading intervention with 80 struggling third-grade readers who were retained at grade level as a result of poor performance on the reading portion of a criterion referenced state assessment. The students were distributed in 11 elementary schools in a large, urban school district in the state of Florida. A matched, quasi-experimental design was constructed using propensity scores for this study. Students in the guided, silent reading intervention, Reading Plus, evidenced higher, statistically significant mean scores on the Florida Comprehensive Assessment Test criterion assessment measure of reading at posttest. The effect size, favoring the guided, silent reading intervention group was large, 1 full standard deviation, when comparing the 2 comparison groups’ mean posttest scores. As such, the results indicate a large advantage for providing struggling third-grade readers guided silent reading fluency practice in a computer-based practice environment. No significant difference was found between the treatment and control group on the Stanford Achievement Test–10 (SAT-10) posttest scores, although posttest scores for the treatment group trended higher than the control. After conducting a power analysis, it was determined that the sample size (n = 80) was too small to provide sufficient statistical power to detect a difference in third-grade students’ SAT-10 scores.     

Readers Theatre: effects on word recognition automaticity and reading prosody

In this quasi‐experimental study, the researchers examined the effects of implementing Readers Theatre in a second grade classroom, comprised of seven and eight‐year‐old students. The 70 subjects were chosen as a non‐probability sample from two different classes and served as the treatment (n = 29) and comparison (n = 41) groups. A repeated measures analysis of variance revealed statistically significant interaction and time effects. The post hoc analysis of simple effects indicated that the Readers Theatre treatment yielded larger effects on word recognition automaticity and prosody. Practical implications of this study suggest that consistent implementation of Readers Theatre in grade two classrooms can have a large impact on students' reading fluency.     

The Poor Get Richer: Heterogeneity in the Efficacy of a School-Level Intervention for Academic Language

We investigate the impact of a relatively brief cross-curricular intervention, Word Generation, on middle school students' development of taught academic vocabulary. Students (n = 8382) in forty-four middle schools in three urban districts were randomly assigned to treatment or control conditions. Treatment teachers implemented the program with minimal support and varying levels of commitment. Students in treatment schools scored almost a point higher on the curriculum-based vocabulary posttests than those in control schools (Hedges's g = 0.094, p < 0.05). Though there was no main treatment effect on the standardized measures of students' general vocabulary knowledge or reading comprehension, baseline-by-treatment interactions at the school and student level acted to attenuate the Matthew Effect in reading and vocabulary growth.     

Findings From a Multiyear Scale-Up Effectiveness Trial of Open Court Reading

This multiyear scale-up effectiveness study of Open Court Reading (OCR) involved approximately 4,500 students and more than 1,000 teachers per year in Grades K–5 from 49 elementary schools in seven districts across the country. Using a school-level cluster randomized trial design, we assessed the implementation and effectiveness of Open Court Reading over two years. Implementation study results demonstrated adequate to high levels of fidelity across the treatment schools. Intent-to-treat analyses revealed no statistically significant main effects on students’ reading performance in Year 1 and a small negative effect (d = – .09) in Year 2. There were positive impacts for particular subgroups, including kindergarten (d = .12) and Hispanic (d = .10) students in the first year. However, there were negative impacts for first grade (d = –.13), females (d = –.11), students who were not eligible for free or reduced-price lunch (d = –.19), and non-English language learners (d = –.10) in the second year of the study. Thus, relative to the “business-as-usual” reading curricula, no positive overall impacts of OCR and mixed impacts for student subgroups were found.     

Goals,data use,and instruction: the effect of a teacher professional development program on reading achievement

In this paper, we investigated whether student reading comprehension could be improved with help of a teacher Professional Development (PD) program targeting goals, data use, and instruction. The effect of this PD program on 2nd- and 3rd-grade student achievement was examined using a pretest-posttest control group design. Applying propensity score matching, 35 groups in the experimental condition were matched to 35 control groups. Students in the experimental condition (n = 420) scored significantly higher on a standardized assessment than the control condition (n = 399), the effect size being d = .37. No differential effects of the PD program were found in relation to initial reading performance or grade. Different model specifications yielded similar albeit smaller effect sizes (d = .29 and d = .30). At the end of the program, students in the experimental condition were more than half a year ahead of students in the control condition.     

Evidence for a simplicity principle: teaching common complex grapheme‐to‐phonemes improves reading and motivation in at‐risk readers

This study examines the effects of teaching common complex grapheme‐to‐phoneme correspondences (GPCs) on reading and reading motivation for at‐risk readers using a randomised control trial design with taught intervention and control conditions. One reading programme taught children complex GPCs ordered by their frequency of occurrence in children's texts (a ‘simplicity principle’). The other reading programme taught children word usage. Thirty‐eight students participated in the 9‐week programme of 30 supplemental small group sessions. Participants in the complex GPC group performed significantly better at post‐tests with generally large value‐added effect sizes (Cohen's d) at both by‐participant and by‐item for spelling, d = 1.85, d = 1.16; word recognition with words containing taught GPCs, d = 0.96, d = 0.95; word recognition, d = 0.79, d = 0.61, and reading motivation, d = 0.34, d = 0.56. These findings suggest that the simplicity principle aids in structuring maximally effective supplemental phonic interventions.     

Long-Term Follow-Up of Spanish and English Interventions for First-Grade English Language Learners at Risk for Reading Problems

Abstract

We provide data 3 to 4 years postintervention for four samples of English language learners from two sequential Grade 1 cohorts who received supplemental Grade 1 reading interventions in Spanish or English and for whom the language of instruction for intervention was matched with language of core reading instruction. Participants were 300 students at risk for reading difficulties who were randomly assigned to intervention or comparison groups; there were 186 students from the four samples assessed in both languages (Spanish, English) 3 or 4 years after intervention completion (Spring Grade 4 or 5). Findings from the Spanish study revealed few statistically significant differences in favor of intervention students on Spanish measures, although effect sizes generally favored this group (median d = +0.33). Findings from the English study also revealed few statistically significant differences in favor of intervention students, though again, effect sizes were positive (median d = +0.23). Transfer effects were generally small, though nearly all were positive. Although the effects were small, receipt of intervention in Grade 1 was associated with clinically significant gains in a variety of literacy-related domains 3 to 4 years after the termination of supplemental instruction.     

The Comparative Effects of Prediction/Discussion‐Based Learning Cycle,Conceptual Change Text,and Traditional Instructions on Student Understanding of Genetics

The present study examined the comparative effects of a prediction/discussion‐based learning cycle, conceptual change text (CCT), and traditional instructions on students' understanding of genetics concepts. A quasi‐experimental research design of the pre‐test–post‐test non‐equivalent control group was adopted. The three intact classes, taught by the same science teacher, were randomly assigned as prediction/discussion‐based learning cycle class (N = 30), CCT class (N = 25), and traditional class (N = 26). Participants completed the genetics concept test as pre‐test, post‐test, and delayed post‐test to examine the effects of instructional strategies on their genetics understanding and retention. While the dependent variable of this study was students' understanding of genetics, the independent variables were time (Time 1, Time 2, and Time 3) and mode of instruction. The mixed between‐within subjects analysis of variance revealed that students in both prediction/discussion‐based learning cycle and CCT groups understood the genetics concepts and retained their knowledge significantly better than students in the traditional instruction group.     

Examining the Effects and Feasibility of a Teacher-Implemented Tier 1 and Tier 2 Intervention in Word Reading,Fluency, and Comprehension

This study investigates the effects and feasibility of an intervention for first-grade students at risk for reading difficulties or disabilities (RD). The intervention was provided by general education classroom teachers and consisted of 15 min whole-class comprehension lessons (Tier 1) and 30 min Tier 2 intervention sessions in word reading, comprehension, and text reading. First-grade teachers (n = 21), with 4–5 students at risk for reading difficulties and potential reading disability were randomly assigned to treatment or typical practice comparison conditions. Significant group differences were detected on all measures of word reading, decoding, and fluency. Effect sizes were educationally important for all measures of word reading, decoding, and reading comprehension; however, effects on standardized measures were smaller than those in prior studies with similar students in which intervention was typically provided outside the regular classroom. An exploratory analysis indicated that students at different parts of the pretest and posttest distributions responded more and less positively to the intervention, providing insights that may help guide future revisions. The study provides preliminary evidence of the intervention's promise for positively impacting student outcomes.     

Improving reading comprehension with readers theater

Abstract

Although readers theater has traditionally been recommended as a method for improving reading fluency, this 18-week quasi-experimental study examined the effects of a readers theater instructional protocol that updates and expands on traditional approaches by adding specific tasks that engage students in various reading comprehension and vocabulary activities. Because the students were not randomly assigned to either condition, propensity score matching was used to minimize potential bias between the groups. After the matching procedure, the overall total of second-grade students decreased from 145?to 76. A repeated-measures analysis of variance was conducted for all three measures. The results revealed statistically significant time effects on all three measures of the Gates-MacGinitie Reading Test, including decoding, word knowledge, and reading comprehension. Only the reading comprehension measure was qualified by an interaction effect, and the results favored the readers theater treatment group. Implications for instruction and future research are discussed.     

Reading intervention at age 6: Long-term effects of Reading Recovery in the UK on qualifications and support at age 16

One argument for early intervention for reading difficulties is that it can sustainably improve children’s reading competence trajectory (the ‘inoculation model’), but there are virtually no studies on sustained effects at the end of compulsory schooling. This study reports on a 10-year follow-up of a widely used early literacy intervention, Reading Recovery. UK schools adopting Reading Recovery enrol selected teachers for a year’s training, after which they provide one-to-one tutoring and typically act as literacy advisors. In a quasi-experimental, intention to treat, design, 293 6-year-olds with reading difficulties in 42 London schools were assigned to Reading Recovery (RR), standard provision in Reading Recovery schools (RRS) or standard provision in comparison schools (CS). Children were traced at ages 14 (204) and 16 (271) and data collected from the National Pupil Database. At age 14 and 16, significantly fewer RR than CS pupils were officially identified as having special educational needs, a potential consequence of reading difficulties. Using multi-level modelling and controlling for baseline reading and Free School Meal status (an indicator of poverty), at age 16 the RR group significantly outperformed the CS group on academic qualifications (GCSEs) (d = 0.52). However, the RRS group also performed significantly better than the CS group (d = 0.37), consistent with the fact that standard provision for weaker readers in RR schools differed from that provided in CS. Thus, these results support the long-term effects of early intervention but raise questions about the importance of whole-school effects and systemic intervention.     

Role of reading engagement in mediating effects of reading comprehension instruction on reading outcomes

The engagement model of reading development suggests that instruction improves students' reading comprehension to the extent that it increases students' engagement processes in reading. We compared how Concept‐Oriented Reading Instruction (CORI) (support for cognitive and motivational processes in reading), strategy instruction (support for cognitive strategies in reading), and traditional instruction in fourth‐grade classrooms differentially influenced students' reading comprehension, strategy use, and engagement in reading. Students experiencing CORI were significantly higher than both comparison groups on reading comprehension, reading strategies, and reading engagement. When students' level of reading engagement was statistically controlled, the differences between the treatment groups were not significant. We infer that the level of students' reading engagement during classroom work mediated the instructional effects on reading outcomes. © 2008 Wiley Periodicals, Inc.     

Improving reading in children with German as a first or second language

The study Improving Language And Reading Skills (LARS) in children with German as a first or second language evaluates a newly developed differentiating programme for reading in terms of its effects on the reading and language ability of second graders with German as a first or second language. The participant group consisted of 105 children. Fifty-five children belonged to the group that received the programme (LARS-group) and 50 children received traditional instruction (TI-group). The reading, spelling and language ability of each participating child were assessed before and after the programme period. The children of the LARS-group were supported over three months in terms of reading texts and completing the corresponding tasks. The texts and the tasks were adapted to the students' ability levels (three different ability levels: above average, average and below average level in reading). The results indicate that the learning outcomes for children in the LARS-classes were significantly higher for reading fluency and comprehension, but no effect was observed for language and spelling. The results suggest that the LARS programme was equally effective for children with German as a first or second language.     

Succeeding with High-Risk K–3 Populations Using Arts-Based Reading Instruction: A Longitudinal Study

ABSTRACT

Numerous studies have identified isolated elements for successfully teaching early reading. However, very few studies have examined the effect of early reading programs that use a combination of multiple research-based practices. A 4-year longitudinal study starting with 243 students was conducted to determine the effects of the Reading in Motion reading program on standardized measures of students’ reading skills. The program provided students from kindergarten through Grade 3 arts-based instruction in reading that teaches phonemic awareness, systematic phonics, and oral reading fluency using small groups and peer-assisted instruction with frequent, corrective feedback. Although the two groups were nearly identical upon entering kindergarten, the at-risk treatment students (N = 57) significantly outperformed control students (N = 48) at the end of kindergarten and Grades 1 and 2.     

Effectiveness of an extracurricular program for struggling readers: A comparative study with parent tutors and volunteer tutors

This study reviews the effectiveness of an extracurricular paired reading program to enhance the reading of struggling readers. For the first time, two program conditions are compared within one study: parent tutors and volunteer tutors. The program was implemented within a randomized controlled field trial; its effects on reading fluency and reading ability were investigated on a sample of 198 Swiss third graders with reading difficulties. The findings revealed that volunteers outperformed parents: Children who trained with volunteers developed significantly better reading fluency after 20 weeks (d = .21). However, the main effects on reading fluency did not last at follow-up and no effects on general reading ability were found. Children with higher reading fluency at the pretest benefitted significantly more than very poor readers (post-test: d = .47; 5 month FU: d = .39). The study highlights the benefit of volunteer tutoring and the necessity of ongoing, adaptive support for very poor readers.     

The effects of Common Knowledge Construction Model sequence of lessons on science achievement and relational conceptual change

The purpose of this study was to investigate the effects of the Common Knowledge Construction Model (CKCM) lesson sequence, an intervention based both in conceptual change theory and in Phenomenography, a subset of conceptual change theory. A mixed approach was used to investigate whether this model had a significant effect on 7th grade students' science achievement and conceptual change. The Excretion Unit Achievement Test (EUAT) indicated that students (N = 33) in the experimental group achieved significantly higher scores (p < 0.001) than students in the control group (N = 35) taught by traditional teaching methods. Qualitative analysis of students' pre‐ and post‐teaching conceptions of excretion revealed (1) the addition and deletion of ideas from pre‐ to post‐teaching; (2) the change in the number of students within categories of ideas; (3) the replacement of everyday language with scientific labels; and (4) the difference in the complexity of students' responses from pre‐ to post‐teaching. These findings contribute to the literature on teaching that incorporates students' conceptions and conceptual change. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 47: 25–46, 2010     

Improvements in interval time tracking and effects on reading achievement

This study examined the effect of improvements in timing/rhythmicity on students' reading achievement. 86 participants completed pre‐ and post‐test measures of reading achievement (i.e., Woodcock‐Johnson III, Comprehensive Test of Phonological Processing, Test of Word Reading Efficiency, and Test of Silent Word Reading Fluency). Students in the experimental group completed a 4‐week intervention designed to improve their timing/rhythmicity by reducing the latency in their response to a synchronized metronome beat, referred to as a synchronized metronome tapping (SMT) intervention. The results from this non‐academic intervention indicate the experimental group's post‐test scores on select measures of reading were significantly higher than the non‐treatment control group's scores at the end of 4 weeks. This paper provides a brief overview of domain‐general cognitive abilities believed effected by SMT interventions and provides a preliminary hypothesis to explain how this non‐academic intervention can demonstrate a statistically significant effect on students' reading achievement scores. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 849–863, 2007.     

Promoting foundational linguistic skills for reading development in young Chinese language learners: A 1-year intervention study

Background

Using a 1-year longitudinal design, we evaluated the effectiveness of an intervention programme to improve reading attainments among Chinese-as-a-second-language (CSL) learners. Using the simple view of reading as a theoretical framework, the intervention focused on students' orthographic knowledge, word reading and listening comprehension to facilitate reading comprehension.

Method

A total of 186 Grade 4 CSL students (mean age = 9.22, SD = 0.56) participated in the study and were grouped into the treatment (N = 96) and control (N = 90) groups. A range of Chinese language and literacy skills were assessed before and after the intervention.

Results

The path analysis showed that the intervention significantly affected orthographic knowledge, word reading and listening comprehension directly and reading comprehension indirectly through the three componential skills after controlling for nonverbal reasoning, vocabulary and autoregressors.

Conclusions

The findings suggest that orthographic knowledge, word reading and listening comprehension may be promising targets for instructing young CSL learners.     

Training reading fluency among poor readers of German: many ways to the goal

Outcomes of two training programs aimed at improving reading speed for 39 German-speaking poor readers in grades 2 and 4 were evaluated. During a 6-week training period, a specific target for children in a computer group was to improve reading of word-initial consonant clusters by practice in associating an orthographic unit with a corresponding phonological unit. Children in a paired reading group read books with an adult tutor. The results showed that, in reading words in which the computer-trained sublexical items were included, both groups exhibited similar improvement. A post hoc analysis suggested that computer training was associated with better reading skills with respect to the trained sublexical items; however, this improvement did not show large generalization effects to the words with the sublexical items. The paired reading group showed a more rapid gain in global word reading fluency than the computer group. Neither of the groups improved their pseudoword reading.