The validity of reading comprehension rate: Reading speed,comprehension, and comprehension rates

This article describes a secondary analysis of a brief reading comprehension rate measure, percent comprehension questions correct per minute spent reading (%C/M). This measure includes reading speed (seconds to read) in the denominator and percentage of comprehension questions answered correctly in the numerator. Participants were 22 4th‐, 29 5th‐, and 37 10th‐grade students. Results showed that reading speed accounted for much of the variance in Broad Reading Cluster scores and subtest scores of the Woodcock–Johnson III Tests of Achievement across all grade levels. Converting reading speed to the rate measure %C/M increased Broad Reading Cluster variance accounted for in the 4th‐ and 5th‐grade sample, but decreased the Broad Reading Cluster variance accounted for in the 10th‐grade sample. Discussion focuses on the importance of reading speed and the failure to enhance validity of a brief rate measure in more skilled readers by incorporating a direct measure of comprehension. © 2009 Wiley Periodicals, Inc.     

A preliminary investigation of the concurrent validity of reading comprehension rate: A direct,dynamic measure of reading comprehension

Reading comprehension rate (RCR) is a direct measure of reading skills that may be useful in formatively evaluating students reading beyond the fourth‐grade level. To investigate the concurrent validity of RCR, we correlated RCR, reading comprehension level (RCL), and words correct per minute (WC/M) with the Broad Reading Cluster Scores of the Woodcock‐Johnson III Tests of Achievement (WJ‐III ACH) across 88 students in 4th, 5th, and 10th grades. Results showed that aloud‐RCR was significantly correlated with the WJ‐III ACH scores for 4th‐grade (r = .90; n = 22), 5th‐grade (r = .87; n = 29), and 10th‐grade (r = .65; n = 37) students. Regression analysis specified a one‐predictor model for 4th‐grade students (aloud‐RCR), a two‐predictor model for 5th‐grade students (WC/M and aloud‐RCR), and a one‐predictor model for 10th‐grade students (WC/M). Discussion focuses on directions for future research and applied issues related to RCR probe passage development. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 373–388, 2007.     

Is fluency‐based story retell a good indicator of reading comprehension?

This study examined the reliability and validity of scores on a fluency‐based measure of reading comprehension. The Dynamic Indicators of Basic Early Literacy Skills (DIBELS; 6th ed. revised) Retell Fluency (RTF), Oral Reading Fluency (DORF), and Woodcock Johnson III NU Tests of Achievement (WJ‐III NU ACH) Reading Comprehension measures were administered to fourth‐grade students. Results indicated a large difference between real time and recorded retell fluency scores for each passage. In addition, students' retell fluency scores had a low correlation with their reading comprehension scores. In light of these findings, practitioners may want to exercise caution in using fluency‐based story‐retell scores as a measure of reading comprehension. © 2011 Wiley Periodicals, Inc.     

Graduate students' administration and scoring errors on the Woodcock‐Johnson III Tests of Cognitive Abilities

The interpretation of cognitive test scores often leads to decisions concerning the diagnosis, educational placement, and types of interventions used for children. Therefore, it is important that practitioners administer and score cognitive tests without error. This study assesses the frequency and types of examiner errors that occur during the administration and scoring of the Woodcock‐Johnson III Tests of Cognitive Abilities (WJ III COG). Data from 36 graduate students across 108 test records revealed a total of 500 errors across all records. Further analyses indicated three frequently occurring errors, including the use of incorrect ceilings, failure to record errors, and failure to encircle the correct row for the total number correct. The results of this study may be used to inform training programs so that appropriate steps can be taken to decrease the number of examiner errors on the WJ III COG and similar cognitive test batteries. © 2009 Wiley Periodicals, Inc.     

The Effects of an Intensive Reading Intervention for Ninth Graders with very Low Reading Comprehension

This experimental study examined the efficacy of a multicomponent reading intervention compared to a control condition on the reading comprehension of adolescent students with low reading comprehension (more than 1½ standard deviations below normative sample). Ninth‐grade students were randomly assigned to treatment (n = 25) and comparison (n = 19). Reading teachers provided instruction for 90‐min, five times every two weeks for approximately 80 sessions. Treatment effects for each outcome measure were estimated using repeated measure of analysis of covariance for measures of reading comprehension and fluency. Results indicate no statistically significant differences between treatment and comparison conditions. Repeated‐measures analyses of variance between students with lower and higher decoding skills indicated a statistically significant interaction between treatment condition and decoding ability on the WJ‐III PC and Bridge‐IT, with large effect sizes (η_p² .16 and .12, respectively), indicating that treatment was differentially beneficial for students with higher decoding skills.     

Predicting reading performance using the slingerland procedures

The purpose in this study was to examine predictive relationships between the Slingerland Pre- Reading Screening Procedures and performance on measures of word recognition and reading comprehension. Longitudinal data were collected on 104 children administered the Slingerland Procedures in kindergarten and the Stanford Achievement Test at first, third, and fifth grades. Outcome measures included achievement subtests, Word Study Skills, Reading Comprehension, Reading and Listening Total. Significant relationships were found between Slingerland measures and reading outcomes. However, prediction varied across grades and according to the measure of reading used. Listening contributed to reading comprehension but not to word recognition, and visual skills influenced early but not later reading performance. Gender and socioeconomic status influenced the strength of associations.     

Reading Comprehension Tests Vary in the Skills They Assess: Differential Dependence on Decoding and Oral Comprehension

Comprehension tests are often used interchangeably, suggesting an implicit assumption that they are all measuring the same thing. We examine the validity of this assumption by comparing some of the most popular reading comprehension measures used in research and clinical practice in the United States: the Gray Oral Reading Test (GORT), the two assessments (retellings and comprehension questions) from the Qualitative Reading Inventory (QRI), the Woodcock–Johnson Passage Comprehension subtest (WJPC), and the Reading Comprehension test from the Peabody Individual Achievement Test (PIAT). Modest intercorrelations among the tests suggested that they were measuring different skills. Regression analyses showed that decoding, not listening comprehension, accounts for most of the variance in both the PIAT and the WJPC; the reverse holds for the GORT and both QRI measures. Large developmental differences in what the tests measure were found for the PIAT and the WJPC, but not the other tests, both when development was measured by chronological age and by word reading ability. We discuss the serious implications for research and clinical practice of having different comprehension tests measure different skills and of having the same test assess different skills depending on developmental level.     

The incremental variance of morphological knowledge to reading comprehension in grades 3–10 beyond prior reading comprehension,spelling, and text reading efficiency

We know that knowledge of word structure—morphology—relates to reading, but there is limited research on its unique contribution to reading comprehension, especially with students in middle and high schools and with the nesting of students within classrooms taken into account. In this study with 4780 students in grades 3 to 10, we examined how students' winter scores in morphological knowledge, spelling, text reading efficiency, and reading comprehension predicted spring scores in reading comprehension. Reading comprehension was measured by a computeradaptive, interim reading assessment. Bivariate relations were examined and a strong relation between morphological knowledge and reading comprehension was observed in all grades except grade 10. Multilevel analyses showed that morphological knowledge added 2%–9% unique variance beyond the autoregressor in predicting spring reading comprehension at the student level and that over 90% of the large variability between classrooms was explained by performance on these component skills. Educational implications were discussed.     

The reading performance of English learners in grades 1–3: the role of initial status and growth on reading fluency in Spanish and English

The purposes of this study were to (a) examine the developmental patterns in pseudoword reading and oral reading fluency in Spanish and English for Spanish-speaking English learners (ELs) in grades 1?C3, and (b) investigate whether initial status and growth rates in reading fluency in Spanish and English, significantly predicted reading comprehension within languages and across languages. Participants were 173 Spanish-speaking ELs in first grade, 156 ELs in second grade, and 142 ELs in third grade across four schools providing a paired bilingual reading program. Results of hierarchical linear modeling indicated different patterns of reading growth in Spanish and English across measures and across grades. ELs at the beginning of first grade had higher scores on pseudoword reading in Spanish than in English and had a higher rate of growth on Spanish pseudoword reading. In second and third grades, initial scores on oral reading fluency were comparable in both languages, but oral reading fluency growth rates were higher in English than in Spanish. Results from regression and path analysis indicated that student initial scores and growth on reading fluency were strong and direct predictors of their reading comprehension within the same language, but not across different languages.     

Relationships between reading comprehension and its components in young Chinese-as-a-second-language learners

Based on the Simple View of Reading model, this study examines the relationships among Chinese reading comprehension and its two componential processes, Chinese character reading and listening comprehension, in young learners of Chinese as a second language (CSL) using a longitudinal design. Using relevant measures, a sample of 142 senior primary ethnic minority students in Hong Kong was assessed twice a year. The results of regression analyses showed that character reading and listening comprehension could together account for a significant portion of the variance in reading comprehension at grades 4 and 5 both concurrently and predictively. Subsequently, a trivariate, cross-lagged path model was specified to evaluate the relationships among these variables after controlling for their autoregressive effects. The study identifies statistically significant and unique contributions of character reading and listening comprehension to reading comprehension; further, it finds reciprocal relationships between reading comprehension and its componential processes. Moreover, the two componential processes themselves are significantly related across grades 4 and 5. Apart from supporting the predictive influence of character reading and listening comprehension on reading comprehension, the findings of this study reveal how Chinese language comprehension and literacy development are interrelated in young CSL learners.     

Individual and group sensitivity to remedial reading program design: examining reading gains across three middle school reading projects

The purpose of this project was to examine group- and individual-level responses by struggling adolescents readers (6th–8th grades; N = 155) to three different modalities of the same reading program, Reading Achievement Multi-Component Program. The three modalities differ in the combination of reading components (phonological decoding, spelling, fluency, comprehension) that are taught and their organization. Latent change scores were used to examine changes in phonological decoding, fluency, and comprehension for each modality at the group level. In addition, individual students were classified as gainers versus non-gainers (a reading level increase of a year or more vs. less than 1 year) so that characteristics of gainers and differential sensitivity to instructional modality could be investigated. Findings from both group and individual analyses indicated that reading outcomes were related to modalities of reading instruction. Furthermore, differences in reading gains were seen between students who began treatment with higher reading scores than those with lower reading scores; dependent on modality of treatment. Results, examining group and individual analyses similarities and differences, and the effect the different modalities have on reading outcomes for older struggling readers will be discussed.     

Should the Simple View of Reading Include a Fluency Component?

The Simple View of Reading states that reading comprehension is the product of word recognition and listening comprehension. Whereas much research has focused on word recognition accuracy, recent attention has been directed toward word recognition fluency. The current study investigated whether a separate fluency component should be added to the Simple View of Reading. A battery of reading and language measures was administered to 604 children in second, fourth, and eighth grades. Approximately half these children had language and/or nonverbal cognitive impairments in kindergarten, but weighting procedures were used to reduce the potential bias this sampling characteristic may have entailed. Structural equation modeling was used to determine whether fluency accounted for unique variance in reading comprehension after controlling for word recognition accuracy and listening comprehension. Individual profile analyses were conducted to determine the number of individual participants who␣had poor fluency in the spite of good word recognition accuracy and listening comprehension. Results showed that fluency did not account for unique variance in reading␣comprehension and that few individuals had problems in fluency separate from word recognition accuracy or listening comprehension. Thus, it does not appear that a separate fluency component should be added to the Simple View of Reading.     

Oral reading fluency and comprehension in Kenya: reading acquisition in a multilingual environment

Reading research has shown that variable relationships exist between measures of oral reading fluency and reading comprehension, depending on whether the language of the text is the reader's first language or an additional language. This paper explores this phenomenon, using reading assessment data for 2,000 Kenyan children in two or three languages: English, Kiswahili and one of two mother tongues, Dholuo or Gikuyu. The assessment data allowed us to compare reading and comprehension rates across languages. The data indicated that many children could read English words more easily than words in Kiswahili or their mother tongue; nevertheless, their reading comprehension was significantly lower in English than in Kiswahili, Dholuo or Gikuyu. The paper concludes that emphasising English reading fluency is an inefficient route to gaining reading comprehension skills because pupils are actually attaining minimal oral reading fluency in English and only modest comprehension skills in their own languages. The evidence also demonstrates that Kenya's national language policy of mother tongue as a medium of instruction in the early primary grades is consistently ignored in practice.     

Is retell a valid measure of reading comprehension?

Retell is used widely as a measure of reading comprehension. In this meta-analysis, we evaluated the relation between retell and other measures of reading comprehension among students in Grades 1–12. Data from 23 studies (82 effect sizes; N = 4705 participants) showed a moderate relation between retell and other measures of reading comprehension, r = 0.46. Moderation analyses revealed that the relation was stronger when reading comprehension was measured by cloze or maze tasks than when measured using a multiple-choice format. In addition, the relation was weaker in higher grades, but this was largely explained by text genre or the number of prompts in retell. The relation between ‘oral’ retell and reading comprehension was stronger with a greater number of prompts provided during retell tests. In contrast, results did not differ by other features of retell such as reading mode (oral or silent), text genres of retell (narrative or informational), or use of different oral retell evaluation methods (e.g., number of words or ideas, overall quality). Overall, the moderate magnitude of the relation between retell and other measures of reading comprehension indicates caution for using retell as the sole measure of reading comprehension. The results also indicate a need for a better understanding about more systematic approaches to retell assessment (e.g., number and kind of prompts in the case of oral retell) as a measure of reading comprehension.     

AN INVESTIGATION OF RELATIONS AMONG ACADEMIC ENABLERS AND READING OUTCOMES

The current study examined the link between academic enablers and different types of reading achievement measures. Academic enablers are skills and behaviors that support, or enable, students to perform well academically, such as engagement, interpersonal skills, motivation, and study skills. The sample in this study consisted of 61 third‐, fourth‐, and fifth‐grade students (54% male). Academic enablers were rated by classroom teachers via the Academic Competence Evaluation Scales (ACES; DiPerna & Elliott, 2000 ). Four different measures of reading achievement were included: classroom grades, global ratings of reading skills, standardized test scores, and Reading CBM scores. Results indicated that academic enablers were significantly related to each type of reading outcome. Academic enablers accounted for the greatest amount of variance for classroom grades (45%) and the least amount of variance in standardized test scores (11%). Results suggest that academic enablers are an important part of academic success in reading, particularly classroom grades, but when considering the variance accounted for by academic enablers, they alone are not likely to improve Reading CBM scores or standardized test scores.     

Reorganizing the instructional reading components: could there be a better way to design remedial reading programs to maximize middle school students with reading disabilities’ response to treatment?

The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities (RD). Three different modules (Alternating, Integrated, and Additive) of the Reading Achievement Multi-Modular Program were implemented with 90 middle school (sixth to eighth grades) students with reading disabilities. Instruction occurred 45 min a day, 5 days a week, for 26 weeks, for approximately 97 h of remedial reading instruction. To assess gains, reading subtests of the Woodcock Johnson-III, the Gray Silent Reading Test, and Oral Reading Fluency passages were administered. Results showed that students in the Additive module outperformed students in the Alternating and Integrated modules on phonological decoding and spelling and students in the Integrated module on comprehension skills. Findings for the two oral reading fluency measures demonstrated a differential pattern of results across modules. Results are discussed in regards to the effect of the organization of each module on the responsiveness of middle school students with RD to instruction.     

In search of factors in deaf and hearing children's reading comprehension

The present study examined whether specific item characteristics, such as mode of acquisition (MoA) of word meanings, make reading comprehension tests particularly difficult for deaf children. Reading comprehension data on nearly 13,000 hearing 7-to-12-year-olds and 253 deaf 7-to-20-year-olds were analyzed, divided across test levels from second to sixth grade (not necessarily corresponding to chronological age). Factor analyses across item scores suggested that, of the determinants studied, MoA--referring to the type of information (perceptual, linguistic, or both) used in word meaning acquisition--was the only factor that contributed significantly to deaf and hearing children's reading comprehension. For hearing children, MoA influenced item scores at the third- and fourth-grade levels. For the deaf children, MoA influenced item scores through the sixth-grade level.     

Reading development in European Portuguese: relationships between oral reading fluency,vocabulary and reading comprehension

This study investigated direct and indirect effects between oral reading fluency, vocabulary and reading comprehension across reading development in European Portuguese. Participants were 329 children attending basic education, from grade 1 to grade 6. The results of path analyses showed that text reading fluency is much more dependent on the foundational skills of word recognition than reading comprehension, and the later, in turn, depends crucially on the specific constituent skill of text reading fluency. Text reading fluency has a significant influence on vocabulary from the beginning, but vocabulary contributed to reading comprehension only in more advanced grades. These results, obtained with an orthography of intermediate depth, are in line with the Simple View of Reading (SVR). However, they also highlight the importance of textual cues—besides the pivotal role of decoding—from the beginning of learning to read, which must be taken into account in the SVR.     

Latent Profiles of Reading and Language and Their Association With Standardized Reading Outcomes in Kindergarten Through Tenth Grade

The objective of this study was to determine the latent profiles of reading and language skills that characterized 7,752 students in kindergarten through tenth grade and to relate the profiles to norm-referenced reading outcomes. Reading and language skills were assessed with a computer-adaptive assessment administered in the middle of the year and reading outcome measures were administered at the end of the year. Three measures of reading comprehension were administered in third through tenth grades to create a latent variable. Latent profile analysis (LPA) was conducted on the reading and language measures and related to reading outcomes in multiple regression analyses. Within-grade multiple regressions were subjected to a linear step-up correction to guard against false-discovery rate. LPA results revealed five to six profiles in the elementary grades and three in the secondary grades that were strongly related to standardized reading outcomes, with average absolute between-profile effect sizes ranging from 1.10 to 2.53. The profiles in the secondary grades followed a high, medium, and low pattern. Profiles in the elementary grades revealed more heterogeneity, suggestive of strategies for differentiating instruction.     

TAKING A “SIMPLE VIEW” OF THE DYNAMIC INDICATORS OF BASIC EARLY LITERACY SKILLS AS A PREDICTOR OF MULTIPLE MEASURES OF THIRD‐GRADE READING COMPREHENSION

The purpose of this study was to examine the validity evidence of first‐grade Dynamic Indicators of Basic Early Literacy Skills (DIBELS) scores for predicting third‐grade reading comprehension scores. We used the “simple view” of reading as the theoretical foundation for examining the extent to which DIBELS subtest scores predict comprehension through both word recognition and language comprehension. Scores from the DIBELS Oral Reading Fluency (ORF) subtest, a measure of word recognition speed and accuracy, strongly and significantly predicted multiple measures of reading comprehension. No other DIBELS subtest score explained additional variance beyond DIBELS ORF. Although experimental DIBELS Word Use Fluency (WUF) was significantly correlated with a language comprehension measure and measures of reading comprehension, WUF scores did not predict reading comprehension beyond ORF scores. Alternatively, first‐grade Peabody Picture Vocabulary Test scores did predict additional, significant variance in reading comprehension, beyond DIBELS ORF.