Criterion‐related validity of two curriculum‐based measures of mathematical skill in relation to reading comprehension in secondary students

This study analyzed the relationship between benchmark scores from two curriculum‐based measurement probes in mathematics (M‐CBM) and student performance on a state‐mandated high‐stakes test. Participants were 298 students enrolled in grades 7 and 8 in a rural southeastern school. Specifically, we calculated the criterion‐related and predictive validity of benchmark scores from CBM probes measuring math computation and math reasoning skills. Results of this study suggest that math reasoning probes have strong concurrent and predictive validity. The study also provides evidence that calculation skills, while important, do not have strong predictive strength at the secondary level when a state math assessment is the criterion. When reading comprehension skill is taken into account, math reasoning scores explained the greatest amount of variance in the criterion measure. Computation scores explained less than 5% of the variance in the high‐stakes test, suggesting that it may have limitations as a universal screening measure for secondary students.     

Parent involvement and reading: Using curriculum‐based measurement to assess the effects of paired reading

This study examined the effectiveness of a paired reading intervention using curriculum‐based measurement (CBM) probes to document reading progress for one fourth‐ and two third‐grade students. These students were considered below‐average readers. Parents and children used the paired reading method in their homes for 10 minutes, four times a week. Children and parents were also provided with reading material at their instructional level. Results showed that the children's reading accuracy and rates increased from baseline to follow‐up on CBM measures and on pre/posttesting. In addition, students and parents gave favorable treatment acceptability ratings for paired reading. Implications for future research are outlined. © 2003 Wiley Periodicals, Inc. Psychol Schs 40: 613–626, 2003.     

Another look at the “C” in CBM: Does it really matter if curriculum‐based measurement reading probes are curriculum‐based?

This study investigated differences between two types of reading probe material to monitor students' oral reading fluency over time. Thirty‐six second‐grade students participated in this study. Twice each week for 5 weeks, participants read two passages from each of two sources. One source was the curriculum in which the child was being instructed at school, and the second source was the “Tests of Reading Fluency,” a set of generic (curriculum‐independent) passages. Standardized curriculum‐based measurement administration and scoring procedures were used. Level and rate of improvement (slope) of oral reading fluency were the dependent measures. Level and slope data were analyzed using two, two‐tailed t‐tests. Also, readability of passages was calculated using two readability formulas. Correlational analyses were used to examine the relation between the readability and reading fluency. Correlations among readability and words read correct were not significant. Results of the analyses examining level and slope indicated that students read significantly more words correct in the generic reading passages than in the curriculum‐based passages. However, rate of progress was not significantly different. These results suggest that practitioners could use either set of passages to gauge students' reading progress over time. Implications for future research and practice are discussed. © 2001 John Wiley & Sons, Inc.     

Correlates of orthographic learning in third‐grade children's silent reading

This study examined word identification, phonological recoding efficiency, familiar word reading efficiency, orthographic choice for familiar words and serial naming speed as potential correlates of orthographic learning following silent reading in third‐grade children. Children silently read a series of short stories, each containing six repetitions of a different target non‐word. They subsequently read target non‐words faster than homophones and preferred target non‐words to homophones in an orthographic choice task, indicating that they had formed functional orthographic representations of the target non‐words through phonologically recoding them during silent story reading. Target non‐word orthographic choice was correlated with all measures bar non‐symbol naming speed. The association between phonological recoding efficiency and orthographic learning lends support to the hypothesis that self‐teaching occurs through phonological recoding even in silent reading. Our findings were not generally consistent with the view that serial naming speed assesses orthographic learning aptitude.     

An examination of the criterion validity and sensitivity to brief intervention of alternate curriculum‐based measures of writing skill

Curriculum‐based measures have been validated for use in evaluating reading, mathematics, and writing skills (Marston, 1989). Despite its common use by school psychologists (Wilson & Reschly, 1996), the relationship between the Woodcock Johnson‐Revised and curriculum‐based measures of writing has not been evaluated. This study investigated the relationship between the Woodcock Johnson‐Revised Writing Samples subtest and alternate curriculum‐based measures of written expression. In addition, the sensitivity of the measures to the effects of a short group writing intervention was assessed. Forty‐five third and fourth graders participated in an intervention that consisted of brainstorming ideas, presenting those ideas on a dry‐erase board, and writing a complete sentence on paper with writing quality feedback before completing a CBM (curriculum‐based measurement) writing passage. Numbers of words written as well as five alternate measures of writing samples were used to assess the effects of the intervention. The intervention had a positive effect on total words written. Total punctuation marks, simple sentences, and words in complete sentences emerged as the best predictors of the Woodcock Johnson‐Revised Writing Samples subtest scores in regression analyses. The implications of the analyses, limitations of the study, and directions for future research are discussed. © 2004 Wiley Periodicals, Inc. Psychol Schs 41: 291–300, 2004.     

Developmental,gender, and practical considerations in scoring curriculum‐based measurement writing probes

The present study focused on CBM written language procedures by conducting an investigation of the developmental, gender, and practical considerations surrounding three categories of CBM written language scoring indices: production‐dependent, production‐independent, and accurate‐production. Students in first‐ through eighth‐grade generated a three‐minute writing sample in the fall and spring of the school year using standard CBM procedures. The writing samples were scored using all three types of scoring indices to assess the trends in scoring indices for students of varying ages and gender and of the time required to score writing samples using various scoring indices. With only one exception, older students outperformed younger students on all of the scoring indices. Although at the middle school level students' levels of writing fluency and writing accuracy were not closely associated, at the younger grade levels the CBM indices were significantly related. With regard to gender differences, girls outperformed boys on measures of writing fluency at all grade levels. The average scoring time per writing sample ranged from 1‐1/2 to 2‐1/2 minutes (depending on grade level). © 2003 Wiley Periodicals, Inc. Psychol Schs 40: 379–390, 2003.     

Web‐based reading annotation system with an attention‐based self‐regulated learning mechanism for promoting reading performance

Due to the rapid development of information technology, web‐based learning has become a dominant trend. That is, learners can often learn anytime and anywhere without being restricted by time and space. Autonomic learning primarily occurs in web‐based learning environments, and self‐regulated learning (SRL) is key to autonomic learning performance. Moreover, sustained attention to web‐based learning activities can be challenging for students. Therefore, a web‐based reading annotation system with an attention‐based self‐regulated learning mechanism (ASRLM), which is based on brainwave detection, is designed to enhance the sustained attention of learners while reading annotated English texts online, and thereby promote online reading performance. In total, 126 Grade 7 students in four classes at a junior high school in New Taipei City, Taiwan, are the participants. Among the four classes, two classes are randomly distributed to the experimental group and the other two classes are randomly distributed to the control group. The experimental group utilizes the ASRLM to support their reading of annotated English texts online, whereas the control group is not supported by the ASRLM while reading annotated English texts online. Experimental results show that sustained attention and reading comprehension of the experimental group are better than those of the control group. Moreover, the web‐based reading system with ASRLM support promotes the sustained attention and reading comprehension of female learners more than those of male learners while reading annotated English texts online. Additionally, learners with high‐SRL ability in the experimental group have better sustained attention and reading comprehension than those learners with low‐SRL ability. Furthermore, the sustained attention and reading comprehension of the experimental group are strongly correlated, and the duration of sustained attention strongly predicts their reading comprehension performance.     

Sources of variance in end-of-course student evaluations

Abstract

Evaluation of college instructors often centers on course ratings; however, there is little evidence that these ratings only reflect teaching. The purpose of this study was to assess the relative importance of three facets of course ratings: instructor, course and occasion. We sampled 2,459 fully-crossed dyads from a large university where two instructors taught the same two courses at least twice in a 3-year period. Generalizability theory was used to estimate unconfounded variance components for instructor, course and occasion, as well as their interactions. Meta-analysis was used to summarize those estimates. Results indicated that a three-way interaction between instructor, course and occasion that includes measurement error accounted for the most variance in student ratings (24%), with instructor accounting for the second largest amount (22%). While instructor - and presumably teaching - accounted for substantial variance in student course ratings, factors other than instructor quality had a larger influence on student ratings.     

Computer‐based cognitive assessment and the development of reading

This paper reports on a longitudinal study using the computer‐based cognitive assessment system CoPS, and considers the applicability of this system in the early identification of cognitive strengths and limitations that affect the development of reading. CoPS comprises eight tests of basic cognitive abilities, including phonological awareness, auditory discrimination, and short‐term visual and auditory‐verbal memory. A total of 421 children participated in the study. Assessment with the CoPS tests was carried out at age 5 years, and follow‐up assessments using conventional tests of reading and general ability were carried out at 6 and 8 years of age. Correlations between the CoPS tests administered at age 5 and reading ability at age 8 were in the region of 0.6 for auditory‐verbal memory and phonological awareness, and in the region of 0.3 for the CoPS measure of auditory discrimination as well as most of the other memory measures. Stepwise linear regression analyses showed that the CoPS tests of auditory‐verbal memory and phonological awareness administered at age 5 together accounted for 50% of the variance in reading ability at age 8, compared with only 29% of the variance being attributable to intelligence. It was concluded that short‐term memory is an important predictor variable for reading, in addition to the more generally acknowledged variable of phonological processing. Discriminant function analysis showed that CoPS tests provide a highly satisfactory prediction of poor reading skills, with very low or zero rates for false positives and false negatives. By contrast, a word recognition test given at age 6 was not found to predict reading at age 8 to the same degree of accuracy, resulting in an unsatisfactory false positive rate of 21%. Measures of verbal and nonverbal ability at age 6 produced unacceptably high false positive rates between 50% and 70%. These findings are discussed in relation to the prediction of children at risk of reading failure. The potential of computer‐based cognitive profiling for facilitating differentiated teaching in early reading is also considered.     

Rapid recovery in sub‐optimal readers in Wales through a self‐paced computer‐based reading programme

Basic literacy skills underlie much future adult functioning, and are targeted in children through a variety of means. Children with identified special needs in reading were exposed to a self‐paced computer‐based reading programme that focused on improving phonetic ability. Exposure was limited to three, 40‐minute sessions a week, for 10 weeks. The children were assessed in terms of their reading, spelling and mathematics abilities before the programme commenced, and immediately after the programme terminated. The programme improved reading and spelling by about eight months, but had no impact on mathematics. The results suggest that brief exposure to a self‐paced phonetic computer‐based teaching programme had some benefits for the sample.     

Evaluation of a computer‐based reading intervention in infant and junior schools

Recent studies (Fawcett et al, 1999; Nicolson et al, 1999) have demonstrated that 6 and 8 year old children found to be at risk of reading failure can be provided with very cost‐effective support using traditional teaching methods. Nonetheless, a significant minority of children failed to make sufficient progress. The present studies undertook a replication of these studies, using the RITA computer‐based literacy support system. The RITA system assists, rather than replaces, the teacher in providing support tailored to each child’s profile of reading attainments. The results indicated that the RITA support was both educationally effective and economically effective, with comparable cost effectiveness to the traditional approach when used with infant school children (6 year olds), and somewhat greater cost effectiveness when used with junior school children (8 year olds). All groups of children reacted very positively to the RITA lessons. It is suggested that computer‐assisted reading support can be effective in supporting children at risk of reading failure, even at junior school level.     

Assessing the importance of subvocalization during normal silent reading

A concurrent speaking paradigm was used to assess the importance of subvocalization during the reading of lengthy natural prose passages. Experiment 1 showed that having subjects count aloud while reading interfered with their comprehension and recall of the text's details as well as its gist, but did not affect the durability of the memory trace. Experiment 2 replicated these findings and established the validity of using concurrent speaking as a technique to interfere with speech-specific processes during silent reading. By pitting concurrent speaking against a nonverbal concurrent task, Experiment 2 provided evidence that its detrimental effect on comprehension was due to a competition for speech-related resources rather than a general competition for cognitive resources. Interfering with speech recoding during silent reading led to an average decrement of 10–12% in comprehension performance. However, Experiment 2 also showed that there were substantial individual differences in the magnitude of the speech interference effect and that these differences were systematically related to subjective reports about the concurrent speaking manipulation.     

Predicting growth of nonword reading and letter‐sound knowledge following rime‐ and phoneme‐based teaching

The present study sought to extend a recent study by Savage, Carless and Stuart , by looking at the pre‐test phonological skills that predicted improvements in letter‐sound knowledge and nonword reading. Results showed overall that phoneme manipulation predicted improvements in nonword reading and letter‐sound knowledge even when pre‐test scores on the respective dependent variables were controlled. Pre‐test letter‐sound knowledge was an independent predictor of nonsense word reading. Overall, onset‐rime manipulation did not add to the prediction of outcome. Onset‐rime manipulation predicted decoding improvements in a subgroup where children were exposed to both rime and phoneme‐based teaching.     

Prosody in skilled silent reading: evidence from eye movements

Recent eye movement experiments offer preliminary evidence that skilled readers activate word‐level prosodic information when silently reading sentences. This paper reviews the role of eye movements during reading as well as the preliminary evidence for prosodic processing. A new experiment examines whether prosodic processing differs for high and low frequency words. Readers' eye movements were monitored while reading target words presented in sentences preceded by parafoveal previews that either contained the exact initial syllable of the target (i.e. the congruent preview condition) or the initial syllable plus the next letter (i.e. the incongruent preview condition). Reading times on high frequency words did not differ in the congruent and incongruent preview conditions, but reading times on low frequency words were faster in the congruent condition. The implications of the present result and previous studies are discussed in terms of phonological hub theory, which is a production‐based theory of word recognition during skilled silent reading.     

An examination of group‐based treatment packages for increasing elementary‐aged students' reading fluency

Reading fluency has been described as one of the essential ingredients for ensuring that students become successful readers. Unfortunately, a large number of elementary‐aged students in this country do not fluently read age‐appropriate material. Because of this, small‐group interventions are practical and more time efficient than individualized intervention programs, but very few small‐group interventions have been developed to target students' reading fluency of connected text. The primary purpose of this study was to examine four group‐based treatment packages containing two or more of the following reading interventions: repeated reading, listening passage preview, and practicing difficult words in isolation. Effects of each treatment package were evaluated with 4 third graders using an alternating‐treatments design, and effects were evaluated for both immediate and retained reading‐fluency gains. Findings indicated that the combination of all three intervention components was most effective. Results also suggested some inconsistent relationships between immediate and retained reading gains for 3 of the 4 students. Implications of these findings, limitations of the study, and directions for future research are discussed. © 2006 Wiley Periodicals, Inc. Psychol Schs 43: 183–195, 2006.     

Students' comprehension of science textbooks using a question‐based reading strategy

Despite the heavy reliance on textbooks in college courses, research indicates that college students enrolled in first‐year science courses are not proficient at comprehending informational text. The present study investigated a reading comprehension questioning strategy with origins in clinical research based in elaboration interrogation theory, which outlines how to encourage readers to recall relevant background knowledge while reading text materials. The theory suggests that the strategy increases the likelihood that readers will integrate what they read with what they know to make new knowledge. The setting for the study more closely resembled classroom conditions compared to similar studies in the past. Unlike previous studies on reading comprehension, students read a challenging passage from the textbook used in a science course in which they were enrolled. In addition, the text was longer than that used in clinical research. The college students (n = 294) in this study were randomly assigned to either a questioning strategy treatment or a rereading placebo‐control. While reading, treatment students were presented with statements taken from regular intervals in their textbook (about every 150 words) and asked a simple why question about each of these statements. Significant differences were found favoring elaborative interrogation theory and its question strategy treatment over the placebo‐control in terms of science comprehension even after significant estimated predictors of prior knowledge and verbal ability were statistically controlled or accounted for by removing the statistical contributions of these predictors to the main effects. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 47: 363–379, 2010