Videobased lesson analysis: Effective science PD for teacher and student learning

The Science Teachers Learning from Lesson Analysis (STeLLA) project is a videobased analysis‐of‐practice PD program aimed at improving teacher and student learning at the upper elementary level. The PD program developed and utilized two “lenses,” a Science Content Storyline Lens and a Student Thinking Lens, to help teachers analyze science teaching and learning and to improve teaching practices in this year‐long program. Participants included 48 teachers (n = 32 experimental, n = 16 control) and 1,490 students. The STeLLA program significantly improved teachers' science content knowledge and their ability to analyze science teaching. Notably, the STeLLA teachers further increased their classroom use of science teaching strategies associated with both lenses while their students increased their science content knowledge. Multi‐level HLM analyses linked higher average gains in student learning with teachers' science content knowledge, teachers' pedagogical content knowledge about student thinking, and teaching practices aimed at improving the coherence of the science content storyline. This paper highlights the importance of the science content storyline in the STeLLA program and discusses its potential significance in science teaching and professional development more broadly. © 2011 Wiley Periodicals, Inc., J Res Sci Teach 48: 117–148, 2011     

Impact of rapid reading skills training on reading rate and reading achievement among primary school students in China

Abstract

The current study examined the effects of a silent rapid reading skills training intervention on the reading rate and reading achievement of primary school students in China in order to determine the efficacy of the intervention and explore potential gender differences. A total of 108 Chinese primary school students were randomly assigned by the classroom to either an experimental (n = 54) or control (n = 54) condition. Students in the experimental group completed 12 sessions of rapid reading skills training designed to increase their ability to rapidly read Chinese text in silence. Students in the control group engaged in regular Chinese language curriculum for the same time period. After the three-week intervention period, students in the experimental group displayed significantly greater silent reading speed of Chinese characters (M?=?1331.26 characters per minute) compared to students in the control group (M?=?617.48 characters per minute; p?<?.001). Children in the intervention group also displayed a significantly greater effective reading rate (F = 87.11, p?<?.001, partial η²?=?0.46) at post-test compared to the control. Male students displayed greater increases in reading speed than female students. Neither intervention effect nor gender difference was evident for reading comprehension. Implications for educational interventions designed to increase silent reading speed among Chinese students are discussed.     

Effectiveness of Supplemental Kindergarten Vocabulary Instruction for English Learners: A Randomized Study of Immediate and Longer-Term Effects of Two Approaches

Abstract

A two-cohort cluster-randomized trial was conducted to estimate effects of small-group supplemental vocabulary instruction for at-risk kindergarten English learners (ELs). Connections students received explicit instruction in high-frequency decodable root words, and interactive book reading (IBR) students were taught the same words in a storybook reading context. A total of 324 EL students representing 24 home languages and averaging in the 10th percentile in receptive vocabulary completed the study (Connections n = 163 in 75 small groups; IBR n = 161 in 72 IBR small groups). Although small groups in both conditions made significant immediate gains across all measures, Connections students made significantly greater gains in reading vocabulary and decoding (d =.64 and.45, respectively). At first-grade follow-up, longer-term gains were again greater for Connections students, but with smaller effect sizes (d =.29 and.27, respectively). Results indicate that explicit Connections instruction features designed to build semantic, orthographic, and phonological connections for word learning were effective for improving proximal reading vocabulary and general decoding; however, increases in root word reading vocabulary did not transfer to general vocabulary knowledge.     

Supplemental Fluency Intervention and Determinants of Reading Outcomes

This study replicates research on the efficacy of a repeated reading intervention with word-level instruction for students in Grades 2 and 3 with low to moderate fluency skills, examines differences between treatment implementers, and tests unique contributions of treatment-related variables on outcomes. Students from 13 schools were randomly assigned to dyads; dyads were randomly assigned to treatment or control conditions. Schools were matched into treatment implementer groups (teachers or paraeducators) at study onset. Tutoring occurred during school hours for 15 weeks (M = 25.5 hr). Multilevel model results showed treatment students (n = 98) gained more than controls (n = 104) on measures of letter-sound knowledge (d = .41), fluency (d = .37–.38), and comprehension (d = .30–.31); students tutored by teachers gained more than their paraeducator-tutored peers on word reading and fluency. Finally, dyads tutored with greater fidelity gained more in word reading and fluency; dyads that read more complex words in their texts gained less on letter-sounds, fluency, and comprehension.     

The Effects of an Intensive Reading Intervention for Ninth Graders with very Low Reading Comprehension

This experimental study examined the efficacy of a multicomponent reading intervention compared to a control condition on the reading comprehension of adolescent students with low reading comprehension (more than 1½ standard deviations below normative sample). Ninth‐grade students were randomly assigned to treatment (n = 25) and comparison (n = 19). Reading teachers provided instruction for 90‐min, five times every two weeks for approximately 80 sessions. Treatment effects for each outcome measure were estimated using repeated measure of analysis of covariance for measures of reading comprehension and fluency. Results indicate no statistically significant differences between treatment and comparison conditions. Repeated‐measures analyses of variance between students with lower and higher decoding skills indicated a statistically significant interaction between treatment condition and decoding ability on the WJ‐III PC and Bridge‐IT, with large effect sizes (η_p² .16 and .12, respectively), indicating that treatment was differentially beneficial for students with higher decoding skills.     

Succeeding with High-Risk K–3 Populations Using Arts-Based Reading Instruction: A Longitudinal Study

ABSTRACT

Numerous studies have identified isolated elements for successfully teaching early reading. However, very few studies have examined the effect of early reading programs that use a combination of multiple research-based practices. A 4-year longitudinal study starting with 243 students was conducted to determine the effects of the Reading in Motion reading program on standardized measures of students’ reading skills. The program provided students from kindergarten through Grade 3 arts-based instruction in reading that teaches phonemic awareness, systematic phonics, and oral reading fluency using small groups and peer-assisted instruction with frequent, corrective feedback. Although the two groups were nearly identical upon entering kindergarten, the at-risk treatment students (N = 57) significantly outperformed control students (N = 48) at the end of kindergarten and Grades 1 and 2.     

Findings From a Multiyear Scale-Up Effectiveness Trial of Open Court Reading

This multiyear scale-up effectiveness study of Open Court Reading (OCR) involved approximately 4,500 students and more than 1,000 teachers per year in Grades K–5 from 49 elementary schools in seven districts across the country. Using a school-level cluster randomized trial design, we assessed the implementation and effectiveness of Open Court Reading over two years. Implementation study results demonstrated adequate to high levels of fidelity across the treatment schools. Intent-to-treat analyses revealed no statistically significant main effects on students’ reading performance in Year 1 and a small negative effect (d = – .09) in Year 2. There were positive impacts for particular subgroups, including kindergarten (d = .12) and Hispanic (d = .10) students in the first year. However, there were negative impacts for first grade (d = –.13), females (d = –.11), students who were not eligible for free or reduced-price lunch (d = –.19), and non-English language learners (d = –.10) in the second year of the study. Thus, relative to the “business-as-usual” reading curricula, no positive overall impacts of OCR and mixed impacts for student subgroups were found.     

An Experimental Study of Scheduling and Duration of “Tier 2” First-Grade Reading Intervention

Abstract

This study compared the effects on reading outcomes of delivering supplemental, small-group intervention to first-grade students at risk for reading difficulties randomly assigned to one of three different treatment schedules: extended (4 sessions per week, 16 weeks; n = 66), concentrated (4 sessions per week, 8 weeks; n = 64), or distributed (2 sessions per week, 16 weeks; n = 62) schedules. All at-risk readers, identified through screening followed by 8 weeks of oral reading fluency (ORF) progress monitoring, received the same Tier 2 reading intervention in groups of 2 to 4 beginning in January of Grade 1. Group means were higher in word reading and ORF at the final time point relative to pretest; however, the groups did not differ significantly on any reading outcome or on rates of adequate intervention response. Of potential covariates, site, age, free lunch status, program coverage rate, and tutor were significantly related to student outcomes; however, the addition of these variables in multivariate models did not substantially change results. Rates of adequate intervention response were lower than have been reported for some first-grade interventions of longer duration.     

The effects of technology‐enhanced formative evaluation on student performance on state accountability math tests

Technology‐enhanced formative evaluation (TEFE) could enhance student achievement while diminishing the burden of formative evaluation for educators. The current study examined data from 360 randomly selected schools that either used a TEFE program for 1 year to 4 years 11 months, for 5 or more years, or not at all. Analyses of covariance found a significant and moderate to large (d = .51 and .78) effect on percentage of students who scored proficient on state accountability tests in math. Moreover, among schools that used TEFE, those with a non‐White student population of at least 50% scored in the proficient range on state math tests at a rate equal to that of those with at least 50% White students. A significant and moderate to large (d = .71) effect was found, however, between these two groups of schools among schools that did not use a TEFE program. © 2010 Wiley Periodicals, Inc.     

Evidence for a simplicity principle: teaching common complex grapheme‐to‐phonemes improves reading and motivation in at‐risk readers

This study examines the effects of teaching common complex grapheme‐to‐phoneme correspondences (GPCs) on reading and reading motivation for at‐risk readers using a randomised control trial design with taught intervention and control conditions. One reading programme taught children complex GPCs ordered by their frequency of occurrence in children's texts (a ‘simplicity principle’). The other reading programme taught children word usage. Thirty‐eight students participated in the 9‐week programme of 30 supplemental small group sessions. Participants in the complex GPC group performed significantly better at post‐tests with generally large value‐added effect sizes (Cohen's d) at both by‐participant and by‐item for spelling, d = 1.85, d = 1.16; word recognition with words containing taught GPCs, d = 0.96, d = 0.95; word recognition, d = 0.79, d = 0.61, and reading motivation, d = 0.34, d = 0.56. These findings suggest that the simplicity principle aids in structuring maximally effective supplemental phonic interventions.     

“Literacy Lift-Off”: an experimental evaluation of a reading recovery programme on literacy skills and reading self-concept

Worldwide, considerable emphasis is currently being placed on the provision of appropriate classroom-based preventative interventions and in-class literacy support, in preference to withdrawal methods of educational support. Many schools in Ireland are currently implementing Literacy Lift-Off in their classrooms. Literacy Lift-Off is an adaption of the well-known Reading Recovery programme. The current study aims to establish whether Literacy Lift-Off improves students’ literacy skills. It further seeks to determine what impact Literacy Lift-Off has on students’ reading self-concept levels. Ninety-two students aged between five years and six years six months (52 boys, 40 girls) attending four Senior Infant classes were recruited for this study. Two class groups were randomly chosen to act as an intervention cohort (n = 47) and two class groups were randomly chosen to act as a wait-list control cohort (n = 45). This experimental study evaluated the Literacy Lift-Off intervention on students’ letter identification, word attack skills, word reading, and reading self-concept beliefs. Intervention students were compared with control students who did not receive the Literacy Lift-Off intervention at pre-test and post-test levels. Results showed that while both groups showed significant change on all dependent variables from pre-intervention to post-intervention, those in the experimental group showed significantly more improvement on word attack skills, word reading and reading self-concept beliefs. This study showed that a whole-class reading recovery programme can be effective in improving literacy skills and reading self-concept.     

Impact of a Technology-Mediated Reading Intervention on Adolescents' Reading Comprehension

In this experimental study we examined the effects of a technology-mediated, multicomponent reading comprehension intervention, Comprehension Circuit Training (CCT), for middle school students, the majority of whom were struggling readers. The study was conducted in three schools, involving three teachers and 228 students. Using a within-teacher design, middle school teachers' reading classes were randomly assigned to treatment (n = 9) or business as usual (n = 7) conditions. In the CCT condition, students received, on average, 39 lessons of video-modeled instruction in word reading, vocabulary, and comprehension instruction during reading intervention classes. Results of multilevel structural equation models indicated statistically significant effects favoring the CCT condition on three measures: reading comprehension latent variable (ES = 0.14), proximal vocabulary (ES = 0.43), and silent reading efficiency (ES = 0.28). Subgroup analyses indicated that students with lower entry-level reading comprehension tended to benefit more from the CCT intervention in reading comprehension, silent reading efficiency, and state test scores.     

Intervening with Struggling Readers in Seventh Grade: Impact Evidence from Six School Districts

Abstract

This study uses a regression discontinuity design to evaluate the impact of seventh-grade interventions delivered by 25 schools on the reading and school engagement outcomes of struggling readers. Students in participating schools were assigned to intervention (n?=?1,495) or comparison (n?=?4,397) conditions, based on their state reading performance and reading fluency scores in sixth grade. On the state reading test, intervention impact favoring the treatment group approached, but did not reach, statistical significance (p?=?.056, g?=?.15). On a measure of reading fluency, there was a significant interaction between the cut points schools chose for condition assignment and intervention impact (p?=?.015). In schools that chose a lower cut point, intervention students outperformed comparison students, while in schools that chose a higher cut point, comparison students outperformed intervention students. On a student self-report measure of school engagement, no significant differences between the intervention and comparison groups were observed (p?=?.83, g?=?.02). Implications for rigorous evaluation of interventions implemented by districts and schools under naturalistic conditions are discussed.     

Generating Vocabulary Knowledge for At-Risk Middle School Readers: Contrasting Program Effects and Growth Trajectories

We tested whether urban middle-school students from mostly low-income homes had improved academic vocabulary when they participated in a freely available vocabulary program, Word Generation (WG). To understand how this program may support students at risk for long-term reading difficulty, we examined treatment interactions with baseline achievement on a state standardized test and also differential effects for students with (n = 398) and without (n = 1,395) individualized education plans (IEPs). Students in this unmatched quasi-experiment (5 WG and 4 comparison schools) completed pre- and postvocabulary assessments during the intervention year. We also retested student vocabulary knowledge after summer vacation and the following spring on 11 target words to construct a longitudinally consistent scaled score across 4 waves of data. Growth models show that students experienced summer setback. Although there were no average underlying differences in growth or differences in summer setback for students by baseline achievement, better readers improved more from program participation. IEP status did not predict differential benefits of program participation, and students with IEPs maintained gains associated with participation in WG; however, participation in the program did not change underlying growth trajectories favoring students who did not have IEPs.     

The Poor Get Richer: Heterogeneity in the Efficacy of a School-Level Intervention for Academic Language

We investigate the impact of a relatively brief cross-curricular intervention, Word Generation, on middle school students' development of taught academic vocabulary. Students (n = 8382) in forty-four middle schools in three urban districts were randomly assigned to treatment or control conditions. Treatment teachers implemented the program with minimal support and varying levels of commitment. Students in treatment schools scored almost a point higher on the curriculum-based vocabulary posttests than those in control schools (Hedges's g = 0.094, p < 0.05). Though there was no main treatment effect on the standardized measures of students' general vocabulary knowledge or reading comprehension, baseline-by-treatment interactions at the school and student level acted to attenuate the Matthew Effect in reading and vocabulary growth.     

The effect of learning style on doctoral course completion in a Web-based learning environment

One hundred and fifty-nine doctoral students, majoring in Computing Technology in Education (CTE), were tracked during the coursework phase in a Web-based learning environment. At the beginning of the coursework, each student completed a demographic data form and Kolb's Learning Style Inventory (LSI). Due to the type of program, it was hypothesized that students would primarily fall into Kolb's Converger and Assimilator categories, and learning style would predict completion of the required courses. Results indicated 84.3% (n=134) of all students finished the required coursework. One hundred and twenty-four of the students (78%) fell into the predicted categories and, of these, 87.1% (n=108) finished the coursework. Students not falling into the predicted categories (n=35) had a 74.3% (n=26) completion rate.An examination of the means scores for both groups indicated that students with a preference for Abstract Conceptualization dropped out of the program at significantly lower rates, t(157)=1.667, p=.045(one-tailed), than students with other preferred learning strategies. The implications are clear. First, students, for the most part, are able to adapt their personal learning styles in order to succeed in a Web-based learning environment. Second, students with a preference for systematic planning and an intellectual understanding of a situation are more likely to succeed than students preferring concrete experience and interaction with other students. Institutions offering programs of this type should be prepared to address learning style issues when developing and offering such programs.     

Effects of reciprocal teaching on reading comprehension of low‐achieving adolescents. The importance of specific teacher skills

Low‐achieving adolescents are known to have difficulties with reading comprehension. This article discusses how reciprocal teaching can improve low‐achieving adolescents' reading comprehension in whole‐classroom settings (as opposed to small‐group settings) and to what extent intervention effects are dependent on teacher behaviour. Over the course of 1 year, experimental teachers (n = 10) were given extensive training and coaching aimed at using principles of reciprocal teaching, while control teachers (n = 10) used their regular teaching method. Observations of teacher behaviour were focused on instruction of reading strategies, modelling and support of group work and were performed in both experimental and control classes, comprising a total of 369 students (mean age = 13.01). Our study shows that reciprocal teaching contributed to adolescent low achievers' reading comprehension only when experimental teachers provided high‐quality strategy instruction. In addition, results suggest that the quality of implementation of reciprocal teaching in whole‐classroom settings should receive more research attention.

Highlights

What is already known about this topic

• Reciprocal teaching is a method of instructing and guiding learners in reading comprehension.
• It consists of a set of three related instructional principles: (a) teaching comprehension‐fostering reading strategies; (b) expert modelling, scaffolding and fading; and (c) students practising and discussing reading strategies with other students, guided and coached by the teacher.
• High quality of implementation of reciprocal teaching by teachers in classrooms is difficult.

What this paper adds

• After 1 year of implementing reciprocal teaching, no main effects of the treatment were established.
• Intervention effects were moderated by quality of instruction: strategy instruction led to higher scores on reading comprehension in the treatment condition but not in the control condition.
• Implementation of the instructional principles was by no means optimal: teachers were unable to provide detailed guidance to students working in small groups and modelling of strategies requires more experience and theoretical insight in the use and nature of reading strategies.

Implications for practice and/or policy

• Extensive training and coaching are needed for teachers to become experts in reciprocal teaching.
• Teachers need hands‐on tools to be able to guide students in their collaborative group work and to fade the teachers' role in order to allow more individual self‐regulation by students in their use of strategies.
• Implementation quality has to be taken into account when doing effectiveness research and when adopting new, theory‐based didactic approaches.

     

Writing to learn in science: Effects on Grade 4 students' understanding of balance

In this study, we randomly assigned 69 Grade 4 students to a writing-to-learn treatment (n = 23), comparison (n = 23), or no-treatment control (n = 23). Treatment and comparison students completed a science experiment involving balance. During the experiment, treatment students wrote four short responses and an extended response to document their learning. To control for writing time, comparison students wrote four short responses and an extended response about topics other than balance. On a 20-item balance knowledge posttest, control outperformed treatment (d = 0.89) and comparison (d = 1.05) on the lowest level balance questions (Level 1). At the highest level questions, Levels 3 and 4, treatment (ds = 1.42 and 0.94) and comparison (ds = 1.62 and 1.37) outperformed control. There were no significant differences in total words written or level of balance understanding on a posttest written response. The performance of individual responders to treatment is also discussed.     

Effects of single‐case reading interventions for students with and at‐risk of emotional and behavioral disorders in grades K–12: A quantitative synthesis

This study examined the effects of reading interventions from single‐case design studies for students with and at‐risk of emotional and behavioral disorders in grades K–12 using a quantitative synthesis. Seventeen studies met the selection criteria of having one more dependent variables meeting what works clearinghouse (WWC) design standards with or without reservations. Although students’ reading performance significantly improved from baseline to intervention phases (p < 0.001), the overall weighted average effect size was weak (Tau‐U = 0.58, 95% confidence interval = [0.54, 0.63]; d = 0.29); smaller effects were found on reading comprehension. Interventions were less effective for students in secondary grades, students with a comorbid disability, and students in substantially separate settings. While no studies meeting the selection criteria were conducted in inclusive settings, the teacher provided interventions were more effective than those provided by researchers suggesting the importance of the student–teacher relationship for reading instruction. Study limitations, areas for future research, and implications for school practices are discussed.