Examining the Sustainability of an Evidence-Based Preschool Curriculum: The REDI Program

This study examined the extent to which an evidence-based preschool curriculum (Head Start REDI) was sustained by 20 teachers during the year following a randomized controlled efficacy trial, when teachers were no longer required by the research project to implement the curriculum. Two quantitative measures of sustainability (teacher ratings, REDI coach ratings) and a qualitative measure (teacher interview) were collected and compared. Sustainability varied by the specific curriculum component, with higher rates of sustainability for the social-emotional component (Preschool PATHS) than for the language and literacy components. Estimates of sustainability were affected by the method of measurement, with REDI coach ratings and qualitative teacher interviews more closely aligned than teacher ratings. Responses from qualitative interviews identified the main factors that teachers thought affected sustainability. Teacher responses suggest that efforts to promote sustainability are best targeted at reducing barriers, such as competing demands, rather than simply highlighting the benefits of the new curriculum.     

Sustaining High-Quality Teaching and Evidence-Based Curricula: Follow-Up Assessment of Teachers in the REDI Project

Research Findings: Recent research has validated the power of evidence-based preschool interventions to improve teaching quality and promote child school readiness when implemented in the context of research trials. However, very rarely are follow-up assessments conducted with teachers in order to evaluate the maintenance of improved teaching quality or sustained use of evidence-based curriculum components after the intervention trial. In the current study, we collected follow-up assessments of teachers 1 year after their involvement in the REDI (REsearch-based, Developmentally Informed) research trial to evaluate the extent to which intervention teachers continued to implement the REDI curriculum components with high quality and to explore possible preintervention predictors of sustained implementation. In addition, we conducted classroom observations to determine whether general improvements in the teaching quality of intervention teachers (relative to control group teachers) were sustained. Results indicated sustained high-quality implementation of some curriculum components (the Promoting Alternative THinking Strategies curriculum) but decreased implementation of other components (the language/literacy components). Sustained intervention effects were evident on most aspects of general teaching quality targeted by the intervention. Practice or Policy: Implications for practice and policy are discussed.     

Examining Different Forms of Implementation and in Early Childhood Curriculum Research

The purpose of this study was to examine different approaches to assessing implementation in an early childhood curriculum research study. Early childhood teachers in 51 preschool classes located at nationally dispersed sites implemented the Children's School Success curriculum for a school year. Structural (proportion of curriculum delivered) and process (quality of delivery of curriculum) measures of implementation were collected for the literacy, math, and social components of the curriculum. Also, a multiplicative composite score incorporating information from the structural and process measures was calculated. Site differences occurred for the process measure, but not the structural and composite measures. Analysis of the process implementation measures collected across time revealed primarily stable trends across sites. Significant associations were found between measures of implementation and some of the child outcome variables, with the different forms of implementation associated with different outcome variables.     

Implementation fidelity of MyTeachingPartner literacy and language activities: Association with preschoolers’ language and literacy growth

There is surprisingly little empirical research examining issues of fidelity of implementation within the early childhood education literature. In the MyTeachingPartner project, 154 teachers were provided with materials to implement a supplemental classroom curriculum addressing six aspects of literacy and language development. The present study examines the degree of variability in three aspects of implementation fidelity – dosage, adherence, and quality of delivery – and whether these components of fidelity were associated with children's growth in language and literacy skills across the preschool year. Findings indicate that teachers reported using the curriculum fairly often (dosage) and that they were observed to generally follow curricular lesson plans (adherence). In contrast, the quality of delivery, defined as the use of evidence-based teacher–child interactions for teaching literacy and language, was much lower. Children in classrooms in which activities were observed to last for longer (dosage) and in which teachers exhibited higher quality of delivery of literacy lessons made significantly greater gains in early literacy skills across the preschool year. Also, teachers’ use of higher quality language interactions was associated with gains for children who did not speak English at home. Results have implications for teacher professional development and the supports provided to ensure that curricula are delivered most effectively.     

Promoting Academic and Social‐Emotional School Readiness: The Head Start REDI Program

Forty‐four Head Start classrooms were randomly assigned to enriched intervention (Head Start REDI—Research‐based, Developmentally Informed) or “usual practice” conditions. The intervention involved brief lessons, “hands‐on” extension activities, and specific teaching strategies linked empirically with the promotion of: (a) social‐emotional competencies and (b) language development and emergent literacy skills. Take‐home materials were provided to parents to enhance skill development at home. Multimethod assessments of three hundred and fifty‐six 4‐year‐old children tracked their progress over the course of the 1‐year program. Results revealed significant differences favoring children in the enriched intervention classrooms on measures of vocabulary, emergent literacy, emotional understanding, social problem solving, social behavior, and learning engagement. Implications are discussed for developmental models of school readiness and for early educational programs and policies.     

Helping Head Start Parents Promote Their Children's Kindergarten Adjustment: The Research‐Based Developmentally Informed Parent Program

Head Start enhances school readiness during preschool, but effects diminish after children transition into kindergarten. Designed to promote sustained gains, the Research‐based Developmentally Informed (REDI) Parent program (REDI‐P) provided home visits before and after the kindergarten transition, giving parents evidence‐based learning games, interactive stories, and guided pretend play to use with their children. To evaluate impact, two hundred 4‐year‐old children in Head Start REDI classrooms were randomly assigned to REDI‐P or a comparison condition (mail‐home math games). Beyond the effects of the classroom program, REDI‐P promoted significant improvements in child literacy skills, academic performance, self‐directed learning, and social competence, demonstrating the utility of the approach in promoting gains in cognitive and social‐emotional skills evident after the transition into kindergarten.     

Effects of small-group reading instruction and curriculum differences for students most at risk in kindergartenL: two-year results for secondary- and tertiary-level interventions

This article describes the implementation of small-group reading instruction as secondary- and tertiary-level components of a three-tier model of prevention and intervention. The study consisted of 83 students who were targeted in the winter of kindergarten as being at high risk for reading failure. Intervention consisted of evidence-based curriculum delivered in groups of one to six students during 30- to 40-min sessions a minimum of three times per week over a 2-year period. Outcome data were collected for early literacy skills, using the Dynamic Indicators of Basic Early Literacy Skills and Woodcock Reading Mastery Test, with comparisons across the different curricula. Results indicated that students in the more directed, explicit intervention groups generally out-performed students in the comparison group. Implications for future research and practice implementing schoolwide three-tier prevention models are discussed.     

Two-year impacts of a universal school-based social-emotional and literacy intervention: an experiment in translational developmental research

This study contributes to ongoing scholarship at the nexus of translational research, education reform, and the developmental and prevention sciences. It reports 2-year experimental impacts of a universal, integrated school-based intervention in social-emotional learning and literacy development on children's social-emotional, behavioral, and academic functioning. The study employed a school-randomized, experimental design with 1,184 children in 18 elementary schools. Children in the intervention schools showed improvements across several domains: self-reports of hostile attributional bias, aggressive interpersonal negotiation strategies, and depression, and teacher reports of attention skills, and aggressive and socially competent behavior. In addition, there were effects of the intervention on children's math and reading achievement for those identified by teachers at baseline at highest behavioral risk. These findings are interpreted in light of developmental cascades theory and lend support to the value of universal, integrated interventions in the elementary school period for promoting children's social-emotional and academic skills.     

Using the Quality of Literacy Implementation Checklist to Improve Preschool Literacy Instruction

Despite much progress in improving the quality of preschool programs, there is still an uneven quality of instruction in early childhood settings. Providing support and professional development (PD) for teachers that is practical, systematic and sustainable is one potential avenue to increase classroom quality in preschool, including quality of literacy instruction. Preschool educators who want to focus on increasing the quality of literacy instruction need simple-to-use tools that can be implemented quickly and provide a means to assess progress towards the goal of improving literacy instruction. The Quality of Literacy Implementation checklist measures how well the teaching staff include intentional, instruction in literacy/oral language. Rather than focusing on a specific curriculum or intervention, quality of implementation focuses on the teacher’s delivery of key procedural features of evidence-based instruction. As is the case with fidelity of implementation, a quality of implementation checklist not only measures implementation but also provides a roadmap about how instruction might be modified to ensure that critical and essential skills are emphasized across the preschool day.     

Teachers’ adaptations to and orientations towards an adolescent literacy curriculum

This study examines teacher implementation of an adolescent literacy curriculum designed as an intervention for students reading two years below grade level. Specifically, this work focuses on the adaptations made by four experienced teachers in a single school that sustained implementation of this curriculum after the intervention trial had ended. Data were collected through observation and interview. An accounts of teaching practice methodology was used to define each teacher’s orientation towards the curriculum, and then to determine whether this orientation demonstrated assimilation or accommodation to intervention principles. I found that the vast majority of time spent implementing the curriculum included adaptations, and that each teacher’s adaptations were different, and reflected her pre-existing orientation towards literacy teaching. Although one teacher demonstrated assimilation and accommodation to intervention principles, the other three primarily demonstrated assimilation. These findings suggest the importance of understanding teachers’ orientations towards curriculum in order to provide more tailored professional development which may help teachers accommodate to the most critical pedagogical features of a curriculum. This may be especially significant in considering sustained implementation, after research-related supports have been withdrawn.     

Impact of a play‐based curriculum in the first two years of primary school: literacy and numeracy outcomes over seven years

In 2000–2002 an innovative early years curriculum, the Enriched Curriculum (EC), was introduced into 120 volunteer schools across Northern Ireland, replacing a traditional curriculum similar to others across the UK at that time. It was intended by the designers to be developmentally appropriate and play‐based with the primary goal of preventing the experience of persistent early failure in children. The EC was not intended to be a literacy and numeracy intervention, yet it did considerably alter pedagogy in these domains, particularly the age at which formal reading and mathematics instruction began. As part of a multi‐method evaluation running from 2000–2008, the research team followed the primary school careers of the first two successive cohorts of EC children, comparing them with year‐ahead controls attending the same 24 schools. Compared to the year‐ahead control group, the findings show that the EC children's reading and mathematics scores fell behind in the first two years but the majority of EC children caught up by the end of their fourth year. Thereafter, the performance of the first EC cohort fell away slightly, while that of the second continued to match that of controls. Overall, the play‐based curriculum had no statistically significant positive effects on reading and mathematics in the medium term. At best, the EC children's scores matched those of controls.     

Social,emotional and intercultural competencies: a literature review with a particular focus on the school staff

Framed by the EU-project Hand in Hand focusing on Social, Emotional and Intercultural (SEI) competencies among students and school staff the paper discusses implementation and professional competencies based on a literature review. Five themes were identified: 1) Intercultural/transcultural competency is not often referred to in the same research as social-emotional learning, though socio-emotional aspects appear to be `in the core´, 2) it is crucial to be aware of agency among school staff in a SEI-implementation, 3) successful implementation is about more than the activities in the specific program, it is rather about elements in synergy and professional learning over time, 4) the subtle balance between adaptation and fidelity might best be addressed in an adaptive curriculum emphasizing active ingredients, and 5) this is a field with many intervention studies, but it is urgent to consider if the psychometric measures are sufficiently sensitive to catch the subtle changes related to SEI-competencies.     

Can Early Childhood Curriculum Enhance Social-Emotional Competence in Low-Income Children? A Meta-Analysis of the Educational Effects

Research Findings: This meta-analysis examined 29 (quasi-)experimental studies that involved low-income children ages 3 to 5 who might be subject to risks of academic failure and other negative outcomes. Compared to the controls, children who learned with social-emotional learning (SEL) curricula demonstrated significantly improved social-emotional competence, with an effect size or standardized mean difference of 0.241 (95% confidence interval [0.194, 0.287]). However, the use of other curricula that lacked an intensive focus on SEL yielded nonsignificant effects on the social-emotional competence of low-income children. Type of curriculum, fidelity of curriculum implementation, and duration of intervention were found to moderate the educational effects. Practice or Policy: The findings of this meta-analysis contribute to the growing body of empirical evidence on the positive effects of early SEL curricula and explain how curricula can produce social-emotional benefits for low-income children in their early years.     

Evaluating a screening and support system for early intervention in Wales

The concept of early screening and response to intervention has been recognised as key to success in literacy. In this article, an implementation model, which combined a published screening test with a free open access short‐term intervention, was piloted and evaluated over several years. Significant improvements in risk levels for literacy difficulties were identified following a series of 12‐week interventions for 1 hour weekly, split into three small group sessions. In phase 1a, 54% of 224 children were no longer ‘at risk’, and in Phase 1b, 51% of 151 children were no longer ‘at risk’, with evidence for transfer to reading over time. In phase 2a, the approach included whole class screening, (670 children, 25% risk at pre‐test reduced to ‘no‐risk’ in 17.4%). In Phase 2b, targeted support was provided for 306 children in reception, year 1 and year 2. After the intervention, 57% of these children were no longer ‘at‐risk’, with reception children making greatest progress. The model has successfully impacted on greater awareness of ALN and approaches to intervention in the teachers involved. Interviews with users indicated a high level of satisfaction and the approach has been recommended for wider application, following further research.     

Literacy Achievement during Kindergarten: Examining Key Contributors in an At-Risk Sample

This study investigated the contributions of initial literacy, oral language, and social adjustment to literacy achievement at the end of the kindergarten year. Data were collected across the kindergarten year from 48 children attending a school serving primarily children from low-income households with researchbased curriculum and intervention programs. Data were used to create latent variables to represent initial literacy, oral language, and social adjustment as predictor variables and a variable representing word reading and spelling as an outcome variable. Multiple regression indicated that only initial literacy contributed significantly to the outcome. Path analysis also indicated the significance of initial literacy while supporting the shared contribution of oral language to the literacy outcome. Discriminant function analysis indicated that individuals with higher scores on the literacy outcome had high factor loadings on both initial literacy and oral language. Social adjustment did not contribute significant variance to the literacy outcome in any of the analyses. This study has implications for both policy and practice, documenting the importance of initial literacy skills, even from the beginning of kindergarten, to kindergarten literacy outcome and highlighting the correlation between the effects of initial literacy and oral language on reading and spelling.     

Can social and emotional learning improve children’s academic progress? Findings from a randomised controlled trial of the Promoting Alternative Thinking Strategies (PATHS) curriculum

Despite the significant evidence base demonstrating the positive impact of the Promoting Alternative Thinking Strategies (PATHS) curriculum on children’s social-emotional and mental health outcomes, there has been very little research on its efficacy in improving academic attainment. More generally, the relationship between implementation variability and PATHS intervention outcomes has been underexplored. A cluster-randomised controlled trial with two arms: intervention (PATHS – 23 schools) and control (usual practice – 22 schools) was implemented to assess the impact of PATHS on English and Mathematics for children in years 5 (aged 9–10 years, n = 1705 pupils) and 6 (aged 10–11 years, n = 1631 pupils) in English primary schools. Two-level hierarchical linear models (school, child) were used to assess both primary ‘intention-to-treat’ effects and secondary ‘subgroup’ effects (for children eligible for free school meals). Additionally, the moderating role of implementation variability was assessed in 31 year 5 (n = 712 pupils) and 32 year 6 (n = 732 pupils) classes across the 23 intervention schools, with fidelity, dosage, quality/responsiveness and reach data generated via classroom-level structured lesson observations. Intention-to-treat and subgroup analyses revealed no significant positive effect of PATHS on children’s academic attainment. Cluster analyses of observational data revealed four distinct implementation profiles, differentiated primarily by dosage levels. However, these profiles were not significantly associated with differential academic outcomes. In light of our findings and their likely generalisability, it is not possible to recommend PATHS as an effective intervention for improving the academic attainment of children in English primary schools.

Trial registration: ISRCTN85087674

     

Implementation of the PATHS Curriculum in an Urban Elementary School

We examined the effectiveness of the PATHS curriculum in a magnet elementary school serving a distressed urban area. Aspects of social-emotional competence were examined for second graders who had, and had not, received the PATHS intervention. The intervention groups differed, with the control group having lower social-emotional competence than the intervention group. The measures that contributed most to this effect were objective ratings of observed social competence, and self-reports of child depression and social rejection. School personnel reported modest enthusiasm and approval of the PATHS curriculum. The importance of school acceptance, and contexts that may enhance such acceptance, are discussed.     

Implementation of the PATHS Curriculum in an Urban Elementary School

We examined the effectiveness of the PATHS curriculum in a magnet elementary school serving a distressed urban area. Aspects of social-emotional competence were examined for second graders who had, and had not, received the PATHS intervention. The intervention groups differed, with the control group having lower social-emotional competence than the intervention group. The measures that contributed most to this effect were objective ratings of observed social competence, and self-reports of child depression and social rejection. School personnel reported modest enthusiasm and approval of the PATHS curriculum. The importance of school acceptance, and contexts that may enhance such acceptance, are discussed.     

An evaluation of curriculum, setting, and mentoring on the performance of children enrolled in pre-kindergarten

An alarming number of American pre-school children lack sufficient language and literacy skills to succeed in kindergarten. The type of curriculum that is available within pre-kindergarten settings can impact children's academic readiness. This work presents results from an evaluation of two language and literacy curricula (i.e., Let's Begin with the Letter People and Doors to Discovery) from a random assignment study that occurred within three settings (i.e., Head Start, Title 1, and universal pre-kindergarten) and included a control group. The design included a mentoring and non- mentoring condition that was balanced across sites in either curriculum condition. A pre and post-test design was utilized in the analyses, with children (n = 603) tested before the intervention and at the end of the year. Multilevel growth curve modeling, where the child outcomes (dependent measures) are modeled as a function of the child's level of performance and rate of growth between pre and post-testing, was used for all analyses. Results indicated that in many key language/literacy areas, the skills of children in classrooms using either one of the target curricula grew at greater rates than children in control classrooms. This was especially true in the Head Start programs. The findings from this study indicate that at-risk children can benefit from a well-specified curriculum. Additionally, findings demonstrate that a well-detailed curriculum appeared to be less important for children from higher income families. The impact of mentoring was less clear and seemed dependent on the type of skill being measured and type of program.