Efficacy of an evidence-based literacy preparation program for young children beginning school

Abstract

This study aimed to provide evidence regarding the efficacy of an early literacy preparation program, PreLit, designed to improve the skills of young Australian children. Participants comprised 240 children in eight schools attending their first year of schooling. Children in the four experimental group schools received instruction in the program while children in the four comparison group schools continued with typical literacy activities in their classrooms. All children were assessed on measures of emergent literacy and language skills prior to and following intervention. It was found that 91% of students were in the bottom quartile for phonological awareness at pre-test. While neither the children nor their schools were randomly allocated to groups, the mean scores for the two groups were very similar at pre-test on all measures. Analyses showed that although the means for the two groups were not statistically different on any of the measures at post-test, significantly fewer students in experimental schools remained in the bottom quartile and more moved into the top quartile for phonological awareness skills, compared with students in the comparison schools. Fine grain analyses, taking into account additional qualitative data about the schools, helped to clarify these findings.     

Longitudinal analysis of the trajectories of academic and social motivation across the transition from elementary to middle school

School transitions are important phases in students’ educational experiences. The current study aimed to explore the trajectories of academic and social motivation across the transition from elementary to middle school. Participants (N = 415) were sampled from six elementary schools; 55% transitioned after sixth grade (transition) and 45% remained at the same school (no-transition). The students reported academic and social goals and perceived teacher goal emphasis at four time points over two successive years. A growth curve analysis revealed that students who transitioned reported a greater decline in mastery goals and an increase in performance-approach goals. Students from no-transition schools reported higher initial levels for all social goals, with a steeper decline in seventh grade. Perceived teacher goal emphasis was associated with social development goals over time. Practitioners should be aware that school transitions may influence academic motivation but may not similarly influence social motivation.     

Examining the text-based,on-demand,analytical writing of mainstreamed Latino English learners in a randomized field trial of the Pathway Project intervention

This study reports on the effects of the Pathway Project, a professional development intervention aimed at supporting the academic language development of English Learners (ELs). Using a subset of data collected during a multi-site cluster randomized controlled trial involving nine middle and six high schools in an urban, low-income school district over 3 years, this study examines how the Pathway Project intervention impacted ELs’ abilities to analyze literature, use academic words, and include commentary in their essays. A total of 103 English teachers were stratified by school and grade and randomly assigned to the intervention or control group. Each year, Pathway teachers participated in 46 hours of training and learned how to apply a cognitive strategies approach to literacy instruction in order to help students understand, interpret, and write analytical essays about themes in literature. Through a textual analysis of 300 randomly sampled pre- and 300 post-intervention essays collected from 1,640 mainstreamed secondary ELs (820 experimental and 820 control), this study examined the ways in which the intervention impacted the writing outcomes of secondary ELs. A univariate analysis of variance (ANOVA) of the students’ literary analysis and the use of commentary in their essays with the number of years in the treatment condition as the independent variable revealed significant effects of the intervention on the afore-mentioned posttest measures, with students who received 2 years of the intervention outperforming those who received only 1 year of the intervention.     

Intervening with Struggling Readers in Seventh Grade: Impact Evidence from Six School Districts

Abstract

This study uses a regression discontinuity design to evaluate the impact of seventh-grade interventions delivered by 25 schools on the reading and school engagement outcomes of struggling readers. Students in participating schools were assigned to intervention (n?=?1,495) or comparison (n?=?4,397) conditions, based on their state reading performance and reading fluency scores in sixth grade. On the state reading test, intervention impact favoring the treatment group approached, but did not reach, statistical significance (p?=?.056, g?=?.15). On a measure of reading fluency, there was a significant interaction between the cut points schools chose for condition assignment and intervention impact (p?=?.015). In schools that chose a lower cut point, intervention students outperformed comparison students, while in schools that chose a higher cut point, comparison students outperformed intervention students. On a student self-report measure of school engagement, no significant differences between the intervention and comparison groups were observed (p?=?.83, g?=?.02). Implications for rigorous evaluation of interventions implemented by districts and schools under naturalistic conditions are discussed.     

Education Reform and Reconstruction as a Challenge to Research Genres: Reconsidering School Effectiveness Research and Inclusive Schooling

This project investigates the impact of the dynamic approach to school improvement (DASI) aiming to help schools face and reduce bullying through integrating research on bullying with educational effectiveness research (EER). A network of approximately 15 schools in each participating country (i.e., Belgium, Cyprus, England, Greece, and The Netherlands) received support to use DASI in order to improve the functioning of school factors included in the dynamic model of educational effectiveness which are associated with reduction of bullying. The Revised Olweus Bully/Victim Questionnaire was administered to students of the experimental (n = 1461) and control (n = 1535) group at the beginning and at the end of the intervention. With the use of multilevel modelling techniques, it was found that schools which made use of DASI were able to reduce bullying at a significantly higher level than the schools of the control group. Implications for the development of effective policies and practices in reducing bullying are drawn.     

Educational inclusion in Singapore for children with physical disabilities

Under Singapore’s inclusive education policy, children with mild physical disabilities are integrated into mainstream schools. There is currently no known published research yet in Singapore on the outcomes of inclusion for children with physical disabilities. Internationally, recent research had compared the school experience of children with physical disabilities to that of their typically developing peers. This study examined the social and academic impact of educational inclusion for children with physical disabilities. It investigated how their participation in school activities, academic performance, self-esteem, peer relationships, and social/emotional development compared to that of typically developing schoolmates. A total of 60 clients (n = 30 with physical disability; n = 30 typically developing students; age range = 8 to 16 years) in a local primary and secondary regular school participated in the study. The children with physical disabilities met academic expectations in school and had comparable levels of self-esteem, but experienced peer problems and participated less in school activities. Understanding children’s overall school experience is critical to becoming an inclusive society that enables children with a range of disabilities to benefit academically and socially. Implications for practice and future research were discussed.     

Group-based intervention on attention and executive functions in the school context

The objective of the study was to examine the effects of a group-based behavioural, cognitive and skills training intervention (Maltti) provided in schools for elementary school pupils with attention and executive function (EF) deficits. The treatment effects were identified by comparing an intervention group (n = 46) with a waitlist control group (n = 26). Specific effects of the intervention on behavioural deficits in attention and EF in a classroom setting as well as on academic skills were examined. Our analysis indicated that significant intervention effects could be found in the behavioural manifestation of attentional and executive skills in the classroom setting among children (n = 30) who were evaluated as having moderate symptoms in the pre-intervention assessment. Positive effects of the intervention were also observed in arithmetic and reading skills. The severity level of pre-intervention attention and EF deficits did not moderate the results observed in the academic skills tests. The results of this study suggest that a combination of behavioural, cognitive and skills training methods applied in a school context can be effective in reducing attention and EF problems and enhancing the academic performance of children with attention and EF deficits.     

Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions

Abstract

Two complementary approaches to developing empirical benchmarks for achievement effect sizes in educational interventions are explored. The first approach characterizes the natural developmental progress in achievement made by students from one year to the next as effect sizes. Data for seven nationally standardized achievement tests show large annual gains in the early elementary grades followed by gradually declining gains in later grades. A given intervention effect will therefore look quite different when compared to the annual progress for different grade levels. The second approach explores achievement gaps for policy-relevant subgroups of students or schools. Data from national- and district-level achievement tests show that, when represented as effect sizes, student gaps are relatively small for gender and much larger for economic disadvantage and race/ethnicity. For schools, the differences between weak schools and average schools are surprisingly modest when expressed as student-level effect sizes. A given intervention effect viewed in terms of its potential for closing one of these performance gaps will therefore look very different depending on which gap is considered.     

A comparison of Dabrowski's overexcitabilities by gender for American and Korean high school gifted students

The differences between US (Ohio) gifted and talented high school students and South Korean gifted and talented high school students on the Overexcitabilities Questionnaire II (OEQ II) were investigated. The OEQ II was administered to 227 Ohio identified gifted and talented high school students (M = 88, F = 139) and to 341 high school students from four specialized high schools (one for science, one for foreign language, and two for the arts) in Seoul, Korea (M = 117; F = 224). Multiple analysis of variance by gender and country revealed that Korean males and females scored higher in psychomotor OE and that US males and females scored higher in imaginational OE. No differences were found in intellectual OE, emotional OE, or sensual OE.     

Effects of a Developmentally Based Intervention With Teachers on Native American and White Early Adolescents’ Schooling Adjustment in Rural Settings

This study reports the effectiveness of a developmentally based, teacher professional development intervention aimed at improving early adolescent school adjustment. Teachers in rural schools in a Northern Plains state took part in professional development activities across a year. Following a randomized control trial design, Native American and White students’ (N = 165) social, behavioral, and academic adjustment was assessed in intervention compared with control schools. Regression analyses, controlling for baseline and demographic variables, indicated that students in intervention schools improved in achievement, and improved or sustained beginning-of-year schooling dispositions, and perceptions of the school social/affective context, in comparison with evident declines for students in control schools. Native American students more so than White students evidenced particular gains in achievement and perceptions of the school social/affective context.     

Accelerating the development of formal thinking in middle and high school students

In an attempt to accelerate the development of formal operations in average young adolescents, intervention lessons relating to all formal schemata were designed in the context of school science courses. Over a period of two years, up to 30 intervention lessons were given by science teachers to their classes in eight schools. Boys who started the program aged 12+ showed a pre-posttest effect size on Piagetian tests of 0.89 SD compared with control classes. In terms of British norms for the development of operational thinking this was a mean change from the 51st to the 74th percentile. Neither the middle school students nor the 12+ girls showed greater gain than the controls. Gains were shown by girls in one 11+ class and in the two 11+ laboratory classes. In the laboratory school students given intervention lessons by the researchers maintained their gains over controls in formal operations at a delayed posttest one year after cessation of the program. There was no effect on tests of science achievement during the intervention. It was argued that the interventions needed to be accompanied by in-service training designed to enable teachers to change their teaching style in line with their students' increased operational thinking capacity.     

Immediate Impacts of PALS: A school‐wide multi‐level programme targeting behaviour problems in elementary school

The article describes the main outcomes of the intervention programme “Positive behaviour, interactions and learning environment in school” (PALS). PALS is an adapted Norwegian version of the School‐Wide Positive Behaviour Support model, developed in the United States with school‐wide interventions aiming at the prevention of behaviour problems and the promotion of social competence through a supportive learning environment. The effectiveness was evaluated with a quasi‐experimental design in four elementary schools, two years after implementation. An equal number of comparison schools were included in the study. Informants were students (n = 735) in third to seventh grade and teachers working at least 50% (n = 82). The immediate reductions in teacher‐observed problem behaviour ranged from moderate to large, while the results based on student ratings of social competence and classroom climate were less encouraging. Differential effects were found and implementation quality was together with teacher collective efficacy significantly related to better outcomes. The programme and results are discussed in relation to prior research, limitations of study design, and future implementation and research.     

Disentangling the predictive validity of high school grades for academic success in university

To refine selective admission models, we investigate which measure of prior achievement has the best predictive validity for academic success in university. We compare the predictive validity of three core high school subjects to the predictive validity of high school grade point average (GPA) for academic achievement in a liberal arts university programme. Predictive validity is compared between the Dutch pre-university (VWO) and the International Baccalaureate (IB) diploma. Moreover, we study how final GPA is predicted by prior achievement after students complete their first year. Path models were separately run for VWO (n = 314) and IB (n = 113) graduates. For VWO graduates, high school GPA explained more variance than core subject grades in first-year GPA and final GPA. For IB graduates, we found the opposite. Subsequent path models showed that after students’ completion of the first year, final GPA is best predicted by a combination of first-year GPA and high school GPA. Based on our small-scale results, we cautiously challenge the use of high school GPA as the norm for measuring prior achievement. Which measure of prior achievement best predicts academic success in university may depend on the diploma students enter with.     

Reading Intervention for Poor Readers at the Transition to Secondary School

This study evaluated two 20-week reading interventions for pupils entering secondary school with reading difficulties. The interventions were delivered by trained teaching assistants (three 35-min sessions per week). 287 pupils (ages 11–13) from 27 schools were randomly allocated to three groups: reading intervention (targeting word recognition and decoding skills), reading intervention plus comprehension, or a waiting list control group. Neither intervention produced statistically significant gains in word reading but the reading intervention plus comprehension intervention produced significant gains in reading comprehension (d = 0.29) and vocabulary (d = 0.34). Further evaluations of methods to improve word reading in this population are needed.     

Home Visiting Among Inner-City Families: Links to Early Academic Achievement

This study examines the long-term effects of a home visiting program, Home Instruction for Parents of Preschool Youngsters, on students from mostly low-income, Latino families (n = 254). Children who were in the home visiting program during their early years were compared with a similar demographic group who participated in prekindergarten in the same inner-city area but did not participate in home visiting. Data linked participation in home visiting to state test scores and other information from public schools through the end of elementary school. Research Findings: Secondary data analyses tested for intervention effects on reading and math achievement in an urban school district using 4 waves of data covering kindergarten through 5th grade. Growth curve modeling showed that participation in home visiting predicted higher academic achievement through the 5th grade. Practice or Policy: Parent-focused intervention during early childhood appears to have a lasting impact on children’s achievement. In addition to parent engagement, quality school curriculum and quality instruction affect achievement in elementary school. A comprehensive curriculum focus throughout the early school years should be implemented regardless of preparation for high-stakes testing.     

A known group analysis validity study of the Vanderbilt Assessment of Leadership in Education in US elementary and secondary schools

The Vanderbilt Assessment of Leadership in Education (VAL-ED) provides educators with a tool for principal evaluation based on principal, teacher, and supervisor reports of principals’ learning-centered leadership. In this study, we conduct a known group analysis as part of a larger argument for the validity of the VAL-ED in US elementary and secondary schools. We asked superintendents to select the principals in their district who they believe in performance of their duties are in the top 20 % and the bottom 20 %. We ask how accurately VAL-ED scores can identify membership of the two known groups. Using a discriminant analysis, the VAL-ED places principals in the superintendent groups, on average, 70 % of the time for both elementary and secondary schools. Placement accuracy is greater for the top group than the bottom group.     

Effectiveness of a digital literacy programme for primary education students / Efectividad de un programa de alfabetización digital para estudiantes de educación primaria

This study carried out an assessment of the effectiveness of a digital literacy programme for primary education students. A quasi-experimental design with repeated measures of assessment was used. The sample consisted of 364 students (206 male and 158 female) from the sixth year of primary education. The students were assessed in their own schools and the sample was divided into two groups: experimental group (N = 190) and control group (N = 174). The assessment was carried out in three sessions: pre-intervention, post-intervention and six-month follow-up. The programme was composed of three sessions aimed at improving digital literacy, as a way of developing a safe and responsible use of the internet. The results obtained after the intervention showed statistically significant differences in the comparison between the two groups. Specifically, the experimental group reached a significantly higher degree of digital literacy (conceptual, procedural and attitudinal) than the control group after passing through the programme.     

Does Student Effort Respond to Incentives? Evidence from a Guaranteed College Admissions Program

This paper studies the effects of guaranteed college admission on student effort and achievement. In 1997, Texas enacted the “Top Ten Percent” law, which guarantees admission to any public college for students in the top ten percent of their high school class. In practice, eligible students become aware of their admission status at the end of their junior year in high school—more than 1 year prior to attending college. We use data from a large, urban school district and regression discontinuity methods to test for effects on effort. Our preferred estimates show that students who barely qualify for the admissions guarantee earn marginally lower grades and take fewer advanced courses in their senior year compared to students who do not qualify for guaranteed admission and learn their status in the final senior year term. We find qualitatively similar results when limiting our sample to finer bandwidths, although the estimates are imprecise.     

“The types of kids we get are different”—The distinguishing characteristics of school choosers in Detroit,Michigan

Providing improved educational options for low-income African American families has been one of the primary objectives of the charter school movement. However, among demographically similar families, school choosers may possess subtle advantages compared to nonchoosers, leading to biased estimates of charter school performance in nonexperimental research. This study examines within-group differences between school choosers and nonchoosers in Detroit, Michigan through semistructured interviews with parents (n = 31) and teachers (n = 23) in charter and public schools. Findings indicate differences between school choosers and nonchoosers in access to transportation, experience, social and professional networks, orientation toward choice, parental involvement, and home stability. These differences offer insight into potential controls for self-selection bias that may lead to improved statistical evaluations using nonexperimental methods.