Hard Cash and Soft Skills: Experimental Evidence on Combining Scholarships and Mentoring in Argentina

Abstract

We evaluate a long-standing program run by one of the largest education foundations in Argentina that offers scholarships and nonacademic mentoring to secondary school students. We randomly assigned 408 grade 6 students within 10 public schools in the Province of Buenos Aires to either receive the program throughout secondary school or not to receive it. After three years, the program improved students’ academic behaviors (e.g., studying before an exam or catching up on missed work), but we find little evidence that these changes translated into broader improvements in students’ academic mindsets (e.g., self-beliefs about performance and efficacy), perseverance (e.g., grit), or learning strategies (e.g., metacognition). The program also improved students’ performance in school during the first year (e.g., grades, attendance, and passing rates), but we do not find similar gains in subsequent years. This may be due to a large share of treatment students being expelled from the program for not meeting its requirements. The program did not improve student learning or personality traits (e.g., conscientiousness). Finally, we find some heterogeneous effects for female students and students from low-income families.     

How schools and students respond to school improvement programs: The case of Brazil's PDE

This study uses rich empirical data from Brazil to assess how a government program (PDE) that decentralizes school management decisions changes what goes on in schools and how these changes affect student outcomes. It appears that the PDE resulted in some improvements in management and learning materials, but little change in other areas including evaluation and community relations. However, we find no evidence that schools’ participation in the PDE improved student achievement. The results for grade passing are stronger. Students in PDE schools saw greater increases in grade passing rates than students in non-PDE schools during the period of our study. We also estimate a positive relationship between PDE spending and student gains for those schools in the program, especially for spending on teaching and learning materials and furniture. We find no benefit of electronics spending or spending on teacher training, two of the three largest areas of school investment.     

School size and student achievement: a longitudinal analysis

Numerous initiatives by private philanthropies and the US government have supported school size reduction policies as an educational reform intended to improve student outcomes. Empirical evidence to support these claims, however, is underdeveloped. In this article, we draw on information from a longitudinal dataset provided by the Northwest Evaluation Association covering more than 1 million students in 4 US states. Employing a student fixed effects strategy, we estimate how a student’s achievement changes as (s)he moves between schools of different sizes. We find evidence that students’ academic achievement in math and reading declines as school size increases. The negative effects of large schools appear to matter most in higher grades, which is also when schools tend to be the largest.     

Free Lunch for All! The Effect of the Community Eligibility Provision on Academic Outcomes

We analyze the effect of the Community Eligibility Provision (CEP), a universal free-lunch program, on elementary and middle school students' academic performance and attendance in the state of South Carolina. As part of the program, eligible schools can provide free lunches to all students, regardless of whether an individual student qualifies for free or reduced lunch. Using a difference-in-differences approach, we show that CEP leads to about 0.06 of a standard deviation increase in math test scores for elementary school students. We find smaller effects on reading scores and on middle school students. These effects also vary by student poverty, school poverty, and locality. In particular, we find students that were previously eligible for free lunches but not on other public assistance programs benefit the most from CEP. The results may suggest that the expansion of access to free lunch help improve students' academic outcomes.     

Improvements in school climate associated with enhanced health and welfare services for students

School improvement initiatives are needed to better meet the needs of underprivileged students, to reduce underachievement and to break a continuing cycle of disadvantage. This article describes part of a school improvement initiative in New Zealand that provided additional funding for school nurse and social worker services in nine secondary schools with the most disadvantaged students in New Zealand. It describes the nature and delivery of services provided by the social workers in these schools. In addition, the article reports changes over time in staff and student views about school climate including a comparison with non-participating schools of similar socioeconomic status. The findings indicated that school climate is a useful intermediate measure of the effectiveness of school improvement initiatives. There were significant improvements in staff views about school climate over time, with staff views about school climate becoming more favourable on scales measuring Improvements in the Last 12 Months and Support for Ethnic Diversity compared to eight non-participating schools. Student views were more favourable on scales measuring Satisfaction with School, Support for Achievement and Support for Ethnic Diversity, compared to the non-participating schools.     

Can incentives for parents and students change educational inputs? Experimental evidence from summer school

This paper examines whether incentives for parents and students can increase educational inputs, in this case, specifically, attendance. We evaluate the impact of randomly-assigned incentives for improving attendance at the summer program of a large metropolitan school district. Students were assigned to one of three experimental conditions: (1) financial incentives for parents combined with non-financial incentives for students, (2) non-financial incentives for students (no incentives for parents), and (3) control. We find that the combination of the parent and student incentives increased the daily attendance rate by 9% and the likelihood of having perfect attendance by 63%. The student-only incentives had a smaller and statistically insignificant effect on attendance. We find little evidence that these incentives affected attendance rates or standardized test scores during the regular school year following the summer program, but we do find that they increased the likelihood of re-enrolling in the district.     

Generating Vocabulary Knowledge for At-Risk Middle School Readers: Contrasting Program Effects and Growth Trajectories

We tested whether urban middle-school students from mostly low-income homes had improved academic vocabulary when they participated in a freely available vocabulary program, Word Generation (WG). To understand how this program may support students at risk for long-term reading difficulty, we examined treatment interactions with baseline achievement on a state standardized test and also differential effects for students with (n = 398) and without (n = 1,395) individualized education plans (IEPs). Students in this unmatched quasi-experiment (5 WG and 4 comparison schools) completed pre- and postvocabulary assessments during the intervention year. We also retested student vocabulary knowledge after summer vacation and the following spring on 11 target words to construct a longitudinally consistent scaled score across 4 waves of data. Growth models show that students experienced summer setback. Although there were no average underlying differences in growth or differences in summer setback for students by baseline achievement, better readers improved more from program participation. IEP status did not predict differential benefits of program participation, and students with IEPs maintained gains associated with participation in WG; however, participation in the program did not change underlying growth trajectories favoring students who did not have IEPs.     

Preventing Early School Failure: Impacts of Success for All on Standardized Test Outcomes,Minority Group Performance,and School Effectiveness

Prior research on the Success for All (SFA) program has produced consistent evidence showing higher reading performance for program participants compared to matched control students. This study extended this research by examining student performance across 3 grades on both individually administered reading tests and state-mandated standardized tests. Of particular interest were longitudinal outcomes over a 3-year period for minority students versus nonminority students. Findings from a quasi-experimental design consisting of 2 SFA schools and 2 matched control schools indicated (a) overall positive effects for SFA on reading performance, (b) relatively stronger effects on the standardized tests than on the individually administered tests, (c) differential program effectiveness in the 2 SFA schools, (d) some decline in program effects over time, and (e) relatively stronger effects for minority than for nonminority students. The implications of the findings for SFA implementation, particularly in helping the most disadvantaged students, and school restructuring are discussed.     

An Empirical Study of Geahigan's Inquiry Model in Learning Art at Senior Secondary School Level

The philosophical foundation for teaching art criticism in schools has been dominated by formalist and expressionist aesthetics, while from a practical point of view it has been influenced by art criticism models that emphasise observation and linguistic practices. Instead of asking students to observe an artwork and make verbal or written statements, George Geahigan proposed an inquiry‐based art criticism learning model that engages students in personal response, research, and aesthetic concept and perceptual skill acquisition activities. Using inquiry‐based art criticism as a foundation for curriculum development and connecting the model to authentic situations in schools, the present study investigated the effectiveness of the model on student learning. Fifteen secondary school teachers were invited to participate. Eight teachers taught the experimental group (n=85) with inquiry‐based curriculum plans and the other seven teachers taught the control group (n=82) with their own school curriculum plans. Students of both groups were asked to write an art criticism essay before and after the implementation of the curriculum plans. The results demonstrated that the overall improvement of the experimental group after one academic year was significantly greater than that of the control group. This article reports on the theoretical framework, methodology and results of the study. It was found that the inquiry‐based approach was a successful strategy in improving students’ skills in analysing, judging and using aesthetic and contextual knowledge in art criticism writing. The discussion focuses on the improvements that were made in the art criticism essays of the experimental group.     

Do Testing Conditions Explain Cyber Charter Schools’ Failing Grades?

Recent Center for Research on Education Outcomes (CREDO) analyses find that cyber charter schools in seventeen states show consistently low reading and mathematics value-added test scores compared to traditional public schools serving comparable students. This generally accords with prior research. We hypothesize that the relatively poor measured academic value-added of cyber charters reflects artificial testing conditions for students in those schools. Accordingly, we have collected testing information from the seventeen CREDO states. State-level analyses find that cyber student persistence, which likely indicates school quality, correlates moderately and significantly with the cyber student academic value-added as measured by CREDO. Further, we find evidence of lower cyber school value-added in states which permit cybers to use narrow testing windows, perhaps reflecting testing fatigue on the part of test-takers. We discuss implications, and suggest next steps for research exploring whether testing conditions affect measured cyber charter performance.     

SCALE‐UP OF SAFE & CIVIL SCHOOLS’ MODEL FOR SCHOOL‐WIDE POSITIVE BEHAVIORAL INTERVENTIONS AND SUPPORTS

This study evaluated the scale‐up of a Safe & Civil Schools Foundations: Establishing Positive Discipline Policies positive behavioral interventions and supports initiative through 4 years of “real‐world” implementation in a large urban school district. The study extends results from a previous randomized controlled trial that established the effectiveness of the Safe & Civil Schools program in 32 elementary schools in the same district. This study emphasizes the application and evaluation of the program in regular district schools. Four‐year results indicate that elementary, middle, and high schools experienced moderate but steady improvements in (a) school discipline, (b) student safety policy and training, (c) staff perceptions of student behavior, and (d) student suspension and chronic tardiness rates. With few exceptions, improvements occurred after schools began Safe & Civil Schools Foundations training, and more years of training were associated with larger cumulative improvements in school and student outcomes. Given that similar effects were observed in schools with and without random assignment of training, and only after training began, we concluded that the improvements stem from Safe & Civil School's Foundations training.     

Part of the assignment: student–teachers’ planning instruction within/across activity systems

ABSTRACT

Looking closely at lesson plans as mediating tools, this study examines preservice teacher learning. By using activity theory in our analysis of lesson plans and other data collected in a student-teaching course, we uncovered tensions within/across the contexts of university teacher education program and secondary school field placements. This study serves to further understandings of how new teachers learn to appropriate the genres of teaching and to explore contradictions between a university preparation program and secondary school contexts. Findings provide an account of the student–teachers’ lesson planning and an explanation of how disruptions in those plans provided insight into points of tension. By viewing these tensions as contradictions within/across activity systems, we identify them as opportunities to better understand teacher learning and ways we might support new teachers in navigating tensions in their classrooms and schools.     

Innovative programs for improvement in reading through cognitive enhancement: a remediation study of Canadian First Nations children

Forty-five Grade 3 students from a reservation school in Western Canada were divided into two remedial groups and a no-risk control group. One remedial group was given a classroom-administered cognitive enhancement program (COGENT) throughout the school year. The second group received COGENT for the first half of the year followed by a pull-out cognitive-based reading enhancement program (PREP). Children were assessed across phonological awareness, rapid naming, reading, and cognitive ability at the beginning of the year, mid-term, and at the end of the school year. MANOVA results showed a significant interaction for reading measures, with students receiving classroom intervention over the school year making the greatest gains. Results are discussed in terms of group, remediation program, and individual participant improvements.     

Effects of a Supplemental Vocabulary Program on Word Knowledge and Passage Comprehension

Abstract

A cluster randomized trial estimated the effects of a supplemental vocabulary program, Elements of Reading®: vocabulary on student vocabulary and passage comprehension in moderate- to high-poverty elementary schools. Forty-four schools participated over a period spanning 2 consecutive school years. At baseline, 1,057 teachers and 16,471 students from kindergarten, first, third, and fourth grade participated. The schools were randomly assigned to either the primary or intermediate grade treatment group. In each group, the nontreatment classrooms provided the control condition. Treatment classrooms used the intervention to supplement their core reading program, whereas control classrooms taught vocabulary business-as-usual. The intervention includes structured, weekly lesson plans for 6 to 8 literary words and aural/oral and written language activities providing multiple exposures and opportunity for use. Hierarchical linear modeling was used to estimate both proximal (Year 1) and distal (Year 2) effects on vocabulary and passage comprehension. The intervention had positive and statistically significant proximal effects but no statistically significant distal effects. The results indicate that the intervention can improve targeted vocabulary and local passage comprehension, but expecting global effects may be overly optimistic.     

The effect of technology funding on school-level student proficiency

This study presents new evidence on the effect of technology funding on school-level student proficiency. I exploit exogenous variation in school-level technology funding using the California Education Technology K-12 Voucher Program. The program provided eligible schools with technology vouchers to purchase qualifying hardware and software products and services. Using a regression discontinuity difference-in-difference design and data on voucher eligibility, voucher use, and school-level student proficiency, I find that voucher eligibility had no significant impact on school-level student proficiency, while voucher use had positive impacts on school-level student proficiency. The voucher use results are driven entirely by schools using the voucher funds for technology resources, but reallocating dollars initially earmarked for technology to other school inputs.     

Are effective or meritorious schools meretricious?

Data on student achievement gain in a large urban school district during the 1984–85 school year were analyzed to identify schools with achievement consistently higher or lower than schools with similar student and school characteristics. Before calculating gain scores, students were grouped with others of the same sex, ethnicity, initial grade level, and initial achievement level. After residuals for students who were above or below similar students were summed and averaged for reading and math at each grade, school-level regression analysis was used to further control for student and school characteristics. Results indicated that schools with reading gains one standard deviation above the mean had average raw scores less than two items higher than the district average on the sixty-item reading test, while schools with math gains this large had raw scores little more than one item higher than the average on the 44-item math test. In addition, examination of data on schools with residual (combined) reading and math gain scores 1.5 or more standard deviations above the average showed that after taking account of student background information and salient school characteristics, only one elementary school among 173 and no secondary school among 71 had unusually high achievement scores. Implications are discussed regarding efforts to identify and reward meritorious schools which allegedly have improved achievement more than other similar schools.     

"Bridging the Gap": The Effects of the Success For All Program on Elementary School Reading Achievement as a Function of Student Ethnicity and Ability Level

This study examined the effects on reading achievement of the Success For All (SFA) program for minority and nonminority students attending elementary school in a small midwestern city. SFA uses a research-based kindergarten program, beginning and intermediate reading programs in Grades 1–3, one-to-one tutoring for low achievers, family support, and other elements. Findings from a comparison between two SFA schools and two matched control schools showed that on individually-administered reading tests, minority (African American) students in the SFA schools performed comparably to their nonminority counterparts at the four schools while significantly outperforming control school minority students. Although overall program effects were not significant, SFA was also effective for the subsample consisting of the lowest-25% achieving students. Longitudinal results over four years showed stable benefits for the lowest-achievers, but some decline in overall program effects relative to the first two years.     

The determinants of student achievement in Turkey

Recent achievement test results show that Turkish students have been performing poorly compared to students from other countries. Using science literacy results from the PISA 2006 survey, we aim to measure the determinants of student achievement in Turkey within the education production function framework. We find that program types have large effects on student achievement. Since many students are allocated across program types as a result of a centralized exam, we try to control for past academic achievement and also for differences in the average socioeconomic background of students in a given school. The results indicate that students cluster in schools according to their socioeconomic background, and previous academic record is important, however, the effects of program types persist. Policies to augment socioeconomic background, such as conditional cash transfers and lifelong learning programs that prioritize parents will increase educational output.     

The effect of school closures on standardised student test outcomes

The school closures owing to the 2020 COVID-19 crisis resulted in a significant disruption of education provision, leading to fears of learning losses and of an increase in educational inequality. This article evaluates the effects of school closures based on standardised tests in the last year of primary school in the Dutch-speaking Flemish region of Belgium. Using a 6-year panel, we find that students of the 2020 cohort experienced significant learning losses in three out of five tested subjects, with a decrease in school averages of mathematics scores of 0.17 standard deviations and Dutch scores (reading, writing, language) of 0.19 standard deviations as compared to previous cohorts. This finding holds when accounting for school characteristics, standardised tests in Grade 4 and school fixed effects. Given the large observed effect sizes, the effect of school closures appears to be a combination of lost learning progress and learning loss. Moreover, we observe that inequality both within schools and across schools rises by 7% for mathematics and 8% for Dutch. The learning losses are correlated with observed school characteristics, as schools with a more disadvantaged student population experience larger learning losses.     

The Impact of School Improvement Grants on Student Outcomes: Findings From a National Evaluation Using a Regression Discontinuity Design

As part of the American Recovery and Reinvestment Act of 2009, the School Improvement Grants (SIG) program received more than $3 billion with the goal of substantially improving student achievement. The SIG program’s funding was to help states turn around the nation’s persistently lowest-achieving schools using one of four school intervention models—transformation, turnaround, restart, or closure. We used a regression discontinuity design and a large sample of schools from more than 20 states to evaluate the impact of implementing a SIG-funded intervention model on use of SIG-promoted practices and student outcomes. Our regression discontinuity design exploited cutoff values on the continuous variables used to define the SIG eligibility tiers to compare outcomes in schools that just met the eligibility cutoff for receiving SIG funding to outcomes in schools that just missed it. We found that SIG had no impact on any of the outcomes we examined, including math and reading test scores, high school graduation rates, and college enrollment rates. Using a correlational analysis, we found the turnaround model was associated with larger student achievement gains in math than the transformation model for grades 6 through 12.