Heterogeneous treatment effects in the low track: Revisiting the Kenyan primary school experiment

I present results from a partial re-analysis of the Kenyan school tracking experiment first described in Duflo, Dupas and Kremer (2011). My results suggest that, in a developing country school system with state-employed teachers, tracking can reduce short-run test scores of initially low-ability students with high learning potential. The highest scoring students subjected only to the tracking intervention scored well below comparable students in untracked classrooms at the end of the intervention. In contrast, students assigned to tracking under the experimental alternative teacher intervention experienced gains from tracking that increased across the outcome distribution. These alternative teachers were drawn from local areas, exhibited significantly higher effort levels and faced different incentives to produce learning. I conclude that although Pareto-improvements in test scores from tracking are possible, they are not guaranteed.     

An integrated assessment of the effects of Title I on school behavior,resources, and student achievement

We examine the effects of Title I on school behavior, resources, and academic performance using a rich set of school finance and student-level achievement data from one large urban school district using a regression discontinuity design. We find that Title I eligibility raises Federal revenues of schools by about $460 per student. This is partially offset by decreases in revenues from state categorical aid grants, so that the net increase to schools is about $360 per student. We find no impact on overall school-level test scores, but also no impact among the subgroups of students most likely to be affected by Title I. A novel finding is that schools appear to respond to the incentives embedded in the Title I allocation process by manipulating the fraction of their students signed up for free lunch to secure more Federal funds.     

Education inputs,student performance and school finance reform in Michigan

This paper estimates the impact of the Michigan school finance reform, Proposal A, on education inputs and test scores. Using a difference-in-difference estimation strategy, I find that school districts in Michigan used the increase in educational spending generated through Proposal A to increase teacher salaries and reduce class size to a smaller extent. Then, using the foundation allowance created by Proposal A as an instrument, I estimate the causal effect of increased spending on 4th and 7th grade math scores for two test measures – a scaled score and a percent satisfactory measure – and find positive effects of increased spending on 4th grade test scores. A 60% increase in spending increases the percent satisfactory score by one standard deviation. The positive impact of expenditures on test performance seems largely due to higher teacher salaries.     

High school start times and student achievement: Looking beyond test scores

The American Academy of Pediatrics recommends that U.S. secondary schools begin after 8:30 a.m. to better align with the circadian rhythms of adolescents. Yet due to economic and logistic considerations, the vast majority of high schools begin the school day considerably earlier. We leverage a quasi-natural experiment in which five comprehensive high schools in one of the nation’s largest school systems moved start times forty minutes earlier to better coordinate with earlier-start high schools. Here, disruption effects should exacerbate any harmful consequences. We report on the effect of earlier start times on a broad range of outcomes, including mandatory ACT test scores, absenteeism, on-time progress in high school, and college-going. While we fail to find evidence of harmful effects on test scores, we do see a rise in absenteeism and tardiness rates, as well as higher rates of dropping out of high school. These results suggest that the harmful effects of early start times may not be well captured by considering test scores alone.     

The distributional impacts of a universal school reform on mathematical achievements: A natural experiment from Canada

We investigate the impact of an ambitious provincial school reform in Canada on students’ mathematical achievements. It is the first paper to exploit a universal school reform of this magnitude to identify the causal effect of a widely supported teaching approach on students’ math scores. Our data set allows us to differentiate impacts according to the number of years of treatment and the timing of treatment. Using the changes-in-changes model, we find that the reform had negative effects on students’ scores at all points on the skills distribution and that the effects were larger the longer the exposure to the reform.     

Can incentives for parents and students change educational inputs? Experimental evidence from summer school

This paper examines whether incentives for parents and students can increase educational inputs, in this case, specifically, attendance. We evaluate the impact of randomly-assigned incentives for improving attendance at the summer program of a large metropolitan school district. Students were assigned to one of three experimental conditions: (1) financial incentives for parents combined with non-financial incentives for students, (2) non-financial incentives for students (no incentives for parents), and (3) control. We find that the combination of the parent and student incentives increased the daily attendance rate by 9% and the likelihood of having perfect attendance by 63%. The student-only incentives had a smaller and statistically insignificant effect on attendance. We find little evidence that these incentives affected attendance rates or standardized test scores during the regular school year following the summer program, but we do find that they increased the likelihood of re-enrolling in the district.     

Effects of differentiated school vouchers: Evidence from a policy change and date of birth cutoffs

This paper studies the effects of an increase in school choice by examining a 2008 reform that made the value of Chile’s (previously flat, universal) school voucher a step function of student income. This policy increased the number of private schools that low income children could access free of charge. I identify the impact of the policy by combining its introduction with variation from a date of birth enrollment cutoff. I show that the differentiated voucher lowered, but only slightly, the probability that students used public schools. Students more likely to move to private schools experienced better school characteristics but no increase in test scores. Further analysis suggests a rise in test scores for students most likely to stay in public schools. These results suggest that the effects of the policy on test scores were caused by responses from public schools, instead of by the re-sorting of students into private schools.     

Heterogeneous effects of school autonomy in England

A 2010 education reform gave English schools the option to become academies, autonomous but state-funded schools. Academies can opt for two different models of governance by choosing to remain standalone schools or join an academy chain. We investigate the causal effect of the governance model on student achievement and school inputs. We find that students in academy chains have higher end-of-primary school test scores, with stronger effects for low achievers and early converter academies. School chains are more efficient than standalone academies, achieving better results while spending less overall. Survey data suggest that chains favor management changes, whereas standalone academies make changes related to educational practices.     

Something in the air? Air quality and children's educational outcomes

Poor air quality has been shown to harm the health and development of children. Research on these relationships has focused almost exclusively on the effects of human-made pollutants, and has not fully distinguished between contemporaneous and long-run effects. This paper contributes on both of these fronts. Merging data on ambient levels of human-made pollutants and plant pollen with detailed panel data of children beginning kindergarten in 2010, I study the relationship between poor air quality on achievement in early grades. I also provide tentative estimates of the effects of air quality in the first years of life on school-readiness. I find that students score between 1 to 2 percent lower on math and reading scores on days with high levels of pollen or fine airborne particulate matter, and that asthmatic students score about 10 percent lower on days with high levels of ozone. I find suggestive evidence that poor air quality during early childhood negatively affects school readiness.     

Home Visiting Among Inner-City Families: Links to Early Academic Achievement

This study examines the long-term effects of a home visiting program, Home Instruction for Parents of Preschool Youngsters, on students from mostly low-income, Latino families (n = 254). Children who were in the home visiting program during their early years were compared with a similar demographic group who participated in prekindergarten in the same inner-city area but did not participate in home visiting. Data linked participation in home visiting to state test scores and other information from public schools through the end of elementary school. Research Findings: Secondary data analyses tested for intervention effects on reading and math achievement in an urban school district using 4 waves of data covering kindergarten through 5th grade. Growth curve modeling showed that participation in home visiting predicted higher academic achievement through the 5th grade. Practice or Policy: Parent-focused intervention during early childhood appears to have a lasting impact on children’s achievement. In addition to parent engagement, quality school curriculum and quality instruction affect achievement in elementary school. A comprehensive curriculum focus throughout the early school years should be implemented regardless of preparation for high-stakes testing.     

Book matters: The effect of Cocky’s Reading Express on student performance

The literature argues that children are more likely to succeed academically if they acquire strong reading skills and a love of reading at a young age. In this paper, I evaluate an early childhood literacy program, Cocky’s Reading Express (CRE), to understand how reading events at school and the gifts of books impact learning. Combining the CRE visit records with administrative student data, I find that CRE leads to 0.02–0.03 of a standard deviation increase in statewide English Language Arts test scores among low-income students one year after the visit and find suggestive evidence that CRE improves the math scores for subgroups of students in poverty. In particular, the CRE effect varies based on locality and access to reading materials, with a larger effect on students residing in metropolitan areas or close to public libraries. However, the positive effects on low-income students diminish over time; CRE does not show impacts on the scores of students from better-off families either.     

Does the timing of tracking affect higher education completion?

This paper investigates the effect of the timing of tracking on completion of higher education by exploiting unique variation from the Dutch education system. At the age of 12 Dutch students can enrol in tracked schools or in comprehensive schools. The comprehensive schools postpone enrolment into tracked classes by one or two years. OLS- and IV-estimates, using regional variation in the supply of schools as instruments, show that early tracking has a detrimental effect on completion of higher education for students at the margin of the Dutch high and low tracks. The negative effects of early tracking are larger for students with relatively high ability or students with a higher socioeconomic background. In addition, we find no negative effects of comprehensive classes on higher ability students. These results suggest that increasing participation in comprehensive classes would increase graduation from higher education.     

Are girls always good for boys? Short and long term effects of school peers’ gender

This paper exploits idiosyncratic variations in school cohorts’ gender composition to investigate the short and long-term effects of school peers’ gender. Using French administrative data over the 2008–2012 period, it shows that the proportion of female peers’ in middle school not only affects students’ contemporaneous performance but also influences their subsequent educational attainment. More specifically, a larger share of girls among school peers increases girls’ test scores, reduces their dropout rates and increases their probability to graduate from high school several years later, especially in the scientific track. By contrast, it increases boys’ probability to attend a vocational school and decreases their high school graduation rate. I find suggestive evidence that these effects partially operate through a negative effect of opposite-gender peers on students’ school behaviour and through an adjustment of teacher behaviour based on the gender composition of the classroom.     

Does closing schools close doors? The effect of high school closings on achievement and attainment

This paper examines the effect of high school closures on student achievement and educational attainment. Previous studies primarily focus on effects of elementary school closings on test scores. This study furthers the literature by focusing on high school closures and examines several measures of achievement and attainment. I utilize student data from the Milwaukee Public School district and follow five freshman cohorts through high school. I find that school closings cause a negative shock to student attendance. Importantly, these closures also have long-run consequence both lowering the probability of high school graduation and college attendance.     

Academic tracking is related to gains in students' intelligence over four years: Evidence from a propensity score matching study

Ability grouping or tracking during secondary schooling is widespread. Previous research shows academic track schools are more successful than non-academic track schools in teaching mathematics, reading and foreign languages. Reasons include a more favorable student composition and higher instructional quality. However, there is less evidence that between track differences are even large enough to differentially affect the students' cognitive development. We used data from a large Hamburg panel study to test this hypothesis (N = 8628). By employing several propensity score matching algorithms we formed parallelized samples of academic track and either non-academic track students or comprehensive school students. After four years of tracking, academic track students showed considerably higher intelligence scores than their counterparts at the non-academic tracks and slightly higher scores than students at the comprehensive schools. Our results underline the importance of a cognitively stimulating learning environment in school to support students' cognitive development.     

Is academic tracking related to gains in learning competence? Using propensity score matching and differential item change functioning analysis for better understanding of tracking implications

This study analyzes gains in cognitive components of learning competence with respect to cohorts based on ability tracking in a Czech longitudinal study. Propensity score matching is used to form parallelized samples of academic and non-academic track students and to eliminate the effect of selective school intake. We applied regression models on the total scores to test for the overall track effect. Furthermore, we analyze scores and gains on the subscores and check for differential item functioning in Grade 6 and in change to Grade 9. While after 3 years, no significant difference between the two tracks was apparent in the total learning competence score, we did, however, find significant differences in some subscores and in the functioning of some items. We argue that item-level analysis is important for deeper understanding of the tracking implications and may provide the basis for more precise evidence-based decisions regarding the tracking policy.     

The Causal Effects of Grade Retention on Behavioral Outcomes

This study examines the impact of grade retention on behavioral outcomes under a comprehensive assessment-based student promotion policy in New York City. To isolate the causal effect of grade retention, we implement a fuzzy regression discontinuity (RD) design that exploits the fact that grade retention is largely determined by whether a student scores below a cutoff on a standardized test score. We use data on students subject to the policy over a nine-year span to examine impacts on attendance and disciplinary event outcomes. We do not find evidence of systematic effects of retention on behavioral outcomes in either direction. We do find sporadic nonsustained significant effects of retention on behavioral outcomes. When present, these isolated nonpersistent effects tend to be beneficial when found for retained elementary school students and mixed for retained middle school students.     

Expanding schooling opportunities for 4-year-olds

We use a novel quasi-experimental strategy to estimate the effect of expanding early schooling enrollment possibilities on early achievement. It exploits two features of the school system in The Netherlands. The first is rolling admissions; children are allowed to start school immediately after their 4th birthday instead of at the beginning of the school year. The second is that children having their birthday before, during and after the summer holiday are placed in the same class. These features generate sufficient exogenous variation in children’s enrollment opportunities to identify its effects on test scores. Making available one additional month of time in school increases language scores of disadvantaged pupils by 6 percent of a standard deviation and their math scores by 5 percent of a standard deviation. For non-disadvantaged pupils we find no effect.     

Early to rise? The effect of daily start times on academic performance

Local school districts often stagger daily start times for their schools in order to reduce busing costs. This paper uses data on all middle school students in Wake County, NC from 1999 to 2006 to identify the causal effect of daily start times on academic performance. Using variation in start times within schools over time, the effect is a two percentile point gain in math test scores – roughly fourteen percent of the black–white test score gap. I find similar results for reading scores and using variation in start times across schools. The effect is stronger for students in the lower end of the distribution of test scores. I find evidence supporting increased sleep as a mechanism through which start times affect test scores. Later start times compare favorably on cost grounds to other education interventions which result in similar test score gains.     

Education management and performance after rural education finance reform: Evidence from Western China

Based on a survey of rural school districts in Western China, this essay explores the effects of fiscal centralisation on the relationship between local governance and school district management, most particularly on how managerial power is distributed in the rural education sector. The essay also examines some of the possible effects that changes in managerial arrangements may have on teacher incentives and on educational quality as measured by student test scores. Our analysis suggests that teachers’ incentives and students’ education performance are unlikely to benefit from the excessive centralisation of decision-making power or from incessant horizontal level power struggles among different government bodies.