Charter school authorizers and student achievement

In this paper we analyze the relationship between charter school authorizers and student achievement. We perform this analysis using a 10-year panel dataset from Minnesota, a state that permits four distinct types of authorizers—local school boards, postsecondary institutions, nonprofit organizations, and the Minnesota Department of Education. The results of the analysis indicate that there is no statistically significant relationship between charter school authorizing type and mean levels of student achievement. However, the analysis also reveals that schools authorized by nonprofit organizations exhibit substantially more variability in achievement than schools authorized by local school boards.     

Twice considered: Charter schools and student achievement in Utah

A relatively small state, Utah presents an interesting case to study charter schools given its friendly policy environment and its significant growth in charter school enrollment. Based on longitudinal student-level data from 2004 to 2009, this paper utilizes two approaches to evaluate the Utah charter school effectiveness: (a) hierarchical linear growth models with matched sample, and (b) general methods of moments with student-fixed effects regressions. Both methods yield consistent results that charter schools on average perform slightly worse as compared to traditional public schools, a result that is primarily affected by the low effectiveness and high student mobility of newly opened charter schools. Interestingly, when charter schools gain more experience they become as effective as traditional public schools, and in some cases more effective than traditional public schools. This research has implications for local and state charter school policies, particularly policies that avoid “start-up” costs associated with new charter schools.     

Short-run effects of parental job loss on children's academic achievement

We study the relationship between parental job loss and children's academic achievement using data on job loss and grade retention from the 1996, 2001, and 2004 panels of the Survey of Income and Program Participation. We find that a parental job loss increases the probability of children's grade retention by 0.8 percentage points, or around 15%. After conditioning on child fixed effects, there is no evidence of significantly increased grade retention prior to the job loss, suggesting a causal link running from the parental employment shock to children's academic difficulties.     

The effect of kindergarten classroom size reduction on second grade student achievement: Evidence from California

Because classroom size reduction (CSR) and standards based testing were implemented at the same time in California during the mid-1990s, it is difficult to isolate the effects of classroom size on outcomes from the effects of curriculum changes. As a result, the main comparison in this paper is very specific – the effect of reduced sized kindergarten classrooms on test performance in second grade. The main result of the paper is that the effect of classroom size reduction is small, especially when compared to the other determinants of student achievement at the second grade level. There is a very small effect of classroom size reduction on student achievement in reading and math, and no effect in language and spelling. Of the two offsetting effects of CSR controlling for spending – the direct effect of smaller classes and the indirect effect on teacher quality, the class-size effect is larger. Over time, the negative effect on teacher quality is reduced as new teachers gain experience and credentials.     

School innovation in district context: Comparing traditional public schools and charter schools

Market reforms in education are part of the educational policy landscape in many countries. Central to arguments for market reforms is the idea that competition and choice will spur changes in schools to be more innovative, which in turn will lead to better student outcomes. We define innovation in terms of a practice's relative prevalence in a local district context. A charter school is innovative in its use of a practice if the traditional public schools in its local school district are not using that practice. We explore factors based on arguments for charter schools that may affect a charter schools’ propensity toward innovation to explain variation in levels of innovation across charter schools. We find that, on the whole, charter schools do not fulfill their promise of innovation. Teacher tenure is the most notable exception. Parental involvement is the only characteristic of charter schools that significantly predicts variation in levels of organizational innovativeness.     

Choices for studying choice: Assessing charter school effectiveness using two quasi-experimental methods

Two quasi-experimental methods – fixed effects (FE) and virtual control records (VCR) – were used to measure charter schooling in 14 states and two districts. The new VCR method uses all available observable charter student characteristics and prior performance to create a composite comparison record. A head-to-head comparison of the FE and VCR methods used the same charter students to test the FE control (e.g., the charter student's own traditional public school experience) and the VCR for equivalence. The comparison produced highly similar estimates; charter coefficients were identical in sign and significance and of the same general magnitudes. In an analysis of the sampling fractions included in each method using all available tested charter students, the VCR method was found to produce more generalizable results. In the policy analysis, charter school quality was found to be demographically and geographically uneven with only 19 percent of charter schools outperforming their local markets.     

Measuring the effect of charter schools on public school student achievement in an urban environment: Evidence from New York City

This paper uses student level data from New York City to study the relationship between a public school losing enrollment to charter school competitors and the academic achievement of students who remain enrolled in it. Geographic measures most often used to study the effect of school choice policies on public school student achievement are not well suited for densely populated urban environments. I adopt a direct approach and measure charter school exposure as the percentage of a public school's students who exited for a charter school at the end of the previous year. Depending on model specification, I find evidence that students in schools losing more students to charter schools either are unaffected by the competitive pressures of the choice option or benefit mildly in both math and English.     

Combination classes and educational achievement

Using the ECLS-K and considering first graders in single-grade and K–1 and 1–2 combination classes, I discuss the mechanisms underlying the combination-class effect and address the systematic school-, teacher-, and student-level differences that confound estimates of this effect. I find evidence for positive selection into 1–2 classes, but using a rich set of control variables, find no relationship between class type and student achievement in first grade within schools, and no difference in overall first-grade achievement between single-grade and combination schools in a matched school sample. The results I present suggest that first graders are not harmed by being in a combination class or by their schools offering combination classes. As long as other stakeholders such as parents, teachers, and students in other grades are not made worse off, these results suggest that offering combination classes may be a Pareto-improving option for school administrators.     

Using lotteries to evaluate schools of choice: Evidence from a national study of charter schools

This paper draws on data and experiences observing and analyzing school lotteries from the National Evaluation of Charter School Impacts (Gleason et al., 2010) to describe the challenges associated with lottery-based research. In that study, covering 36 charter middle schools in 15 states, we found that charter schools did not affect student achievement or behavior on average, although there was substantial variation across schools. In this paper, we discuss the prevalence of oversubscribed charter schools at the time the study was conducted (the 2005–2006 and 2006–2007 school years), which was lower than commonly reported. We then describe how the sample of schools that participated in the study compared to all other charter middle schools nationwide, to provide some insight into the generalizabilty of findings from lottery-based studies. In general, oversubscribed charter schools were more likely to be located in urban areas and serve a higher-achieving population of students than those without excess demand. We also describe common features of school lotteries and waitlists, and examine implications of these features for a school's ability to support a lottery-based study. Finally, we summarize lessons learned for conducting lottery-based research on charter schools, drawing on our observations of the schools’ lotteries and analysis of the data from these lotteries.     

The adverse effects of parents’ school selection errors on academic achievement: Evidence from the Beijing open enrollment program

One major concern with public school open enrollment programs is the potential for parents’ school selection errors to adversely affect their children's academic achievement. In this study of the Beijing middle school open enrollment program, we estimate the degree to which children's school outcomes were negatively affected by the poor choices their parents made during the school selection process. We do this by examining parents’ responses to a survey on school choices combined with actual school applications, school admission records, and High School Entrance Examination test scores for 4717 students entering middle schools in Beijing via randomized lotteries. We find that the children of parents who made judgment errors in school selection were admitted to lower quality schools and achieved lower test scores on the High School Entrance Examination. Parents who had less education, whose children performed at lower levels in primary school, and who were less attentive to teachers’ opinions about schools were more prone to make these errors. Providing assistance to parents, especially those less prepared to make informed choices about school selection, is consequently important for supporting more efficient and equitable open enrollment programs.     

Frequency of examinations and student achievement in a randomized experiment

We carry out a randomized experiment involving undergraduate students enrolled at an Italian University attending two introductory economics classes to evaluate the impact on achievement of examination frequency and interim feedback provision. Students in the treated group were allowed to undertake an intermediate exam and were informed about the results obtained, while students in the control group could only take the final exam. The results show that students undertaking the intermediate exam perform better both in terms of the probability of passing the exams and of grades obtained. High ability students appear to benefit more from the treatment. The experiment design allows us to disentangle “workload division or commitment” effects from “feedback provision” effects. We find that the estimated treatment impact is due exclusively to the first effect, while the feedback provision has no positive effect on performance. Finally, the better performance of treated students in targeted examinations seems not to be obtained at the expenses of results earned in other examinations.     

The effects of deeper learning opportunities on student achievement: Examining differential pathways

This study investigates relations between cognitive, interpersonal, and intrapersonal opportunities, noncognitive outcomes, and student achievement in 1,096 students from 20 high schools (10 Deeper Learning [DL] network, 10 control) who participated in the Study of DL (SDL). DL is an umbrella term used to encompass the cognitive, interpersonal, and intrapersonal skills and knowledge that students need to be successful in school and the workforce. Structural equation modeling (SEM) was used to test a theoretical model that hypothesizes plausible pathways between DL opportunities to interpersonal, intrapersonal, and cognitive outcomes. Further, a multigroup structural equation modeling examined differences in these relations between DL and matched nonnetwork schools. Cognitive and intrapersonal opportunities were related to both interpersonal and intrapersonal outcomes. Further, cognitive opportunities were indirectly related to student achievement through interpersonal outcomes. Similar patterns of relations were found in DL and control schools. This study helps to build a stronger understanding of how types of DL opportunities and strategies can best develop the complex skills that students need to be successful in school and can also be used to inform future intervention designs and research studies.     

Relationship between private schooling and achievement: Results from rural and urban India

This paper contributes to the important but small body of research on the role of private schools in Indian education. It uses a household dataset from India with a rich set of household covariates and student performance data on reading, writing, and mathematics. For both rural and urban India the results from regression analyses indicate that private school students perform better on tests controlling for covariates. In both contexts, however, the private school benefit becomes largely, statistically, insignificant after conducting multivariate analysis on data balanced using the propensity score matching technique. The paper also makes an initial attempt to identify ‘low-fee’ private schools; within the regression framework it finds that children in such schools may perform no better than their public school counterparts. The data and methods used in this paper are not without limitations; however these analyses call into question the claim that private school effect may be unequivocally positive and highlights the potential heterogeneity in private school performance in the Indian context.     

Education inputs,student performance and school finance reform in Michigan

This paper estimates the impact of the Michigan school finance reform, Proposal A, on education inputs and test scores. Using a difference-in-difference estimation strategy, I find that school districts in Michigan used the increase in educational spending generated through Proposal A to increase teacher salaries and reduce class size to a smaller extent. Then, using the foundation allowance created by Proposal A as an instrument, I estimate the causal effect of increased spending on 4th and 7th grade math scores for two test measures – a scaled score and a percent satisfactory measure – and find positive effects of increased spending on 4th grade test scores. A 60% increase in spending increases the percent satisfactory score by one standard deviation. The positive impact of expenditures on test performance seems largely due to higher teacher salaries.     

Recess, physical education, and elementary school student outcomes

Today's children experience a decreased amount of time at recess and fewer physical education (PE) classes throughout the school day. Breaks for physical activity limit class time for academics, potentially reducing learning. However, breaks may improve alertness and achievement. Using the Early Childhood Longitudinal Survey Kindergarten Class of 1998-1999, we evaluate how recess and PE in elementary school influence children's learning. We find no statistically significant or economically significant impacts of weekly recess or PE time on student learning for kindergarteners through fifth graders. For example, in kindergarten, adding an hour a week of recess reduces the average test score gain in reading by a statistically insignificant 0.01 standard deviations. An additional 49 min per week of PE in kindergarten improves reading test score gains by a statistically insignificant 0.05 standard deviations. We find no statistical difference in the male and female students’ response to recess and PE. Evidence suggests that recess and PE do not harm student outcomes.     

Examining school leadership effects on student achievement: the role of contextual challenges and constraints

The present study examined indirect effects of principal leadership on the mathematics achievement of 254,475 15-year-old students from 10,313 schools in 32 OECD economies. Results showed that the students could be divided into three categories (Disadvantaged, Average, and Privileged) differing in levels of student SES and prior achievement, parental academic expectations, and access to school resources. Results also showed that principal leadership effects accounted for a greater proportion of between-school achievement variance for Disadvantaged vis-à-vis Privileged or Average students. In particular, instructional leadership had the largest positive effect on Disadvantaged vis-à-vis other students’ achievement via the mediating variables of teacher autonomy and morale. Distributed leadership negatively affected the achievement of Disadvantaged but not other students. The negative effects of principal goal-setting were the largest while those of principal problem-solving were the smallest for Disadvantaged students. The study contributes to the literature by examining contextual influences on the leadership–achievement relationship.     

Where class size really matters: Class size and student ratings of instructor effectiveness

We examine the impact of class size on student evaluations of instructor performance using data on all economics classes offered at the University of California, Santa Barbara from Fall 1997 to Spring 2004. A particular strength of this data is the opportunity to control for both instructor and course fixed effects. In contrast to the literature examining class size effects on test-based outcomes—where results can vary considerably across specifications—we find a large, highly significant, and nonlinear negative impact of class size on student evaluations of instructor effectiveness that is highly robust to the inclusion of course and instructor fixed effects.     

Public subsidies to private schools do make a difference for achievement in mathematics: Longitudinal evidence from Canada

Selection into private schools is the principal cause of bias when estimating the effect of private schooling on academic achievement. By exploiting the generous public subsidizing of private high schools in the province of Québec, the second most populous province in Canada, we identify the causal impact of attendance in a private high school on achievement in mathematics. Because the supply of highly subsidized spaces is much higher at the high school level than at the grade school level, 94% of transitions from the public to the private sector occur at the end of primary school, we assume that these transitions are exogenous with respect to changes in transitory unobserved variables affecting math scores conditional on variables such as changes in income and child fixed effects. Using 7 cycles of data from Statistics Canada's National Longitudinal Survey on Children and Youth (NLSCY), we estimate the effect of attending a private high school on the percentile rank and a standardized math test score with different models (child fixed effects, random effects and a pooled OLS) and restricted samples to control for the degree of selection. The results, interpreted as a treatment on the treated effect show that the effect of changing schools, from a public grade school to a private high school, increases the percentile rank of the math score between 4 and 10 points and by between 0.12 and 0.36 of a standard deviation depending on the specification and samples.