Selective retention bonuses for highly effective teachers in high poverty schools: Evidence from Tennessee

Research has established that racially isolated schools with high concentrations of low-income students disproportionately struggle to recruit and retain highly effective teachers, limiting disadvantaged students’ exposure to high-quality instruction and driving institutional and community instability. This study estimates the effect of selective retention bonuses (SRB) for highly effective teachers on low-performing, high poverty schools’ ability to elevate student performance by increasing access to effective instruction. The theory of action behind the bonus program is simple: SRBs result in greater numbers of highly effective teachers at participating schools, who subsequently drive larger student gains than the teachers who would otherwise fill their positions. To examine whether students in high poverty schools benefit from retention of highly effective teachers, we use differences in eligibility for schools to offer bonuses and the discrete timing of the program in a matched sample, difference-in-differences framework. Results indicate that schools who offered SRBs saw greater test score gains in subsequent years, especially on state reading exams.     

The impact of high-stakes testing on student proficiency in low-stakes subjects: Evidence from Florida's elementary science exam

An important criticism of high-stakes testing policies – policies that reward or sanction schools based on their students’ performance on standardized tests – is that they provide schools with an incentive to focus on those subjects that play a role in the accountability system while decreasing attention to those subjects that are not part of the program. This paper utilizes a regression discontinuity design to evaluate the impact of Florida's high-stakes testing policy on student proficiency in the low-stakes subject of science. We confirm prior results that students in schools facing more immediate sanctions under the policy made substantial gains in the high-stakes subjects of math and reading. Contrary to the crowding-out hypothesis, we find that students in these schools made substantial achievement gains in the low-stakes subject of science as well.     

Placism in NCLB—How Rural Children are Left Behind

No Child Left Behind (NCLB) has been proclaimed by some as a reform that will improve education for students from all backgrounds, in all locations. The main components of NCLB, however, are biased against students in small and rural schools. This bias, called “placism,” discriminates against people based on where they live. This rural incompatibility is evident in NCLB's accountability provisions, sanctions, and highly qualified teacher provisions. Problems in these areas are the result of ignoring, or distorting, the realities of rural schooling. The accountability provisions are constructed so that small schools will frequently be incorrectly labeled as failing. The sanctions, inappropriate for rural areas, fail to provide solutions to existing rural challenges. The “highly qualified” teacher provisions make it more difficult, not easier, for rural districts to attract and retain competent teachers. Unless these injustices are corrected, NCLB will serve to decrease educational quality for rural students.     

Which students are left behind? The racial impacts of the No Child Left Behind Act

The No Child Left Behind Act imposes sanctions on schools if the fraction of any of five racial groups of students demonstrating proficiency on a high stakes exam falls below a statewide pass rate. This system places pressure on school administrators to redirect educational resources from groups of students likely to demonstrate proficiency towards those who are marginally below proficient. Using statewide observations of 3rd and 4th grade math tests, this paper demonstrates that students of successful racial groups at schools likely to be sanctioned gain less academically over their subsequent test year than comparable peers at passing schools. This effect is stronger at schools more likely to suffer from NCLB sanctions and is robust to corrections for non-random sample selection.     

Using Regression Discontinuity to Test the Impact of a Tier 2 Reading Intervention in First Grade

Abstract

?Multitiered systems of reading instruction and intervention, including response to intervention, are widely used in early reading by schools to provide more intense services to students who need them. Research using randomized controlled trials has compared innovative Tier 2 interventions to business-as-usual Tier 2 approaches and established a number of important components that compose effective Tier 2 interventions in early reading. The purpose of this study was to test the impact of a Tier 2 intervention with Tier 2 compared to Tier 1 instruction alone using regression discontinuity. A cut score was used to assign first-grade students at risk for reading difficulties to Tier 2 intervention plus Tier 1 instruction. Students who missed the cut score in the control group received Tier 1 instruction only. Students in the treatment group, just below the cut score, made greater gains on the SAT10 total score and the individual subtests than students just above the cut score. Outcomes were not significant on oral reading fluency.     

Who benefits from selective education? Evidence from elite boarding school admissions

Existing research finds minimal gains from attending elite US secondary schools. This paper estimates the causal effect of attending a selective public boarding school, an institutional model increasingly used by states to serve academically gifted students. Regression discontinuity estimates using multiple admissions thresholds show math score gains and college application and enrollment patterns that shift away from less competitive colleges. Effects are concentrated among minorities, students with lower prior individual achievement, from rural neighborhoods, or lower-achieving sending schools. The opportunity to attend selective boarding schools reduces the tendency of disadvantaged or under-represented students to attend a less selective college by at least one-quarter.     

Returning special education students to regular classrooms: Externalities on peers’ reading scores

Policy reforms to boost full inclusion and conventional return flows send students with special educational needs (SEN) from segregated settings to regular classrooms raising the question how this affects students in the receiving schools. Using full population microdata from Denmark, I investigate whether being exposed to returning SEN students affects the academic achievement of other students in the school-grade cohort. The basic identification strategy controls for student and school-by-grade fixed effects in value-added test scores and is similar to the model in Hanushek, Kain and Rivkin (2002). I add a third dimension to disentangle differential exposure effects in reform years (years with extraordinarily large numbers of returners). The main finding is that being exposed to returning SEN students during the reform period has a negative effect on test score gains of moderate size (−0.04 SD), corresponding to half a month of learning gains per year or 5% of the initial test score gap between students from well-educated and less well-educated homes. An investigation into the mechanisms shows stronger effects in schools with little or no recent experience with accommodating returners, in particular if these schools must accommodate several new returners at the same time. The effect in reform years is not significantly stronger than in nonreform years, indicating that no additional harm is caused by the larger return flows in reform years.     

Are there peer effects associated with having English Language Learner (ELL) classmates? Evidence from the Early Childhood Longitudinal Study Kindergarten Cohort (ECLS-K)

Over the past decade, several state and federal policies have directed schools to mainstream English Language Learner (ELL) students into English-only instruction classrooms. While there is mixed evidence on the effects of these immersion policies on the ELL students, research examining potential peer effects on their non-ELL classmates is non-existent. This paper begins to fill in this gap by using a nationally representative longitudinal sample of children in early elementary grades. Results indicate that having an ELL classmate during kindergarten and first grade is associated with lower test score gains in reading but not necessarily in math for non-ELL students whose primary language is English, controlling for unobserved fixed school characteristics as well as individual characteristics. The negative peer effects on reading test score gain are sensitive to the frequency of within classroom ability grouping usage, gender, and household income level of non-ELL children.     

Early to rise? The effect of daily start times on academic performance

Local school districts often stagger daily start times for their schools in order to reduce busing costs. This paper uses data on all middle school students in Wake County, NC from 1999 to 2006 to identify the causal effect of daily start times on academic performance. Using variation in start times within schools over time, the effect is a two percentile point gain in math test scores – roughly fourteen percent of the black–white test score gap. I find similar results for reading scores and using variation in start times across schools. The effect is stronger for students in the lower end of the distribution of test scores. I find evidence supporting increased sleep as a mechanism through which start times affect test scores. Later start times compare favorably on cost grounds to other education interventions which result in similar test score gains.     

Science achievement of english language learners in urban elementary schools: Results of a first‐year professional development intervention

This study is part of a 5‐year professional development intervention aimed at improving science and literacy achievement of English language learners (or ELL students) in urban elementary schools within an environment increasingly driven by high‐stakes testing and accountability. Specifically, the study examined science achievement at the end of the first‐year implementation of the professional development intervention that consisted of curriculum units and teacher workshops. The study involved 1,134 third‐grade students at seven treatment schools and 966 third‐grade students at eight comparison schools. The results led to three main findings. First, treatment students displayed a statistically significant increase in science achievement. Second, there was no statistically significant difference in achievement gains between students at English to Speakers of Other Language (ESOL) levels 1 to 4 and students who had exited from ESOL or never been in ESOL. Similarly, there was no significant difference in achievement gains between students who had been retained on the basis of statewide reading test scores and students who had never been retained. Third, treatment students showed a higher score on a statewide mathematics test, particularly on the measurement strand emphasized in the intervention, than comparison students. The results indicate that through our professional development intervention, ELL students and others in the intervention learned to think and reason scientifically while also performing well on high‐stakes testing. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 45: 31–52, 2008     

Using school scholarships to estimate the effect of private education on the academic achievement of low-income students in Chile

This paper estimates the impact of private education on the academic achievement of low-income students in Chile. To deal with selection bias, we use propensity score matching to compare the test scores of reduced-fee paying, low-income students in fee-charging private voucher schools to those of similar students in public schools and free private voucher schools. Our results reveal that students in fee-charging private voucher schools score slightly higher than students in public schools. The difference in standardized test scores is approximately 10 points, a test score gain of 0.2 standard deviations. We find no difference in the academic achievement of students in the fee-charging private voucher treatment group relative to their counterparts in free private voucher schools.     

Segregated school effects on first grade reading gains: Using propensity score matching to disentangle effects for African-American,Latino, and European-American students

Increasing evidence from observational studies indicates that students attending minority segregated schools are at risk for constrained performance in reading. However, analyses of data gathered under observational conditions may yield biased results. Using data from the Early Childhood Longitudinal Study, 1998–1999 Kindergarten Cohort, this study used propensity score matching to address selection bias due to students’ observed socio-economic, literacy, and social-emotional background characteristics, allowing for a less biased estimate of minority segregated schooling on African-American, Latino, and European-American students’ reading gains in first grade. We found that African-American students attending segregated schools made less gain in reading across the first grade year than African-American students in non-segregated schools. There was no evidence for significant negative effects of segregation on reading gains for Latino and European-American students.     

Frühübergang in ein grundständiges Gymnasium – Übergang in ein privilegiertes Entwicklungsmilieu?

This article examines whether students’ learning gains in reading and mathematics depend on the time of their transition from elementary school to the academic track of secondary schooling. Drawing on data from the ELEMENT study, the learning gains of fifth and sixth graders in elementary schools (N?=?3167) and academic-track schools with various curricular profiles (N?=?1758) in Berlin were modelled by regression and propensity score matching (PSM) analyses. When baseline differences between the school types were controlled, analyses for reading did not reveal statistically significant differences at all. Findings for mathematics were inconsistent depending on the method of analysis. Regression analysis showed statistically significant results of small effect size in favour of the academic-track schools. However, this finding could not be replicated by means of PSM. The study does not provide evidence for a generally positive effect of early transition to the academic track of secondary schooling with respect to mathematics and reading performance. Theoretical and methodological implications and limitations of the study are discussed.     

Test‐based accountability: Potential benefits and pitfalls of science assessment with student diversity

Recent test‐based accountability policy in the U.S. has involved annually assessing all students in core subjects and holding schools accountable for adequate progress of all students by implementing sanctions when adequate progress is not met. Despite its potential benefits, basing educational policy on assessments developed for a student population of White, middle‐ and upper‐class, and native speakers of English opens the door for numerous pitfalls when the assessments are applied to minority populations including students of color, low SES, and learning English as a new language. There exists a paradox; while minority students are a primary intended beneficiary of the test‐based accountability policy, the assessments used in the policy have been shown to have many shortcomings when applied to these students. This article weighs the benefits and pitfalls that test‐based accountability brings for minority students. Resolutions to the pitfalls are discussed, and areas for future research are recommended. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 47: 6–24, 2010     

Promoting Reading Achievement and Countering the “Fourth-Grade Slump”: The Impact of Direct Instruction on Reading Achievement in Fifth Grade

Previous research has documented a substantial decline of standardized test scores of children from low-income backgrounds, relative to more advantaged peers, in later elementary grades, the so-called “fourth-grade slump.” This article examines changes in reading achievement from first to fifth grade for students in a large urban school system with a high proportion of students from economically deprived backgrounds. Students received first-grade reading instruction from Direct Instruction (DI), Open Court, or a mixture of reading curricula. Results indicate that students in schools using DI had significantly greater gains in both reading vocabulary and comprehension than students in the two other settings and that their average levels of achievement in fifth grade were above the national norms, thus countering the fourth-grade slump.     

Context Effects on Students’ Gains in Reading Comprehension in Reading First Schools in Michigan

Reading First, Part B of Title 1 of the No Child Left Behind Act of 2001, provides support for states with approved programs to improve the reading achievement of early elementary students in high poverty, chronically low achieving schools. The purpose of this study is to examine the extent to which the Reading First program in the state of Michigan is making progress in meeting this goal after five years of implementation. The study design makes use of the reading comprehension achievement test results for cohorts of students who entered the program in different years and who took the test two or three times while attending a Reading First school in Michigan between 2002 and 2006. The results indicate that overall the students showed significant gains in reading comprehension; further, students with three years in Reading First tended to score higher than those with two years in Reading First. However, students whose socio-demographic characteristics place them at an educational disadvantage (e.g., eligibility for subsidized lunch) made relatively modest gains in reading comprehension. In addition, any negative effects attributable to such student characteristics are compounded when the student body in the school is composed of a large percentage of students with the same characteristic. These results suggest that while a successful program overall, Reading First is not comprehensive enough to counteract the socio-demographic problems of extremely high poverty schools.      

The effect of charter schools on districts’ student composition,costs, and efficiency: The case of New York state

Charter schools can influence a school district's costs by reducing economies of scale and by changing the share of high cost students a district serves, but might also increase the district's efficiency through competition. Utilizing data for New York State school districts from 1998/99 to 2013/14, we estimate difference-in-differences models to assess the effect of charter schools on enrollment and student composition. Then, we estimate an expenditure function, using data prior to the charter school program, to measure the costs associated with reaching a given performance standard for students in various need categories and different enrollments. Next, using the entire data set, we run a second expenditure function to determine changes in efficiency associated with charter school entry. We find that charter schools increase the cost of providing education, and that these cost increases are larger than short-run efficiency gains, but are offset by efficiency gains in the long term.     

Do gains in test scores explain labor market outcomes?

Using data from the National Education Longitudinal Study of 1988, this article investigates whether students who made relatively large test score gains during high school had larger earnings 7 years after high school compared to students whose scores improved little. In models that control for pre-high school test scores, family background, and demographic characteristics, employed women who gain one standard deviation more than average are predicted to earn 9 percent more than average. These effects are even larger unconditional on employment status, indicating that test score gains influence both the employment status and earnings once employed. For men, however, test score gains are not significantly related to employment status or earnings, except for those men who have low initial test scores.     

Understanding the Impact of Accountability on Preservice Teachers’ Decisions About Where to Teach

Research has shown that individuals who become teachers are uniquely oriented to the psychic rewards of teaching such as connecting with students and making a difference. Yet, in the era of “No Child Left Behind”, emphasis upon test scores as indicators of student learning, competition within and between school districts, and threats of external sanctions seem to promote a different orientation to teachers’ work. This is especially the case in schools with limited human, social, physical, and cultural capital serving disproportionate numbers of low-income, racial/ethnic and linguistic minority students typically located in urban areas. Given the existing problem of teacher shortages in urban schools and the current impact of accountability, this study seeks to explore two questions: How do preservice teachers believe their aspirations to teach will be affected by the accountability movement? And how do these views affect their considerations about where to teach?     

ASSESSING CHEMISTRY-LEARNING COMPETENCIES OF STUDENTS IN ISOLATED RURAL SENIOR HIGH SCHOOLS BY USING THE NATIONAL EXAMINATION: A CASE STUDY OF SIMEULUE ISLAND,INDONESIA

This study explored learning competency based on the Indonesian National Examination focusing especially on chemistry performance and the circumstances of senior high school students and teachers in rural areas of Simeulue Island, Indonesia. The National Examination total score and chemistry score for students in rural areas were consistently lower than students in urban areas during 2008–2010. The majority of rural students were failing to master key chemistry concepts. Their low performance on laboratory-based questions appeared to indicate that the associated practical work was not done as part of the chemistry courses. Some chemistry topics were not taught due to insufficient time, student weaknesses, insufficient textbooks, and other reasons. The issues of low competency of teachers, poverty for the majority of students, low enrollment in schools, and low competition among students in these rural senior high schools appeared to be common problems across rural settings. The local government has recommended providing a consolidated rural high school with qualified chemistry teachers, laboratories, and transportation to address factors negatively influencing student achievement. Furthermore, local rural school officials need to recruit and retain qualified teachers in these isolated areas, provide effective textbooks and instructional resources, and facilitate the professional development of chemistry teachers.