Management by results: Student evaluation of faculty teaching and the mis-measurement of performance

Using data on 4 years of courses at American University, regression results show that actual grades have a significant, positive effect on student evaluations of teaching (SETs), controlling for expected grade and fixed effects for both faculty and courses, and for possible endogeneity. Implications are that the SET is a faulty measure of teaching quality and grades a faulty signal of future job performance. Students, faculty, and provost appear to be engaged in an individually rational but socially destructive game of grade inflation centered on the link between SETs and grades. When performance is hard to measure, pay-for-performance, embodied by the link between SETs and faculty pay, may have unintended adverse consequences.     

Unequal education,poverty and low growth—A theoretical framework for rural education of China

This paper constructs an intertemporal substitution educational model based on endogenous growth theory and examines the rural education, farmer income and rural economic growth problems in China. It shows that the households originally with the same economic endowment but different education endowment take different growth routes, the income difference between low- and high-income families can be enlarged as they take different educational growth routes, and the low-income family has the chance to get into the “poverty trap”. In the mean time, urban and rural, developed and underdeveloped rural areas, as they take the different education growth routes the difference of economic growth tend to be expanded for the flow of high-quality labor and different industrialization, and they also have the risk of “poverty trap”. The key to solve this problem is the active public policies that promote the equal education, rational income and equilibrium development.     

Math skills and labor-market outcomes: Evidence from a resume-based field experiment

We examine the link between math skills and labor-market outcomes using a resume-based field experiment. Specifically, we send fictitious resumes in response to online job postings, randomly assigning some resumes to indicate stronger math skills, and measure employer responses. The resumes that are randomly assigned to indicate stronger math skills receive more interest from employers than the comparison resumes. Our findings add to the body of evidence showing that stronger math skills positively affect labor-market outcomes.     

Aggregate unemployment decreases individual returns to education

Aggregate unemployment may affect individual returns to education through qualification-specific responses in participation and wage bargaining. This paper shows that an increase in regional unemployment by 1% decreases returns to education by 0.005 percentage points. This implies that higher skilled employees are better sheltered from labour market changes with respect to their jobs but they encounter larger wage changes than less skilled employees. We use representative individual data and panel variation in unemployment between German regions and employee groups. We demonstrate that our results are robust with respect to aggregation bias, time lags and potential endogeneity of the unemployment variable.     

Overskilling dynamics and education pathways

This paper uses panel data and econometric methods to estimate the incidence and the dynamic properties of overskilling among employed individuals. The paper begins by asking whether there is extensive overskilling in the labour market, and whether overskilling differs by education pathway. The answer to both questions is yes. The paper continues by asking whether overskilling is a self-perpetuating labour market state (state dependence), and whether state dependence differs by education pathway. Overskilled workers with a higher degree show the highest state dependence, while workers with vocational education show none. Workers with no post-school qualifications are somewhere between these two groups. The finding that higher degree graduates suffer the greatest overskilling state dependence, combined with the well-established finding that they also suffer the highest overskilling wage penalty, suggests that the cost of mismatch among this grouping are greater relative to vocationally qualified workers.     

Do bans on affirmative action hurt minority students? Evidence from the Texas Top 10% Plan

In light of the recent bans on affirmative action in higher education, this paper provides new evidence on the effects of alternative admissions policies on the persistence and college completion of minority students. I find that the change from affirmative action to the Top 10% Plan in Texas decreased both retention and graduation rates of lower-ranked minority students. Results show that both fall-to-fall freshmen retention and six-year college graduation of second-decile minority students decreased, respectively, by 2.4 and 3.3 percentage points. The effect of the change in admissions policy was slightly larger for minority students in the third and lower deciles: fall-to-fall freshmen retention and six-year college graduation decreased, respectively, by 4.9 and 4.2 percentage points. Moreover, I find no evidence in support of the minority “mismatch” hypothesis. These results suggest that most of the increase in the graduation gap between minorities and non-minorities in Texas, a staggering 90%, was driven by the elimination of affirmative action in the 1990s.     

Do course evaluations truly reflect student learning? Evidence from an objectively graded post-test

It is difficult to assess the extent to which course evaluations reflect how much students truly learn from a course because valid measures of learning are rarely available. This paper makes use of a unique setting in which students take a common, high-stakes post-test which is centrally graded and serves as the basis for capturing actual student learning. We match these student-specific measures of learning to student-specific course evaluation scores from electronic records and a rich set of student-level covariates, including a pre-test score and other measures of skills prior to entering the course. While small in magnitude, we find a robust positive, and statistically significant, association between our measure of student learning and course evaluations.     

Family background,self-confidence and economic outcomes

In this paper we analyze the role played by self-confidence, modeled as beliefs about one's ability, in shaping task choices. We propose a model in which fully rational agents exploit all the available information to update their beliefs using Bayes’ rule, eventually learning their true type. We show that when the learning process does not converge quickly to the true ability level, small differences in initial confidence can result in diverging patterns of human capital accumulation between otherwise identical individuals. If differences in self-confidence are correlated with socio-economic background (as a large body of empirical literature suggests), self-confidence can be a channel through which education and earning inequalities perpetuate across generations. Our theory suggests that cognitive tests should take place as early as possible, in order to avoid that systematic differences in self-confidence among equally talented people lead to the emergence of gaps in the accumulation of human capital.     

The redistributive equity of affirmative action: Exploring the role of race,socioeconomic status,and gender in college admissions

This paper contributes to research on affirmative action by examining issues of equity in the context of racial quotas in Brazil. We study the experience of the University of Brasilia, which established racial quotas in 2004 reserving 20% of available admissions slots for students who self-identified as black. Based on university admissions data and a student survey conducted by the authors, we find evidence that race, socioeconomic status, and gender were considerable barriers to college attendance and achievement. For example, first-difference regressions involving pairs of siblings indicate that black identity and gender had a negative effect on entrance exam scores. Moreover, we compare displaced and displacing applicants and find that racial quotas helped promote equity to some extent. Nevertheless, the scale and scope of redistribution were highly limited, and the vast majority of Brazilians had little chance of attending college, suggesting that more still needs to be done.     

The cost structure of higher education in further education colleges in England

This paper examines the cost of the increased provision of higher education courses within further education colleges in England. We believe this to be the first attempt to fit a cost function specifically to the further education sector. Cost functions for a sample of 96 colleges over a 2-year period, from 2000 to 2002, are fitted using a panel data methodology as well as stochastic frontier analysis. We compare and contrast our findings with a sample of 959 US colleges. Our findings indicate that most further education colleges are able to benefit from economies of scale. Results from both methodologies suggest the presence of product-specific economies of scale, substantial ray economies of scale and indicate that higher education classroom-based courses, such as business studies, as well as vocational courses display substantial economies of scope.     

Girls,girls, girls: Gender composition and female school choice

Gender segregation in employment may be explained by women's reluctance to choose technical occupations. However, the foundations for career choices are laid much earlier. Educational experts claim that female students are doing better in math and science and are more likely to choose these subjects if they are in single-sex classes. One possible explanation is that coeducational settings reinforce gender stereotypes. In this paper, we identify the causal impact of the gender composition in coeducational classes on the choice of school type for female students. Using natural variation in the gender composition of adjacent cohorts within schools, we show that girls are less likely to choose a traditionally female dominated school type and more likely to choose a male dominated school type at the age of 14 if they were exposed to a higher share of girls in previous grades.     

Non-formal basic education as a development priority: Evidence from Nicaragua

Almost 900m adolescents and adults are illiterate in the developing world, yet most policy discussions focus on the educational circumstances of primary aged children. As a result non-formal educational programs for adolescents and adults are given very little support, and this group is virtually ignored in international agreements such as the millennium declaration. This article presents the first serious attempt at evaluating the impact of a non-formal education program. Results show significant learning achievement over the academic year, as well as strong development impacts of the program in non-learning dimensions of participants’ lives. These positive impacts, plus the significantly lower unit costs and self-targeted nature of the program provide strong evidence that this type of program can be an important part of the poverty reduction and human capital enhancement strategy of developing countries with large illiterate adult populations.     

Cognitive skills among children in Senegal: Disentangling the roles of schooling and family background

We use unique data to estimate the determinants of cognitive ability among 14–17-year olds in Senegal. Unlike standard school-based samples, tests were administered to current students as well as to children no longer – or never – enrolled. Years of schooling strongly affects cognitive skills, but conditional on years of school, parental education and household wealth, as well as local public school quality, have surprisingly modest effects on test performance. Instead, family background primarily affects skills indirectly through its impacts on years of schooling. Therefore closing the schooling gaps between poor and wealthy children will also close most of the gap in cognitive skills between these groups.     

Career effects of occupation-related vocational education: Evidence from the military's internal labor market

Prior research on the labor market success of secondary vocational education has produced mixed results, with several studies finding wage gains only for individuals who work in training-related occupations. We contribute to this debate by focusing on a single occupation and organization and by comparing the careers of employees with and without occupation-related training in high school. We use longitudinal data on the careers of military recruits who completed high school Junior Reserve Officers’ Training Corps (JROTC), a military science program that has features of a vocational training and school-to-work program. We find that the occupation-specific training received via JROTC reduces early turnover and improves long-run job stability for those who choose military jobs, suggesting that an important effect of vocational training is to improve job match quality. We also find that promotion rates for vocational graduates are similar to their peers, suggesting that vocational education in general works by improving occupational sorting.     

Estimating the impact of relative expected grade on student evaluations of teachers

Grade inflation over the past few decades has been a concern for many universities. Course evaluation scores are known to be positively correlated with students’ expected grades, and this paper tests whether or not there is an incentive for the instructor to “buy” higher evaluation scores by inflating grades. To test this hypothesis, I use unique data from the University of Washington's Office of Educational Assessment that includes a measure of each student's relative expected grade in the course. I find that there is an incentive for instructors to grade leniently after accounting for the potential endogeneity of the relative expected grade variable due to unobserved teacher productivity and unobserved heterogeneity of instructors and departments. Instructor fixed effects account for a significant part of the measured effect of relative expected grade on evaluations, and by not including them, the estimated impact of relative expected grade on evaluations is biased upwards.     

Where class size really matters: Class size and student ratings of instructor effectiveness

We examine the impact of class size on student evaluations of instructor performance using data on all economics classes offered at the University of California, Santa Barbara from Fall 1997 to Spring 2004. A particular strength of this data is the opportunity to control for both instructor and course fixed effects. In contrast to the literature examining class size effects on test-based outcomes—where results can vary considerably across specifications—we find a large, highly significant, and nonlinear negative impact of class size on student evaluations of instructor effectiveness that is highly robust to the inclusion of course and instructor fixed effects.