Validity Evidence Supporting Use of Anchoring Vignettes to Measure Teaching Practice

High-quality measures of instructional practice are essential for research and evaluation of innovative instructional policies and programs. However, existing measures have generally proven inadequate because of cost and validity issues. This paper addresses two potential drawbacks of survey self-report measures: variation in teachers’ interpretation of response scales and their interpretation of survey questions. To address these drawbacks, researchers tested out use of “anchoring vignettes“ in teacher surveys to capture information about teaching practice, and they gathered validity evidence in regard to their use as a tool for adjusting teachers’ survey self-reports about their instructional practices for research purposes, or potentially to inform professional development. Data from 65 teachers in grades 4-9 responding to our survey suggested that vignette adjustments were reliable and valid for some instructional practices more than others. For some instructional practices, researchers found significant and high correlations between teachers’ adjusted survey self-rating, through use of anchoring vignettes, and previous observation ratings of teachers’ instruction, including ratings from several widely-used observation rubrics. These results suggest that anchoring vignettes may provide an efficient, cost-effective method for gathering data on teachers’ instruction.     

Examining the Effects of High School Contexts on Postsecondary Enrollment

The present study is organized around the central hypothesis that the high school context affects students’ postsecondary outcomes. Drawing on a nationally representative sample of high school seniors from the Educational Longitudinal Survey (ELS:2002), this study broadens our empirical understanding of how students’ acquisition of human, social, and cultural capital at the individual and school level affects 2- and 4-year college attendance. Results highlight the normative role of high schools in promoting college enrollment, particularly the role of socioeconomics, academic preparation, and access to parent, peer, and college-linking networks. This study advances our understanding of the secondary-postsecondary nexus and has implications for policies and practices aimed at realizing the current administration’s promise of providing greater access to postsecondary education for all students.     

The Counseling Opportunity Structure: Examining Correlates of Four-Year College-Going Rates

This study examines the relationships between the normative and resource dimensions of a high school counseling department and four-year college-going rates. Utilizing data from the High School Longitudinal Study of 2009 (HSLS: 09), we employ multiple regression and latent class analysis to identify salient factors related to the college-going culture of a high school and to classify schools according to their underlying counseling opportunity structure, respectively. Results demonstrate that both norms (i.e., average caseload and hours spent on college counseling) and resources (i.e., college fairs, college course offerings, and financial aid) are important predictors of a school’s four-year college-going rates. These results, in turn, produced a three-level typology of schools based on a divergent, emergent, and convergent classification system. The study concludes with a discussion of findings and implications for researchers and policymakers interested in improving and better understanding the counseling opportunity structure.     

Students' Precollege Preparation for Participation in a Diverse Democracy

This study focuses on how students' precollege experiences predisposed them to 3 democratic outcomes: (a) ability to see the world from someone else's perspective; (b) beliefs that conflict enhances democracy; and (c) views about the importance of engaging in social action activities. We analyzed data from 3 flagship universities as part of a nationally funded research project and found first-year females are more likely than males to report values and beliefs consistent with democratic outcomes. Participation in race/ethnic discussions, student clubs, and volunteer work, as well as studying with students of different groups and discussing controversial issues are significant predictors in each model. Results also indicate that students might be unprepared to negotiate conflict in a diverse democracy, suggesting that college engagement will play a key role in fostering the development of democratic citizenship. This study also provides new measures of democratic outcomes to assess the impact of diversity and service learning initiatives.     

EDUCATING THE WORKFORCE FOR THE 21ST CENTURY: A Cross-Disciplinary Analysis of the Impact of the Undergraduate Experience on Students’ Development of a Pluralistic Orientation

This study extends the extant research demonstrating the educational benefits of diversity and examines how undergraduate students across disciplinary contexts acquire a set of pluralistic skills and dispositions necessary for today’s diverse workforce and society. The sample consisted of 4697 students who participated in a longitudinal study in the Fall of 2000 and Spring of 2002 at nine different public institutions. Findings from the study emphasize the importance of structural diversity in promoting positive interactions across race, which in turn produce positive indirect effects on students’ intergroup learning and second-year pluralistic orientation. The study also demonstrates the varying ways in which students in different majors acquire pluralistic skills, especially students in the engineering and life sciences. The study concludes with implications for practice and policy in the wake of the affirmative action case at the University of Michigan. This paper was originally presented at the Annual Meeting of the Association for the Study of Higher Education, November 4–6, 2004, Kansas City, MO.     

Pervasive Inequality in the Stratification of Four-Year College Destinations

Rooted in sociological models of educational transitions and tracking, this study examines patterns of stratification in the educational trajectories of low- and high-socioeconomic (SES) students. Utilizing longitudinal data from the Educational Longitudinal Study of 2002, this study describes differences in students’ choice sets based on a number of metrics obtained from the Integrated Postsecondary Data System (IPEDS). Additionally, multinomial logistic regression models are used to demonstrate the relative probabilities of attending a low-, moderate-, or high- selectivity undergraduate institution between students of low- and high-socioeconomic statuses. Overall, the results demonstrate the pervasiveness of inequality in the college choice decisions of low- and high-SES students and the continued stratification of opportunity for students based on their family background. The study concludes with implications for policymakers and practitioners working within secondary and postsecondary educational sectors.     

Fair Game: Using Simulators to Change Likelihood of Distracted Driving at the Minnesota State Fair

Distracted driving is a problem on U.S. roadways. Strategic campaigns have tried to curb this behavior with varying success. Researchers are examining how distracted-driving simulators might be useful in helping to combat this epidemic. Participants (N = 193) took part in a pretest/posttest, between-subjects field experiment where they were randomly assigned to one of five video game driving simulation scenarios (e.g., texting/talking/two combo conditions/distraction-free). Results indicated that participants texting during simulation committed more crashes, fog line crossings, and speed infractions than those talking and those who were not distracted. Further, results indicated that the simulation experience led to reports of being less likely to drive distracted in the future.