The Performance of the Mantel-Haenszel Procedure Across Samples and Matching Criteria

This study examined the reliability of the Mantel-Haenszel indexes across different samples of test takers as well as across sample sizes and investigated whether these indexes are robust to item context effects. Mathematics data from the Second International Mathematics Study (SIMS; 1985) for U.S. eighth-grade students were analyzed. The results suggest that the MH D-DIF is robust to item context effects. However, larger sample sizes than those used in this investigation (N = 141-167 for the focal group) may be necessary to obtain stable estimates from the Mantel-Haenszel procedure.     

Who are Rural Students? How Definitions of Rurality Affect Research on College Completion

Research in Higher Education - Given a revived national discourse about rural populations, more educational research on rural students is necessary, including ways that rural students transition to...     

Understanding student pathways in context-rich problems

This paper describes the ways that students’ problem-solving behaviors evolve when solving multi-faceted, context-rich problems within a web-based learning environment. During the semester, groups of two or three students worked on five physics problems that required drawing on more than one concept and, hence, could not be readily solved with simple “plug-and-chug” strategies. The problems were presented to students in a data-rich, online problem-based learning environment that tracked which information items were selected by students as they attempted to solve the problem. The students also completed a variety of tasks, like entering an initial qualitative analysis of the problem into an online form. Students were not constrained to complete these tasks in any specific order. As they gained more experience in solving context-rich physics problems, student groups showed some progression towards expert-like behavior as they completed qualitative analysis earlier and were more selective in their perusal of informational resources. However, there was room for more improvement as approximately half of the groups still completed the qualitative analysis task towards the end of the problem-solving process rather than at the beginning of the task when it would have been most useful to their work.     

The building of weak expertise: the work of global university rankers

University rankers are the subject of much criticism, and yet they remain influential in the field of higher education. Drawing from a two-year field study of university ranking organizations, interviews with key correspondents in the sector, and an analysis of related documents, I introduce the concept of weak expertise. This kind of expertise is the result of a constantly negotiated balance between the relevance, reliability, and robustness of rankers’ data and their relationships with their key readers and audiences. Building this expertise entails collecting robust data, presenting it in ways that are relevant to audiences, and engaging with critics. I show how one ranking organization, the Times Higher Education (THE), sought to maintain its legitimacy in the face of opposition from important stakeholders and how it sought to introduce a new “Innovation and Impact” ranking. The paper analyzes the strategies, methods, and particular practices that university rankers undertake to legitimate their knowledge—and is the first work to do so using insights gathered alongside the operations of one of the ranking agencies as well as from the rankings’ conference circuit. Rather than assuming that all of these trust-building mechanisms have solidified the hold of the THE over its audience, they can be seen as signs of a constant struggle for influence over a skeptical audience.     

Tracking New Directions in the Evaluation of Postgraduate Supervision

This article focuses on the evaluation of thesis supervision and highlights the vast range of problem areas presently documented as significant areas of concern for both graduate students and their supervisors. Additionally, the authors report on a study completed in 1995, which surveyed all Australian universities about current evaluative practices in postgraduate supervision. The conclusion of this study was that the conduct of such evaluations appears to be minimal and is primarily designed to obtain an indicator of the general health of a university's postgraduate supervision rather than to foster improved supervisory practices. As part of the same study, the authors conducted University faculty-based student and supervisor focus groups. Key issues emerging from these focus groups were: (1) the importance of relational aspects of supervision as the student communicates over the long term with one or more supervisors; (2) the importance of systematic feedback, monitoring, and evaluation to the supervisory process; and (3) the lack of strategies to facilitate this evaluative feedback process. On the basis of these findings, the authors designed evaluative strategies to facilitate regular ongoing feedback between students and supervisors.     

A portrait of academic life:

The process of constructing A Portrait of Academic Life web resource has included careful evidence gathering and analysis of student performance necessary to assess learning and give useful feedback to increase the students’ ability to use information effectively in education. The students, too, develop self-assessment and reflective skills as they create online research portfolios. The online resources model new technologyenhanced strategies for teaching and learning that support standards-based teacher education programs in higher institutions. Other artifacts contained in A Portrait of Academic Life include digital video vignettes of students actively completing course assignments and reflecting on the learning process, and instructor reflections on teaching strategies to improve learning outcomes. As a culminating course activity, students showcase their online research portfolios at a gallery walk. The students were tremendously excited to present the wealth of information they have so carefully collected using the powerful technology tools available for their use in the teacher education program at Towson University. The innovation and originality presented in the form of student online research portfolios offered fresh perspectives to the honored guests. Likewise, it will enormously help students and faculty to see examples of the process of transforming traditional research papers into rich, informative online research portfolios.     

Ideological composition of the classroom: testing the effects of polarization on perceptions of open classroom climate among students in five countries

Abstract

This quantitative study tests the relationship between ideological classroom composition and perceptions of open classroom climate. Using data from the 2016 International Education Association’s International Civic and Citizenship Study, the study uses latent class analysis and multilevel regression modelling across five countries. First, latent class analysis identified students as low or high socioeconomic status. To assess ideological polarization, the gap between support for gender equality and ethnic rights was calculated between groups. Finally, a multilevel regression model measured the relationship between ideological polarization and students’ perception of open classroom climate. Across three countries, results found negative associations between increased polarization and perception of an open classroom climate. Additional testing identified that polarization modified the relationship between student socioeconomic status and perceptions of open classroom climate in Croatia.     

Adolescents’ Friendships,Academic Achievement,and Risk Behaviors: Same-Behavior and Cross-Behavior Selection and Influence Processes

This study examined to what extent adolescents’ and their friends’ risk behaviors (i.e., delinquency and alcohol use) hinder or promote their academic achievement (grade point average [GPA]), and vice versa. Longitudinal data were used (N = 1,219 seventh- to ninth-grade adolescents; M_age = 13.69). Results showed that risk behaviors negatively affected adolescents’ GPA, whereas GPA protected against engaging in risk behaviors. Moreover, adolescents tended to select friends who have similar behaviors and friends’ behaviors became more similar over time (same-behavior selection and influence). Furthermore, although same-behavior effects seemed to dominate, evidence was found for some cross-behavior selection effects and a tendency in seventh grade for cross-behavior influence effects. Concluding, it is important to investigate the interplay between different behaviors with longitudinal social network analysis.     

Elementary teachers’ science subject matter knowledge across the teacher career cycle

Although widely touted as important, there is little evidence regarding the influence of teaching experience on elementary teachers' science subject matter knowledge (SMK). To better understand this phenomenon, we administered an assessment of science topics taught in the fifth and sixth grades to 169 preservice teachers, 231 fifth-grade teachers, and 208 sixth-grade teachers. We then compared the mean scores of teachers at different stages in the career cycle using one-way and two-way ANOVA and explored the relationship between SMK scores and years of teaching experience using regression analysis. Findings indicate that (i) being assigned to a specific grade level had an impact on teachers' SMK for topics included in the grade level, (ii) teachers' SMK scores were lower later in their careers for both science topics they had never taught and for science topics they were responsible for teaching, and (iii) results differed for fifth and sixth grades. This study adds to the existing literature through the examination of a large sample of elementary teachers, with teachers of varying years of experience, while focusing on the science topics these teachers are responsible for teaching. The results of this study provide strong evidence that (i) years of experience teaching specific science topics is associated with the development of teachers' knowledge of these topics, and (ii) teaching experience, what teachers do in the context of their everyday practice, can be an effective means of self-directed learning for teachers. There is also evidence that this influence is not uniform across years of teaching experience or science topics taught. These findings raise important implications about future research into the mechanism of SMK development through teaching experience and teacher grade-level assignments.     

Understanding the Use of Student-Centered Teaching Methods in Undergraduate Chemistry Courses

A growing body of research suggests that student-centered teaching methods are associated with positive learning outcomes for undergraduate students. Yet, the extent of their use and factors leading to their adoption in fields, such as chemistry, continue to be under-explored. Utilizing survey data collected during 2015, we begin to fill this gap, first by considering the degree to which faculty and instructors use and plan to use various student-centered teaching methods in their undergraduate chemistry courses. Then, we examine three potential factors that may help us understand variation in (1) use of and (2) intentions to implement student-centered methods: attitudes toward teaching methods; teaching approaches; and institutional characteristics. Importantly, our findings suggest attitudes and individual teaching approaches are significant predictors of the use and intention to implement student-centered methods in the classroom. Perhaps surprisingly, several institutional factors examined (such as class size, percentage of time spent teaching, and type of institution) play no significant role. Given the positive student outcomes associated with various student-centered methods reported in literature, these findings suggest potential avenues for faculty and instructors’ professional development toward further implementation of these methods.