Bias and the intended use of student evaluations of university faculty

This study examines whether the intended use of data obtained from student evaluations of university faculty biases the ratings. The paper reviews and critiques previous research done in the area. Previous studies produced contradictory results, but the results were confounded by several methodological problems. The research reported here remedied some of the problems in previous studies. The findings indicated that, while students are aware of the intended use of ratings as stipulated in written directions, different uses do not result in statistically significant differences in the ratings. Implications for the use of student ratings in the evaluation of faculty are discussed.     

Using Bourdieu in practice? Urban secondary teachers’ and students’ experiences of a Bourdieusian-inspired pedagogical approach

This article discusses an attempt at a Bourdieusian-inspired form of praxis, developed and implemented in collaboration with nine London teachers, aimed at developing a socially just approach to engaging students with science. Data are discussed from nine months of classroom observations of nine secondary science classes from six inner London schools (approximately 200 students, aged 11–15), interviews and workshop data from the nine teachers and 13 discussion groups conducted with 59 students. The approach resulted in noticeable changes in practice, which were perceived by teachers and students to improve student engagement, cultivate a range of science-related dispositions and promote wider student participation and ‘voice’ in classes. Issues, limitations and possibilities for sociology of education are discussed.     

Improving assessment tasks through addressing our unconscious limits to change

Despite widespread recognition of the need to improve assessment in higher education, assessment tasks in individual courses are too often dominated by conventional methods. While changing assessment depends on many factors, improvements to assessment ultimately depend on the decisions and actions of individual educators. This paper considers research within the ‘heuristics and biases’ tradition in the field of decision-making and judgement which has identified unconscious factors with the potential to limit capacity for such change. The paper focuses on issues that may compromise the process of improving assessment by supporting a reluctance to change existing tasks, by limiting the time allocated to develop alternative assessment tasks, by underestimating the degree of change needed or by an unwarranted overconfidence in assessment design decisions. The paper proposes countering these unconscious limitations to change by requiring justification for changing, or not changing, assessment tasks, and by informal and formal peer review of assessment task design. Finally, an agenda for research on heuristics and biases in assessment design is suggested in order to establish their presence and help counter their influence.     

Introducing Argumentation About Climate Change Socioscientific Issues in a Disadvantaged School

Research in Science Education - Improving the ability of young people to construct arguments about controversial science topics is a desired outcome of science education. The purpose of this...     

The effect of writing assignments on achievement in college general chemistry

This study was designed to determine if student learning in college general chemistry could be increased through the addition of required writing assignments. Sixty-four students enrolled in the same section of a general chemistry II course were randomly assigned to two groups. Treatment group members were required to turn in written summaries of 8 class lectures. These summaries were graded and returned with mistakes in chemistry and writing noted. Feedback concerning errors in chemical content was shared with the entire class prior to the posttest. Analysis of covariance of the posttest results showed that the treatment group members scored significantly higher than the students who did not write the summaries (F = 6.78, p < .05). No interaction was observed between group membership and pretest scores. These results indicate that student achievement in chemistry may be enhanced through required writing assignments. The study results are inconclusive as to whether the gains in achievement were due to the processes involved in organizing and writing the summaries, or due to the additional study time required to write the summaries.     

Exploring the effects of group testing on graduate students’ motivation and achievement

This study explored the impact of individual versus two‐person group testing on graduate students’ achievement and motivation to learn while enrolled in a 16‐lesson educational research methods course. Students in two sections of the course were exposed to the same content and instructional methods, with one exception: students in one section took three professor‐created, criterion‐referenced examinations (during lessons 6, 11 and 16) individually, whereas students in the other section took the same examinations with a partner with whom they could examine and discuss the test items in order to derive a common answer. At the end of the course, the motivation to learn of all students was assessed. Results revealed that students tested with a partner achieved significantly higher scores on two of the examinations and demonstrated significantly higher levels of motivation to learn than did students taking the examinations alone. Qualitative analysis of the students’ written expressions concerning the course and of their comments from group and individual interviews revealed possible explanations for these outcomes.     

Support for assessment practice: developing the Assessment Design Decisions Framework

There are many excellent publications outlining features of assessment and feedback design in higher education. However, university educators often find these ideas challenging to realise in practice, as much of the literature focuses on institutional change rather than supporting academics. This paper describes the conceptual development of a practical framework designed to stimulate educators’ thinking when creating or modifying assessments. We explain the concepts that underpin this practical support, including the notions of ‘assessment decisions’ and ‘assessment design phases’, as informed by relevant literature and empirical data. We also present the outcome of this work. The Assessment Design Decisions Framework. This provides key considerations in six categories: purposes, contexts, tasks, interactions, feedback processes and learning outcomes. By tracing the development of the Framework, we highlight complex ways of thinking about assessment that are relevant to those who design and deliver assessment to tertiary students.     

Personalizing instruction in business and economics

This paper examines personalized instruction in business and economics at the Long Island Learning Center, Empire State College, State University of New York. In this mode of instruction the course of study is tailored to the individual background, interests, needs, and abilities of the student. Learning activities often incorporate some aspect of the student's academic or professional experience. Most of the students have fairly well-established goals, are highly motivated, have jobs, and have enjoyed considerable success in their fields. Various examples are provided that indicate how the subject matter gains relevance when basic theoretical concepts are applied to real-life situations.