Threats to student evaluative judgement and their management

ABSTRACT

Students’ capacity for making evaluative judgements of their own work is widely acknowledged as central to their learning within programmes as well as being vital to their subsequent professional practice. In higher education literature, the act of evaluative judgement is usually portrayed as a process of deliberative, analytical reasoning requiring student agency and objectivity, typically scaffolded by points of reference such as explicit criteria, rubrics or exemplars. This article challenges this common portrayal of judgement by drawing attention to research from outside higher education on the role of unconscious factors in judgement and decision-making. Drawing from the field of heuristics and bias studies, the article outlines six unconscious factors that have the potential to distort students’ analytical judgement of their work. A recent challenge to the heuristics and bias approach that radically repositions the place of reasoning in judgement is also considered. Since these unconscious factors have received scant attention in higher education literature, the purpose of this article is to draw attention to them, to identify the challenges they pose to current understandings of evaluative judgement, and to outline their implications for enhancing assessment practice.     

Investigating Students’ Learning Through Co-designing with Technology

Involving students in the co-design of educational curricula and practices can benefit both students and teachers. Students who participate in co-design may show better learning or increased agency or engagement. In the present study, we investigated what kind of science knowledge or practices can be learned by student co-designers while engaging in co-design practices and how that learning happens with six high school students. We created a model to guide the analysis of students’ learning with technology in co-designing processes. The results revealed that students learned engineering design process even if no explicit instruction on engineering learning was given. Also, our analysis suggested that co-designing with technology enabled learning of the engineering design process and potentially furthered learning of science because it promoted knowledge integration. The results have implications for understanding and enhancing engineering design and science learning through co-designing with technology.

     

Conflict within dyadic interactions as a stimulant for conceptual change in physics

Research suggests that conventional teaching techniques have proved largely ineffective for dealing with the problem of science students’ misconceptions or alternative frameworks. This paper reports an investigation whereby inter‐personal conflict within dyadic interactions is used as a strategy for promoting development towards correct scientific conceptions in specific areas of electrical circuits and mechanics amongst first‐year tertiary physics students. The data indicate that a large number of physics students at the tertiary level hold non‐scientific conceptions of these physical phenomena. The dyadic interaction strategy proved effective as a means of encouraging students to actively and closely consider their own thinking about basic physical concepts. Further, results highlight the importance of inter‐personal conflict in the process of conceptual change.     

Longitudinal confirmatory factor analysis: Common,time‐specific,item‐specific,and residual‐error components of variance

Following Cronbach (1970) and others, it is useful to decompose test score variation into common factor, time‐specific, item‐specific, and residual components. In the traditional approach to factor analysis, only two sources of variance can be estimated: common factor variance and a uniqueness term that confounds specific sources of variation and residual error. When the same items are measured on different occasions, however, it is possible to separate specific variance and residual error. Two approaches, the first‐order approach described by Raffalovich and Bohrnstedt (1987) and a second‐order approach based on Jöreskog and Sörbom (1989; Jöreskog, 1974) are considered initially. The two approaches, although based on different rationales, both suffer a similar weakness in that two of the four sources of variance are confounded. In the Raffalovich and Bohrnstedt approach, time‐specific variance is confounded with common factor variance that generalizes across items and time. In the second‐order approach based on Jöreskog and Sörbom, time‐specific variance is confounded with residual error. Here we demonstrate that by combining features from both approaches we can eliminate these weaknesses and estimate all four of Cronbach's sources of variance, and that this combined approach is easily generalized to a wide variety of applications.     

Distributed leadership and organizational change: Reviewing the evidence

This article explores the relationship between distributed leadership and organizational change. It draws upon the existing literature to consider whether distributed forms of leadership influence development and change in schools. The article examines the research base relating to distributed leadership and organizational outcomes. It focuses on how different patterns or configurations of distributed leadership contribute to organizational development. The article concludes by highlighting issues that require further study and more empirical confirmation. This article is based on a literature review commissioned by the Department for Education and Skills as part of a research project currently being undertaken by Leithwood, K., Day, C., Sammons, P., Harris, A., and Hopkins, D. (2006) ‘Leadership and student outcomes’ and Leithwood, K., Day, C., Sammons, P., Harris, A., and Hopkins, D. (2006) ‘Successful school leadership: What it is and how it influences pupil learning’. London, DFES.     

Endurance of Undergraduate Attitudes Toward Older Adults

This cross-sectional study assessed undergraduate attitudes toward older adults and attitude endurance 3 to 18 months after aging coursework. Survey respondents included 349 students who took an aging elective and 430 comparison students. Aging-elective students indicated more positive attitudes than comparison students. Attitudes did not vary across 3 groups staggered by time elapsed from completing the course until testing (3 to 18 months). 4 variables accounted for the variance in attitudes toward elders at a statistically significant level: majoring in biology, having frequent or occasional contact with unrelated older adults, taking an aging course, and post-course knowledge of aging.     

A Cross-cultural Study of the Development of Artistic Talent,Creativity and Giftedness

In this study, examining the relationships among age, culture, training in the fine arts, the technical and aesthetic properties of drawings, and realized artistic giftedness, the researchers intermixed the juvenile drawings executed by critically acclaimed artists with artworks executed by contemporary North American and Chinese North American children. When judges from the North American culture and from the Chinese North American culture, blind to this mix, assessed the drawings, assessments made by the representatives of both cultures were more alike than they were different. Only the North American judges' assessments, however, suggest that the art students' life drawings were more technically and aesthetically successful, and more creative, on the average, than the non-art students' drawings. These judges also gave the juvenilia the highest scores in technical skill and the lowest scores in creativity independent of technical skill and aesthetic success. Conclusions and implications stress the role of technical skill in the development of artistic potential.