Psychometric models of student conceptions in science: Reconciling qualitative studies and distractor-driven assessment instruments

We stand poised to marry the fruits of qualitative research on children's conceptions with the machinery of psychometrics. This merger allows us to build upon studies of limited groups of subjects to generalize to the larger population of learners. This is accomplished by reformulating multiple choice tests to reflect gains in understanding cognitive development. This study uses psychometric modeling to rank the appeal of a variety of children's astronomical ideas on a single uniform scale. Alternative conceptions are captured in test items with highly attractive multiple choice distractors administered twice to 1250 8th through 12th-grade students at the start and end of their introductory astronomy courses. For such items, an unusual psychometric profile is observed—instruction appears to strengthen support for alternative conceptions before this preference eventually declines. This lends support to the view that such ideas may actually be markers of progress toward scientific understanding and are not impediments to learning. This method of analysis reveals the ages at which certain conceptions are more prevalent than others, aiding developers and practitioners in matching curriculum to student grade levels. This kind of instrument, in which distractors match common student ideas, has a profoundly different psychometric profile from conventional tests and exposes the weakness evident in conventional standardized tests. Distractor-driven multiple choice tests combine the richness of qualitative research with the power of quantitative assessment, measuring conceptual change along a single uniform dimension. © 1998 John Wiley & Sons, Inc. J Res Sci Teach 35: 265–296, 1998.     

Anthrax in transit; practical experience and intellectual exchange

Focusing on three Anglo-American outbreaks of industrial anthrax, this essay engages the question of how local circumstances influenced the transmission of scientific knowledge in the late nineteenth century. Walpole (Massachusetts), Glasgow, and Bradford (Yorkshire) served as important nodes of transnational investigation into anthrax. Knowledge about the morphology and behavior of Bacillus anthracis changed little while in transit between these nodes, even during complex debates about the nature of bacterial morphology, disease causation, and spontaneous generation. Working independently of their more famous counterparts (Robert Koch and Louis Pasteur), Anglo-American anthrax investigators used visual representations of anthrax bacilli to persuade their peers that a specific, identifiable cause produced all forms of anthrax-malignant pustule (cutaneous anthrax), intestinal anthrax, and woolsorter's disease (pneumonic anthrax). By the late 1870s, this point of view also supported what we would today call an ecological notion of the disease's origins in the interactions of people, animals, and microorganisms in the context of global commerce.     

Static and dynamic accuracy of a magnetic-inertial measurement unit used to provide racket swing kinematics

Magnetic-inertial measurement units (MIMUs) are becoming more prevalent in sports biomechanics and may be a viable tool to evaluate kinematic parameters. This study examined the accuracy of a MIMU to estimate orientation angles under static conditions and dynamically from a squash racket during a forehand drive shot. A MIMU was mounted onto a goniometer and moved through 0–90°, with static data collected at 10° increments during 10 repetitions of all three axes. Typical error analyses showed the MIMU to be very reliable (TE ≤ 0.03°). MIMU accuracy was determined via intraclass correlation coefficients (ICC) (r > 0.999, p < 0.001). An ordinary least products regression showed no proportional bias and minimal fixed bias for all axes. Dynamic accuracy was assessed by comparing MIMU and optical motion capture data of squash racket swing kinematics. A MIMU was fixed onto a racket and 10 participants each hit 10 forehand shots. Mean orientation angle error at ball impact was <0.50° and ICC showed very high correlations (r ≥ 0.988, p < 0.001) for all orientations. Swing phase root mean squared errors were ≤2.20°. These results indicate that a MIMU could be used to accurately and reliably estimate selected racket swing kinematics.     

Accelerating the development of formal thinking in middle and high school students III: Testing the permanency of effects

Two years after the end of a two-year intervention program intended to promote formal operational thinking, the achievement of students initially 12 years of age was tested by their results in British National examinations, taken at age 16. The intervention methodology was set within the context of science learning, so the difference between experimental and control classes was examined first in terms of their science results. The boys achieved an average of 40% more grades of C or above than the controls. This grade is the minimum criterion for higher education in Britain. The achievement was not found equally in all students: About 40% of the boys and 25% of the girls showed effect sizes of two standard deviations in relation to comparable controls, whereas the others did not differ from the controls. Both boys and girls showed significantly higher achievement in English than comparable controls, with an effect size about half that for science. The boys—but not the girls—also showed higher achievement in mathematics. It is argued that this evidence supports the interpretation that the students' increased science achievement was caused by increased general intellectual capacity, and not just by improved domain-specific skills.     

Using statement banks to return online feedback: limitations of the transmission approach in a credit-bearing assessment

Electronic marking tools that incorporate statement banks have become increasingly prevalent within higher education. In an experiment, printed and emailed feedback was returned to 243 first-year students on a credit-bearing laboratory report assessment. A transmission approach was used, students being provided with comments on their work, but no guidance as to how they should use these remarks. A multiple-choice question test, undertaken before and after the return of feedback, was used to measure learning. Although returned comments included model answers, test scores showed no overall enhancement, even when students’ marks for their laboratory reports were initially hidden. A negative and significant (p = .010) linear trend between relative test scores and test date suggests that even modest improvements in subject knowledge were lost over time. Despite this, students could accurately guess their mark based on emailed feedback alone, estimated and awarded marks being linearly correlated (p < .001). It is concluded that statement banks organised according to published assessment criteria can ultimately help students to appreciate how their work was graded. However, students should be encouraged to produce a structured response to received feedback if self-assessment is to occur.     

Whose curriculum is it anyway? Stakeholder salience in the context of Degree Apprenticeships

A Degree Apprenticeship model has recently been introduced into the United Kingdom (UK) Higher Education system as part of wider changes to vocational training. The system has experienced numerous rapid changes in regulation and funding, and it is now little understood by many stakeholders. Distinguishing different phases in UK Higher Education, and using a salience model as a lens for analysis, this article identifies and examines stakeholders with regards to their influence on the Higher Education curriculum. The new Degree Apprenticeship model is funded by an employer payroll levy and it requires Higher Education institutions to deliver training to specific standards. This research explores the implications of the model for the Higher Education curriculum, concluding that the direct involvement of employers in the design and delivery of vocational Higher Education introduces untried elements into UK Higher Education on the assumption that the funding requirement will lead to a change in employer behaviour. This, coupled with the opening of Higher Education provision to private providers, transfers power over the curriculum to those with potentially no commitment to wider public values, and may offer a threat to the international standing of UK Higher Education. This article contributes to research in understanding how Higher Education systems respond to, and actors cope with, imposed change.     

PUSH(ing) Limits: Using Fiction in the Classroom for Human Behavior and the Social Environment

The use of fiction and autobiography in social science course work has been shown to enhance students' learning experience. Using the novel PUSH, by Sapphire, we designed a curriculum supplement for the social work course, human behavior and the social environment (HBSE) that encourages students to integrate course content in an innovative way and enables them to apply the material to life-like situations. The HBSE supplement allows students to explore poignant and problematic issues that push them past intrapersonal and interpersonal limits. Classes are infused with energy and the critical consciousness of the students. Final projects are a systematic case study of a chosen character (or characters) in the book and are a testament to student critical thinking and creativity. Methods, assignments, and student experiences in an introductory BSW course are described.