Psychometric characteristics of integrated multi-specialty examinations: Ebel ratings and unidimensionality

Over recent years, UK medical schools have moved to more integrated summative examinations. This paper analyses data from the written assessment of undergraduate medical students to investigate two key psychometric aspects of this type of high-stakes assessment. Firstly, the strength of the relationship between examiner predictions of item performance (as required under the Ebel standard setting method employed) and actual item performance (‘facility’) in the examination is explored. It is found that there is a systematic pattern of difference between these two measures, with examiners tending to underestimate the difficulty of items classified as relatively easy, and overestimating that of items classified harder. The implications of these differences for standard setting are considered. Secondly, the integration of the assessment raises the question as to whether the student total score in the exam can provide a single meaningful measure of student performance across a broad range of medical specialties. Therefore, Rasch measurement theory is employed to evaluate psychometric characteristics of the examination, including its dimensionality. Once adjustment is made for item interdependency, the examination is shown to be unidimensional with fit to the Rasch model implying that a single underlying trait, clinical knowledge, is being measured.     

Instructions to Adopt an External Focus Enhance Muscular Endurance

Abstract

The influence of internal (movement focus) and external (outcome focus) attentional-focusing instructions on muscular endurance were investigated using three exercise protocols with experienced exercisers. Twenty-three participants completed a maximal repetition, assisted bench-press test on a Smith's machine. An external focus of attention resulted in significant (p < .05) improvements in performance compared to the internal focus of attention, but not the control condition. Seventeen participants completed repetitions to failure at 75% 1-RM on free bench-press and squat exercises. In both tasks, externally focused instructions resulted in significantly greater repetitions to failure than control and internal focus conditions (p < .05). These results support previous research showing beneficial effects of externally focused instructions on movement efficiency.     

The Scholarship of Teaching and Learning as collaborative working: a case study in shared practice and collective purpose

The Scholarship of Teaching and Learning (SoTL) has yet to fully enter the mainstream of life in higher education. In this case study, we consider a specific network focused on the reform of engineering education. The network involves global collaboration within the discipline of Engineering and is based around curricular activity that affects entire departments or groups of staff. We suggest that SoTL should pay greater attention to collaboration that addresses substantive disciplinary purposes, further embodying these purposes through spaces, motivations and capacities for action in the disciplinary and departmental setting. We frame our argument around a theoretical model of collaborative working in higher education and go on to offer a synoptic overview of ways to articulate common purpose around teaching and learning at large. Our account highlights potential drivers for such collaborative activity in other settings. In this way, we offer a means for others to develop the collective commitments, structures and understanding needed to mainstream SoTL within specific disciplinary or departmental settings.     

A Review of: ““Doing School”: How We Are Creating a Generation of Stressed Out,Materialistic, and Miseducated Students”

The views of Jewish education articulated by Rosenzweig in his essays “It is Time” and in “The Opening of the Lehrhaus” are quite different. So different, in fact, that an account of how one mind can produce such different accounts is necessary. Following the lead of a 1950’s popular television quiz show, the authors ask “Will the Real Franz Rosenzweig Please Stand Up?” The authors end by exploring how the tensions within Rosenzweig's educational thinking can yield new insights into the contemporary challenges of Jewish education.     

Graphic Novels as Tools for Teaching Complexity About Israel

ABSTRACT

Building on the established idea that to provide students with a full portrait of Israeli society and history, educators must introduce greater complexity into their Israel curriculum, the following paper explores three recently published graphic novels about Israel and considers how each offers opportunities for considering Israel in more nuanced ways. The paper is grounded in recent research about Israel education and empirical studies about graphic novels in education. Each of the three texts highlights aspects of Israeli society that are less frequently addressed in curriculum about Israel and therefore provide opportunities for presenting students with primary sources that directly grapple with the complexities of Israeli society.     

Instructions to adopt an external focus enhance muscular endurance

The influence of internal (movement focus) and external (outcome focus) attentional-focusing instructions on muscular endurance were investigated using three exercise protocols with experienced exercisers. Twenty-three participants completed a maximal repetition, assisted bench-press test on a Smith's machine. An external focus of attention resulted in significant (p < .05) improvements in performance compared to the internal focus of attention, but not the control condition. Seventeen participants completed repetitions to failure at 75% 1-RM on free bench press and squat exercises. In both tasks, externally focused instructions resulted in significantly greater repetitions to failure than control and internal focus conditions (p < .05). These results support previous research showing beneficial effects of externally focused instructions on movement efficiency.     

Use of the probit model to estimate school performance in student attainment of achievement testing standards

In the USA, trends in educational accountability have driven several models attempting to provide quality data for decision making at the national, state, and local levels, regarding the success of schools in meeting standards for competence. Statistical methods to generate data for such decisions have generally included (a) status models that examine simple indications of number of students meeting a criterion level of achievement, (b) growth models that explore change over the course of one or more years, and (c) value-added models that attempt to control for factors deemed relevant to student achievement patterns. This study examined a new strategy for student and school achievement modeling that augments the field through the use of the probit model to estimate the likelihood of students meeting an established level standard and estimating the proportion of individuals within a school meeting the standard. Results of the study showed that the probit model was an effective tool both for providing such adjustments, as well as for adjusting them based upon salient demographic variables. Implications of these results and suggestions for further use of the model are discussed.     

Design Principles for Augmented Reality Learning

Augmented reality is an emerging technology that utilizes mobile, context-aware devices (e.g., smartphones, tablets) that enable participants to interact with digital information embedded within the physical environment. This overview of design principles focuses on specific strategies that instructional designers can use to develop AR learning experiences. A review of the literature reveals the following three design principles as instructive: 1. Enable and then challenge (challenge): 2. Drive by gamified story (fantasy); and 3. See the unseen (curiosity). These design principles can also be viewed as an attempt to either leverage the unique affor- dances of AR or minimize the limitations of the medium as reported in the literature (Dunleavy & Dede, 2014). As the field matures and more research teams explore the potential of AR to enhance teaching and learning, it will be critical to determine the design techniques that optimize the unique affordances of AR, minimize the limitations of the medium, and ultimately enhance learning across the curriculum.