Formative assessment of procedural skills: students’ responses to the Objective Structured Clinical Examination and the Integrated Performance Procedural Instrument

Assessment of clinical skills is a critical element of undergraduate medical education. We compare a traditional approach to procedural skills assessment – the Objective Structured Clinical Examination (OSCE) with the Integrated Performance Procedural Instrument (IPPI). In both approaches, students work through ‘stations’ or ‘scenarios’ undertaking defined tasks. In the IPPI, all tasks are contextualised, requiring students to integrate technical, communication and other professional skills. The aim of this study was to explore students’ responses to these two assessments. Third‐year medical students participated in formative OSCE and IPPI sessions on consecutive days. Although performance data were collected in both assessments, quantitative data are not presented here. Group interviews with students were conducted by independent researchers. Data were analysed thematically. The OSCE and the IPPI were both valued, but for different reasons. Preference for the OSCE reflected the format of the summative assessment. The IPPI was valued for the opportunity to practise patient‐centred care in a simulated setting which integrated technical, communication and other professional skills. We posit that scenario‐based assessments such as the IPPI reflect real‐world issues of patient‐centred care. Although the limitations of this study prevent wide extrapolation, we encourage curriculum developers to consider the influence of assessments on what and how their students learn.     

Changes in instructors' assessment thinking related to experimentation with new strategies

Formative assessment has been recognised as a critical element in teaching for conceptual development. A case study research design was employed to: (1) characterise the assessment thinking of three science instructors at a research‐based university; and (2) examine the complex relationship between instructor thinking and practice by encouraging experimentation with alternative assessment strategies. Interviews, reflective journals, field notes and course documents were the data sources used to create a single case study that documented the development of these university instructors’ assessment thinking during their experimentation with formative assessment strategies. Throughout two semesters of experimentation, the instructors’ assessment thinking became more sophisticated; they grew to view the purpose of assessment less as a summative activity used for the assignment of marks and more as a tool for diagnosing student learning. However, more sophisticated thinking was not associated with revisions in teaching practice based on formative assessment data. Further investigations are needed to more completely understand the nature of assessment thinking and how assessment thinking influences assessment practices. Implications for professional development of university‐level science instructors include personalised experiences through which instructors can become active participants in gathering evidence of student learning that promotes growth in assessment thinking.     

Designing biomimetic robots: iterative development of an integrated technology design curriculum

Educational technology research and development - In most middle schools, learning is segregated by discipline. Yet interdisciplinary approaches have been shown to cultivate creative thinking,...     

A Paradigm of Normal Birth: Teaching Through the Healthy Birth Practices

Debra McAllister, a childbirth educator with 9 years of experience as a labor and delivery nurse, provides commentary on how she teaches through the Six Healthy Birth Practices as a paradigm for normal birth.     

The Imponderable Bloom: A Multimodal Social Semiotic Analysis of an Online Secondary English Course

The use of online learning and other software-powered technologies is on the rise in the United States, encouraged financially and politically by governmental and commercial entities. Specifically, online courses are gaining ground in K–12 public schools, schools which often purchase from third-party providers. After a decade in the New York City Department of Education as an English teacher and schools official responsible for a large-scale online learning programme, the author asks the question: How does the use of software-powered technologies like online learning affect the teaching of literature? In pursuit of this question, the author draws on concept from the field of software studies while adapting qualitative methods from multimodal studies to examine precisely how the nature of software (and the ideologies of those who create and sell it) are subtly influencing the teaching of literature.     

Is Peer Interaction Necessary for Optimal Active Learning?

Meta-analyses of active-learning research consistently show that active-learning techniques result in greater student performance than traditional lecture-based courses. However, some individual studies show no effect of active-learning interventions. This may be due to inexperienced implementation of active learning. To minimize the effect of inexperience, we should try to provide more explicit implementation recommendations based on research into the key components of effective active learning. We investigated the optimal implementation of active-learning exercises within a “lecture” course. Two sections of nonmajors biology were taught by the same instructor, in the same semester, using the same instructional materials and assessments. Students in one section completed in-class active-learning exercises in cooperative groups, while students in the other section completed the same activities individually. Performance on low-level, multiple-choice assessments was not significantly different between sections. However, students who worked in cooperative groups on the in-class activities significantly outperformed students who completed the activities individually on the higher-level, extended-response questions. Our results provide additional evidence that group processing of activities should be the recommended mode of implementation for in-class active-learning exercises.     

Identifying Key Features of Effective Active Learning: The Effects of Writing and Peer Discussion

We investigated some of the key features of effective active learning by comparing the outcomes of three different methods of implementing active-learning exercises in a majors introductory biology course. Students completed activities in one of three treatments: discussion, writing, and discussion + writing. Treatments were rotated weekly between three sections taught by three different instructors in a full factorial design. The data set was analyzed by generalized linear mixed-effect models with three independent variables: student aptitude, treatment, and instructor, and three dependent (assessment) variables: change in score on pre- and postactivity clicker questions, and coding scores on in-class writing and exam essays. All independent variables had significant effects on student performance for at least one of the dependent variables. Students with higher aptitude scored higher on all assessments. Student scores were higher on exam essay questions when the activity was implemented with a writing component compared with peer discussion only. There was a significant effect of instructor, with instructors showing different degrees of effectiveness with active-learning techniques. We suggest that individual writing should be implemented as part of active learning whenever possible and that instructors may need training and practice to become effective with active learning.     

Evaluation of a networked staff development strategy for departmental tutor trainers: benefits,limitations and future directions

As part of the 1997–1999 Teaching and Learning Enhancement Plan, the University of Queensland mandated that all its academic departments should conduct tutor training. The University's academic development unit, TEDI (the Teaching and Educational Development Institute) designed a network‐based staff development strategy for the development of departmental staff designated as tutor trainers. The strategy was known as the Tutor Training Network (TTN). This paper describes the strategy and reports on an evaluation of the Network programme. The data show that although it was very successful, the network‐based strategy has a limited lifespan. Nonetheless it is an effective strategy for wholesale staff development to support institution‐wide implementations of policy or changes in practice.     

Inclusive education and best practice for children with autism spectrum disorder: an integrated approach

Many parents of children with autism spectrum disorder (ASD) have reported general discontent with the services offered by the education system and have advocated for increased ASD‐specific services to better meet their children’s educational needs. The elements of best practice offer an ideal model for educational support. There are, however, limitations to advocating ASD‐specific services. This paper describes how best practice for ASD as an educational model fits within what is described as authentic inclusion. Further, it is suggested that the ASD community align with the greater inclusive education reform movement. With the use of this unified model of education, all children will receive the educational support they require.