Validating written feedback in clinical formative assessment

Abstract

Formative assessment is widely accepted as being crucial to promoting student learning and, since 2010, the UK General Medical Council has mandated its use in workplace-based clinical training for all new doctors. As a result, the Royal College of Radiologists (RCR) instituted a range of formative workplace-based assessments including the Radiology Direct Observation of Procedural Skills (Rad-DOPS), in which supervisors appraise trainees’ performance in carrying out clinical procedures. This paper reports on the quality of the written feedback in 2,500?Rad-DOPS online feedback forms in addressing the aims of the new assessment approach. Random samples of 500 were selected from the first three years of the new assessment implementation, 2010–13, and from 2016 to 17. Using an appropriate coding frame, the feedback was analysed across the samples against key trainee attributes including stage of training and level of adjudged competence. Criteria for identifying high quality feedback were derived from the literature and a simplified form of qualitative comparative analysis was used to identify the conditions associated with high quality feedback. An average of 97% of the assessments contained written feedback but the number of instances of high quality feedback was found to be exceedingly small at around 5%. The paper offers suggestions for making the feedback process more purposeful in achieving the aims of formative assessment.     

Viewing students consistently: how stable are teachers’ expectations?

ABSTRACT

Over the past 50 years, research has shown that teacher expectations can influence student outcomes. Many studies have examined within-year effects. There is, however, a paucity of research that has investigated the stability of teachers’ expectations across a single year, and there are no studies that have examined stability beyond 1 year. The current study examined the stability of 94 teachers’ expectations within 3 separate years and across 3 years in mathematics and reading. In both subject areas, teachers’ expectations remained relatively stable from beginning to end-of-year for each separate year and also across 3 years. Additionally, teachers who under- or overestimated their students by more than half a standard deviation continued to do so across all periods in the study. This was despite the teachers having different students each year. The study suggests that teachers view students’ capabilities similarly despite having different student cohorts.     

Planning for Quality: Advice respectfully tendered to the Polytechnics and Colleges Funding Council

What is ‘quality’ and how should it be handled by a funding body? This article discusses the practical implications of concern for quality in the PCFC sector of higher education, the role of institutions and of external agencies other than the PCFC. It concludes by offering advice to the PCFC on its policies towards the preservation and enhancement of quality.     

Developmental and individual differences in girls' sex-typed activities in middle childhood and adolescence

Girls' time in sex-typed leisure activities was studied across 2 years in middle childhood ( n =98, M =8.2 years in Year 1), early adolescence ( n =106, M =11.7 years), and middle adolescence ( n =86, M =14.9 years). In annual home interviews, White middle-class girls, mothers, and fathers rated their gendered attitudes, interests, and personality qualities, and saliva samples were used to assess testosterone; activity data were collected in 7 nightly phone interviews. Girls spent more time in feminine than masculine activities except in early adolescence. Girls' and parents' personalities and interests predicted sex-typed activities at each developmental period, but associations between testosterone and activities emerged only in middle childhood.