Promoting assessment efficacy through an integrated system for online clinical assessment of practical skills

This paper presents evaluation outcomes from an externally funded research project involving the online clinical assessment of practical skills (eCAPS) using web-based video technologies within a university medical programme. eCAPS was implemented to trial this web-based approach for promoting the efficacy of practical skills assessment in knee joint examinations for a pre-clinical cohort of second year medical students. eCAPS involves a progressive organisation of online video experiences and task expectations for formative and summative assessments of selected competencies. Data are presented from semi-structured interviews with the medical students (N?=?40). eCAPS successfully supported students’ skill development in knee joint examinations on fellow students and allowed remote assessment of candidates’ performances by clinicians experienced in musculoskeletal examinations. An ‘indicative standard’ paradigm, involving formative assessment of one randomly selected performance from the submission of all students’ responses within a small group, offered an efficient and efficacious avenue for providing consolidated feedback to students and promoted desirable learning behaviours. Overall, there was evidence of reciprocal learning benefits to the ‘blending’ of an online learning and assessment approach with an existing face-to-face environment. The medical students were able to successfully engage online with high quality and consistent practical skill-based materials in a flexible, independent and individual manner.     

Impact of Course and Fieldwork on Multicultural Beliefs and Attitudes

This study investigated preservice teachers’ beliefs and attitudes about teaching culturally and linguistically diverse students when progressing through specially designed courses. Data were collected using the Teacher Multicultural Attitude Survey and semi-structured interviews. Analyses indicated that preservice teachers who received more multicultural preparation held more positive attitudes and based their attitudes more on academic preparation than on personal experiences. Preservice teachers who completed the multicultural course and English for speakers of other languages field placement had a more in-depth understanding of how to help culturally and linguistically diverse students.     

Education and the Face of the Other: Levinas,Camus and (mis)understanding

Abstract

Among the most neglected of Albert Camus’ literary works is his play The misunderstanding. Composed while Camus was in exile in occupied France, and first performed on stage in 1944, The misunderstanding depicts the events that unfold when a man returns, without declaring his identity, to a home he left 20 years ago. Unrecognized, he is killed by his mother and sister for financial gain. This article draws on ideas from Emmanuel Levinas in identifying and discussing some of the key ethical and educational themes in the text. It is argued that the forms of misunderstanding evident in Camus’ play mirror those exhibited in pedagogical institutions such as schools. The misunderstanding demonstrates that what is often missing in our communicative relations is careful attention to the Other. Camus does not offer us any easy way out when confronting the impossibility of fully knowing ourselves and others; instead, he shows that we must acknowledge the suffering this brings and take responsibility for it.     

Short Reports Examining the test: an evaluation of the police Standard Entrance Test in Scotland

This short report describes an evaluation of the instrument used for the selection of future police officers in Scotland – the Standard Entrance Test (SET). The study was commissioned by the Scottish Office and undertaken by the Scottish Council for Research in Education during 1995–6. The authors outline the project, report their main findings and identify groups which may have been disadvantaged. The outcome, a revised test, is currently being piloted with new entrants to the force.     

The development of a questionnaire on metacognition for students in higher education

Interest in the role of metacognition has been steadily rising in most forms of education. This study focuses on the construction of a questionnaire for measuring metacognitive knowledge, metacognitive regulation and metacognitive responsiveness among students in higher education and the subsequent process of testing to determine its validity.

Purpose

The aim of the study was to construct an original instrument for measuring features of metacognition, henceforth referred to as the Awareness of Independent Learning Inventory (AILI), and further to establish the similarities and differences between this model and existing instruments for measuring metacognition.

Sample

The AILI questionnaire was distributed to 1058 students in various types of Teacher Training Institutes in the Netherlands and Belgium. The abridged English version of the questionnaire was administered to another sample of 729 students reading Economics and Business Administration at the University of Maastricht in the south of the Netherlands.

Design and methods

The AILI instrument was constructed on the basis of a facet design along two dimensions: components of metacognition and topics of concern to students in higher education. The data gathered with the instrument was analyzed by means of a generalisability study and a decision study, respectively. The validity of the instrument was investigated by using confirmatory factor analysis.

Results

The generalisability study showed that the reliability of the instrument was satisfactory. The decision study revealed that the number of items included in the questionnaire could be reduced substantially by leaving out two components of one of the dimensions in the facet design, without losing too much generalisability. The validity study showed that there was a considerable level of congruity between parts of the AILI questionnaire and the relevant parts of the Motivated Strategies for Learning Questionnaire (MSLQ).

Conclusions

The AILI questionnaire is a reliable and valid instrument for measuring metacognitive knowledge, regulation and responsiveness. It is suitable for use in the evaluation of the effects of interventions that purport to increase metacognitive knowledge, regulation and responsiveness of students in higher education.