Making practical work work: using discussion to enhance pupils’ understanding of physics

Background: Practical work is widely seen as a necessary part of a good physics education, but convincing evidence that it impacts positively on pupils’ learning is scarce. Recent work suggests the use of talk and discussion might hold the key to making practical work more educationally productive.

Purpose: The research question that this study aims to answer is: Can the use of targeted discussion improve learning through practical work?

Sample: The study took place in a medium-sized (700-pupil, Years 7–13 (ages 11–18)) mixed-gender independent (fee-paying) day school in southern England. It is academically selective and public examination results are above the national average. The activities were carried out with three teaching groups (n = 73) with a fourth being used occasionally for comparison purposes (giving n = 97).

Design and methods: Pupils were given a number of practical tasks – some from the usual scheme of work, some devised for this project – and given specific time to discuss with a partner the various aspects of the practical such as predictions, devising methods, problem-solving, conclusions or explanations of phenomena. Questionnaires and booklets were used to gather pupil responses. Some audio recording and analysis of pupil-pupil discussion was also done.

Results: There was evidence from booklets pupils filled in during the practical that prescribing the use of discussion at various points in a practical task led to improved outcomes, particularly on the more cognitively challenging tasks. In particular, discussion was seen to turn incorrect responses into correct ones much more frequently than the reverse. In a later exam, pupils who had participated in the discussion activities performed better than a control group on questions which directly related to practical concepts, but performed similarly on the remaining exam questions.

Conclusion: Evidence gathered suggests a more nuanced pattern than that reflected in previous literature: that discussion during practical work can impact positively on pupils’ understanding of ideas related to practical work, but does not necessarily have a positive impact on their wider understanding.     

Using peer assessment of fieldwork to enhance students’ practical training

Fieldwork training is a key component of several practical disciplines. In this study, students’ peer assessment of fieldwork is explored as a method to improve their practical training. Peer assessment theories are first discussed. A framework for peer assessment of fieldwork is proposed, and the steps taken for preparation of students for this task are discussed. A developed marking, feedback and moderation tool of assessment are presented. Application of peer assessment in the field was investigated over a period of two years in one undergraduate unit in the geospatial discipline as an example. Reliability of peer assessment was estimated by measuring the difference between assessments carried out by groups of peer assessors, and its validity was measured by comparing students’ marks with those given by tutors. Results show that students have gained from the peer assessment process, mainly as a formative form of assessment, by better understanding and endeavouring to achieve the objectives of field tasks. Tutors use differences among assessments made by groups of students compared to tutors’ assessments to identify field components that need better explanation of their content and assessment criteria.     

A closer look at social skills and school performance: students’ peer relations skills and assertion skills as predictors for their written and oral performances

Students’ individual learning is supposed to be based on cognitive and social processes. Therefore, students’ social skills are assumed to play an important role for school performance. This study set out to investigate the links between students’ peer relations skills and assertion skills and their grades for written performances and oral performances. In the middle of the school year, 94 ninth-grade students of a German secondary school reported on their peer relations skills and assertion skills. Additionally, at this point of measurement, students’ initial school performance in German and mathematics was measured by standardized academic achievement tests. In these two subjects, students’ grades in in-class tests and for oral participation were collected during the following 5 months. These grades were given by the students’ respective subject teachers. Path analysis revealed that students’ peer relations skills were positively associated with their grades in in-class tests, but they were not linked to their grades for oral participation. In contrast, students’ assertion skills were positively related to their grades for oral participation, whereas no correlation was found between students’ assertion skills and their grades in in-class tests. These results are discussed with respect to the role of peer relations skills and assertion skills for students’ academic learning and the fostering of these skills in the classroom.     

Online self-assessment and peer-assessment as a tool to enhance student-teachers’ assessment skills

Self-assessment and peer-assessment are strategies employed to encourage students to take more responsibility for the learning process. Although the advantages are not obvious, the process has the potential to empower learning and to assist the development of assessment skills, which are so important for future teachers. The research aimed to identify student-teachers' attitudes concerning the contribution of self-assessment and anonymous peer-assessment to the quality of their assignments and improvement of their assessment skills, using both qualitative and quantitative methodologies. The sample included 300 students studying for bachelor’s or master’s degrees. Texts that were analysed included: responses to a questionnaire, self and peer-assessments, word comments on the assignments and written blog content relating to students’ activities and their performance of peer evaluations. The students noted that they significantly benefitted from the process, learned various methods of assignment and assessment performance and it positioned them in relation to others, noticing how others evaluated them. Anonymous evaluation allowed students to overcome inhibitions in evaluating peers' works and improved their assessment skills.     

Anonymity as an instructional scaffold in peer assessment: its effects on peer feedback quality and evolution in students’ perceptions about peer assessment skills

Although previous research has indicated that providing anonymity is an effective way to create a safe peer assessment setting, continuously ensuring anonymity prevents students from experiencing genuine two-way interactive feedback dialogues. The present study investigated how installing a transitional approach from an anonymous to a non-anonymous peer assessment setting can overcome this problem. A total of 46 bachelor’s degree students in Educational Studies participated in multiple peer assessment cycles in which groups of students assessed each other’s work. Both students’ evolution in peer feedback quality as well as their perceptions were measured. The content analysis of the peer feedback messages revealed that the quality of peer feedback increased in the anonymous phase, and that over time, the feedback in the consecutive non-anonymous sessions was of similar quality. The results also indicate that the transitional approach does not hinder the perceived growth in peer feedback skills, nor does it have a negative impact on their general conceptions towards peer assessment. Furthermore, students clearly differentiated between their attributed importance of anonymity and their view on the usefulness of a transitional approach. The findings suggest that anonymity can be a valuable scaffold to ease students’ importance level towards anonymity and their associated need for practice.     

The quality of written peer feedback on undergraduates’ draft answers to an assignment,and the use made of the feedback

The research described here investigated the quality and characteristics of peer feedback given on a draft piece of writing in the context of an undergraduate summative assignment. It also investigated whether the recipients made use of the feedback, with the aim of discovering whether some types of feedback were used in preference to others. The peer feedback was characterised in various ways, and then a comparison with the feedback subsequently given on the polished piece of writing by the tutor was used to determine the strengths and weaknesses of the peer feedback. Although the peers’ feedback had some different characteristics from that of the tutors, it was nevertheless of good quality. The examination of the use the recipients made of the feedback showed that much feedback was ignored. The use recipients made of the feedback depended very little on the characteristics of the feedback received, but did vary strongly across the recipients. The ability level of the recipients was not found to be a factor in this variation. The results of this research suggest that future work needs to focus more on students using feedback than on students giving feedback.     

Fifteen pupils’ positive approach to primary school science: when does it decline?

The decline in secondary school pupils’ attitudes towards science is well documented. However, recent research has shown that pupils’ attitudes to science appear to become fixed during their primary school years. This study investigated end of Key Stage 1 (Yr 2 (ages six to seven years)) and end of Key Stage 2 (Yr 6 (ages 10–11 years)) pupils’ attitudes to science, using Klopfer’s themes (1971 Klopfer, L.E. 1971. “Evaluation of learning in science”. In Handbook on summative and formative evaluation of student learning, Edited by: Bloom, B.S., Hastings, J.T. and Madaus, G.F. 559–641. New York: McGraw‐Hill.  [Google Scholar]), through a paired activity and interview for Yr 2 pupils and a pre‐ and post‐Test of Science‐Related Attitudes questionnaire (adapted) for Yr 6 pupils. The questionnaire was analysed using the mean and chi square values and Cronbach’s alpha was calculated to test reliability. The results revealed that while Yr 2 pupils exhibit a thirst for knowledge and enthusiasm for science, Yr 6 pupils’ attitudes over the period of one academic year did not change: their attitude towards science was fixed. This insight raises some implications and responsibilities for primary school teachers.     

Building a game-enhanced formative assessment to gather evidence about middle school students’ argumentation skills

Educational technology research and development - In this paper, we describe an effort to develop and evaluate an innovative formative assessment to gather evidence about middle school...     

Gender, ‘bias’, assessment and feedback: analyzing the written assessment of undergraduate history essays

This paper reports on findings relating to a project on gender and essay assessment in HE. It focuses on one aspect of the study: the assessment of and feedback given to two sample essays by 50 historians based at universities in England and Wales. We found considerable variation both as to the classification awarded to the essays and to positive and negative comments made about their quality, supporting the argument that the ‘quality’ of a piece of writing for assessment is ultimately constructed by the reader of the essay and cannot be objectively ascertained. Gender issues emerging from the data are explored in the paper, relating to lecturers’ perceptions of the essays’ qualities; views concerning the way feedback should be presented; and the content and style of feedback given by lecturers on the sample essays. We found that gender constructions were manifested more in presentation than practice. These findings on the situated practice of assessment have implications for the conception of the ‘reliability’ of essay assessment in HE.     

Teachers’ use of research evidence in practice: a pilot study of feedback to enhance learning

Background: There is worldwide interest in improving the effectiveness of teachers and teaching. This paper considers two strands of that interest. It revisits the impact of using enhanced feedback from teachers to pupils as a way of improving attainment, and it looks at the feasibility of teachers using research evidence to create their own interventions. Current evidence on the causal impact of effective feedback on learning is unclear: many studies have mixed results, are small in scale, lack randomisation or are not conducted in real classroom conditions. Purpose: The aim of this paper is to describe the experience of schools as they engage with research evidence to support their own enquiry into the effectiveness of feedback in the classroom. Research design: This study took place over one academic year, involving nine treatment schools in one local authority. The study involved teachers themselves using research findings to create an intervention, which took, as its focus, enhanced feedback in the classroom. Test results from these schools were compared to the results in 5 participating comparator schools, to the 49 other schools in the borough and to all state-funded primary schools in England. Results: Although teachers showed that they could engage with research evidence, the study indicated that the process was complex in practice. In addition, the independent impact evaluation suggested that enhanced feedback in itself does not necessarily lead to improved pupil test performance. Discussion and conclusions: The paper considers some of the challenges faced by teachers as they attempted to use research evidence, and discusses implications for schools wishing to use research evidence in practice. The findings of the study suggest that it may be feasible for practitioners to use research evidence to inform their own practice. However, to do it well would require clearer guidance, professional development and modelling of any strategies suggested. These findings have implications for policy on teacher development, and for the research community to make research outputs more comprehensible and accessible to research users.     

Using and rejecting peer feedback in the science classroom: a study of students’ negotiations on how to use peer feedback when designing experiments

Background: Research on peer assessment has noted ambiguity among students in using peer assessment for improving their work. Previous research has explained this in terms of deficits in the student feedback, or differences in student views of what counts as high-quality work.

Purpose: This study frames peer assessment as a social process in the science classroom. The aim is to explore peer assessment in science education as social practice in order to contribute to an understanding of the affordances and constraints of using peer assessment as a learning tool in science education.

Design and Method: The study was conducted in four lower secondary school classes, school years 8 and 9, in two different schools. An intervention study was designed focussing on the topic of experimental design. It involved the students in a process of peer assessment where they designed experiments individually, and then exchanged their designs, conducted each other’s experiments, provided feedback to each other and revised their original design after discussing the feedback in groups. Data were collected in the form of audio recordings of student discussions and written work.

Results: The results show that, although not all peer feedback resulted in revisions, peer feedback was useful to the students in group interaction when negotiating quality in their work.

Conclusions: To conclude, the potential for using peer assessment in science education should not only be evaluated through the students’ revisions but also in terms of in what ways the feedback constitutes interactional resources for defining quality in student work.     

Using feedback requests to actively involve assessees in peer assessment: effects on the assessor’s feedback content and assessee’s agreement with feedback

Criticizing the common approach of supporting peer assessment through providing assessors with an explication of assessment criteria, recent insights on peer assessment call for support focusing on assessees, who often assume a passive role of receivers of feedback. Feedback requests, which require assessees to formulate their specific needs for feedback, have therefore been put forward as an alternative to supporting peer assessment, even though there is little known about their exact impact on feedback. Operationalizing effective feedback as feedback that (1) elaborates on the evaluation and (2) to which the receiver is agreeable, the present study examines how these two variables are affected by feedback requests, compared to an explanation of assessment criteria in the form of a content checklist. Situated against the backdrop of a writing task for 125 first-year students in an educational studies program at university, the study uses a 2 × 2 factorial design that resulted in four conditions: a control, feedback request, content checklist, and combination condition. The results underline the importance of taking message length into account when studying the effects of support for peer assessment. Although feedback requests did not have an impact on the raw number of elaborations, the proportion of informative elaborations within feedback messages was significantly higher in conditions that used a feedback request. In other words, it appears that the feedback request stimulated students to write more focused messages. In comparison with feedback content, the use of a feedback request did, however, not have a significant effect on agreement with feedback.     

Formative assessment of procedural skills: students’ responses to the Objective Structured Clinical Examination and the Integrated Performance Procedural Instrument

Assessment of clinical skills is a critical element of undergraduate medical education. We compare a traditional approach to procedural skills assessment – the Objective Structured Clinical Examination (OSCE) with the Integrated Performance Procedural Instrument (IPPI). In both approaches, students work through ‘stations’ or ‘scenarios’ undertaking defined tasks. In the IPPI, all tasks are contextualised, requiring students to integrate technical, communication and other professional skills. The aim of this study was to explore students’ responses to these two assessments. Third‐year medical students participated in formative OSCE and IPPI sessions on consecutive days. Although performance data were collected in both assessments, quantitative data are not presented here. Group interviews with students were conducted by independent researchers. Data were analysed thematically. The OSCE and the IPPI were both valued, but for different reasons. Preference for the OSCE reflected the format of the summative assessment. The IPPI was valued for the opportunity to practise patient‐centred care in a simulated setting which integrated technical, communication and other professional skills. We posit that scenario‐based assessments such as the IPPI reflect real‐world issues of patient‐centred care. Although the limitations of this study prevent wide extrapolation, we encourage curriculum developers to consider the influence of assessments on what and how their students learn.     

Male primary school teachers: Helping or hindering a move to gender equity?

Despite research linking dominant masculinities to the disengagement of some boys from schooling, men teachers appear to be either unaware of the related literature, or reluctant to engage in behaviours that have increased their vulnerability to accusations of sexual abuse or homosexuality. A small study of men teachers in England, Sweden and New Zealand investigated the extent to which the men believed their teacher education had prepared them to teach in the gendered environment of the primary school. Teachers were also questioned about their views on gender differences in students and in the teaching practices of male and female teachers. Although the size of the study restricts the validity of data, the differences between the teachers in England and New Zealand, and those interviewed in Sweden, suggest that further research is warranted. A societal emphasis on gender equity in Sweden was reflected in the commentaries of Swedish men teachers on their pedagogical attitudes and actions relative to gender-based issues in schools. This emphasis was not evident to the same extent in England and New Zealand.     

To do or not to do with feedback. A study of undergraduate students’ engagement and use of feedback within a portfolio assessment design

Feedback is important for student learning; however, research shows that students can have a number of difficulties when attempting to learn from feedback. Based on an in-depth analysis of undergraduate students’ self-reported reflection logs, we present findings about students’ experiences with oral and written feedback and how they act upon this feedback when a portfolio is the main assessment and learning tool. Our findings indicate that, within our context, students’ overall experiences with receiving feedback are positive. Oral feedback was perceived as particularly valuable to the students while written feedback challenged their understanding. We identified four specific actions the students engaged in to create meaning from the feedback: internal feedback, using oral feedback, initiating dialogue and interacting with peers. The findings indicate that the students take responsibility in the feedback process. The findings are discussed in relation to current perspectives on feedback in higher education.     

Leaving or staying in teaching: a ‘vignette’ of an experienced urban teacher ‘leaver’ of a London primary school

In the field of teacher attrition, there is a significant body of literature on why teachers leave high-needs urban schools and particularly why beginning teachers leave their schools and the profession. However, there is little research on the reasons why experienced teachers leave the teaching profession. This paper examines this subject by considering whether teachers experience an ‘identity crisis’ in their careers which prompts them to leave. Drawing on identity theory, data from a single case study of an experienced urban teacher are taken from a wider qualitative research study carried out in London, England. The case is made that decisions to leave or stay in a school are contingent on a number of personal, professional and situational factors related to the teacher’s identity. The article concludes that one way to understand why long-serving teachers leave the profession is to examine aspects of their teacher identity and explore how a crisis in professional identity can contribute towards teacher attrition. In the light of this alternative approach towards understanding attrition, at the very least, supportive structures can be put in place to encourage more teachers to stay and contribute to the success and well-being of children from disadvantaged backgrounds.     

Development of a performance assessment task and rubric to measure prospective secondary school mathematics teachers’ pedagogical content knowledge and skills

The purpose of this paper is to share a performance assessment task and rubric designed to assess secondary school mathematics preservice teachers’ pedagogical content knowledge and skills. The assessment task and rubric were developed in collaboration with five education faculty, four arts and sciences faculty, and four high school teachers over a period of one year. Over this period, the group met more than 15 times and designed an assessment task and rubric to measure secondary school preservice teachers’ pedagogical content knowledge and skills. The assessment task and rubric were piloted at the end of the year and extensively revised using the pilot data. The redesigned task and rubric were successfully carried out in the second and subsequent years. Other teacher education programs can benefit from this assessment of teacher candidates’ pedagogical content knowledge and skills.