Investigating secondary school students’ unmediated peer assessment skills

The purpose of this study was to investigate secondary school students’ unmediated peer assessment skills. Specifically, 36 seventh graders, without receiving any kind of support, were anonymously assigned to reciprocally assess their peers’ science web-portfolios. Additionally, students’ attitudes towards and intentions about the use of unsupported reciprocal peer assessment were examined. Three data sources were used, namely, interviews, screen-video captured data, and the peer assessors’ feedback produced. Findings showed that the students have positive attitudes towards unsupported reciprocal peer assessment and that they intend to implement it again. It was also found that students have the skills, at least the beginnings, needed for the implementation of peer assessment. Specifically, they were found to be able to define and use their own assessment criteria, whose overall validity and reliability, however, were found to be low. Finally, the feedback they produced included grades, positive and negative judgments, as well as suggestions for changes.     

Effects of training peer tutors in content knowledge versus tutoring skills on giving feedback to help tutees’ complex tasks

This study aimed to investigate the effectiveness of training tutors in content knowledge of a particular domain versus training them in tutoring skills of pedagogical knowledge when tutoring on a complex tutee task. Forty-seven tutor–tutee pairs of fourth-year secondary school students were created and assigned to one of the two treatments. Twenty-two tutors received training in content knowledge and the other twenty-five tutors in tutoring skills. Tutors formulated written feedback immediately after the training. Tutees first interpreted the tutor feedback and then used it to revise their research questions. The results showed that tutors trained in tutoring skills formulated more effective feedback than tutors trained in content knowledge. In addition, tutees helped by tutoring-skills tutors found the feedback more motivating than those helped by content-knowledge tutors. However, no differences were found in tutee performance on revision. The findings are discussed in terms of the set-up of this study and implications for improving the effectiveness of peer tutoring.     

The quality of written peer feedback on undergraduates’ draft answers to an assignment,and the use made of the feedback

The research described here investigated the quality and characteristics of peer feedback given on a draft piece of writing in the context of an undergraduate summative assignment. It also investigated whether the recipients made use of the feedback, with the aim of discovering whether some types of feedback were used in preference to others. The peer feedback was characterised in various ways, and then a comparison with the feedback subsequently given on the polished piece of writing by the tutor was used to determine the strengths and weaknesses of the peer feedback. Although the peers’ feedback had some different characteristics from that of the tutors, it was nevertheless of good quality. The examination of the use the recipients made of the feedback showed that much feedback was ignored. The use recipients made of the feedback depended very little on the characteristics of the feedback received, but did vary strongly across the recipients. The ability level of the recipients was not found to be a factor in this variation. The results of this research suggest that future work needs to focus more on students using feedback than on students giving feedback.     

How does student peer review influence perceptions,engagement and academic outcomes? A case study

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we examined: (1) students’ perceptions of the peer review process before and after peer review, (2) content of the peer reviews and what kinds of feedback were adopted and (3) the effect of participation in peer review on performance (grades) in the assessment task. Students overwhelmingly perceived peer review to be beneficial, and the opportunity to participate in peer review resulted in a significant improvement in the quality of work submitted for assessment. Students who benefited most from peer review were those of below-median performance, and the magnitude of benefit was related to the degree to which students engaged with the peer review process. Our study confirms that participation in peer review can lead to important improvements in performance and learning outcomes.     

网络同伴互评活动设计与应用研究

同伴互评作为一种形成性评价策略,已经成为现阶段网络学习评价领域研究的热点。本研究将同伴互评策略应用于高校混合式教学之中,设计同伴互评学习活动。研究整体采用行动研究法设计、修改同伴互评活动,并分析学习者对活动的改进意见。研究一方面分析互评活动对在线学习效果的影响以及活动对于两类学习风格学习者影响的差异;另一方面深入分析学习者对于活动的态度及改进意见。主要研究结论认为：（1）研究设计的同伴互评活动能够促进学习者深入理解学习内容,并提升最终成果的质量。（2）相对综合型学习风格的学习者而言,同伴互评更加有助于提升序列型学习者对知识运用的水平。最后,研究总结了同伴互评活动设计的改进方案及后续设计要点。     

Assessing teamwork in undergraduate education: a measurement tool to evaluate individual teamwork skills

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing individual teamwork skills, with the intention of refining and measuring these skills over time. The TeamUp rubric was selected as the preliminary standardised measure of teamwork and tested in a second year undergraduate course (Phase One). Although the tool displayed acceptable psychometric properties, there was concern that it was too lengthy, compromising student completion. This prompted refinement and modification leading to the development of the Team-Q, which was again tested in the same undergraduate course (Phase Two). The new tool had high internal consistency, as well as conceptual similarity to other measures of teamwork. Estimates of inter-rater reliability were within a satisfactory range, although it was determined that logistical issues limited the feasibility of external evaluations. Preliminary evidence suggests that teamwork skills improve over time when taught and assessed, providing support for the continued application of the Team-Q as a tool for developing teamwork skills in undergraduate education.     

The road to self-assessment: exemplar marking before peer review develops first-year students’ capacity to judge the quality of a scientific report

Lack of clarity about assessment criteria and standards is a source of anxiety for many first-year university students. The Developing Understanding of Assessment for Learning (DUAL) programme was designed as a staged approach to gradually familiarise students with expectations, and to provide opportunities for the development of the skills required to successfully complete assessment tasks. This paper investigated the students’ perceptions of the first two components of the DUAL programme, which assist first-year biology students to engage with stated assessment criteria and standards in order to develop their capacity to make judgements about scientific report exemplars, their peers’ scientific reports and ultimately their own. The study found strong evidence (96% of responses) that the marking and discussion of exemplar reports with peers and demonstrators clarified expectations of scientific report writing. A key feature of this element of DUAL was the opportunity for structured discussion about assessment criteria and standards between peers and markers (demonstrators). During these discussions, students can clarify explicit statements and develop a tacit knowledge base to enhance their ability to judge the quality of others’ work and their own. The peer review exercise (the second element of DUAL) was not rated as highly, with 65% of students finding the process helpful for improving their report. The negative reactions by a sizeable minority of students highlight the need to clearly communicate the expectations and benefits of peer review, with a focus on how the process of giving feedback to peers might benefit a student as much as receiving feedback on their own report.     

The impact of formative peer feedback on higher education students’ academic writing: a Meta-Analysis

Peer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’ writing performance. The current study conveyed two types of observations. First, regarding the impact of peer feedback on writing performance, this study synthesized the results of 24 quantitative studies reporting on higher education students’ academic writing performance after peer feedback. Engagement in peer feedback resulted in larger writing improvements compared to (no-feedback) controls (g?=?0.91 [0.41, 1.42]) and compared to self-assessment (g?=?0.33 [0.01, 0.64]). Peer feedback and teacher feedback resulted in similar writing improvements (g?=?0.46 [-0.44, 1.36]). The nature of the peer feedback significantly moderated the impact that peer feedback had on students’ writing improvement, whereas only a theoretically plausible, though non-significant moderating pattern was found for the number of peers that students engaged with. Second, this study shows that the number of well-controlled studies into the effects of peer feedback on writing is still low, indicating the need for more quantitative, methodologically sound research in this field. Findings and implications are discussed both for higher education teaching practice and future research approaches and directions.     

Evaluating the effectiveness of a social skills training (SST) programme for victims of bullying

Several programmes have been developed to help support victims of bullying, but few have been formally evaluated. On the basis of previous research and from a review of existing programmes, a Social Skills Training (SST) Programme was developed for victims of bullying, and the effectiveness of this intervention was evaluated. Twenty-eight children (aged nine to 11 years) took part in the SST Programme – 15 in the experimental group and 13 in the waiting-list control group. A Peer Nomination Inventory was used to assess social skills problems, peer victimization and friendship/peer acceptance. In addition, a number of psycho­social adjustment variables (i.e. depression, anxiety, self-esteem) were assessed, using self-report. The measures were completed at three time points over the course of an academic year. It was found that there was an increase in ‘global self-worth’ (i.e. self-esteem) for the experimental group (compared to the control group). However, there were no other significant improvements, e.g. in terms of social skills problems or victim status. These findings have important implications for interventions to tackle the negative effects associated with bullying in schools.