Promoting learning by leveraging the collaborative nature of formative peer assessment with instructional scaffolds

Over the past two decades, formative peer assessment has become a popular instructional approach. Initially, it was more readily applied in higher education but has since expanded to other educational levels, including primary and secondary education. The popularity is understandable given the increased amount of feedback by multiple peers and enhanced awareness of performance criteria. Although it is increasingly acknowledged by the research community that formative peer assessment is inherently a social endeavour, the collaborative nature is simultaneously the least-explored mechanism. The contributions in this special issue address this gap conceptualising peer assessment and peer feedback as both an individual and a collaborative learning practice. Furthermore, we highlight core learning conditions: learner characteristics, domain and task characteristics, and, finally, instructional scaffolds.     

A GEARed peer feedback model and implications for learning facilitation

This study proposes a model to view and analyse college students’ written peer feedback after they assess each other’s formative task assignment and provide comments. The model was developed by: (a) revisiting learning-oriented assessment and feedback theories, (b) reviewing and summarising existing peer feedback analysis approaches as detailed in published empirical studies, and (c) analysing a small set of primary learner peer feedback data. In the proposed GEARed model of peer feedback, each complete piece of comment on one improvable unit may have four cognitive elements, i.e. identification of the Gap between performance and goal, Explanation of the gap, gap-bridging Aspirations, and being Resourceful to reach beyond the current knowledge/skill level. Two social-affective-interactive elements also play a part, i.e. being encouraging to the peer feedback receiver and doubtful toward the provider self. Each feedback comment may contain any or all of these incremental elements rather than being assigned only to one category. It is argued that the absent or unresolved aspects in feedback leave room for the receiver to reflect and may suggest instructional actions for teachers. Finally, different patterns of GEARed component combinations are hypothesised and their implications for learning and teaching are discussed.     

Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment

This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the training, students reviewed learning concepts, discussed marking criteria, graded example projects and compared their evaluations with the instructor’s evaluation. Data were collected in the form of initial and final versions of students’ projects, students’ scoring of example projects before and after the assessment training, and written feedback that students provided on peer projects. Results of data analysis indicate that the assessment training led to a significant decrease in the discrepancy between student ratings and instructor rating of example projects. In addition, the degree of student vs. instructor discrepancy was highly predictive of the quality of feedback that students provided to their peers and the effectiveness of revisions that they made to their own projects upon receiving peer feedback. Smaller discrepancies in ratings were associated with provision of higher quality peer feedback during peer assessment, as well as better revision of initial projects after peer assessment.     

Engaging postgraduates in a peer research group at the research proposal stage in a Malaysian university: support and challenges

Due to the increasing workloads for supervisors and the challenges in research proposals for postgraduates, the study focused on engaging 15 postgraduates in a Malaysian public university in a peer research group. The data was collected from observations of the group meetings, video-recorded peer feedback and follow-up interviews. The qualitative analysis of the data indicates that the research group supported the postgraduates through peer feedback practices, learning how to present proposals and defend themselves and finding directions in research proposals. Although their engagement was challenged by initial reservations of some postgraduates to present their proposals and provide feedback and issues related to provision, reception and reliability of peer feedback, these challenges were minimized through mentoring and instructional strategies. While peer research groups represent a valuable pedagogical support that complement supervisors’ support to postgraduates in developing their research proposals, the value should be maximized by integrating supervisors in research groups.     

An empirical review of anonymity effects in peer assessment,peer feedback,peer review,peer evaluation and peer grading

Abstract

Peer assessment has proven to have positive learning outcomes. Importantly, peer assessment is a social process and some claim that the use of anonymity might have advantages. However, the findings have not always been in the same direction. Our aims were: (a) to review the effects of using anonymity in peer assessment on performance, peer feedback content, peer grading accuracy, social effects and students’ perspective on peer assessment; and (b) to investigate the effects of four moderating variables (educational level, peer grading, assessment aids, direction of anonymity) in relation to anonymity. A literature search was conducted including five different terms related to peer assessment (e.g., peer feedback) and anonymity. Fourteen studies that used a control group or a within group design were found. The narrative review revealed that anonymous peer assessment seems to provide advantages for students’ perceptions about the learning value of peer assessment, delivering more critical peer feedback, increased self-perceived social effects, a slight tendency for more performance, especially in higher education and with less peer assessment aids. Some conclusions are that: (a) when implementing anonymity in peer assessment the instructional context and goals need to be considered, (b) existent empirical research is still limited, and (c) future research should employ stronger and more complex research designs.     

Designing and implementing peer formative feedback within online learning environments

With increasing need to achieve appropriate balance between learning support and self-regulation within the context of online learning, formative feedback has been identified as a viable means to achieve meaningful engagement. Specifically, this study sought to establish how peer–peer formative feedback was facilitated in an online course and to what extent this engaged students in meaningful learning experiences. This case study entailed an in-depth investigation into the design and implementation of an online course in a New Zealand university. The studied course was part of a postgraduate programme in continuing (in-service) teacher education. The study adopted a case study methodology with a bias on qualitative techniques. Online observations, analysis of the archived course discourse and interviews were utilised as sources of data. The data from multiple sources were subsequently triangulated to corroborate the evidence. The findings indicate that peer formative feedback promoted active learners’ participation and meaningful engagement. The findings further showed that opportunities for dialogic peer formative feedback promoted learning support and self-regulation.     

Oral presentations in higher education: a comparison of the impact of peer and teacher feedback

In this paper the authors analyse the competency of a sample of economics and business students in orally presenting academic content, as well as the changes that occurred after receiving feedback. The students’ presentations were videotaped, and a total of 96 were analysed at three stages: pre-test, post-test and follow-up. The participants were divided into two groups. In one, each student received feedback from a peer as part of a peer assessment with rubric activity. In the other, they received feedback from the teacher immediately after their presentation. In the post-test, the peer assessment with rubric students improved by 10% in the valuation of their presentation, while the teacher feedback students only improved by 5%. These results support the idea that undergraduates’ evaluations of their peers can be effective in improving oral presentation skills, especially when they are provided with some support instruments (videos and rubrics). However, the improvements in the peer assessment with rubric group were not maintained in the follow-up re-test. This suggests that a single session of peer assessment with rubric is insufficient to generalise any improvements in the said competency. The implications of these results with regard to the implementation of methods of formative peer assessment in higher education are discussed.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

Enhancing students’ choreography and reflection in university dance courses: A mobile technology-assisted peer assessment approach

Choreography is an important and challenging educational objective in dance courses. However, most previous technology-enhanced learning studies for dance education mainly focused on students’ dance skills, while the issue concerning the approaches to promoting students’ choreographic performance has generally been ignored. To address this issue, the present study developed a mobile technology-assisted peer assessment approach based on social constructivism for use in a university general education dance routine choreography class. A total of 266 university students were divided into an experimental group and a control group. The experiment lasted for 15 weeks and involved two rounds of peer assessment. The results showed that mobile peer assessment could significantly enhance the innovative competence of dance routines and dance skills. In addition, according to the students’ feedback, the dance routine choreography class was conducive to improving social skills, innovative competence, and intrinsic motivation, while mobile peer assessment could assist students in understanding accurate evaluation criteria, reflecting on their own in a more objective way, and broadening the aspects of appreciating the work.     

Improving the effectiveness of peer feedback for learning

The present study examined the effectiveness of (a) peer feedback for learning, more specifically of certain characteristics of the content and style of the provided feedback, and (b) a particular instructional intervention to support the use of the feedback. A quasi-experimental repeated measures design was adopted. Writing assignments of 43 students of Grade 7 in secondary education showed that receiving ‘justified’ comments in feedback improves performance, but this effect diminishes for students with better pretest performance. Justification was superior to the accuracy of comments. The instructional intervention of asking assessees to reflect upon feedback after peer assessment did not increase learning gains significantly.     

In the eye of the beholder: The relationship between perceived peer language skills,provided peer feedback and peer grading in secondary education

Students involved in peer assessment have interpersonal relationships, partly consisting of reciprocal perceptions. In the domain of argumentative writing, little is known about the way peer assessment is affected by the assessor’s perception of the assessee’s language skills. Dutch 10th grade students (N = 176, age = 15–16) provided feedback and grades on two texts, being under the illusion that the texts had been written by two classmates whom the assessors perceived as a peer with either stronger or weaker language skills than their own (within-subjects design). In reality, students assessed similar texts, created by the researchers. Assessors did not provide different feedback to the two types of assessees. Simultaneously, they provided higher grades to peers perceived to have stronger language skills than their own than to peers perceived to have weaker language skills than their own. Future research should capture assessors’ rationale behind the composition of feedback and grades.     

Peer feedback on college students’ writing: exploring the relation between students’ ability match,feedback quality and essay performance

There does not appear to be consensus on how to optimally match students during the peer feedback process: with same-ability peers (homogeneously) or different-ability peers (heterogeneously). In fact, there appears to be no empirical evidence that either homogeneous or heterogeneous student matching has any direct effect on writing performance. The current study addressed this issue in the context of an academic writing task. Adopting a quasi-experimental design, 94 undergraduate students were matched in 47 homogeneous or heterogeneous reciprocal dyads, and provided anonymous, formative peer feedback on each other’s draft essays. The relations between students’ individual ability or dyad composition, feedback quality and writing performance were investigated. Neither individual ability nor dyad composition directly related to writing performance. Also, feedback quality did not depend on students’ individual ability or dyad composition, although trends in the data suggest that high-ability reviewers provided more content-related feedback. Finally, peer feedback quality was not related to writing performance, and authors of varying ability levels benefited to a similar extent from peer feedback on different aspects of the text. The results are discussed in relation to their implications for the instructional design of academic writing assignments that incorporate peer feedback.     

Grudges and gratitude: the social-affective impacts of peer assessment

Abstract

Students’ dissatisfaction with peer assessment has been widely documented. While most relevant literature places focus on the cognitive (content and uptake of feedback) or structural (feedback design) dimensions, students’ emotions in peer assessment have received scant attention. This study investigates the social-affective impacts of peer assessment by analysing students’ appeal letters addressed to their tutors, reflective posts in the online discussion forum and responses to a survey. A thematic analysis of data indicated three main aspects of students’ (dis)satisfaction: content, scores and process of peer assessment. The most negative emotion that students expressed was related to ‘disrespectful’ behaviour and attitudes of peer reviewers, whereas the feeling of appreciation was triggered by the helpful feedback attributes which were perceived as reflecting reviewers’ respect to others’ works. Students generally held mixed feelings toward peer assessment, valuing learning in the process of providing and receiving feedback but showing resistance to using peer assessment for summative purposes. The findings highlight the significance of respect in peer assessment and argue that the perceived lack of mutual respect seems to underpin the nature of students’ dissatisfaction. This study carries implications for nurturing students’ respectful attitudes and behaviour in and through peer assessment.     

The effects of peer assessment on learner autonomy: An empirical study in a Chinese college English writing class

The study reports on a one-semester-long intervention study of peer assessment in a college English writing class. The purpose of the study was to investigate the effects of peer assessment on learner autonomy (LA). Seventy English major sophomores from an independent college in China participated in the study, who were randomly divided into two groups of 35 students each. Traditional teacher feedback was used in the control group while peer assessment was adopted for the experimental group. A questionnaire on LA was administered to both groups as the pre-test and the post-test. A number of ANCOVA analyses were run to measure the effects of peer assessment on students’ LA. The results indicate that peer assessment enhanced the students’ learner autonomy. Peer assessment significantly reduced learners’ dependence on the teacher and boosted the students’ confidence in learning ability, while failing to make noticeable improvement in the other aspects of LA.     

The effects of autonomy support on student engagement in peer assessment

Although peer assessment is widely implemented in higher education, not all students are highly engaged in it. To enhance student engagement in peer assessment, we designed and developed a web-based tool, autonomy-supportive peer assessment (ASPA), to support students’ need for autonomy when they conducted peer assessment. Students’ sense of autonomy, and their behavioral, emotional, and cognitive engagement in peer assessment were examined via interviews and surveys. We also examined students’ academic performances, including their improvement from initial to revised essays and the quality of feedback they provided. Survey results indicated that the ASPA group (1) experienced a slightly higher sense of autonomy than the non-ASPA group, and (2) spent much more time on each evaluation criterion than the non-ASPA group. Interviews suggested that both the ASPA and non-ASPA groups were engaged in peer assessment. However, there were no statistically significant differences between the two groups in behavioral, emotional, cognitive engagement, and academic performances.     

Teaching domain-specific skills before peer assessment skills is superior to teaching them simultaneously

Instruction in peer assessment of complex task performance may cause high cognitive load, impairing learning. A stepwise instructional strategy aimed at reducing cognitive load was investigated by comparing it with a combined instructional strategy in an experiment with 128 secondary school students (mean age 14.0?years; 45.2% male) with the between-subjects factor instruction (stepwise, combined). In the stepwise condition, study tasks in Phase 1 were domain-specific and study tasks in Phase 2 had both domain-specific and peer assessment components. In the combined condition, these two components were present in all tasks in both phases. Final performance (i.e. speed and accuracy in domain-specific skills and peer assessment skills) showed no significant differences, but performance improved more from Phase 1 to Phase 2 in the stepwise condition than in the combined condition. The results suggest that, with complex study tasks, it might be beneficial to teach domain-specific skills before peer assessment skills.     

The quality of peer assessment in a wiki-based online context: a qualitative study

Peer assessment (PA) provides opportunities for authentic assessment, autonomy and collaboration. Several authors advocate that students can benefit from PA and put forward the effects of PA on the students’ learning outcomes. Questions concerning the validity and reliability of PA and PA competences are also addressed by different researchers. This qualitative study is part of a wider project that seeks to develop and test evaluation and assessment strategies in online contexts. In a doctoral module, PA was used for summative and formative purposes. Formative PA aimed to give feedback about the ongoing group work, but also to increase online interaction between the different groups of students. The main module task was to write a literature review, about a selected topic, using a wiki. Criteria and indicators to assess the literature review were negotiated with the students. Different criteria were used to assess the quality of PA, such as, the use of the negotiated criteria, the adequacy of the chosen vocabulary or the provision of constructive feedback. The results show that overall the quality of PA can be improved. Groups did not provide sufficient criticism, questions and suggestions for improvement.     

Investigating peer-assessment strategies for mathematics pre-service teacher learning on formative assessment

Formative assessment practices for secondary mathematics have been advocated as valuable for students, but difficult for teachers to learn. There have been calls in the literature to increase the emphasis on formative assessment in mathematics teacher preparation courses. This study explored the use of peer-assessment strategies for helping pre-service secondary mathematics teachers (PSTs) cultivate formative assessment principles and practices for assessing school students. Twenty-seven PSTs participated in a peer-assessment cycle comprised of: sourcing a rich mathematics task; constructing an assessment rubric for it; and collecting and analysing a selection of secondary student responses to the task. Each PST then provided written and verbal feedback to a peer on his/her rubric and student solution assessments. We draw on theoretical conceptions of Teacher Assessment Literacy in Practice to characterize the PSTs’ perceptions of their experience of formative assessment processes for learning to assess school students, in terms of cognitive and affective dimensions of their conceptions of assessment. The cohort evidenced a wide range of levels of confidence with the various aspects of formative assessment practices but on average less confidence in assessing school student task responses themselves than in assessing peer work. In addition to highlighting specific changes to different types of assessment knowledge, the PSTs also evidenced an awareness of shifts in their attitudes, in coming to view student task responses with more appreciation and humility.

     

基于同侪互评的在线学习评价研究综述

在线同侪互评是一种形成性评价策略。它通过学习者之间相互给予评分或反馈来改善学习成果,对学习者的学习成绩、态度及高阶思维能力等方面能够产生重要的影响。首先回顾了近10年来国际在线同侪互评的主要文献．从概念与内涵、程序与方法、系统与工具,以及效果与影响等四个方面综述了现有研究成果。而后,展望未来研究可能聚焦于：同侪互评与其他网络教学策略整合、同侪互评与教师评价结合运用、同侪评语分析等主题。