Synchronous discussion between assessors and assessees in web-based peer assessment: impact on writing performance,feedback quality,meta-cognitive awareness and self-efficacy

Research on peer assessment in higher education has been conducted for decades. However, ways to improve the quality of peer feedback and optimise student’ benefits through peer assessment remain a puzzle. The present study aimed to examine the impacts of synchronous discussion between assessors and assessees on writing performance, qualitative feedback quality, meta-cognitive awareness and self-efficacy in web-based peer assessment. A total of 64 undergraduate students participated in the study and were randomly assigned into either the experimental or control group. Participants in the experimental group conducted synchronous discussion after the first round of peer assessment, while students in the control group did not conduct any synchronous discussion. The results revealed that synchronous discussion between the assessors and assessees significantly improved the students’ writing performance, especially content writing skills, affective and meta-cognitive feedback quality, meta-cognitive awareness and self-efficacy. Practical implications, limitations and future directions are discussed based on these findings.     

Formative peer assessment in a CSCL environment: a case study

In this case study our aim was to gain more insight in the possibilities of qualitative formative peer assessment in a computer supported collaborative learning (CSCL) environment. An approach was chosen in which peer assessment was operationalized in assessment assignments and assessment tools that were embedded in the course material. The course concerned a higher education case‐based virtual seminar, in which students were asked to conduct research and write a report in small multidisciplinary teams. The assessment assignments contained the discussion of assessment criteria, the assessment of a group report of a fellow group and writing an assessment report. A list of feedback rules was one of the assessment tools. A qualitative oriented study was conducted, focusing on the attitude of students towards peer assessment and practical use of peer assessment assignments and tools. Results showed that students’ attitude towards peer assessment was positive and that assessment assignments had added value. However, not all students fulfilled all assessment assignments. Recommendations for implementation of peer assessment in CSCL environments as well as suggestions for future research are discussed.     

Small group discussion as a key component in online assessment training for enhanced student learning in web-based peer assessment

The purpose of this study is to examine the effect of online assessment training, with synchronous group discussion as a key component, on subsequent web-based peer assessment results. Participants included 81 college students, mostly women, taking a business writing class. After initial submission of a draft counter-offer letter, they completed online assessment training by engaging in a consensus-seeking, synchronous group discussion of the rubric-based ratings they gave to sample counter-offer letters. They then engaged in web-based assessment of randomly assigned peer counter-offer letters and upon receiving peer feedback, submitted revision of their own counter-offer letter. The discussion groups were randomly assigned to either anonymous (using a pseudo name) or identified conditions (using real name). Findings indicate that the quality of student counter-offer letters improved after online assessment training, and improved even more after web-based peer assessment. There were no significant differences between anonymous discussion groups and identified groups.     

In search of quality criteria in peer assessment practices

With the increasing popularity of peer assessment as an assessment tool, questions may arise about its measurement quality. Among such questions, the extent peer assessment practices adhere to standards of measurement. It has been claimed that new forms of assessment, require new criteria to judge their validity and reliability, since they aim for specific goals and address different aspects of learning. But although new criteria have been formulated, little is known about how they are deployed and operate in actual peer assessment practices. This study intends to explicate the quality criteria relevant to the context of peer assessment. We conducted a survey in vocational education on peer assessment quality criteria applied in classrooms. Fifty-six teachers using peer assessment rated several quality criteria as relevant to their teaching practice. The findings suggest that peer assessment practices entail many of the quality criteria recognized in measurement and evaluation, although in an embedded way: the generic quality criteria are tuned or adapted to the peer assessment setting. The findings also show that peer assessment is very much in the hands of the teacher, who organizes and orchestrates the appraisal process in which students receive clear guidelines to appraise one another's work. Our results indicate that quality criteria hardly differ from the function peer assessment serves in classrooms, either within a summative or formative evaluation context. By gaining insight on the specific criteria of peer assessment and their precise purposes, we believe it becomes possible to help teachers improve its measurement quality.     

Enhancing students’ choreography and reflection in university dance courses: A mobile technology-assisted peer assessment approach

Choreography is an important and challenging educational objective in dance courses. However, most previous technology-enhanced learning studies for dance education mainly focused on students’ dance skills, while the issue concerning the approaches to promoting students’ choreographic performance has generally been ignored. To address this issue, the present study developed a mobile technology-assisted peer assessment approach based on social constructivism for use in a university general education dance routine choreography class. A total of 266 university students were divided into an experimental group and a control group. The experiment lasted for 15 weeks and involved two rounds of peer assessment. The results showed that mobile peer assessment could significantly enhance the innovative competence of dance routines and dance skills. In addition, according to the students’ feedback, the dance routine choreography class was conducive to improving social skills, innovative competence, and intrinsic motivation, while mobile peer assessment could assist students in understanding accurate evaluation criteria, reflecting on their own in a more objective way, and broadening the aspects of appreciating the work.     

Peer review in the classroom: student perceptions,peer feedback quality and the role of assessment

Abstract

Peer review in the classroom can enhance numerous employability skills such as critical appraisal, writing skills, reflection practices and collaborative experiences. This study takes place over two years and discusses the implementation of a repeating blind peer review cycle across a single semester for final year chemistry students enrolled on a compulsory employability module. The feedback cycle promotes personal reflection through the use of mini-reflective questionnaires. The process was assessed by academic tutors at the resubmission stage and/or the peer feedback stage where the quality of peer feedback was directly assessed. The research investigates the quality of peer feedback, the importance of assessment and student perceptions of what is most useful. Methods include directed content analysis of feedback produced, student opinions and a focus group. Students were capable of offering useable feedback across a range of assessment criteria but tend to focus on the important criteria best aligned to the particular assignment. A range of motivational factors and tactics were noticed but students tended to find reviewing the most beneficial.     

Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment

This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the training, students reviewed learning concepts, discussed marking criteria, graded example projects and compared their evaluations with the instructor’s evaluation. Data were collected in the form of initial and final versions of students’ projects, students’ scoring of example projects before and after the assessment training, and written feedback that students provided on peer projects. Results of data analysis indicate that the assessment training led to a significant decrease in the discrepancy between student ratings and instructor rating of example projects. In addition, the degree of student vs. instructor discrepancy was highly predictive of the quality of feedback that students provided to their peers and the effectiveness of revisions that they made to their own projects upon receiving peer feedback. Smaller discrepancies in ratings were associated with provision of higher quality peer feedback during peer assessment, as well as better revision of initial projects after peer assessment.     

The road to self-assessment: exemplar marking before peer review develops first-year students’ capacity to judge the quality of a scientific report

Lack of clarity about assessment criteria and standards is a source of anxiety for many first-year university students. The Developing Understanding of Assessment for Learning (DUAL) programme was designed as a staged approach to gradually familiarise students with expectations, and to provide opportunities for the development of the skills required to successfully complete assessment tasks. This paper investigated the students’ perceptions of the first two components of the DUAL programme, which assist first-year biology students to engage with stated assessment criteria and standards in order to develop their capacity to make judgements about scientific report exemplars, their peers’ scientific reports and ultimately their own. The study found strong evidence (96% of responses) that the marking and discussion of exemplar reports with peers and demonstrators clarified expectations of scientific report writing. A key feature of this element of DUAL was the opportunity for structured discussion about assessment criteria and standards between peers and markers (demonstrators). During these discussions, students can clarify explicit statements and develop a tacit knowledge base to enhance their ability to judge the quality of others’ work and their own. The peer review exercise (the second element of DUAL) was not rated as highly, with 65% of students finding the process helpful for improving their report. The negative reactions by a sizeable minority of students highlight the need to clearly communicate the expectations and benefits of peer review, with a focus on how the process of giving feedback to peers might benefit a student as much as receiving feedback on their own report.     

Peer assessment in university teaching: evaluating seven course designs

Peer assessment is understood to be an arrangement with students assessing the quality of their fellow students’ writings and giving feedback to each other. This multiple‐case study of seven designs of peer assessment focuses on the contribution of peer assessment to the acquisition of undergraduates’ writing skills. Its aim is to arrive at an optimal design of peer assessment. Factors included in this study are: the quality of peer assessment activities, the interaction between students in oral peer feedback, students’ learning outcomes, and their evaluation of peer assessment. Most students took assessing the work of their fellow students seriously, and included the peer feedback in the revision of their work. In most conversations, students provided feedback in an evaluative manner. In others, the interaction was more exploratory. For peer assessment, we recommend a combination of written and oral peer feedback.     

Outcomes of synergetic peer assessment: first-year experience

Active participation in learning activities and reviewing assessment activity can facilitate learners engaged in these processes. This case study reports student experiences of the process of peer assessment with teacher guidance in a group project for a first-year nursing course with 153 students. Twenty groups of students were assigned roles in exploring one of the two scenarios: one involved analysing diabetes mellitus and the other considered colorectal carcinoma, in each case covering provision of acute nursing care in hospitals and preparing health promotion strategies in a community. Each group also provided comments to the group that worked on the other scenario, based on prearranged assessment criteria. After receiving comments from their peer group, each group was then allowed to revise their drafts prior to final submission. The teacher’s input would be offered, if the peer feedback was inaccurate or insufficient. A survey was conducted to explore the learning experiences, and three semi-structured focus group interviews were conducted to triangulate findings with the survey. The first-year students expressed the need for both peer feedback and the lecturer’s direct guidance.     

An empirical review of anonymity effects in peer assessment,peer feedback,peer review,peer evaluation and peer grading

Abstract

Peer assessment has proven to have positive learning outcomes. Importantly, peer assessment is a social process and some claim that the use of anonymity might have advantages. However, the findings have not always been in the same direction. Our aims were: (a) to review the effects of using anonymity in peer assessment on performance, peer feedback content, peer grading accuracy, social effects and students’ perspective on peer assessment; and (b) to investigate the effects of four moderating variables (educational level, peer grading, assessment aids, direction of anonymity) in relation to anonymity. A literature search was conducted including five different terms related to peer assessment (e.g., peer feedback) and anonymity. Fourteen studies that used a control group or a within group design were found. The narrative review revealed that anonymous peer assessment seems to provide advantages for students’ perceptions about the learning value of peer assessment, delivering more critical peer feedback, increased self-perceived social effects, a slight tendency for more performance, especially in higher education and with less peer assessment aids. Some conclusions are that: (a) when implementing anonymity in peer assessment the instructional context and goals need to be considered, (b) existent empirical research is still limited, and (c) future research should employ stronger and more complex research designs.     

The Use of Exemplars and Formative Feedback when Using Student Derived Marking Criteria in Peer and Self-assessment

This paper reports a study which implemented a method of student self and peer assessment involving student constructed marking criteria in the presence of exemplars. Pairs of first-year undergraduate biology students were asked to complete a poster assignment. The study was designed to allow the evaluation of (1) student self and peer marking and tutor marking for individual marking criteria following the use of exemplars; (2) the role of exemplars in providing a focus for formative feedback about subject standards. The present study shows that: (a) the use of exemplars can help students demonstrate greater understanding of both marking criteria and subject standards; (b) the use of exemplars can help students learning so that higher quality outcomes are produced; (c) the use of exemplars forms a focus for meaningful formative feedback; (d) students may make more objective judgements as a result of peer assessment compared to self-assessment.     

Peer Assessment Training in Teacher Education: Effects on performance and perceptions

The implementation of peer assessment receives much attention in teacher education. This paper reports the effects of peer assessment training on the performance of student teachers. Ninety-three student teachers were randomly assigned to control groups and experimental groups. The experimental groups were trained in defining performance criteria, giving feedback and writing assessment reports. This was done through peer assessment tasks that were embedded in a redesigned course. Analyses of data derived from peer assessment reports written by the students showed that the experimental groups surpassed the control groups in the quality of the assessment skill. As a result of the training, students from the experimental groups also scored significantly higher grades for the end products of the course than students from the control groups. The results of the questionnaire showed that all students were significantly more satisfied with the redesigned course.     

Grudges and gratitude: the social-affective impacts of peer assessment

Abstract

Students’ dissatisfaction with peer assessment has been widely documented. While most relevant literature places focus on the cognitive (content and uptake of feedback) or structural (feedback design) dimensions, students’ emotions in peer assessment have received scant attention. This study investigates the social-affective impacts of peer assessment by analysing students’ appeal letters addressed to their tutors, reflective posts in the online discussion forum and responses to a survey. A thematic analysis of data indicated three main aspects of students’ (dis)satisfaction: content, scores and process of peer assessment. The most negative emotion that students expressed was related to ‘disrespectful’ behaviour and attitudes of peer reviewers, whereas the feeling of appreciation was triggered by the helpful feedback attributes which were perceived as reflecting reviewers’ respect to others’ works. Students generally held mixed feelings toward peer assessment, valuing learning in the process of providing and receiving feedback but showing resistance to using peer assessment for summative purposes. The findings highlight the significance of respect in peer assessment and argue that the perceived lack of mutual respect seems to underpin the nature of students’ dissatisfaction. This study carries implications for nurturing students’ respectful attitudes and behaviour in and through peer assessment.     

The impact of two types of peer assessment on students' performance and satisfaction within a Wiki environment

The purpose of this study was to compare the effects of two peer assessment methods on university students' academic writing performance and their satisfaction with peer assessment. This study also examined the validity and reliability of student generated assessment scores. Two hundred and thirty-two predominantly undergraduate students were selected by convenience sampling during the fall semester of 2007. The results indicate that students in the experimental group demonstrated greater improvement in their writing than those in the comparison group, and the findings reveal that students in the experimental group exhibited higher levels of satisfaction with the peer assessment method both in peer assessment structure and peer feedback than those in the comparison group. Additionally, the findings indicate that the validity and reliability of student generated rating scores were extremely high. Using Wiki interactive software and providing an online collaborative learning environment to facilitate peer assessment added value to peer assessment.     

The effects of autonomy support on student engagement in peer assessment

Although peer assessment is widely implemented in higher education, not all students are highly engaged in it. To enhance student engagement in peer assessment, we designed and developed a web-based tool, autonomy-supportive peer assessment (ASPA), to support students’ need for autonomy when they conducted peer assessment. Students’ sense of autonomy, and their behavioral, emotional, and cognitive engagement in peer assessment were examined via interviews and surveys. We also examined students’ academic performances, including their improvement from initial to revised essays and the quality of feedback they provided. Survey results indicated that the ASPA group (1) experienced a slightly higher sense of autonomy than the non-ASPA group, and (2) spent much more time on each evaluation criterion than the non-ASPA group. Interviews suggested that both the ASPA and non-ASPA groups were engaged in peer assessment. However, there were no statistically significant differences between the two groups in behavioral, emotional, cognitive engagement, and academic performances.     

The effects of peer assessment on learner autonomy: An empirical study in a Chinese college English writing class

The study reports on a one-semester-long intervention study of peer assessment in a college English writing class. The purpose of the study was to investigate the effects of peer assessment on learner autonomy (LA). Seventy English major sophomores from an independent college in China participated in the study, who were randomly divided into two groups of 35 students each. Traditional teacher feedback was used in the control group while peer assessment was adopted for the experimental group. A questionnaire on LA was administered to both groups as the pre-test and the post-test. A number of ANCOVA analyses were run to measure the effects of peer assessment on students’ LA. The results indicate that peer assessment enhanced the students’ learner autonomy. Peer assessment significantly reduced learners’ dependence on the teacher and boosted the students’ confidence in learning ability, while failing to make noticeable improvement in the other aspects of LA.     

Using feedback requests to actively involve assessees in peer assessment: effects on the assessor’s feedback content and assessee’s agreement with feedback

Criticizing the common approach of supporting peer assessment through providing assessors with an explication of assessment criteria, recent insights on peer assessment call for support focusing on assessees, who often assume a passive role of receivers of feedback. Feedback requests, which require assessees to formulate their specific needs for feedback, have therefore been put forward as an alternative to supporting peer assessment, even though there is little known about their exact impact on feedback. Operationalizing effective feedback as feedback that (1) elaborates on the evaluation and (2) to which the receiver is agreeable, the present study examines how these two variables are affected by feedback requests, compared to an explanation of assessment criteria in the form of a content checklist. Situated against the backdrop of a writing task for 125 first-year students in an educational studies program at university, the study uses a 2 × 2 factorial design that resulted in four conditions: a control, feedback request, content checklist, and combination condition. The results underline the importance of taking message length into account when studying the effects of support for peer assessment. Although feedback requests did not have an impact on the raw number of elaborations, the proportion of informative elaborations within feedback messages was significantly higher in conditions that used a feedback request. In other words, it appears that the feedback request stimulated students to write more focused messages. In comparison with feedback content, the use of a feedback request did, however, not have a significant effect on agreement with feedback.