Does peer assessment promote student learning? A meta-analysis

Abstract

In recent years, there has been an increasing use of peer assessment in classrooms and other learning settings. Despite the prevailing view that peer assessment has a positive effect on learning across empirical studies, the results reported are mixed. In this meta-analysis, we synthesised findings based on 134 effect sizes from 58 studies. Compared to students who do not participate in peer assessment, those who participate in peer assessment show a .291 standard deviation unit increase in their performance. Further, we performed a meta-regression analysis to examine the factors that are likely to influence the peer assessment effect. The most critical factor is rater training. When students receive rater training, the effect size of peer assessment is substantially larger than when students do not receive such training. Computer-mediated peer assessment is also associated with greater learning gains than the paper-based peer assessment. A few other variables (such as rating format, rating criteria and frequency of peer assessment) also show noticeable, although not statistically significant, effects. The results of the meta-analysis can be considered by researchers and teachers as a basis for determining how to make effective use of peer assessment as a learning tool.     

An empirical review of anonymity effects in peer assessment,peer feedback,peer review,peer evaluation and peer grading

Abstract

Peer assessment has proven to have positive learning outcomes. Importantly, peer assessment is a social process and some claim that the use of anonymity might have advantages. However, the findings have not always been in the same direction. Our aims were: (a) to review the effects of using anonymity in peer assessment on performance, peer feedback content, peer grading accuracy, social effects and students’ perspective on peer assessment; and (b) to investigate the effects of four moderating variables (educational level, peer grading, assessment aids, direction of anonymity) in relation to anonymity. A literature search was conducted including five different terms related to peer assessment (e.g., peer feedback) and anonymity. Fourteen studies that used a control group or a within group design were found. The narrative review revealed that anonymous peer assessment seems to provide advantages for students’ perceptions about the learning value of peer assessment, delivering more critical peer feedback, increased self-perceived social effects, a slight tendency for more performance, especially in higher education and with less peer assessment aids. Some conclusions are that: (a) when implementing anonymity in peer assessment the instructional context and goals need to be considered, (b) existent empirical research is still limited, and (c) future research should employ stronger and more complex research designs.     

The role of technology-facilitated peer assessment and supporting strategies: a meta-analysis

Abstract

Technology-facilitated peer assessment is gaining increasing attention. However, evidence for the contribution of technology-facilitated peer assessment to learning achievements has not been investigated. The present meta-analysis integrated findings on the effects of technology-facilitated peer assessment based on two main elements: (1) technology-facilitated peer assessment, (2) the use of extra supporting strategies in technology-facilitated peer assessment. A total of 37 empirical studies published from 1999 to 2018 were selected and analysed. Results indicated that technology-facilitated peer assessment had a significant and medium effect on learning achievements with an overall mean effect size of 0.576. The use of extra supporting strategies in technology-facilitated peer assessment also produced a positive and medium effect on students’ learning achievements with an overall mean effect size of 0.543. Different moderator variables, such as task types, assessment modes, training for assessors, durations, grouping types and assessment methods were related to different effect sizes. The results together with the implications for both practice and research are discussed.     

Learning theories and assessment methodologies – an engineering educational perspective

This paper attempts to critically review theories of learning from the perspective of engineering education in order to align relevant assessment methods with each respective learning theory, considering theoretical aspects and practical observations and reflections. The role of formative assessment, taxonomies, peer learning and educational policy as regards promoting the learning of engineering is discussed. It is suggested that an integrated learning method in which cognitive levels, social factors and teamwork and behaviouristic elements are integrated will optimise the learning process on an engineering course. Moreover, assessment of learning should not be isolated from views of teaching and the learning methods employed by the university teacher.     

The assessment cycle: a model for learning through peer assessment

This paper advances a model describing how peer assessment supports self-assessment. Although prior research demonstrates that peer assessment promotes self-assessment, the connection between these two activities is underspecified. This model, the assessment cycle, draws from theories of self-assessment to elaborate how learning takes place through peer assessment. The model is applied to three activity structures described in the literature to analyse their potential to support learning by promoting self-assessment. Broadly speaking, the model can be used to understand learning that takes place in a variety of peer assessment activities: marking/grading, analysis, feedback, conferencing and revision. This approach contrasts most studies on peer assessment, which have focused on calibration of instructor and peer grades, rather than learning opportunities.     

网络同伴互评活动设计与应用研究

同伴互评作为一种形成性评价策略,已经成为现阶段网络学习评价领域研究的热点。本研究将同伴互评策略应用于高校混合式教学之中,设计同伴互评学习活动。研究整体采用行动研究法设计、修改同伴互评活动,并分析学习者对活动的改进意见。研究一方面分析互评活动对在线学习效果的影响以及活动对于两类学习风格学习者影响的差异;另一方面深入分析学习者对于活动的态度及改进意见。主要研究结论认为：（1）研究设计的同伴互评活动能够促进学习者深入理解学习内容,并提升最终成果的质量。（2）相对综合型学习风格的学习者而言,同伴互评更加有助于提升序列型学习者对知识运用的水平。最后,研究总结了同伴互评活动设计的改进方案及后续设计要点。     

A Social-Cognitive Framework for Pedagogical Agents as Learning Companions

Teaching and learning are highly social activities. Seminal psychologists such as Vygotsky, Piaget, and Bandura have theorized that social interaction is a key mechanism in the process of learning and development. In particular, the benefits of peer interaction for learning and motivation in classrooms have been broadly demonstrated through empirical studies. Hence, it would be valuable if computer-based environments could support a mechanism for a peer interaction. Though no claim of peer equivalence is made, pedagogical agents as learning companions (PALs)—animated digital characters functioning to simulate human-peer-like interaction—might provide an opportunity to simulate such social interaction in computer-based learning. In this article we ground the instructional potential of PALs in several social-cognitive theories, including distributed cognition, social interaction, and Bandura’s social-cognitive theory. We discuss how specific concepts of the theories might support various instructional functions of PALs, acknowledging concepts that PALs cannot address. Based on the theoretical perspectives, we suggest key constituents for designing PALs that in human-peer interactions have proven significant. Finally, we review the current status of PAL research with respect to these constituents and suggest where further empirical research is necessary.     

Peer-to-peer Teaching in Higher Education: A Critical Literature Review

The aim of my critical literature review is to identify studies where students are engaged as partners in teaching in higher education and to analyze how tutors and tutees benefit from peer teaching. Thirty studies were included for review. Thirteen countries are represented and two thirds of the studies conducted in the United States of America or the United Kingdom. There is a significant representation of studies from natural- and physical science. The dominating pedagogical belief and theory is social constructivism. The most frequent study design is the use of quasi-experimental pre- and post-testing. University teachers do not comprise the view of peer teaching necessarily resulting in greater academic achievement gains or deep learning. University teachers identify and esteem other pedagogical benefits such as improving students’: critical thinking, learning autonomy, motivation, collaborative and communicative skills. The main finding of this review is the clarification that the training of generic skills benefits from peer teaching.     

Assessment of prior learning in higher education: a review from a validity perspective

The process of giving official acknowledgment to formal, informal and non‐formal prior learning is commonly labelled as assessment, accreditation or recognition of prior learning (APL), representing a practice that is expanding in higher education in many countries. This paper focuses specifically on the assessment part of APL, which undoubtedly is central to the whole process, through a review of research in this area and an analysis of the reviewed studies from a validity perspective. The research reviewed (published 1990–2007) is categorised into empirical as well as more theoretically oriented publications, with a quantitative dominance of the latter. According to the validity analysis, a majority of the studies conducted in this area relate to the evidential basis of test interpretation and use, primarily providing theoretical rationales and theories for a variety of practices. The consequential basis of test interpretation and use has not been studied to any larger extent, resulting in a lack of both theoretical and empirical studies dealing with this aspect of validity.     

How does student peer review influence perceptions,engagement and academic outcomes? A case study

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we examined: (1) students’ perceptions of the peer review process before and after peer review, (2) content of the peer reviews and what kinds of feedback were adopted and (3) the effect of participation in peer review on performance (grades) in the assessment task. Students overwhelmingly perceived peer review to be beneficial, and the opportunity to participate in peer review resulted in a significant improvement in the quality of work submitted for assessment. Students who benefited most from peer review were those of below-median performance, and the magnitude of benefit was related to the degree to which students engaged with the peer review process. Our study confirms that participation in peer review can lead to important improvements in performance and learning outcomes.     

Developing an Eating Disorder Peer Advocate Program on Campus: A Report on the Eating Disorder Awareness and Advocacy Program (EDAAP)

ABSTRACT

This article describes the development and implementation of a peer advocate program for eating disorders and body image outreach on a college campus. Empirical and conceptual literature on the use of peer educators and peer advocates in college student mental health is reviewed. Peer advocate program mission, history, implementation, and training components are described. Learning outcome assessment findings of peer advocate learning are discussed. A counseling center perspective on benefits, challenges, and limitations of facilitating this peer advocate program is shared.     

Methodological quandaries in studying process and outcomes in peer assessment

Peer assessment is very various in its implementation. Six studies of peer assessment are reviewed, four of them in higher education. A literature review is followed by five empirical studies. Strengths and weaknesses of each study are considered and issues are raised. Variables in peer assessment needing further exploration are extricated – in sample definition, specification of type of peer assessment, organisational nature of the intervention, and the measures which are used to evaluate change. It is suggested that further experimental and quasi-experimental studies are necessary to contrast one or two of these variables at a time.     

Student attitudes that predict participation in peer assessment

Peer assessment has been widely applied to actively engage students in learning to write. However, sometimes students resist peer assessment. This study explores reviewers’ attitudes and other underlying factors that influence students’ participation in online peer assessment. Participants were 234 Chinese undergraduates from two different academic backgrounds: engineering majors (n = 168) and English majors (n = 66). Gender, academic background and prior experience with peer assessment were all related to participation levels. Moreover, factor analyses revealed three attitudinal factors: (1) positive attitude (a general endorsement of the benefits of peer assessment), (2) interpersonal negative (concerns about the negative effects on interpersonal relationships), and (3) procedural negative (doubts about the procedural rationality of peer assessment). Among the attitudinal factors, procedural negative was negatively associated with participation, as expected. Interestingly, interpersonal negative was associated with greater participation, and positive attitude was associated with lower participation, in part because students worked hard on each review rather than doing many reviews superficially. Implications for instruction are discussed.     

儿童早期学习品质的本质内涵、因素结构及学习效应

近年来儿童早期学习品质受到国内外学术界的广泛关注。对61个国内外实证研究及25份新修订政策文本的分析表明,学界对儿童学习品质最基本的理解是学习品质关注的是儿童如何学习,而不是儿童学到了什么,描述的是儿童在趋近学习的过程中和投入学习时表现出来的一系列行为、认知与态度倾向;就其构成因素来说,主动性、坚持性、专注力、好奇心、创新创造、灵活性是实证研究与政策文件共同反映的高频因素;学习品质与儿童的在园学习与入学准备显著相关,且能直接预测儿童未来不同阶段的学业成就;学习品质对儿童的同伴关系、社会能力的发展也有显著影响,并能显著降低行为问题与学业困难方面的风险;学习品质在儿童的学习与发展中起着重要的调节作用,如可以调节低质量学校教育或家庭贫困对儿童学习与发展的负面影响,可以降低个体行为问题对其学业成就的不利影响等。学习品质在儿童早期学习与毕生发展中都具有重要的奠基性作用,未来应进一步探索更为低龄儿童学习品质的因素结构及其发展规律,加强我国教育背景下学习品质对儿童学习效应的实证检验与纵向追踪,探索学习品质发展的个体差异及其增长轨迹,开展相关准实验研究以进一步明确学习品质与学习效应之间的关系。不仅要促进我国儿童早期教育实践领域高度重视和践行儿童学习品质的培养,而且应在宏观政策层面把儿童学习品质的发展纳入学前教育质量评价体系,建立儿童学习品质发展数据库,实施儿童学习品质发展监测。     

Student perspectives on formative peer assessment: an attempt to deepen learning?

Peer assessment is a common form of shared learning in which students provide feedback on each others work. Peer assessment takes many forms; and involves students and tutors taking various roles at different stages of the process. This study explores the views and opinions of undergraduate students in relation to their perceptions and experiences of formative peer assessment introduced as a learning development opportunity for the first time. The study found that on the whole formative peer assessment was a positive experience in enhancing students learning and development. However, consideration needs to be taken to address individual learning styles, as a limited number of students found the process to be less useful. Consequently, when tutors are constructing peer assessment strategies they should be cognisant at the planning stage of the variety of learning styles that are evident in order to maximise the development opportunities this can bring to students.     

Assessment revisited: a review of research in Assessment and Evaluation in Higher Education

A review of articles published in Assessment and Evaluation in Higher Education, over the last eight years (2006–2013) on assessment in higher education, since the introduction of the Bologna process, is the subject of the paper. The first part discusses the key issue of assessment in higher education and the method used for selecting articles. The second part presents results according to the main emerging themes arising from data analysis: assessment methods, modes of assessment and assessment related to a given teaching and learning method. The paper concludes that the foci of the studies are aligned with assessment practices other than the written test, in accordance with a learner-oriented perspective. Although the implementation of the Bologna process has had different kinds of impact in different European countries, the review shows that the use and effects of a diversity of assessment methods in higher education have been investigated, particularly those pointing to the so-called alternative methods. Implications of the findings are discussed.     

Interactive learning through web-mediated peer review of student science reports

Two studies analyzed impacts of writing and receiving web-mediated peer reviews on revision of research reports by undergraduate science students. After conducting toxicology experiments, 77 students posted draft reports and exchanged double-blind reviews. The first study randomly assigned students to four groups representing full, partial, or no peer review. Students engaging in any aspect of peer review made more revisions than students confined to reviewing their own reports. In the second study, all students engaged in peer review, and the influence of writing versus receiving critiques was analyzed using linear regression. Both studies showed receiving reviews to be more significant than writing them in terms of triggering report revisions. Students valued the peer review experience and credited it with giving them insights about their work. Conclusions address implications for optimal design of online peer review systems and for further research into student learning gains.

Enhanced student learning in accounting utilising web-based technology,peer-review feedback and reflective practices: a learning community approach to assessment

Higher education is becoming a major driver of economic competitiveness in an increasingly knowledge-driven global economy. Maintaining the competitive edge has seen an increase in public accountability of higher education institutions through the mechanism of ranking universities based on the quality of their teaching and learning outcomes. As a result, assessment processes are under scrutiny, creating tensions between standardisation and measurability and the development of creative and reflective learners. These tensions are further highlighted in the context of large undergraduate subjects, learner diversity and time-poor academics and students. Research suggests that high level and complex learning is best developed when assessment, combined with effective feedback practices, involves students as partners in these processes. This article reports on a four-phase, cross-institution and cross-discipline project designed to embed peer-review processes as part of the assessment in two large, under-graduate accounting classes. Using a social constructivist view of learning, which emphasises the role of both teacher and learner in the development of complex cognitive understandings, we undertook an iterative process of peer review. Successive phases built upon students’ feedback and achievements and input from language/learning and curriculum experts to improve the teaching and learning outcomes.     

Review of computer mediated communication research for education

This research review examines recent developments in computer-mediated communication (CMC) research for educational applications. The review draws on 170 recent research articles selected from 78 journals representing a wide range of disciplines. The review focuses on peer-reviewed empirical studies, but is open to a variety of methodologies. The review is divided into two sections addressing major areas of current research: (a) general CMC research in education, and (b) factors affecting computer-mediated learning. The review covers a variety of key research areas revolving around CMC in education, including, media effect and comparison, on-line courses and networks, course and program evaluations, learning and learning processes, problem solving, writing, decision-making, argumentation, group decision-making, group dynamics, peer evaluations, gender differences, anonymity, teaching practice effects, technology integration, teacher styles and characteristics, socio-cultural factors, and professional development effects. Findings suggest partial advantages of CMC in writing, task focused discussion, collaborative decision-making, group work, and active involvement in knowledge construction during group interactions. Other research findings revealed influences of peer interaction, group composition, group cohesion, goal commitment, group norm development, and process training, mixed-sex groups, and virtual cross-functional teams. Mixed-findings are revealed for performance advantages of computer-mediated versus face-to-face learning environments on various tasks and for the presence of gender differences in computer-mediated environments.