Peer assessment in the digital age: a meta-analysis comparing peer and teacher ratings

Given the wide use of peer assessment, especially in higher education, the relative accuracy of peer ratings compared to teacher ratings is a major concern for both educators and researchers. This concern has grown with the increase of peer assessment in digital platforms. In this meta-analysis, using a variance-known hierarchical linear modelling approach, we synthesise findings from studies on peer assessment since 1999 when computer-assisted peer assessment started to proliferate. The estimated average Pearson correlation between peer and teacher ratings is found to be .63, which is moderately strong. This correlation is significantly higher when: (a) the peer assessment is paper-based rather than computer-assisted; (b) the subject area is not medical/clinical; (c) the course is graduate level rather than undergraduate or K-12; (d) individual work instead of group work is assessed; (e) the assessors and assessees are matched at random; (f) the peer assessment is voluntary instead of compulsory; (g) the peer assessment is non-anonymous; (h) peer raters provide both scores and qualitative comments instead of only scores; and (i) peer raters are involved in developing the rating criteria. The findings are expected to inform practitioners regarding peer assessment practices that are more likely to exhibit better agreement with teacher assessment.     

The overall effects of end-of-course assessment on student performance: A comparison between multiple choice testing, peer assessment, case-based assessment and portfolio assessment

This study investigates the effect of method of assessment on student performance. Five research conditions go together with one of four assessment modes, namely: portfolio, case-based, peer assessment, and multiple choice evaluation. Data collection is done by means of a pre-test/ post-test-design with the help of two standardised tests (N=816). Results show that assessment method does make a difference: assessments do not produce overall effects on student performance. Moreover, student-activating instruction efforts do not automatically result in more extensive learning gains. Finally, test results show, when compared to other assessments, a statistically significant positive effect of the multiple choice test on students' test scores. However, students' preparation level and the closed book format of the tests might serve explanatory purposes.     

The relationship between information-processing ability and notetaking

This study examined the relationship between lecture notetaking behaviors and academic ability and the relationship among lecture notetaking behaviors, information-processing ability, and more global measures of ability (i.e., GPA and ACT scores). Previous research had not investigated working-memory ability and specific notetaking behaviors. Four types of information were gathered from the 32 undergraduate students participating in this experiment: (a) score on a test of information-processing ability, (b) analyses of notes taken during a designated lecture, (c) score on a test pertaining to that lecture, and (d) score on a course exam covering several other lectures. In addition, GPA and ACT scores were drawn from each student's records. Results confirmed that amount of notetaking is related to academic achievement and established that ability to hold and manipulate prepositional knowledge in working memory is related to the number of words, complex propositions, and main ideas recorded in notes. In fact, stepwise multiple regression analyses indicated that this information-processing ability was a more significant predictor of complex propositions and words recorded in notes than were global measures of ability such as GPA or ACT scores. This research is of practical importance because pedagogical activities may reduce cognitive strain associated with notetaking and because information-processing ability is, in part, controllable.     

Dancing with the devil: formative peer assessment and academic performance

Peer assessment can be important in developing active and independent learners, as well as providing more and faster feedback in large classes, compared to marking done by tutors. In addition, the evaluative, critical stance required by students in order to assess their peers' work encourages the development of higher-order cognitive skills. Changing roles from being assessed to being an assessor can also improve students' ability to judge and improve on their own work. However, peer assessment does have potential problems and there is some debate as to the appropriate academic level at which to implement it, the kinds of feedback that are given and the ways in which students respond. In addition, there is little evidence that peer assessment has an impact on academic performance. This research reports the results of an online peer assessment exercise for a macroeconomics essay conducted in a large Economics 1 class at Rhodes University. Of the 800 students, about half participated in the peer assessment exercise. Data were collected from students via a formal course evaluation. In addition, a sample of 50 essays was evaluated in terms of the relationship between peer marks and final (tutor) marks received and the impact that peer assessment had on the quality of the final essay submitted. An Ordinary Least Squares regression was used to investigate the impact of peer assessment participation on marks. Results showed that peer marks tended to ‘bunch’ in the 60–68% range, indicating the reluctance of peers to give very high or low marks. In general, peers gave more useful feedback on technical aspects, such as presentation and referencing (which were also the categories in which students most often made improvements), than on content. Regression analysis showed that peer assessment participation was not a significant determinant of final essay mark, but that economics ability and English language proficiency were.     

The relationship between teachers’ emotional intelligence and classroom discipline management

One of the fundamental problems of educational systems in many countries is related to classroom discipline. This reflects one of the worst problems faced by teachers. Classroom discipline management strategies play an effective role in creating positive teacher‐student relationships. One of the factors that influence behavior management in a classroom is emotional intelligence. Therefore, this study analyzing how teachers emotional intelligence influences the management of discipline in a classroom and the relationship between gender, academic formation, and service time of teachers with their emotional intelligence. Its sample comprises 559 basic and secondary school teachers. An Emotional Competence Questionnaire, a Scale of Teacher Efficacy in Classroom Management, and a personal and professional data inquiry have been used as instruments. Results show that teachers who have more capacity to deal with emotion demonstrate a greater management of discipline in the classroom. Most of the relationships in the model are statistically significant.     

The cycle of victimization: The relationship between childhood maltreatment and adolescent peer victimization

Child maltreatment has been demonstrated to have many short- and long-term harmful consequences for victims, but whether or not child abuse is associated with an increased risk of peer victimization during adolescence is unclear. This study analyzed prospective data from 831 children and parents participating in the Longitudinal Studies on Child Abuse and Neglect (LONGSCAN) to investigate the relationships between child physical and sexual abuse and adolescent victimization by peers, as well as the potential for gender to moderate these relationships. Results from ordinal logit regression models indicated that children who were physically abused prior to age 12, based on official reports, parent reports, and child reports, had a greater risk of experiencing more intimidation and physical assault by peers at age 16. Having a history of sexual abuse predicted more physical assault but not intimidation. There was no evidence that gender moderated these relationships; in all cases, the relationship between abuse and revictimization was similar for boys and girls. The findings emphasize the need to provide victims of abuse with assistance to help prevent a cycle of victimization.     

The relationship between musical ability and literacy skills

Research has shown that a relationship exists between phonological awareness and literary skills. It has been suggested that a structured programme of musical activities can be used to help children develop a multi-sensory awareness and response to sounds. The relationship between musical ability and literacy skills was examined in a study that showed an association between rhythmic ability and reading. A further pilot intervention study showed that training in musical skills is a valuable additional strategy for assisting children with reading difficulties.     

The relationship between peer victimization and post‐traumatic stress symptomatology in a rural sample

Peer victimization (PV) has been associated with a number of negative psychological sequelae. Few studies, however, have examined the relationship between PV and the symptomatology of post‐traumatic stress disorder, and no studies to date have examined this relationship in a rural sample. Adapted versions of the SEQ‐SR and the TSCC were used to assess the relationship between PV and post‐traumatic stress symptomatology in a sample of 244 rural youths (ages 10–14) in two school districts in a south‐central area of the United States. In addition to a positive relationship between PV and post‐traumatic stress symptomatology, the results indicated relatively high rates of adult presence and peer bystanding during PV experiences. Limitations and implications for practice are discussed. © 2010 Wiley Periodicals, Inc.     

Peer review in the classroom: student perceptions,peer feedback quality and the role of assessment

Abstract

Peer review in the classroom can enhance numerous employability skills such as critical appraisal, writing skills, reflection practices and collaborative experiences. This study takes place over two years and discusses the implementation of a repeating blind peer review cycle across a single semester for final year chemistry students enrolled on a compulsory employability module. The feedback cycle promotes personal reflection through the use of mini-reflective questionnaires. The process was assessed by academic tutors at the resubmission stage and/or the peer feedback stage where the quality of peer feedback was directly assessed. The research investigates the quality of peer feedback, the importance of assessment and student perceptions of what is most useful. Methods include directed content analysis of feedback produced, student opinions and a focus group. Students were capable of offering useable feedback across a range of assessment criteria but tend to focus on the important criteria best aligned to the particular assignment. A range of motivational factors and tactics were noticed but students tended to find reviewing the most beneficial.     

In the eye of the beholder: The relationship between perceived peer language skills,provided peer feedback and peer grading in secondary education

Students involved in peer assessment have interpersonal relationships, partly consisting of reciprocal perceptions. In the domain of argumentative writing, little is known about the way peer assessment is affected by the assessor’s perception of the assessee’s language skills. Dutch 10th grade students (N = 176, age = 15–16) provided feedback and grades on two texts, being under the illusion that the texts had been written by two classmates whom the assessors perceived as a peer with either stronger or weaker language skills than their own (within-subjects design). In reality, students assessed similar texts, created by the researchers. Assessors did not provide different feedback to the two types of assessees. Simultaneously, they provided higher grades to peers perceived to have stronger language skills than their own than to peers perceived to have weaker language skills than their own. Future research should capture assessors’ rationale behind the composition of feedback and grades.     

The Influence of Adult and Peer Role Models on Children’ and Adolescents’ Sharing Decisions

This study explores how the age (adult vs. peer) and the suggestion (to be fair vs. unfair) of models affect the sharing decisions of 9‐ and 12‐year‐olds (N = 365) from Italy and Singapore. Results demonstrate a developmental shift in the influence of models on children's and adolescents’ sharing decisions in both cultures: Children's decisions were more affected by an adult model's suggestion than by that of a peer model, whereas the opposite was true for adolescents. Regardless of the models’ influence, participants considered equal sharing to be the fair choice and reported being happier when their sharing decisions were generous. Our results highlight the crucial importance of social and developmental factors for the promotion of fairness judgments and emotions.     

The relationship between parental bonding and peer victimization: examining child stress and hopelessness as mediators

The purpose of the current study was to investigate a two-stage model in which parent-related stress and hopelessness each served as mediators of the relationship between perceived parental bonding and South Korean adolescent peer victimization. This study also examined whether the mediating relationships differed by the gender of parents and adolescents. A casual chain with three links and four sets of variables were analyzed using structural equation modeling. Data were collected from 800 adolescents attending 10 middle schools in the Busan region of South Korea. Results indicated that both maternal and paternal parental bonding were negatively associated with stress, stress was positively associated with hopelessness, and hopelessness was positively associated with South Korean adolescent peer victimization. Most importantly, the significant negative associations between both maternal and paternal parental bonding and peer victimization were mediated by both stress and hopelessness. Furthermore, gender differences in these relationships existed for both parents and adolescents. Limitations and implications to practice were discussed.     

Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment

This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the training, students reviewed learning concepts, discussed marking criteria, graded example projects and compared their evaluations with the instructor’s evaluation. Data were collected in the form of initial and final versions of students’ projects, students’ scoring of example projects before and after the assessment training, and written feedback that students provided on peer projects. Results of data analysis indicate that the assessment training led to a significant decrease in the discrepancy between student ratings and instructor rating of example projects. In addition, the degree of student vs. instructor discrepancy was highly predictive of the quality of feedback that students provided to their peers and the effectiveness of revisions that they made to their own projects upon receiving peer feedback. Smaller discrepancies in ratings were associated with provision of higher quality peer feedback during peer assessment, as well as better revision of initial projects after peer assessment.     

The relationship between syntactic awareness and reading performance

This study was designed to examine the relationship between syntactic awareness and reading performance. A major concern was to provide an estimate of the effect of syntactic training that was not confounded with training that focused on semantic features of words. The training exercises used in the study focused on all levels of syntactic awareness in order that the effect of such training could be assessed on students’ performance on tasks that tapped each of the levels. Results of this study showed that syntactic awareness could be improved through training. The effect was stable, being apparent at the two post-test times. However, no evidence was found for a systematic effect of improved syntactic awareness on reading ability. Moreover, syntactic training did not show any greater effect than no treatment or semantic training on children’s grammatic comprehension, their ability to use fix-up strategies, or on their general reading ability score. Training had a different impact on the accuracy of oral reading for the syntactic and semantic training groups. Thus, in terms of the developmental sequence of syntactic awareness proposed by Gombert (1992), children trained in the cloze procedure improved at the two highest levels, whilst showing neither a corresponding change in the lower levels of awareness, nor improved functional reading performance.     

Mentoring as service-learning: The relationship between perceived peer support and outcomes for college women mentors

This study examined whether peer support was related to psychosocial outcomes for college women serving as youth mentors in the Young Women Leaders Program (YWLP), a service-learning mentoring program. The outcomes assessed were college students’ ethnocultural empathy and their sense of competence, relatedness, and autonomy. Data included questionnaires completed by YWLP mentors (YWLP; n = 227) and college women with (CS; n = 230) and without (no CS; n = 105) alternative community service involvement. Results showed that YWLP mentors’ level of perceived peer support was associated with stronger outcomes in autonomy as compared to the CS group and in ethnocultural empathy as compared to both comparison groups. These findings extend the literature on effective support for college service-learning participants.