Peer assessment in the digital age: a meta-analysis comparing peer and teacher ratings

Given the wide use of peer assessment, especially in higher education, the relative accuracy of peer ratings compared to teacher ratings is a major concern for both educators and researchers. This concern has grown with the increase of peer assessment in digital platforms. In this meta-analysis, using a variance-known hierarchical linear modelling approach, we synthesise findings from studies on peer assessment since 1999 when computer-assisted peer assessment started to proliferate. The estimated average Pearson correlation between peer and teacher ratings is found to be .63, which is moderately strong. This correlation is significantly higher when: (a) the peer assessment is paper-based rather than computer-assisted; (b) the subject area is not medical/clinical; (c) the course is graduate level rather than undergraduate or K-12; (d) individual work instead of group work is assessed; (e) the assessors and assessees are matched at random; (f) the peer assessment is voluntary instead of compulsory; (g) the peer assessment is non-anonymous; (h) peer raters provide both scores and qualitative comments instead of only scores; and (i) peer raters are involved in developing the rating criteria. The findings are expected to inform practitioners regarding peer assessment practices that are more likely to exhibit better agreement with teacher assessment.     

美国80年代以来教师教育发展政策述评

课堂教学质量是教育质量的核心,课堂教学质量的改善与提升关系着高质量教育体系的建成。对话国际上具有典型性与代表性的课堂教学评价框架并从中汲取高质量的核心元素,是中国特色课堂教学评价体系展现国际视野的关键举措。美国教育考试服务中心丹尼森(Danielson)教授研发的Framework for Teaching(FFT)课堂教学评价框架关注课堂教学的过程性质量,秉持高阶性思维、建构性学习、目的性活动和专业性指导的高质量课堂教学理念,涉及4大模块、22个评估要点以及相应的质量观测点,从评价对象与评价方式两个维度跨越时空全面搜集资料并对教师教学工作作出价值判断,旨在通过向教师提供反馈和推动专业发展而引导教师为质量而教,实现教学的背景、投入、过程质量和学生学业成就质量的多维提升。深入研究与反思在理念和内容等方面具有明显优势的FFT课堂教学评价框架,启示中国应在自由和规则、过程和结果的动态和谐关系中,以创设学习文化、促进深度学习为核心,构建具有全球视野的新时代中国特色高质量课堂教学体系,并基于此研发相应的课堂教学质量评价体系和监测工具,构建实现高质量课堂教学的教师教育质量指标体系,促进教育高质量发展。     

Teacher ratings of the achievement-related classroom behaviors of maltreated and non-maltreated children

This study investigated in what ways, if any, maltreated children differ from nonmaltreated children in regard to achievement-related classroom behaviors. Elementary school teachers completed the Hahnemann Elementary School Behavior Rating Scale on 33 maltreated children, 33 non-maltreated public assistance children, and 33 non-maltreated lower middle class children. The maltreated children were matched to the comparison children on gender and grade level. Results indicated that the maltreated children exhibited significantly less classroom behavior that is positively linked with academic achievement than did a comparable group of non-maltreated, public assistance children. However, the maltreated children did not differ significantly as a group from the public assistance children in most behaviors that are negatively linked with academic achievement, such as disruptive social involvement in the classroom. When compared with the lower middle class children, the maltreated children were rated as engaging in significantly less classroom behavior that is positively related to academic achievement and significantly more classroom behavior that is negatively related to academic achievement.     

Mother and teacher ratings of maladaptive behaviour in children with special needs

ABSTRACT

Parents and teachers of 109 children selected from the Special Needs Register and living in a multiethnic urban health district participated in the study. Their perceptions of children's behaviour at home and at school were measured by the Aberrant Behavior Checklist(ABC). About two‐thirds of the subjects presented with at least one type of maladaptive behaviour of at least moderate severity within their family, and 50 per cent had similar difficulties at school. The dimensions of hyperactivity and irritability were the main causes for concern by both sources. Contrary to previous studies, high rates of parent‐teacher agreement were found. This significant association was not affected by factors such as age, ethnicity or type of school. The implications for the provision of services for children in special education are discussed.     

Teacher ratings of Hispanic,black, and Anglo students' classroom behavior

Teachers rated the behavior of Hispanic (N = 56), black (N = 56), and Anglo (N = 56) elementary students with the Teacher Checklist of School Behavior. The behavior of Hispanic students was rated less favorably than that of either of the other two groups. The Hispanic students were perceived to avoid peer and teacher interaction to a greater extent than Anglo and black students and to exhibit more physical reaction (absenteeism, physical complaints, clinic requests, etc.)     

Self-esteem and classroom behavior in elementary school children

While many investigators have examined the relationship between self-esteem and academic achievement, and between behavior and achievement, there has been little research examining the relationship between self-esteem and classroom behavior. The present study investigated the relationship between self-esteem, using the Coopersmith Self-Esteem Inventory, and classroom behavior, using the Classroom Behavior Rating Scale, with a sample of 54 elementary school children. Results indicate that a significant relationship exists between self-esteem and classroom behavior. The implications of this with regard to teachers' modification of student behaviors are discussed.     

The relationship among students' reading performance,their classroom behavior,and teacher skills

The relationship among students' reading performance, their behavior (task-focused behavior, emotional stability, and compliant behavior) in the classroom, and the teacher's skills was investigated in 66 third-grade classrooms. Results from this study showed the students' reading performance and their behavior in the classroom are all significantly interrelated. Better reading performance at the beginning of the school year goes with better behavior at the end of the school year. In turn, better behavior at the beginning of the school year goes with better reading performance at the end of the school year. The teacher can improve the behavior of the students by providing high-quality reading instruction. Some teacher skills have differential effects, however, on the various behavioral aspects. The implications for the educational practice as well as for future research are discussed.     

The impact of teacher preparation on responses to student aggression in the classroom

Despite advances in the development and implementation of school-based interventions, aggression in American schools remains a significant problem for educators. The present study examines the influence of teacher preparation on responses to classroom aggression. A sample of 121 teachers employed in 11 public schools across Southwest Virginia completed measures of teaching characteristics and responded to vignettes depicting student aggression. Multiple regression analyses were used to evaluate the process by which teachers respond to classroom aggression, and the moderating influence of teacher training. Results confirmed the importance of prior training in supporting classroom management. Implications are discussed as they relate to relevant models and recent clinical and educational research initiatives.     

Social behavior of children in a classroom setting

Forty-two children (25 boys, 17 girls) in two traditional second-grade classrooms were videotaped during normal classroom activity until approximately 50 min of tape was accumulated for each child. A variety of behaviors was then coded on an event recorder, including child-child interactions, general behaviors, and child-teacher interactions. Teacher evaluations expressed as ratings between bipolar adjectives were also obtained. A principal components analysis revealed six distinct factors. The strongest factor was composed of teacher-child interactions. Analyses of variance indicated that sex and birth order differences were limited. Compared to boys, girls engaged in more verbalization with same-sex peers (p < .001) and more cooperation with same-sex peers (p < .05). Teacher's evaluations were not significantly influenced by the sex of the children. Favorable teacher evaluations were clearly associated with the extent to which a child approached and remained in proximity to the teacher.     

Achievement,sociometric status,and personality characteristics of children selected by their teachers as having learning and/or behavior problems

This study examined the relationships among academic, sociometric, and personality variables of 242 children who were selected by their teachers as having behavior problems, learning problems, learning and behavior problems, or no problems. The results were generally supportive of teachers' ability to distinguish between children with problems and children without problems. Children without problems and those with behavior problems only were more similar than different. Children with learning problems and those with learning and behavior problems were also more similar than different, yet differed significantly from children with no problems and those with behavior problems only. The unique characteristics of each group were identified and contrasted.     

Strengthening sociometric prediction: scientific advances in the assessment of children's peer relations

This study assessed the strength of sociometric classification in the prediction of concurrent sociobehavioral adjustment. Differential adjustment for subgroups of unclassified children were also examined. Participants were 881 fifth graders (ages 9 to 12). Classification strength (CS) and unclassified subgroups were determined through newly developed algorithms. CS added significantly to the prediction of all areas of adjustment. For example, highly rejected children were at extreme risk for victimization whereas highly controversial children were most likely to be bullies and relationally aggressive. Unclassified subgroups were found to exhibit adjustment problems mirroring those of their extreme status group counterparts. Findings support that increasing the sensitivity of sociometric measurement results in both greater predictive strength and enhanced understanding of underlying social processes.     

Friendship quality and sociometric status: between-group differences and links to loneliness in severely abused and nonabused children.

OBJECTIVE: There were two main aims: first, to illuminate the difference between abused children's general popularity with classmates and success in close friendships; second, to examine the specific interactional qualities of abused children's friendships and their links to loneliness. METHOD: Thirty-five severely abused children and 43 matched, nonabused children were compared on peer-rated sociometric status, self-reported loneliness, and observed and self-reported friendship quality. RESULTS: Abused children were not rated significantly lower sociometrically, nor did they differ significantly from control children on several measures of friendship quality, such as resolving conflicts and helping each other. However, abused children were observed to be more negative and less proactive in their interactions. They also reported their friendships as being more conflictual, and as higher on betrayal and lower on caring. Only observational friendship variables predicted loneliness. CONCLUSIONS: The results challenge the assumption that abused children's peer relationships are uniformly more maladaptive than nonabused children's, and point to the possible benefits of structured interventions for "normalizing" their friendship interactions. The pattern of difficulties exhibited by abused children (e.g., conflict) provides foci for more specific interventions. Multi-method assessments are necessary and the multi-dimensional nature of children's social adjustment is important to understand.     

The relationship of teacher ratings of executive functions to emergent literacy in Head Start

Reading and Writing - The purpose of this study was to investigate the concurrent relationships between selected teacher-rated executive function (EF) and a comprehensive array of emergent literacy...