Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features

This paper reports a systematic literature review examining empirical studies on the effects of peer assessment for learning. Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole. This makes peer assessment an interpersonal and interactional process. Using this social perspective in order to study learning effects, we focus on the impact of the structural arrangement of peer assessment on learning, and the influence of interpersonal variables.The literature search, focusing on empirical studies measuring learning outcomes in a peer assessment setting, resulted in 15 studies conducted since 1990 dealing with effects (performance or perceived learning gains) of peer assessment. Our analysis reveals that, although peer assessment is a social process, interpersonal variables have hardly been studied; more specifically, they were measured in only 4 out of 15 studies. Moreover, they are not used to explain learning gains resulting from peer assessment. Finally, comparing the studies with respect to structural features reveals that, although the differences between the studies are significant, there seems to be no relation with the occurrence of learning benefits. The results of this review seem to indicate that research on peer assessment from a social perspective is still in its infancy and deserves more attention.     

Peer assessment as collaborative learning: A cognitive perspective

Peer assessment is an important component of a more participatory culture of learning. The articles collected in this special issue constitute a representative kaleidoscope of current research on peer assessment. In this commentary, we argue that research on peer assessment is currently in a stage of adolescence, grappling with the developmental tasks of identity formation and affiliation. Identity formation may be achieved by efforts towards a shared terminology and joint theory building, whereas affiliation may be reached by a more systematic consideration of research in related fields. To reach identity formation and affiliation, preliminary ideas for a cognitively toned, process-related model of peer assessment and links to related research fields, especially to research on collaborative learning, are presented.     

Peer assessment as a learning tool for enhancing student teachers' preparation

This study investigates how peer assessment contributes to enhancing student teachers' preparation during field experience. A semi-structured interview was conducted with 72 student teachers. The findings showed that the student teachers have positive beliefs about peer assessment. They think that it can be beneficial if some changes are made in the way it is employed in teacher education programs. In light of the study findings, the researchers put forth a number of suggestions and recommendations for employing peer assessment in teacher education programs in Jordan.     

Peer collaboration in solving qualitative physics problems: The role of collaborative talk

This study investigated whether and how peer collaboration facilitated students' problem solving in physics. A qualitative physics test was administered to two Secondary 6 (Year 12) classes, with half of the students in each class randomly assigned to take the test individually and the other half to work in dyads. The abilities of the individuals and dyads were matched such that there was no significant difference between their physics examination grades. The test results show that the dyads performed better than the individuals on each problem and the test as a whole. The rich collaborative talk of the dyads shows that peer collaboration provided students with experiences of co-construction and conflict that were conducive to successful problem solving. However, it was found that co-construction could lead to correct as well as wrong solutions and that conflict and co-construction could occur in the same instance rather than as separate activities. The study also found that students' success in problem solving depended not so much on their ability but on how they interacted and whether and how they invoked the relevant physics principles and strategies.     

The role of diagrams in collaborative argumentation-based learning

In this article two studies on the use of diagrams in computer-supported collaborative learning are compared. Focus is on the way argumentative diagrams can be used during collaborative learning tasks, more specifically how diagrams support argumentative interaction between students when they discuss ill-defined topics. The main goal is to discover how diagram construction before discussion, and diagram construction during discussion, influence the way students explore the space of debate during discussion. Twenty pairs of 16/17-year-old students were randomly selected from 126 pairs. Ten pairs worked with a diagram before discussion and ten during discussion. The research showed that students use diagrams in very different ways, ranging from a means for talking to just a notebook. Our expectation that using a diagram during discussion leads to more depth in discussion than using one before discussion, was not confirmed. Possible explanations for this finding are structure of the task, and the way students interpreted the goal of the task.     

The discourse of collaborative creative writing: Peer collaboration as a context for mutual inspiration

Drawing on socio-cultural theory, this paper focuses on children's classroom-based collaborative creative writing. The central aim of the reported research was to contribute to our understanding of young children's creativity, and describe ways in which peer collaboration can resource, stimulate and enhance classroom-based creative writing activities. The study drew on longitudinal observations of ongoing activities in Year 3 and Year 4 classrooms (children aged 7-9) in England. Selected pairs’ collaborative creative writing activities were observed and recorded using video and audio equipment in the literacy classroom and in the ICT suite (13 pairs, about 2-4 occasions each).The research built on the contextualised, qualitative analysis of the social and cognitive processes connected to shared creative text composition. Using an analytic tool developed specifically for creative writing tasks, we linked collaborative and discursive features to cognitive processes associated with writing (‘engagement’ and ‘reflection’). The research has identified discourse patterns and collaborative strategies which facilitate ‘sharedness’ and thus support joint creative writing activities.The paper discusses two significant aspects of the observed paired creative writing discourse. It reports the significance of emotions throughout the shared creative writing episodes, including joint reviewing. Also, it shows children's reliance on collaborative floor (Coates, 1996), with discourse building on interruptions and overlaps. We argue that such use of collaborative floor was indicative of joint focus and intense sharing, thus facilitating mutual inspiration in the content generation phases of the children's writing activities. These findings have implications for both educational research and practice, contributing to our understanding of how peer interaction can be used to resource school-based creative activities.     

Knowledge convergence in collaborative learning: Concepts and assessment

In collaborative learning the question has been raised as to how learners in small groups influence one another and converge or diverge with respect to knowledge. Knowledge convergence can be conceptualised as knowledge equivalence and as shared knowledge prior to, during, and subsequent to collaborative learning. Knowledge equivalence refers to learners becoming more similar to their learning partners with regard to the extent of their individual knowledge. Shared knowledge means that learners have knowledge on the very same concepts as their learning partners. In this article, we provide measures for assessing both, knowledge equivalence and shared knowledge.     

Preservice teachers' initial conceptions about assessment of science learning: The coherence with their views of learning science

This study utilized responses from Taiwanese preservice elementary teachers to describe and analyze their conceptions about the assessment of science learning and the extent that these conceptions were coherent with their views of learning science. A methodological framework of phenomenography was used for the study. The results revealed that the preservice teachers' mode of assessment was coherent with a traditional view of learning but their performance mode of assessment was not well developed. Improving preservice teachers' conception of assessment requires clarifying and reconstructing their conceptions of and coherence between assessment, curriculum, pedagogy, and learning.     

Formative assessment strategies for students' conceptions—The potential of learning analytics

Formative assessment is considered to be helpful in students' learning support and teaching design. Following Aufschnaiter's and Alonzo's framework, formative assessment practices of teachers can be subdivided into three practices: eliciting evidence, interpreting evidence and responding. Since students' conceptions are judged to be important for meaningful learning across disciplines, teachers are required to assess their students' conceptions. The focus of this article lies on the discussion of learning analytics for supporting the assessment of students' conceptions in class. The existing and potential contributions of learning analytics are discussed related to the named formative assessment framework in order to enhance the teachers' options to consider individual students' conceptions. We refer to findings from biology and computer science education on existing assessment tools and identify limitations and potentials with respect to the assessment of students' conceptions.

Practitioner notes

What is already known about this topic

• Students' conceptions are considered to be important for learning processes, but interpreting evidence for learning with respect to students' conceptions is challenging for teachers.
• Assessment tools have been developed in different educational domains for teaching practice.
• Techniques from artificial intelligence and machine learning have been applied for automated assessment of specific aspects of learning.

What does the paper add

• Findings on existing assessment tools from two educational domains are summarised and limitations with respect to assessment of students' conceptions are identified.
• Relevent data that needs to be analysed for insights into students' conceptions is identified from an educational perspective.
• Potential contributions of learning analytics to support the challenging task to elicit students' conceptions are discussed.

Implications for practice and/or policy

• Learning analytics can enhance the eliciting of students' conceptions.
• Based on the analysis of existing works, further exploration and developments of analysis techniques for unstructured text and multimodal data are desirable to support the eliciting of students' conceptions.

     

Lifelong learning: concepts and conceptions

This article reviews a number of versions of the concept of Lifelong Learning and sets out the main lines of the conceptions of education articulated in them. It then goes on to suggest an alternative to attempts to produce essentialist definitions and proffers a pragmatic, problem solving approach. The article draws substantially on the book by the same authors The School, The Community and Lifelong Learning (London: Cassell, 1990).     

Peer assessment in a project-based engineering course: comparing between on-campus and online learning environments

As the number of participants in online distance learning courses increases, peer assessment is becoming a popular strategy for evaluating open assignments and for breaking the social isolation surrounding distance education. Yet, the quality and characteristics of peer assessment in massive online courses has received little attention. Hence, this study was set to examine peer feedback quality and grading accuracy in a project-based course. The study applied a sequential exploratory mixed methods design. It included 339 participants who studied the same engineering course, but in three different modes: on-campus (n = 77), small private online course (n = 110), and massive open online course (MOOC) (n = 152). Content analysis of feedback comments identified four categories: reinforcement, statement, verification and elaboration, arranged in an ascending scale of cognitive ability. The findings indicated that the MOOC participants provided more feedback comments and volunteered to assess more projects than their counterparts did. However, the on-campus students provided higher quality feedback and their peer grading was better correlated with the grades assigned by the teaching assistants.     

Peer assessment as a method of improving student engagement

To encourage increased student attendance and engagement in a third-year economics unit, the curriculum was redesigned to incorporate continuous assessment throughout the semester. A component of group project marks were allocated to peer assessment, in an attempt to address concerns about free-riding colleagues sharing a common mark. This study investigated the consistency of marks awarded to peers within teams, and the acceptance by students of marks awarded by peers. Students were asked to provide ratings and explanatory comments for each of their group peers. Focus groups were conducted to determine students’ acceptance of this strategy. Eighty student ratings were compared to determine consistency of assessment. Within groups, students who received higher marks from their peers generally awarded marks to their peers across a wider range, whereas students who received lower average grades often awarded the same mark to all team members. These results might indicate that students who were attending class regularly and/or contributing at a higher level were more discriminating in the marks awarded to their peers. Similarly, non-contributors (as identified by their peers) assigned the same or similar grades to each of their peers, possibly due to a lack of knowledge about their peers’ contributions.     

The role of self- and social directed goals in a problem-based, collaborative learning context

Students’ learning goals demonstrate much stronger variety than traditional goal orientation models for classroom learning assume, especially when the educational context allows so. In this empirical study we will investigate the richness of students’ goal orientation in a collaborative learning context. We do so with the help of a goal setting framework that is based on a two-facet approach distinguishing multiple contents (performance, learning, well-being) and goal directions (varying degrees of self vs social direction). To investigate the role of different goal constellations, goal setting and learning performance data of first year students (n = 2,636) in a problem-based, collaborative learning program, and evaluation data of problem-based tutorial groups (#groups = 206) are combined into a multilevel model. Each tutorial group functions in two different educational settings: one directed at open-ended, group problems, the other at closed, individual problems. Educational context appears indeed to have a crucial role in the relationship between students’ goal setting at the one side, and students’ performance and group functioning on the other side.     

A review of the literature on Attention-Deficit Hyperactivity Disorder children: Peer interactions and collaborative learning

ADHD children may have social skill deficits in at least three main areas: social communication, poor emotional regulation, and social-cognitive biases. They also have cognitive difficulties which have implications for their learning. Based on a review of the literature, it is argued that maladaptive classroom peer interactions for ADHD children may disadvantage their learning on collaborative tasks. Although the literature is sparse in the area of peer interactions and collaborative learning for ADHD children, some suggestions for practice and future research are suggested. © 1996 John Wiley & Sons, Inc.     

Measuring learning: discrepancies between conceptions of and approaches to learning

This study is framed under the student approaches to learning tradition. The aim was to identify convergence in quantitative and qualitative responses of individuals when measuring their conceptions of and approaches to learning with a mixed methods design. A sample of 1110 Spanish Master’s level teacher education students completed a scale on approaches to learning (R-SPQ-2F), and a randomly selected subsample of 111 answered an open-ended question on how they learned. Overall, the qualitative and quantitative data did not support each other, as inventory responses showed a clear predominance of a deep, non-surface approach to learning, whereas qualitative answers reflected a tendency towards lower-order conceptions of learning. Inconsistencies in the results suggest future research ought to use a combination of techniques when exploring constructs such as learning should they wish to draw valid conclusions.