Using feedback requests to actively involve assessees in peer assessment: effects on the assessor’s feedback content and assessee’s agreement with feedback

Criticizing the common approach of supporting peer assessment through providing assessors with an explication of assessment criteria, recent insights on peer assessment call for support focusing on assessees, who often assume a passive role of receivers of feedback. Feedback requests, which require assessees to formulate their specific needs for feedback, have therefore been put forward as an alternative to supporting peer assessment, even though there is little known about their exact impact on feedback. Operationalizing effective feedback as feedback that (1) elaborates on the evaluation and (2) to which the receiver is agreeable, the present study examines how these two variables are affected by feedback requests, compared to an explanation of assessment criteria in the form of a content checklist. Situated against the backdrop of a writing task for 125 first-year students in an educational studies program at university, the study uses a 2 × 2 factorial design that resulted in four conditions: a control, feedback request, content checklist, and combination condition. The results underline the importance of taking message length into account when studying the effects of support for peer assessment. Although feedback requests did not have an impact on the raw number of elaborations, the proportion of informative elaborations within feedback messages was significantly higher in conditions that used a feedback request. In other words, it appears that the feedback request stimulated students to write more focused messages. In comparison with feedback content, the use of a feedback request did, however, not have a significant effect on agreement with feedback.     

Anonymity as an instructional scaffold in peer assessment: its effects on peer feedback quality and evolution in students’ perceptions about peer assessment skills

Although previous research has indicated that providing anonymity is an effective way to create a safe peer assessment setting, continuously ensuring anonymity prevents students from experiencing genuine two-way interactive feedback dialogues. The present study investigated how installing a transitional approach from an anonymous to a non-anonymous peer assessment setting can overcome this problem. A total of 46 bachelor’s degree students in Educational Studies participated in multiple peer assessment cycles in which groups of students assessed each other’s work. Both students’ evolution in peer feedback quality as well as their perceptions were measured. The content analysis of the peer feedback messages revealed that the quality of peer feedback increased in the anonymous phase, and that over time, the feedback in the consecutive non-anonymous sessions was of similar quality. The results also indicate that the transitional approach does not hinder the perceived growth in peer feedback skills, nor does it have a negative impact on their general conceptions towards peer assessment. Furthermore, students clearly differentiated between their attributed importance of anonymity and their view on the usefulness of a transitional approach. The findings suggest that anonymity can be a valuable scaffold to ease students’ importance level towards anonymity and their associated need for practice.     

The impact of an elaborated assessee’s role in peer assessment

The purpose of this study was to investigate the effects of an elaborated assessee’s role on metacognitive awareness, performance and attitude in peer assessment. Two intact groups (a total of 82 students) were randomly assigned to a treatment condition (having back‐feedback activity) or a control condition (not having back‐feedback activity). The results indicated that, regarding metacognitive awareness, when participants played the elaborated assessee role, they tended to report higher metacognitive awareness in their learning process. Regarding performance, when participants played the elaborated assessee role, they tended to receive better scores in making a concept map. Regarding attitude, when participants played the elaborated assessee role, they reported greater motivation towards the peer assessment. The findings of this study suggest instructional implications for those who want to employ peer assessment as a learning method by showing the effectiveness of a well‐developed role design, specifically one that includes the back‐feedback activity.     

Understanding student engagement with peer feedback on master’s theses: a Macau study

While research on peer feedback in second language (L2) writing at university/college level has proliferated, scholars have conducted less research on peer feedback in L2 academic and scholarly writing. Drawing upon multiple sources of data including semi-structured interviews, stimulated recalls, online interviews via WeChat, first and revised drafts of master’s theses, peer written feedback, audio-recordings of oral peer feedback conferences and the finalised master’s theses, this case study examines how three master’s students affectively, behaviourally and cognitively engaged with peer feedback on drafts of their thesis in a Master of Education programme at a Macau university. The findings show that the relationship between sub-constructs within each dimension and the relationships between the three dimensions of student engagement were interconnected in a dynamic and complex way. While there were individual differences among the three students’ engagement, their affective engagement could promote or negatively influence their behavioural and cognitive engagement. This study builds our understanding of the multifaceted nature of master’s students’ engagement with peer feedback. It provides pedagogical implications about how peer feedback can enhance the quality of master’s students’ academic writing and sheds light on how to guide students to establish scholarly learning communities in higher education.     

Peer feedback on academic writing: undergraduate students’ peer feedback role,peer feedback perceptions and essay performance

Within the higher education context, peer feedback is frequently applied as an instructional method. Research on the learning mechanisms involved in the peer feedback process has covered aspects of both providing and receiving feedback. However, a direct comparison of the impact that providing and receiving peer feedback has on students’ writing performance is still lacking. The current study compared the writing performance of undergraduate students (N = 83) who either provided or received anonymous written peer feedback in the context of an authentic academic writing task. In addition, we investigated whether students’ peer feedback perceptions were related to the nature of the peer feedback they received and to writing performance. Results showed that both providing and receiving feedback led to similar improvements of writing performance. The presence of explanatory comments positively related both to how adequate students perceived the peer feedback to be, as well as to students’ willingness to improve based upon it. However, no direct relation was found between these peer feedback perceptions and students’ writing performance increase.     

The effects of feedback on achievement,interest and self-evaluation: the role of feedback’s perceived usefulness

The impact of two types of written feedback (process-oriented, grade-oriented) on changes in mathematics achievement, interest and self-evaluation was compared – with a particular focus on the mediating role of feedback’s perceived usefulness. Participants, 146 ninth graders (aged 14 to 17?years), were assigned to either a process-oriented or a grade-oriented experimental feedback condition. They worked on mathematics tests, received feedback on their test results and completed surveys measuring feedback’s perceived usefulness, interest and self-evaluation. Results of path analysis showed that process-oriented feedback was perceived as more useful than grade-oriented feedback and that feedback’s perceived usefulness had a positive effect on changes in achievement and interest. Consistent with this, process-oriented feedback had a greater positive indirect effect than grade-oriented feedback on changes in mathematics achievement and interest via its perceived usefulness. There were no such effects on changes in self-evaluation. Potential explanations for these findings, educational implications and possible directions for future research are discussed.     

The quality of written peer feedback on undergraduates’ draft answers to an assignment,and the use made of the feedback

The research described here investigated the quality and characteristics of peer feedback given on a draft piece of writing in the context of an undergraduate summative assignment. It also investigated whether the recipients made use of the feedback, with the aim of discovering whether some types of feedback were used in preference to others. The peer feedback was characterised in various ways, and then a comparison with the feedback subsequently given on the polished piece of writing by the tutor was used to determine the strengths and weaknesses of the peer feedback. Although the peers’ feedback had some different characteristics from that of the tutors, it was nevertheless of good quality. The examination of the use the recipients made of the feedback showed that much feedback was ignored. The use recipients made of the feedback depended very little on the characteristics of the feedback received, but did vary strongly across the recipients. The ability level of the recipients was not found to be a factor in this variation. The results of this research suggest that future work needs to focus more on students using feedback than on students giving feedback.     

Effects of training peer tutors in content knowledge versus tutoring skills on giving feedback to help tutees’ complex tasks

This study aimed to investigate the effectiveness of training tutors in content knowledge of a particular domain versus training them in tutoring skills of pedagogical knowledge when tutoring on a complex tutee task. Forty-seven tutor–tutee pairs of fourth-year secondary school students were created and assigned to one of the two treatments. Twenty-two tutors received training in content knowledge and the other twenty-five tutors in tutoring skills. Tutors formulated written feedback immediately after the training. Tutees first interpreted the tutor feedback and then used it to revise their research questions. The results showed that tutors trained in tutoring skills formulated more effective feedback than tutors trained in content knowledge. In addition, tutees helped by tutoring-skills tutors found the feedback more motivating than those helped by content-knowledge tutors. However, no differences were found in tutee performance on revision. The findings are discussed in terms of the set-up of this study and implications for improving the effectiveness of peer tutoring.     

‘Now that’s the feedback I want!’ Students’ reactions to feedback on graded work and what they do with it

Since the introduction of the National Student Survey (NSS) in 2005, like many other institutions, the university where this study took place has expended substantial effort in improving the quality of feedback to students. However, despite much research, changes in pedagogical approaches and shifts in conceptual understanding related to feedback practice, assessment and feedback still receive the lowest satisfaction ratings in the NSS. Lecturers are discouraged when students fail to take note of their feedback, or sometimes do not collect assignments that have been marked. Understanding why feedback is not always acted upon remains an important area for researchers. This paper reports on an in-depth interview study with 14 final year undergraduates, reflecting on their perceptions of feedback written on marked assignments, by selecting examples of what they considered to be ‘good’ and ‘bad’ work. Findings suggested that emotional reactions play a significant part in determining how students will act on the feedback they receive, and the concept of ‘emotional backwash’ is introduced.     

Mediating effects of teacher enthusiasm and peer enthusiasm on students’ interest in the college classroom

This study explored the mediating effects of students’ perceptions of teacher enthusiasm and of peer enthusiasm on the relation between students’ initial interest and their situational interest at the end of the semester. Students’ motivation for affiliation with their teacher and with peers was also measured to allow for potential associations between these variables and the students’ perceptions of teacher and peer enthusiasm. In path analysis, data from 455 undergraduates showed that perceptions of teacher enthusiasm and of peer enthusiasm had direct associations with two kinds of situational interest, both hold and catch interest. Also, the relations between initial interest and both hold and catch interest were mediated by perceptions of peer enthusiasm but not teacher enthusiasm. Students’ affiliative motivation with the teacher and peers had direct effects on their perceptions of teacher and peer enthusiasm. This study contributes to clarifying the importance of contextual factors as well as students’ own individual variables in understanding the mechanisms by which students’ interest in a course develops and is maintained throughout the semester.     

Investigating the effects of peer instruction on preservice mathematics teachers’ achievements in statistics and probability

This study investigated the effects of two different accountability scoring mechanisms (ASMs), which were used during the peer instruction (PI) process, on preservice middle school mathematics teachers’ (PSTs) achievements in statistics and probability. In the spring semester of 2016–2017 academic year, 46 third-year PSTs, who had been attending a statistics and probability course, participated in the study. Based on their pre-test scores, the PSTs were randomly divided into two equally achieving groups (Group 1 and Group 2). The data of this study were collected using an academic achievement test and PI and course evaluation forms. A learning management system (LMS), which was a web-based application designed by the first author, was used in collecting the PSTs’ responses to the given conceptual questions. Two different ASMs were used in calculating the PSTs’ PI scores. The findings showed that the PSTs in Group 1 obtained significantly higher overall academic, PI, and post-test scores than the PSTs in Group 2. Therefore, the PSTs’ PI and overall academic achievement scores differed based on the ASM used. Thus, using an ASM during a PI process found to be effective in increasing the PSTs’ engagement in the peer discussion. Finally, the analysis of the PSTs’ opinions regarding to the PI, learning process, and learning environment indicated their overall satisfaction.     

Getting to know nature: evaluating the effects of the Get to Know Program on children’s connectedness with nature

People in industrialized countries may be losing their connection with nature. The Get to Know Program (Get to Know) is a multi-faceted program aimed at encouraging direct connection with nature through a variety of activities (observations of wildlife, hiking, creative arts, and special events), specifically among youth. Three studies assessed the effects of three Get to Know program activities on youth’s implicit connectedness with nature (measured using a computer based game). Participants were youth recruited from southern California schools or youth organizations. Participation in the Get to Know Program’s Creative Arts Contest was associated with increased implicit connectedness with nature. However, participation in the Get to Know Natural Treasure Adventure and Virtual Hike did not have an effect on connectedness with nature. Implications of these findings are important for agencies seeking to find effective tools for outreach focused on connecting participants with nature.     

Correction to: School climate in Mongolia: Translation and validation of the What’s Happening in This School

Learning Environments Research -     

Implementing embodied learning in the classroom: effects on children’s memory and language skills

The relationship among bodily movements, cognitive abilities, and academic achievement in children is receiving considerable attention in the research community. The embodied learning approach is based on the idea of an inseparable link between body and mind in learning, aiming for teaching methods that promote children’s active engagement in the classroom. This study implements embodied learning as a part of the classroom curriculum in a real classroom environment using motion-based games. A total of 52 elementary students engaged in embodied learning in-class activities for four months. The data-set included standardized pre-post testing for children’s cognitive and academic performance, general learning analytics from games’ usage, interviews, and observations from the teachers involved. Findings showed significant effects both on children’s cognitive abilities (i.e., short-memory skills) and academic performance (i.e., expressive vocabulary). This article contributes to the educational technology community by providing an example of implementing embodied learning via use of motion-based technologies in a real classroom environment.     

Students’ feedback preferences: how do students react to timely and automatically generated assessment feedback?

This study assesses whether or not undergraduate and postgraduate accounting students at an Australian university differentiate between timely feedback and extremely timely feedback, and whether or not the replacement of manually written formal assessment feedback with automatically generated feedback influences students’ perception of feedback constructiveness. The study demonstrates that students do not differentiate between timely feedback and extremely timely feedback. This result holds for both on-campus as well as off-campus students, although undergraduate on-campus students have significantly higher timeliness expectations than undergraduate off-campus students. In addition, the study demonstrates that a replacement of manually generated feedback with automatically generated feedback improves students’ perception of the constructiveness of the provided feedback substantially (undergraduate) or significantly (postgraduate). Instructors may consequently be able to exploit the advantages of automatic feedback tools without having to be concerned about the impact of such feedback on student perceptions. In addition, instructors should only aim to provide extremely timely feedback rather than timely feedback, if sound pedagogical reasons are available to justify the required effort.     

Correction to: Academic engagement: assessment,conditions, and effects—a study in higher education from the perspective of the person-situation interaction

European Journal of Psychology of Education -     

Correction to: Exploring the Effects of Intrinsic Motive,Utilitarian Motive,and Self-Efficacy on Students’ Science Learning in the Classroom Using the Expectancy-Value Theory

Research in Science Education - The original version of this article unfortunately contained a mistake. The name "Wan Zhi Hong" should be corrected to "Zhi Hong Wan".     

Intervention for peer mediation and mother-child interaction: The effects on children’s mediated learning strategies and cognitive modifiability

The effects of intervention for peer mediation and mother-child mediated learning experience (MLE) strategies on children’s MLE strategies and cognitive modifiability (CM) was investigated on a sample of 100 mother–child dyads. CM was examined in domains of executive functions and analogical reasoning. The MLE interactions were analyzed by Observation for Mediated Interaction (OMI) scale. Children of high- and low-mediating mothers were assigned to experimental (n = 49) and control (n = 51) conditions. The experimental group received a peer-mediation program and the control groups received an alternative creativity program. The children (in Grade 3) were assigned as mediators of learners (in Grade 1) and taught them analogical reasoning problems. The peer interaction was videotaped and analyzed by the OMI. All children were given dynamic assessment after the interaction. Children in the experimental group showed higher MLE strategies and CM than did children in the control condition. Mediators of low-MLE mothers in the experimental group showed greater CM than did mediators in the control group. Structural equation modeling analysis showed that mediators’ cognitive modifiability was explained by proximal factors of treatment, mothers’ quality of mediation (QM) and mediators’ QM; learners’ cognitive modifiability was explained by mediators’ QM. The findings were discussed in relation to the MLE theory and earlier findings.     

Academics’ perceptions of the benefits and challenges of self and peer assessment in higher education

Despite compelling evidence of its potential effectiveness, uptake of self and peer assessment in higher education has been slower than expected. As with other assessment practices, self and peer assessment is ultimately enabled, or inhibited, by the actions of individual academics. This paper explores what academics see as the benefits and challenges of implementing self and peer assessment, through the analysis of interviews with 13 Australian academics. Thematic analysis of our qualitative data identified seven themes of benefits and five challenges. Our academics showed strong belief in the power of self and peer assessment as formative assessment, contrary to past literature which has focussed on the accuracy of students’ marking. This paper therefore brings insights as to not only what academics value about self and peer assessment but also identifies potential inhibitors in practice. Recommendations are made about improving the design and implementation of self and peer assessment in higher education.