Constructive content-based feedback in EAP contexts: lessons from a cross-border engineering-related pre-sessional course

This paper investigates a small-scale project concerned with establishing and sustaining an e-partnership between international students in the UK and engineering students in Palestine. It focuses on the value of peer teaching and learning as an attempt to ensure a greater balance between knowledge and language on a UK pre-sessional English language course, by involving more able peers from a Gazan student body. At the same time, it was hoped that such an arrangement would enable the Gazan students to develop a range of transferable skills, of use in accessing employment at a distance. The article initially outlines the wider context to the Project, discussing the issues related to instituting peer learning/teaching schemes in an HE setting. At its centre though is the presentation and evaluation of a constructive feedback course, whose design and delivery aimed at facilitating the development of skills needed to perform as a peer mentor. It demonstrates students’ attitudes towards feedback and the strategies they use when asked to provide their peers with content feedback in an e-partnership. In this way, it provides food for thought to educators interested in developing similar cross-border schemes. Though the potential issues that emerge in terms of First World/Global South imbalance are very considerable, the paper suggests that telecollaboration projects of this nature may help overseas students start interrogating discipline-specific literacies, thus preventing the decontextualisation of the learner, including those unable to pay to study at a prestigious HE institution.     

An empirical review of anonymity effects in peer assessment,peer feedback,peer review,peer evaluation and peer grading

Abstract

Peer assessment has proven to have positive learning outcomes. Importantly, peer assessment is a social process and some claim that the use of anonymity might have advantages. However, the findings have not always been in the same direction. Our aims were: (a) to review the effects of using anonymity in peer assessment on performance, peer feedback content, peer grading accuracy, social effects and students’ perspective on peer assessment; and (b) to investigate the effects of four moderating variables (educational level, peer grading, assessment aids, direction of anonymity) in relation to anonymity. A literature search was conducted including five different terms related to peer assessment (e.g., peer feedback) and anonymity. Fourteen studies that used a control group or a within group design were found. The narrative review revealed that anonymous peer assessment seems to provide advantages for students’ perceptions about the learning value of peer assessment, delivering more critical peer feedback, increased self-perceived social effects, a slight tendency for more performance, especially in higher education and with less peer assessment aids. Some conclusions are that: (a) when implementing anonymity in peer assessment the instructional context and goals need to be considered, (b) existent empirical research is still limited, and (c) future research should employ stronger and more complex research designs.     

Exploring the value of peer feedback in online learning for the provider

This paper reviews studies of peer feedback from the novel perspective of the providers of that feedback. The possible learning benefits of providing peer feedback in online learning have not been extensively studied. The goal of this study was therefore to explore the process of providing online peer feedback as a learning activity for the provider. We concluded that (1) providing online peer feedback has several potential learning benefits for the provider; (2) when providing online peer feedback, students use different cognitive processes; (3) the cognitive processes and the potential learning benefits can be realised when students use specific elements in the feedback they provide.     

A new scholar's perspective on open peer review

This article argues that the pedagogical and scholarly benefits of open peer review far outweigh those of traditional double-blind peer review, but require a shift in our perspective of the function and value of peer review – from a gate-keeping process, toward a supportive, constructive process of collaboration between peers and mentors.     

The quality of written peer feedback on undergraduates’ draft answers to an assignment,and the use made of the feedback

The research described here investigated the quality and characteristics of peer feedback given on a draft piece of writing in the context of an undergraduate summative assignment. It also investigated whether the recipients made use of the feedback, with the aim of discovering whether some types of feedback were used in preference to others. The peer feedback was characterised in various ways, and then a comparison with the feedback subsequently given on the polished piece of writing by the tutor was used to determine the strengths and weaknesses of the peer feedback. Although the peers’ feedback had some different characteristics from that of the tutors, it was nevertheless of good quality. The examination of the use the recipients made of the feedback showed that much feedback was ignored. The use recipients made of the feedback depended very little on the characteristics of the feedback received, but did vary strongly across the recipients. The ability level of the recipients was not found to be a factor in this variation. The results of this research suggest that future work needs to focus more on students using feedback than on students giving feedback.     

A Dialogic Feedback Index measuring key aspects of feedback processes in online learning environments

Research on feedback shows the dialogic perspective as one that potentially promotes learning improvement. This article presents the Dialogic Feedback Index (DFI), a measure that contributes to establishing to what extent feedback design is potentially dialogic. Performing the study in an online context enabled us to evaluate the potential of the index to measure the institutional situation in relation to dialogic feedback. The applied case allowed us to identify four teaching and learning contexts whose designs range from low to high dialogic context. We were also able to establish three components which had a great impact in differentiating one context from another. Specifically, it was found that designing teaching and learning contexts with high levels of dialogic potential of feedback involves: (1) providing feedback before the task is completed, (2) incorporating peer feedback into the process and (3) allowing resubmission once the feedback has been received. The DFI is intended as an applied tool for teaching staff and institutions. With it they can determine the level of dialogic potential of feedback and plan how to improve it.     

The prospects and problems of African social studies teachers as action researchers: a spotlight on ghana

Several accounts concerning the systematic use of action research by eminent educators in the process of identifying and solving an educational problem(s) have appeared in professional journals. Thus, action research is gaining recognition by policy makers and educators as a tool for change However, this growing concept has not yet caught up in Ghanaian classrooms. This inaction needs to be addressed if education in Ghana is to be twenty-first century compliant. Thus, in attempting to shore up efforts to address the dearth of knowledge about action research as a tool for change, this article addresses the telling problems and the gains of undertaking action research in various educational systems in Africa, using Ghana as a case study. This article concludes with strategies about how to counteract the obstacles for the promotion of action research in Ghana.     

A GEARed peer feedback model and implications for learning facilitation

This study proposes a model to view and analyse college students’ written peer feedback after they assess each other’s formative task assignment and provide comments. The model was developed by: (a) revisiting learning-oriented assessment and feedback theories, (b) reviewing and summarising existing peer feedback analysis approaches as detailed in published empirical studies, and (c) analysing a small set of primary learner peer feedback data. In the proposed GEARed model of peer feedback, each complete piece of comment on one improvable unit may have four cognitive elements, i.e. identification of the Gap between performance and goal, Explanation of the gap, gap-bridging Aspirations, and being Resourceful to reach beyond the current knowledge/skill level. Two social-affective-interactive elements also play a part, i.e. being encouraging to the peer feedback receiver and doubtful toward the provider self. Each feedback comment may contain any or all of these incremental elements rather than being assigned only to one category. It is argued that the absent or unresolved aspects in feedback leave room for the receiver to reflect and may suggest instructional actions for teachers. Finally, different patterns of GEARed component combinations are hypothesised and their implications for learning and teaching are discussed.     

Leading Developmental Peer Observation of Teaching in Higher Education: Perspectives from Australia and England

Whilst peer observation of teaching is well established as a practice that can enhance teaching quality, the challenge to fully embed this practice in universities remains unresolved. This article analyses the perspectives of 18 university leaders (nine Australian and nine English) drawn from a range of school-based leaders to senior leaders of learning and teaching. Our study indicates that some of the challenges associated with leading such schemes can be mitigated through approaches to educational leadership that enact a respectful and collegiate ethos. This we suggest can support developmental academic engagement in peer observation for positive and lasting change.     

The road to self-assessment: exemplar marking before peer review develops first-year students’ capacity to judge the quality of a scientific report

Lack of clarity about assessment criteria and standards is a source of anxiety for many first-year university students. The Developing Understanding of Assessment for Learning (DUAL) programme was designed as a staged approach to gradually familiarise students with expectations, and to provide opportunities for the development of the skills required to successfully complete assessment tasks. This paper investigated the students’ perceptions of the first two components of the DUAL programme, which assist first-year biology students to engage with stated assessment criteria and standards in order to develop their capacity to make judgements about scientific report exemplars, their peers’ scientific reports and ultimately their own. The study found strong evidence (96% of responses) that the marking and discussion of exemplar reports with peers and demonstrators clarified expectations of scientific report writing. A key feature of this element of DUAL was the opportunity for structured discussion about assessment criteria and standards between peers and markers (demonstrators). During these discussions, students can clarify explicit statements and develop a tacit knowledge base to enhance their ability to judge the quality of others’ work and their own. The peer review exercise (the second element of DUAL) was not rated as highly, with 65% of students finding the process helpful for improving their report. The negative reactions by a sizeable minority of students highlight the need to clearly communicate the expectations and benefits of peer review, with a focus on how the process of giving feedback to peers might benefit a student as much as receiving feedback on their own report.     

Digital video for fostering self‐reflection in an ePortfolio environment

The ability to self‐reflect is widely recognized as a desirable learner attribute that can induce deep learning. Advances in computer‐mediated communication technologies have led to intense interest in higher education in exploring the potential of digital tools, particularly digital video, for fostering self‐reflection. While there are reports pointing to the salutary effects of digital video on learners’ reflective ability, a systematic inquiry into how digital video can be utilized to promote self‐reflection in an ePortfolio context remains under‐reported. In this paper, we pose two questions: (1) Do students have the confidence to create their own digital videos for reflection and do they find this activity relevant to their learning needs?; and (2) To what extent does digital video affect the level of self‐reflection and the nature of peer feedback? Results from this small‐scale exploratory case study provide evidence in support of video use as a reflective tool in an ePortfolio context and highlight the need for considering pedagogical and technological issues that are of significance for teachers, educators and ePortfolio developers.     

How does student peer review influence perceptions,engagement and academic outcomes? A case study

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we examined: (1) students’ perceptions of the peer review process before and after peer review, (2) content of the peer reviews and what kinds of feedback were adopted and (3) the effect of participation in peer review on performance (grades) in the assessment task. Students overwhelmingly perceived peer review to be beneficial, and the opportunity to participate in peer review resulted in a significant improvement in the quality of work submitted for assessment. Students who benefited most from peer review were those of below-median performance, and the magnitude of benefit was related to the degree to which students engaged with the peer review process. Our study confirms that participation in peer review can lead to important improvements in performance and learning outcomes.     

大学英语写作教学中同伴反馈模式的运用

如何提高学生的英语写作水平是困扰广大师生的一个难题。近年来,在大学英语写作教学的课堂上采用同伴反馈进行教学的模式得到广泛的支持,但仍有许多的教研人员和学生对它持怀疑态度。本文通过讲述在英语教学中采用同伴反馈的原因,及其存在的潜在问题,阐明了只要在活动之前做好充分的准备,就能将同伴反馈活动中存在的问题降到最低限度,它的益处也就能得到充分的发挥。     

The quality of peer assessment in a wiki-based online context: a qualitative study

Peer assessment (PA) provides opportunities for authentic assessment, autonomy and collaboration. Several authors advocate that students can benefit from PA and put forward the effects of PA on the students’ learning outcomes. Questions concerning the validity and reliability of PA and PA competences are also addressed by different researchers. This qualitative study is part of a wider project that seeks to develop and test evaluation and assessment strategies in online contexts. In a doctoral module, PA was used for summative and formative purposes. Formative PA aimed to give feedback about the ongoing group work, but also to increase online interaction between the different groups of students. The main module task was to write a literature review, about a selected topic, using a wiki. Criteria and indicators to assess the literature review were negotiated with the students. Different criteria were used to assess the quality of PA, such as, the use of the negotiated criteria, the adequacy of the chosen vocabulary or the provision of constructive feedback. The results show that overall the quality of PA can be improved. Groups did not provide sufficient criticism, questions and suggestions for improvement.     

A comparison of peer and tutor feedback

We report on a study comparing peer feedback with feedback written by tutors on a large, undergraduate software engineering programming class. Feedback generated by peers is generally held to be of lower quality to feedback from experienced tutors, and this study sought to explore the extent and nature of this difference. We looked at how seriously peers undertook the reviewing task, differences in the level of detail in feedback comments and differences with respect to tone (whether comments were positive, negative or neutral, offered advice or addressed the author personally). Peer feedback was also compared by academic standing, and by gender. We found that, while tutors wrote longer comments than peers and gave more specific feedback, in other important respects (such as offering advice) the differences were not significant.     

The impact of formative peer feedback on higher education students’ academic writing: a Meta-Analysis

Peer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’ writing performance. The current study conveyed two types of observations. First, regarding the impact of peer feedback on writing performance, this study synthesized the results of 24 quantitative studies reporting on higher education students’ academic writing performance after peer feedback. Engagement in peer feedback resulted in larger writing improvements compared to (no-feedback) controls (g?=?0.91 [0.41, 1.42]) and compared to self-assessment (g?=?0.33 [0.01, 0.64]). Peer feedback and teacher feedback resulted in similar writing improvements (g?=?0.46 [-0.44, 1.36]). The nature of the peer feedback significantly moderated the impact that peer feedback had on students’ writing improvement, whereas only a theoretically plausible, though non-significant moderating pattern was found for the number of peers that students engaged with. Second, this study shows that the number of well-controlled studies into the effects of peer feedback on writing is still low, indicating the need for more quantitative, methodologically sound research in this field. Findings and implications are discussed both for higher education teaching practice and future research approaches and directions.     

Using peer feedback in a Master's programme: a multiple case study

This article draws on the findings of a longitudinal case study, which investigated the writing experiences of five students who spoke English as an additional language (EAL). The major interest was in examining what it was like to be an EAL writer and what changes occurred in EAL students' perceptions of academic writing and of themselves as academic writers during their one-year Taught Masters course at a major UK University. This article reflects on the perceptions of peer feedback held by research participants and their engagement with providing and receiving peer comments. Although peer feedback is often viewed as an attractive tool for supporting student writing, most participants did not fully capitalise on the benefits of these practices. Such factors as students' lack of prior peer feedback and their perceptions of peers' ability to provide valid feedback constituted potential barriers to the success of peer feedback. The article suggests that the use of well-structured collaborative activities and tutors' intervention are required for peer feedback to be effective.     

同级反馈在大学英语写作教学中的运用

随着过程教学法被引入到英语写作领域,同级反馈逐渐得到提倡.学习者之间的互相评改有助于充实原稿内容,提高质量,推动有效修改,帮助学习者在写作中开发自主意识.本文主要从同级反馈的理论背景,英语写作教学中实行同级互评的重要意义,以及如何有效的训练学生进行同级反馈等几个方面进行了探讨.     

Comparative efficacy of group and individual feedback in gross anatomy for promoting medical student professionalism

Professionalism is a core competency of medical training that requires students to develop the skills of providing and receiving feedback. Our study evaluated the effectiveness of delivering feedback in a group setting compared with an individual setting. The first‐year class of Mayo medical students (n = 49) enrolled in gross anatomy (in dissection teams), completed weekly anonymous evaluations of themselves and their teammates regarding seven aspects of professionalism (altruism, compassion, respect, honesty/integrity, responsibility, commitment to excellence, and self‐reflection). Professionalism scores from these surveys were calculated using a six‐point Likert scale. Students were also asked to comment on strengths and possible areas for improvement on each peer. At the midpoint of the course, peer comments and professionalism scores were shared with students in debriefing sessions either individually or with their team. Analysis of preintervention and postintervention professionalism scores indicated that the students receiving feedback in a one‐on‐one setting (student and instructor) were more likely to demonstrate higher scores on subsequent evaluations as compared with those students receiving feedback in a group setting (all team members and one instructor). Our findings suggest that providing feedback to first‐year medical students on an individual basis is the best way to improve professional attitudes and behaviors. Anat Sci Educ 3: 64–72, 2010. © 2010 American Association of Anatomists.     

国内近十年二语写作书面反馈研究之述评

书面反馈是国外二语写作研究的热点,近年来在国内也兴起了一股研究热潮。本文从该研究的发展阶段、反馈类型及其有效性和教师反馈与同伴反馈之比较三个方面对近十年发表在核心期刊的相关文章展开述评,指出已有研究的不足和未来的研究方向。