What makes for effective feedback: staff and student perspectives

Since the early 2010s the literature has shifted to view feedback as a process that students do where they make sense of information about work they have done, and use it to improve the quality of their subsequent work. In this view, effective feedback needs to demonstrate effects. However, it is unclear if educators and students share this understanding of feedback. This paper reports a qualitative investigation of what educators and students think the purpose of feedback is, and what they think makes feedback effective. We administered a survey on feedback that was completed by 406 staff and 4514 students from two Australian universities. Inductive thematic analysis was conducted on data from a sample of 323 staff with assessment responsibilities and 400 students. Staff and students largely thought the purpose of feedback was improvement. With respect to what makes feedback effective, staff mostly discussed feedback design matters like timing, modalities and connected tasks. In contrast, students mostly wrote that high-quality feedback comments make feedback effective – especially comments that are usable, detailed, considerate of affect and personalised to the student’s own work. This study may assist researchers, educators and academic developers in refocusing their efforts in improving feedback.     

Using Performance Feedback To Decrease Classroom Transition Time And Examine Collateral Effects On Academic Engagement

Performance feedback has been described as a necessary component of consultation. Although feedback has been used to improve academic performance of individual students, less research has examined the effects on classroom academic engagement when implementation of classroom management variables is the source of feedback. Using a multiple-baseline design, the effects of performance feedback with goal setting was examined across three high school biology teachers who were first provided with feedback on the number of seconds devoted to transitions and then successful implementation of classroom time management strategies. Feedback on the number of transition minutes alone led to decreases in transition time and corresponding increases in student academic engagement for all teachers. One teacher benefited from additional feedback on classroom time management strategies. For all teachers, low rates of transition time and high rates of academic engagement were maintained when the intervention was faded and after it was terminated.     

Assessment of situated orality: the role of reflection and revision in appropriation and transformation of research ethos

In this study, we aim to investigate how students on a cross-disciplinary postgraduate course in research communication describe the formative peer feedback they have received on their oral presentations and what impact they report it has had on their performance. The study is based on a qualitative analysis of 36 transcribed video recordings from the course. Our findings show that the students, through their reflections and revisions, clearly demonstrate to have appropriated and, in some cases, also transformed the course content: they were able to select parts of the feedback relevant to their development and redefine some of the concepts to suit rhetorical situations. Surprisingly, feedback on deficits in student presentations resulted both in reflection and revision, while affirmatory feedback resulted, if at all, in reflection only. These results may help develop effective educational tools for assessment of oral performances in higher education.     

An interaction of screen colour and lesson task in CAL

Colour is a common feature in computer‐aided learning (CAL), though the instructional effects of screen colour are not well understood. This investigation considers the effects of different CAL study tasks with feedback on posttest performance and on posttest memory of the lesson colour scheme. Graduate students (n=68) completed a computer‐based vocabulary lesson that included either multiple‐choice or constructed‐response study tasks with feedback. Each lesson section used a different colour theme, while the posttest did not use colour. The constructed‐response study task was a little more effective for posttest memory of lesson content but was substantially less effective for posttest memory of the lesson colour scheme. These results show a clear interaction of screen colour and lesson study task, a memory‐context effect. The practical and theoretical implications of these findings are discussed.     

Inducing mind sets in self‐regulated learning with motivational information

The way students perceive a learning climate (e.g. controlling or stimulating) is significantly influenced by feedback and assessment. However, at present much is unclear about the relation between feedback and motivational state. More specifically, the interplay with student characteristics is unclear. Since there is a strong increase of group work, the central research question is what are the effects of positive, neutral or negative feedback presented to collaborating teams of students, on students’ intrinsic motivation, performance and on group processes? One hundred thirty‐eight higher education students participated in this study. There were no significant differences in performance across conditions. Multi‐level analysis enabled a detailed comparison between groups and individual members of groups. Amongst others, it was found that feelings of competence facilitate the effect of positive feedback at the group level, which suggests that positive feedback boosts interest especially in groups of highly competent students.     

Reading,listening and feeling: audio feedback as a component of an inclusive learning culture at universities

Feedback on student performance is an important part of university assessment procedures. However, effective feedback is hampered by various obstacles. The growing heterogeneity of the student body increases these barriers, particularly with regard to the reception of feedback. One strategy to overcome these obstacles can be to communicate feedback in the form of audio files. The study presented here tested the possibilities of this procedure by giving students feedback, both as an audio file and in writing. The survey shows that some of the students find audio feedback particularly easy to assimilate, while others prefer written feedback. The aim of the study was to go beyond the level of simplistic evaluation (better–worse), and to be able to make more nuanced statements about the strengths and also the weaknesses of audio feedback. All the students stated that they felt the audio feedback was more personal and appreciative than the written feedback. It becomes clear that the different needs of students can best be catered for with a variety of forms of communication. Audio feedback cannot be considered a comprehensive solution to the different problems associated with feedback, but it can contribute to the development of an inclusive university.     

The impact of formative peer feedback on higher education students’ academic writing: a Meta-Analysis

Peer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’ writing performance. The current study conveyed two types of observations. First, regarding the impact of peer feedback on writing performance, this study synthesized the results of 24 quantitative studies reporting on higher education students’ academic writing performance after peer feedback. Engagement in peer feedback resulted in larger writing improvements compared to (no-feedback) controls (g?=?0.91 [0.41, 1.42]) and compared to self-assessment (g?=?0.33 [0.01, 0.64]). Peer feedback and teacher feedback resulted in similar writing improvements (g?=?0.46 [-0.44, 1.36]). The nature of the peer feedback significantly moderated the impact that peer feedback had on students’ writing improvement, whereas only a theoretically plausible, though non-significant moderating pattern was found for the number of peers that students engaged with. Second, this study shows that the number of well-controlled studies into the effects of peer feedback on writing is still low, indicating the need for more quantitative, methodologically sound research in this field. Findings and implications are discussed both for higher education teaching practice and future research approaches and directions.     

Principles of CBI Design and the Adult Learners The Need for Further Research

The increasing use of computer-based instruction in performance improvement/HRD is accompanied by a growing need for guidelines directing its effective design and use. Current CBI research has limitations that have not been addressed. Research deficiencies include a limited number of studies in many areas, contradictory findings, and questionable generalizability to adults in the workplace due to an almost exclusive use of college age and younger students as research subjects. This article examines principles of CBI design found in the performance improvement/HRD literature and their applicability to adults in the workplace. Five major areas are discussed: learner control, feedback, screen design, use of group methods, and computer anxiety. CBI designers are urged to be cautious in adopting current research guidelines. Further research on CBI for adults in the workplace is urged.     

How accurately can students evaluate the quality of self-generated examples of declarative concepts? Not well,and feedback does not help

Students are commonly asked to learn declarative concepts in many courses. One strategy students report using involves generating concrete examples of abstract concepts. If students have difficulties evaluating the quality of their generated examples, then instructors will need to provide students with appropriate scaffolds or feedback to improve judgmentaccuracy. No prior research has investigated if students can accurately evaluate the quality of the examples they generate, which was the first aim of the current research. The second aim of this research was to investigate the extent to which providing feedback while students evaluate their generated examples can improve the accuracy of their example-quality judgments. In two experiments, students generated examples for declarative concepts from social psychology and then judged the quality of their examples. When making judgments, students received no feedback (in which they were only given the key term), full definition feedback (in which they were shown the definition of the declarative concept) or idea unit feedback (in which they first evaluated if they represented each idea unit of the definition within their example). Outcomes showed that students were overconfident when judging the quality of their examples, specifically for commission errors (i.e., examples that were entirely incorrect). Surprisingly, full definition and idea unit feedback did not help students improve the accuracy of their example-quality judgments. Thus, until scaffolds are discovered to reduce student overconfidence, instructors will need to assist in evaluating generated examples as students use this strategy to learn declarative concepts.     

Perceived teacher feedback and academic performance: the mediating effect of learning engagement and moderating effect of assessment characteristics

Abstract

The aim of this study was to determine the mediating effect of learning engagement on the relationship between perceived teacher feedback and college students’ academic performance, and the moderating effect of assessment characteristics on the relationship between perceived teacher feedback and learning engagement. A sample of 2,458 students in a university in mainland China was studied. Results indicated that perceived teacher feedback had a positive impact on students’ academic performance; learning engagement had a mediating effect on the relationship between perceived teacher feedback and students’ academic performance; and assessment frequency, difficulty and diversity had moderating effects between perceived teacher feedback and learning engagement. With the three factors of high frequency, difficulty and diversity assessment, perceived teacher feedback was more likely to improve students’ learning engagement. In contrast, feedback without these three factors could decrease or have no impact on students’ learning engagement. This indicates that teacher feedback indirectly affects college students’ academic performance by promoting their learning engagement, and is more effective when the frequency, difficulty or diversity of assessments is high.     

Exploring the Impact of Assessment on Medical Students’ Learning

Abstract

What and how students learn depend largely on how they think they will be assessed. This study aimed to explore medical students’ perception of the value of assessment and feedback on their learning, and how this relates to their examination performance. A mixed methods research design was adopted in which a questionnaire was developed and administered to the students to gain their perceptions of assessments. Perceptions were further explored in focus group discussions. Survey findings were correlated with students’ performance data and academic coordinators’ perceptions. Students’ perceptions of the level of difficulty of different assessments mirrored their performance in examinations, with an improvement observed in clinical assessments as students progressed through their degree. Students recognised that feedback is important to allow improvements and seek more timely, better quality and personalised feedback. Academic coordinators identified that some of the students’ suggestions are more realistic than others. Students had a positive attitude towards assessment, but emphasised the need for educators to highlight the relevance of assessment to clinical practice.     

Developing a framework for effective audio feedback: a case study

The increase in the use of technology-enhanced learning in higher education has included a growing interest in new approaches to enhance the quality of feedback given to students. Audio feedback is one method that has become more popular, yet evaluating its role in feedback delivery is still an emerging area for research. This paper is based on a small-scale study which examined the perceptions of first and final-year undergraduates who received feedback from tutors in audio form and considers the impact of this method of feedback delivery as a formative process. The paper examines the extent to which students respond to and engage with audio feedback, and how the method might facilitate a better understanding of the role of feedback amongst teachers and students alike. The two cohorts in the study express differences, but also commonalities in what they require from audio feedback. A conceptual framework is developed from the study’s findings, which highlights best practice and guides practitioners in their effective utilisation of this form of feedback.     

PowerPoint slide provision and student performance: the moderating roles of self-efficacy and gender

Research on the pedagogical value of providing students with PowerPoint (PPT) slide handouts has produced mixed results. One reason for the inconsistent findings may be that most studies in this stream of research have neglected to examine individual differences. In the current study, we aimed to advance research on the pedagogical value of providing students with access to PPT slide handouts by examining whether self-efficacy and gender influence the effect of PPT slide provision on academic performance. We found no evidence to suggest that the provision of slide handouts has broad, unconditional pedagogical value. Instead, we found that both self-efficacy and gender moderated the extent to which the availability of the handouts enhanced or hindered students’ performance. As predicted, both students high on self-efficacy and males performed significantly better when they were provided with handouts. Conversely, students low on self-efficacy performed significantly worse when the handouts were provided. Female students also trended toward lower performance when the handouts were provided. Additionally, we found that students who were provided with PPT handouts perceived their instructor as more effective, and that this relation was mediated by students’ feeling of preparation. Finally, students also considered the provision of PPT handouts more valuable to their learning and course performance than one-to-one interactions with the professor. Implications for research and practice are discussed.     

Control of feedback in computer-assisted instruction

Although considerable research has been conducted on both learner control and feedback, very little research has addressed the effect of giving learners control over the feedback that they receive. The purpose of this study was to examine the effect of learner control over feedback in a CAI lesson. Subjects used one of four CAI programs which provided either program control or learner control over verification or elaboration feedback. Results indicated that subjects who received elaboration feedback during instruction performed better than students who received verification feedback. Type of control did not have a significant influence on performance. However, when subjects selected feedback for items answered incorrectly during instruction, subjects under learner control/elaboration performed better on the posttest than subjects under learner control/verification. Implications for the design of CAI are discussed.     

The anonymous reviewer: the relationship between perceived expertise and the perceptions of peer feedback in higher education

Peer feedback often has positive effects on student learning processes and outcomes. However, students may not always be honest when giving and receiving peer feedback as they are likely to be biased due to peer relations, peer characteristics and personal preferences. To alleviate these biases, anonymous peer feedback was investigated in the current research. Research suggests that the expertise of the reviewer influences the perceived usefulness of the feedback. Therefore, this research investigated the relationship between expertise and the perceptions of peer feedback in a writing assignment of 41 students in higher education with a multilevel analysis. The results show that students perceive peer feedback as more adequate when knowing the reviewer perceives him/herself to have a high level of expertise. Furthermore, the results suggest that students who received feedback from a peer who perceives their expertise as closer to the reviewee’s own perceived expertise was more willing to improve his or her own assignment.     

Can performance feedback during instruction boost knowledge acquisition? Contrasting criterion-based and social comparison feedback

Feedback indicating how well students are performing during a learning task can be very stimulating. In this study with a pre- and post-test design, the effects of two types of performance feedback on learning results were compared: feedback during a learning task was either stated in terms of how well the students were performing relative to other students (social comparison feedback) or relative to an absolute criterion (criterion-based feedback). Thirty-four students in secondary vocational engineering education were randomly assigned to one of two conditions. In both conditions, students worked together in small groups. All groups completed a math learning task, during which they received either social comparison feedback or criterion-based performance feedback. The findings showed that the type of feedback had a strong effect on learning outcomes: the post-test scores and gains of students in the social comparison condition were significantly higher than those of students in the criterion-based feedback condition.     

Student perceptions of quality feedback in teacher education

Many reports have identified a perceived lack of quality in regard to assessment feedback in higher education contexts. One research study in 2007 on undergraduate university students found that less than half of the students (46%) collected their formative feedback, suggesting that from their perspective feedback clearly was not fulfilling the role it should. This is a study of 465 graduate students and 101 undergraduate students studying teacher education at a major Australian university. The study investigated what students perceived to be effective, quality feedback based upon their extensive higher education experiences. Students identified preferences in regard to form, detail and timing of assessment feedback. The data were collected by means of pen and paper survey and identified which strategies the students perceived to be the most effective, particularly within the context of large cohort teaching and written assessment formats. Findings agreed with research elsewhere regarding problems with assessment feedback quality and quantity, but students also provided clear indications of how realistic improvements could be made in terms of assessment feedback processes and strategies.     

同伴互评在翻译教学中的应用效果及其教学法意义

本研究旨在探讨同伴互评在翻译教学中的应用效果。研究对象是20 名英语专业高年级的学生。研究者首先对受试进行一定的培训,随后收集同伴互评的相关数据,此后随机挑选6名 学生进行访谈。结果表明：同伴互评行之有效;同伴评论的利用率很高;修改后的译文质量有显著提高;翻译的方向对同伴互评的效果无明显影响;学习者对互评机制持积极态度。将同伴互评应用到翻译教学中来,有利于培养学习者的自主 学习与合作学习的能力,强化校改意识并提高翻译质量,以及促成我国的翻译教学向以过程为取向过渡。     

The Additional Effects of Process and Outcome Feedback Following Brief In‐service Teacher Training

Three primary school teachers attended a half‐day, in‐service training workshop which targeted instructional and managerial behaviours identified as being functionally related to students’ academic engaged behaviours in class. Following the workshop, daily observations showed only temporary changes in the teachers’ and their students’ behaviours with trends back towards baseline measures. After this period of ‘no feedback’, three conditions of in‐class performance feedback were introduced in different sequences to each teacher: outcome feedback (based on measures of a sample of their students’ academic engaged behaviour during lessons), process feedback (based on measures of the teachers’ own instructional behaviours), and a combination of both outcome and process feedback.

A time‐series, multiple baseline across subjects design was employed which allowed comparison of measures of teachers’ and students’ behaviours during the immediate post‐workshop period and during periods of the three types of feedback. The results showed that the introduction of performance feedback had the immediate (and cumulative) effect of increasing the behaviours targeted in the workshop to high rates that were maintained even when feedback was withdrawn. There were, however, no differences in the comparative efficacy of outcome, process or outcome/process combination effects.

The study builds upon existing research which has shown performance feedback to be an essential component of effective professional development and staff training packages that target workplace behaviour change. It also adds to the limited research that has examined the efficacy of different types of performance feedback and suggests other variables, such as who presents the feedback, may be important.     

过程英语写作中自我监控技巧运用的个案研究

自我监控技巧能使学生控制所得到的教师反馈,并且能促使教师形成有效的反馈。教师根据学生提问的要点形成直接且合适的反馈。本文采用了实证研究的方法探讨自我监控技巧在大学英语过程写作中的应用及其对写作的影响。结果表明,学生能够通过训练掌握该技巧;在写作中使用该技巧有助于教师了解学生存在的问题和想法,使学生更可能地控制所得到的教师反馈;自我监控技巧尤其对提高学生的写作组织能力有益。