Reading,listening and feeling: audio feedback as a component of an inclusive learning culture at universities

Feedback on student performance is an important part of university assessment procedures. However, effective feedback is hampered by various obstacles. The growing heterogeneity of the student body increases these barriers, particularly with regard to the reception of feedback. One strategy to overcome these obstacles can be to communicate feedback in the form of audio files. The study presented here tested the possibilities of this procedure by giving students feedback, both as an audio file and in writing. The survey shows that some of the students find audio feedback particularly easy to assimilate, while others prefer written feedback. The aim of the study was to go beyond the level of simplistic evaluation (better–worse), and to be able to make more nuanced statements about the strengths and also the weaknesses of audio feedback. All the students stated that they felt the audio feedback was more personal and appreciative than the written feedback. It becomes clear that the different needs of students can best be catered for with a variety of forms of communication. Audio feedback cannot be considered a comprehensive solution to the different problems associated with feedback, but it can contribute to the development of an inclusive university.     

Audio feedback to physiotherapy students for viva voce: how effective is ‘the living voice’?

Assessment and feedback remains one of the categories that students are least satisfied with within the United Kingdom National Student Survey. The Student Charter promotes the use of various formats of feedback to enhance student learning. This study evaluates the use of audio MP3 as an alternative feedback mechanism to written feedback for physiotherapy students undergoing practical viva voce assessment. In a pilot and larger study, a total of 37 students and 4 tutors were surveyed regarding their views on the use of audio feedback, with response rates of 45 and 100%, respectively. The paper reports qualitative data supporting the use of audio feedback in this context to provide prompt, detailed feedback that clarifies understanding to the students.     

‘Are you listening please?’ The advantages of electronic audio feedback compared to written feedback

Feedback on students' work is, probably, one of the most important aspects of learning, yet students' report, according to the National Union of Students (NUS) Survey of 2008, unhappiness with the feedback process. Students were unhappy with the quality, detail and timing of feedback. This paper examines the benefits of using audio, as opposed to written, feedback in an attempt to overcome student criticisms. Using the Audacity audio software MP3 feedback files were created and sent to 60 students either via a VLE or email. The students were asked to complete an online survey on audio feedback. Twenty‐six students responded. The results were, generally, very positive. The use of audio feedback seemed to have overcome the problems reported by the NUS survey. Students are at least 10 times more likely to open audio files compared to collecting written feedback. The paper concludes with reflections, and advice, on introducing audio feedback.     

A written,reflective and dialogic strategy for assessment feedback that can enhance student/teacher relationships

In response to the shortcomings of current assessment feedback practice, this paper presents the results of a study designed to examine students’ and teachers’ experience of engaging in a written, reflective and dialogic feedback (WRDF) strategy. The strategy was designed to enhance the learning experience of students undertaking a large first-year core course at a regional Australian university in semester 2, 2012. The evaluation consisted of three components: student surveys pre- and post-WRDF; a student focus group post-WRDF; and a teacher survey post-WRDF. Participating students’ and teachers’ perceptions of the WRDF assessment feedback suggested that students value feedback highly, and show a preference for feedback combining written, reflective and dialogic processes. The research findings suggest that the WRDF framework can be utilised to address the immediate, practical problem of students’ and teachers’ dissatisfaction with the practice of assessment feedback. Thus, WRDF may be used to nurture teacher/student relationships and enhance the learning process. Although a relatively intensive process, the WRDF strategy can serve an integral role in enhancing feedback practices and supporting students.     

A longitudinal,quantitative study of student attitudes towards audio feedback for assessment

This paper reports on the findings of a three-year longitudinal study investigating the experiences of postgraduate level students who were provided with audio feedback for their assessment. Results indicated that students positively received audio feedback. Overall, students indicated a preference for audio feedback over written feedback. No statistically significant differences were found between male and female students’ attitudes, suggesting that both sexes held similar attitudes towards audio feedback. Students also indicated a preference for audio feedback that was recorded simply and returned promptly over delayed, more sophisticatedly recorded and edited feedback.     

Designing effective,contemporary assessment on a flipped educational sciences course

ABSTRACT

Evidence shows flipped learning increases academic performance and student satisfaction. Yet, often practitioners flip instruction but keep traditional curricula and assessment. Assessment in higher education is often via written exams. But these provide limited feedback and do not ask students to put knowledge into practice. This does not support the tenets of flipped learning. For two years, the author flipped instruction but retained traditional curricula and assessment. However, on the author’s current course, all three aspects were redesigned to better support flipped learning. The aim of this research is to test the effectiveness of this redesign regarding student engagement and satisfaction. Thus, it is asked: How, on this course, can meaningful, continuous assessment be provided as well as effective, personalized feedback, while staying in line with the philosophy of flipped learning? Action research took place from September 2016 to June 2017. Quantitative data from a student survey, and qualitative data from a research diary and student focus group were gathered. What emerged is: a little-and-often assessment approach is effective for learning and engagement; tasks must be authentic and test demonstration of knowledge, not memory; quality, not quantity, is key for student learning; and students desire individualized feedback.     

Audiotape feedback for essays in distance education

Students who were required to write three short essays for a university level course on photochemistry at the Open university of the Netherlands received either audio-cassette or written feedback on their essays. The students receiving the audio feedback described their experience as personal, enjoyable, complete and clear. Those receiving written feedback described their experience as adequate. The amount of time spent by instructors supplying the feedback differed minimally (X_audio=53 minutes per student; X_written=49 minutes) with the major difference lying in the amount of time spent in preparation. This difference, possibly attributable to novelty with audio as a mode for feedback, was not significant. The amount communicated to the students with audio feedback (per instructor) was significantly greater than the amount communicated with written feedback. There was no difference in the final grades for the two groups of students.Paul A. Kirschner received his Masters in Educational Psychology from the State University of Amsterdam. He has worked as educational technologist at the Open university of the Netherlands since 1983, primarily with the faculties of Natural Sciences and Engineering. Henk van den Brink received his Masters in Educational Psychology from the State University of Amsterdam, The Netherlands. He has worked at the Open university of the Netherlands since 1984 as an educational technologist, primarily with the Faculty of Economics. Marthie Meester received her Ph.D. in Chemistry from the State University of Amsterdam, The Netherlands. She has worked since 1983 at the Faculty of Natural Sciences of the Open university of the Netherlands as course team chair for a number of undergraduate and graduate level chemistry courses.     

A qualitative synthesis of video feedback in higher education

While written and audio feedback have been well-examined by researchers, video feedback has received less attention. This review establishes the current state of research into video feedback encompassing three formats: talking head, screencast and combination screencast. Existing research shows that video feedback has a high level of acceptability amongst both staff and students and may help strengthen student-marker relationships; however, the impact of video feedback on student learning outcomes is yet to be determined. In addition, current evidence is drawn largely from small-scale studies and self-reported data susceptible to the novelty effect. While video feedback appears to be a promising alternative to traditional written feedback for its relative relational richness, the medium continues to be primarily used for information transmission rather than dialogue. Further research is needed to establish how the medium of video influences the feedback process, its potential to facilitate dialogue and its effects on student learning.     

College students’ perception of e-feedback: a grounded theory perspective

The increasing prominence of technology has given rise to new ways for writing teachers to give feedback electronically. Specifically, this article focuses on electronic written feedback (e-feedback) given to a group of English-as-a-Second-Language (ESL) community college students. Although previous studies have investigated the effectiveness of different computer-mediated feedback practices (e.g. video feedback, audio feedback, multimodal feedback), there is a dearth of research which examines the effectiveness of e-feedback and lower-ability students’ perception of e-feedback in ESL post-compulsory writing classrooms which adopt a process writing approach. The present study, which aims to shed light on this research gap and inform ESL writing teachers’ feedback practices, investigates how feedback is given and attended to online by 93 students of an international community college in Hong Kong. Adopting grounded theory as the methodology and a tripartite definition of written feedback as the conceptual framework, the present study reports students’ perception of e-feedback on Google Docs from two sources: students’ written reflections and semi-structured, focus group interviews. Implications related to e-feedback practices are discussed.     

Peer Assessment Training in Teacher Education: Effects on performance and perceptions

The implementation of peer assessment receives much attention in teacher education. This paper reports the effects of peer assessment training on the performance of student teachers. Ninety-three student teachers were randomly assigned to control groups and experimental groups. The experimental groups were trained in defining performance criteria, giving feedback and writing assessment reports. This was done through peer assessment tasks that were embedded in a redesigned course. Analyses of data derived from peer assessment reports written by the students showed that the experimental groups surpassed the control groups in the quality of the assessment skill. As a result of the training, students from the experimental groups also scored significantly higher grades for the end products of the course than students from the control groups. The results of the questionnaire showed that all students were significantly more satisfied with the redesigned course.     

‘I like the sound of that’ – an evaluation of providing audio feedback via the virtual learning environment for summative assessment

This study aims to ascertain student and staff attitudes to and perceptions of audio feedback made available via the virtual learning environment (VLE) for summative assessment. Consistent with action research and reflective practice, this study identifies best practice, highlighting issues in relation to implementation with the intention of redesigning activities in the light of the findings. It utilises four case studies where audio feedback was provided to students using the Wimba voice authoring tool within Blackboard Learn+ for various types of summative assessment. The intention was to identify how and in what context audio feedback via the VLE is effective and why. The research was undertaken via a combination of techniques, including a student survey and staff reflective logs. The findings indicate that students liked the convenience, effectiveness, flexibility and personalised nature of this feedback, but raised concerns with some aspects of the technology. This paper also makes practical recommendations for the use of the feedback mechanism, focusing on the most effective use of the digital medium, and highlights directions for future research.     

Show and tell: Student and instructor perceptions of screencast assessment

This study addresses students’ and instructors’ perceptions of screencast assessment and compares this feedback method to traditional paper or digital text-based comments. Screencast assessment allows for asynchronous audio and visual commenting on student papers using screencast software. A pilot study using surveys of 39 students enrolled in lower-level composition classes and surveys of five composition instructors have indicated that screencast assessment promotes detailed and effective feedback on student writing. This feedback method reveals instructor's thought process while grading, and this transparency fosters student–teacher communication about writing. Screencast assessment changes the detail and types of comments, fostering an increased use of macro-level comments over micro-level concerns. The method does not necessarily save time grading but allows for feedback in the same amount of time. Because of the suggestion that students and instructors value screencast assessment, this study warrants a larger scale project in order to investigate the student preference for this feedback and whether the method leads to improvement in student performance.     

Improving the student learning experience through dialogic feed-forward assessment

Abstract

Assessment feedback from teachers gains consistently low satisfaction scores in national surveys of student satisfaction, with concern surrounding its timeliness, quality and effectiveness. Equally, there has been heightened interest in the responsibility of learners in engaging with feedback and how student assessment literacy might be increased. We present results from a five-year longitudinal mixed methods enquiry, thematically analysing semi-structured interviews and focus groups with undergraduate students who have experienced dialogic feed-forward on a course in a British university. We use inferential statistics to compare performance pre and post-assessment intervention. The assessment consisted of submitting a draft coursework essay, which was discussed and evaluated face-to-face with the course teacher before a self-reflective piece was written about the assessment process and a final essay was submitted for summative grading. We evidence that this process asserted a positive influence on the student learning experience in a number of inter-related cognitive and affective ways, impacting positively upon learning behaviour, supporting student achievement and raising student satisfaction with feedback. We advocate a cyclic and iterative approach to dialogic feed-forward, which facilitates learners’ longitudinal development. Programme teams should offer systematic opportunities across curricula for students to understand the rationale for and develop feedback literacy.     

Investigating expectations and experiences of audio and written assignment feedback in first-year undergraduate students

Previous research suggests that audio feedback may be an important mechanism for facilitating effective and timely assignment feedback. The present study examined expectations and experiences of audio and written feedback provided through turnitin for iPad^® from students within the same cohort and assignment. The results showed that although initially sceptical of audio compared to written feedback, there were no significant differences in students' experiences of audio and written feedback. Students' performance on the assignment was not associated with their experiences of audio feedback but first-class performing students (?>?70%) had more positive experiences of written feedback than those who received an upper second-class grade (60–69%). In general, the results imply that audio feedback provided through turnitin for iPad^® is a viable alternative to written feedback. The findings are discussed in relation to past research findings.     

Effects of communities of reflecting peers on student‐teacher development – including in‐depth case studies

Despite continuing interest in teacher reflection and an extensive body of research on peer assessment, the interaction between these areas has not been sufficiently investigated. This study on reflection and peer feedback is part of an ongoing action research addressing the design and pedagogical model of a theoretically oriented teacher training course. The course comprised face‐to‐face lessons followed by written reflections of the student‐teachers concerning their learning experiences. These reflections were presented for peer feedback – thereby initiating a community of reflecting peers (‘co‐reflection’) – and were additionally subjected to instructor feedback under two conditions (full vs. diluted). Student‐teachers’ perception of their professional development that resulted from these co‐reflecting communities were quantitatively evaluated (using a self‐reported questionnaire) over a three‐year period. An enhanced positive effect over the three‐year period was found – regardless of the instructor feedback condition – as well as significant differences between parallel groups (higher for science vs. mathematics student‐teachers). These are described in the first part of the paper, followed by an in‐depth case study analysis in the second section. The case studies reported inclusive analysis of the students’ written reflections and feedback. It provides an insight into the processes of co‐reflection, identifies changes over time in the quality of reflections and feedback, as well as in the personal, professional and social development of the student‐teachers, attempting to identify the mechanisms leading to these changes. Examples are cited to illustrate the ways in which the students developed and what activated their motivation for development. The case studies reveal two developmental models, one of external orientation and the other internal. These are characterized by a willing receiver and willing donor, respectively. The importance of a ‘maturity interval’, when the student is ‘ripe’ for developmental change, was also demonstrated. Offering an appropriate trigger at this mature point may stimulate crucial development. Teacher development is further interpreted in terms of interpersonal variables. The current paper may encourage teacher educators and student‐teachers themselves to incorporate co‐reflecting in their course planning and community planning. Ways may be designed to train student‐teachers to offer and use feedback effectively. For feedback to be valuable, it should be reinforcing, challenging, thorough and sincere, radiate faith, and be of a friendly nature – it should be non‐insulting and non‐judgemental. They may be used for in‐text as well as summary remarks.     

Using screen capture feedback to improve academic performance

Feedback is an effective instructional practice for improving achievement. The importance of feedback has been understood by teachers for many years, yet recent research has elevated its status. One characteristic of effective feedback is personalized comments, which assist students in understanding their performance. Most research analyzes the effects of written feedback. Some current studies have examined the effects of alternative delivery methods, such as audio. One new approach for creating and delivering feedback is through screen capture technology. A case study was conducted to examine the effects of this method on the academic performance of 36 undergraduate students in a teacher education course. Results showed that screen capture feedback is effective for guiding corrections on a writing assignment. Students also reported that feedback was useful for knowing what they were doing right or wrong and that they would prefer more feedback of this type.     

Self-regulation of learning and preference for written versus audio-recorded feedback by distance education students

Teacher feedback is critically related to student learning. This study sought to determine the relationships between distance education (DE) student level of self-regulated learning (SRL) and their preference for audio-recorded vs. written feedback from tutors. DE students (n = 102) enrolled in a first-year university course completed an online questionnaire that assessed eight dimensions of SRL as well as a personal evaluation of written vs. audio-recorded tutor feedback that was provided during the academic study period. In general, the participating DE students expressed preference for written over audio-recorded feedback. However, complex patterns of relationships emerged between dimensions of SRL and evaluation of written vs. audio-recorded feedback. For example, DE students who were most likely to listen to audio-recorded feedback appreciated peer interaction and personal challenges more than students who preferred written feedback. In DE learning environments, a variety of feedback formats may best meet the needs of all students, although exposure to various technologies may facilitate SRL.     

Understanding the role of students’ reflections in their uptake of teacher written feedback

This study reports on the role of students’ reflections in their teacher written feedback. Informed by a qualitative case study approach, this study collected data from 18 students across a semester of an English-as-a-foreign language writing course at a university in China. In the course, teacher written feedback and students’ reflections were both informed by writing as a meaning-making process. The data sources included 72 pieces of student essays, 144 pieces of reflection written by the students, and post-semester interviews with the students. The study showed that engaging students in writing reflections was helpful for developing their knowledge of writing, although the process somewhat followed a zigzag trajectory. The exercise helped them transcend their previous knowledge repertoires, thereby assisting them in critically understanding their revision process and refining their knowledge of writing in response to the teacher’s written feedback. In particular, the students felt that the meaning-making-based reflections provided clear and accessible layers for them to understand the close relationship between language and content. As such, the students felt that they were able to harness their reflections as a written venue through which they could critically digest the teacher’s written feedback and develop their knowledge of writing as a meaning-making process while dialoguing with their instructor.     

To do or not to do with feedback. A study of undergraduate students’ engagement and use of feedback within a portfolio assessment design

Feedback is important for student learning; however, research shows that students can have a number of difficulties when attempting to learn from feedback. Based on an in-depth analysis of undergraduate students’ self-reported reflection logs, we present findings about students’ experiences with oral and written feedback and how they act upon this feedback when a portfolio is the main assessment and learning tool. Our findings indicate that, within our context, students’ overall experiences with receiving feedback are positive. Oral feedback was perceived as particularly valuable to the students while written feedback challenged their understanding. We identified four specific actions the students engaged in to create meaning from the feedback: internal feedback, using oral feedback, initiating dialogue and interacting with peers. The findings indicate that the students take responsibility in the feedback process. The findings are discussed in relation to current perspectives on feedback in higher education.