Show and tell: Student and instructor perceptions of screencast assessment

This study addresses students’ and instructors’ perceptions of screencast assessment and compares this feedback method to traditional paper or digital text-based comments. Screencast assessment allows for asynchronous audio and visual commenting on student papers using screencast software. A pilot study using surveys of 39 students enrolled in lower-level composition classes and surveys of five composition instructors have indicated that screencast assessment promotes detailed and effective feedback on student writing. This feedback method reveals instructor's thought process while grading, and this transparency fosters student–teacher communication about writing. Screencast assessment changes the detail and types of comments, fostering an increased use of macro-level comments over micro-level concerns. The method does not necessarily save time grading but allows for feedback in the same amount of time. Because of the suggestion that students and instructors value screencast assessment, this study warrants a larger scale project in order to investigate the student preference for this feedback and whether the method leads to improvement in student performance.     

‘I like the sound of that’ – an evaluation of providing audio feedback via the virtual learning environment for summative assessment

This study aims to ascertain student and staff attitudes to and perceptions of audio feedback made available via the virtual learning environment (VLE) for summative assessment. Consistent with action research and reflective practice, this study identifies best practice, highlighting issues in relation to implementation with the intention of redesigning activities in the light of the findings. It utilises four case studies where audio feedback was provided to students using the Wimba voice authoring tool within Blackboard Learn+ for various types of summative assessment. The intention was to identify how and in what context audio feedback via the VLE is effective and why. The research was undertaken via a combination of techniques, including a student survey and staff reflective logs. The findings indicate that students liked the convenience, effectiveness, flexibility and personalised nature of this feedback, but raised concerns with some aspects of the technology. This paper also makes practical recommendations for the use of the feedback mechanism, focusing on the most effective use of the digital medium, and highlights directions for future research.     

The Effect of Selected Media Feedback upon the Interactive Behavior of Student Teachers

Abstract

The problem involved in this study was to ascertain whether student teachers receiving supervisory feedback with the aid of video and/or audio tape replay demonstrate a greater change in their classroom verbal interactive behavior than student teachers who receive supervisory feedback with no video or audio feedback. Evidence indicates that those receiving video feedback utilize less “direct teaching influence” and more “indirect teaching influence” as categorized by Flanders’ Verbal Interaction Analysis System, Within the audio group, the magnitude of change in the student teachers’ instructional behavior was not statistically significant. The magnitude of the directional change was greater for those students receiving video or audio recorded feedback than the magnitude of change in the control group.     

Audio feedback to physiotherapy students for viva voce: how effective is ‘the living voice’?

Assessment and feedback remains one of the categories that students are least satisfied with within the United Kingdom National Student Survey. The Student Charter promotes the use of various formats of feedback to enhance student learning. This study evaluates the use of audio MP3 as an alternative feedback mechanism to written feedback for physiotherapy students undergoing practical viva voce assessment. In a pilot and larger study, a total of 37 students and 4 tutors were surveyed regarding their views on the use of audio feedback, with response rates of 45 and 100%, respectively. The paper reports qualitative data supporting the use of audio feedback in this context to provide prompt, detailed feedback that clarifies understanding to the students.     

Hearing you loud and clear: student perspectives of audio feedback in higher education

The use of audio feedback for students in a full-time community nursing degree course is appraised. The aim of this mixed methods study was to examine student views on audio feedback for written assignments. Questionnaires and a focus group were used to capture student opinion of this pilot project. The majority of students valued audio feedback as more detailed, personalised and supportive than written feedback. Lecturers were also consulted about their experience of audio feedback and its place within current assessment strategies. Further development of this innovative assessment feedback strategy and its integration into a post-registration nursing course is considered.     

Audio and Written Comments in an Online Undergraduate Composition Class: Student and Instructor Approaches and Preferences

This study investigated students’ and instructors’ approaches and preferences to audio and written comments in an online undergraduate composition class. A mixed-method design was employed utilizing both a survey instrument and interviews for data collection. Forty-nine students and five instructors participated. Students gave more positive ratings to audio comments than to written comments on global- and middle-level items. However, their impressions on the comprehensibility of audio and written comments at the micro level were mixed. Instructors showed a preference for audio comments over written comments in terms of time investment. In addition, instructor commenting styles and the medium used influenced the time invested in providing comments     

Investigating expectations and experiences of audio and written assignment feedback in first-year undergraduate students

Previous research suggests that audio feedback may be an important mechanism for facilitating effective and timely assignment feedback. The present study examined expectations and experiences of audio and written feedback provided through turnitin for iPad^® from students within the same cohort and assignment. The results showed that although initially sceptical of audio compared to written feedback, there were no significant differences in students' experiences of audio and written feedback. Students' performance on the assignment was not associated with their experiences of audio feedback but first-class performing students (?>?70%) had more positive experiences of written feedback than those who received an upper second-class grade (60–69%). In general, the results imply that audio feedback provided through turnitin for iPad^® is a viable alternative to written feedback. The findings are discussed in relation to past research findings.     

‘Are you listening please?’ The advantages of electronic audio feedback compared to written feedback

Feedback on students' work is, probably, one of the most important aspects of learning, yet students' report, according to the National Union of Students (NUS) Survey of 2008, unhappiness with the feedback process. Students were unhappy with the quality, detail and timing of feedback. This paper examines the benefits of using audio, as opposed to written, feedback in an attempt to overcome student criticisms. Using the Audacity audio software MP3 feedback files were created and sent to 60 students either via a VLE or email. The students were asked to complete an online survey on audio feedback. Twenty‐six students responded. The results were, generally, very positive. The use of audio feedback seemed to have overcome the problems reported by the NUS survey. Students are at least 10 times more likely to open audio files compared to collecting written feedback. The paper concludes with reflections, and advice, on introducing audio feedback.     

Reading,listening and feeling: audio feedback as a component of an inclusive learning culture at universities

Feedback on student performance is an important part of university assessment procedures. However, effective feedback is hampered by various obstacles. The growing heterogeneity of the student body increases these barriers, particularly with regard to the reception of feedback. One strategy to overcome these obstacles can be to communicate feedback in the form of audio files. The study presented here tested the possibilities of this procedure by giving students feedback, both as an audio file and in writing. The survey shows that some of the students find audio feedback particularly easy to assimilate, while others prefer written feedback. The aim of the study was to go beyond the level of simplistic evaluation (better–worse), and to be able to make more nuanced statements about the strengths and also the weaknesses of audio feedback. All the students stated that they felt the audio feedback was more personal and appreciative than the written feedback. It becomes clear that the different needs of students can best be catered for with a variety of forms of communication. Audio feedback cannot be considered a comprehensive solution to the different problems associated with feedback, but it can contribute to the development of an inclusive university.     

Expectations of and Attitudes toward Counseling: A Comparison of Asian International and U.S. Graduate Students

This study examined Asian international graduate students’ expectations of and attitudes toward counseling by using U.S. graduate students as a comparative reference group. Survey data from 189 Asian international and 186 U.S. students were subject to analyses. Results indicated that Asian international students, in comparison with U.S. students, indicated less exposure to counseling, less self-perceived need for counseling, greater discomfort/shame with counseling, less openness to counseling, a greater preference for a directive style, and a greater preference for a flexible counseling format. Language and cultural concerns were barriers to seeking counseling. Implications for culturally responsive services were discussed.     

Curtailing marking variation and enhancing feedback in large scale undergraduate chemistry courses through reducing academic judgement: a case study

Variation in marks awarded, alongside quality of feedback, is an issue whenever large-scale assessment is undertaken. In particular, variation between sessional teaching staff has been studied for decades resulting in many recorded efforts to overcome this issue. Attempts to curtail variation range from moderation meetings, extended training programmes, electronic tools, automated feedback or even audio/video feedback. Decreased marking variation was observed whenever automated marking was used, potentially due to less academic judgment being used by the markers. This article will focus on a case study of three interventions undertaken at Monash University that were designed to address concerns around the variability of marking and the feedback between sessional teaching staff employed in the chemistry teaching laboratories. The interventions included the use of detailed marking criteria, Excel marking spreadsheets and automated marked Moodle reports. Results indicated that more detailed marking criteria had no effect whilst automated processes caused a consistent decrease. This was attributed to a decrease in the academic judgment markers were expected to use. Only the Excel spreadsheet ensured the provision of consistent feedback to students. Sessional teaching staff commented that their marking loads were reduced and the new methods were easy to use.     

Self-regulation of learning and preference for written versus audio-recorded feedback by distance education students

Teacher feedback is critically related to student learning. This study sought to determine the relationships between distance education (DE) student level of self-regulated learning (SRL) and their preference for audio-recorded vs. written feedback from tutors. DE students (n = 102) enrolled in a first-year university course completed an online questionnaire that assessed eight dimensions of SRL as well as a personal evaluation of written vs. audio-recorded tutor feedback that was provided during the academic study period. In general, the participating DE students expressed preference for written over audio-recorded feedback. However, complex patterns of relationships emerged between dimensions of SRL and evaluation of written vs. audio-recorded feedback. For example, DE students who were most likely to listen to audio-recorded feedback appreciated peer interaction and personal challenges more than students who preferred written feedback. In DE learning environments, a variety of feedback formats may best meet the needs of all students, although exposure to various technologies may facilitate SRL.     

Developing a framework for effective audio feedback: a case study

The increase in the use of technology-enhanced learning in higher education has included a growing interest in new approaches to enhance the quality of feedback given to students. Audio feedback is one method that has become more popular, yet evaluating its role in feedback delivery is still an emerging area for research. This paper is based on a small-scale study which examined the perceptions of first and final-year undergraduates who received feedback from tutors in audio form and considers the impact of this method of feedback delivery as a formative process. The paper examines the extent to which students respond to and engage with audio feedback, and how the method might facilitate a better understanding of the role of feedback amongst teachers and students alike. The two cohorts in the study express differences, but also commonalities in what they require from audio feedback. A conceptual framework is developed from the study’s findings, which highlights best practice and guides practitioners in their effective utilisation of this form of feedback.     

Undergraduate students’ attitudes towards mistakes in learning and academic achievement

The objective of the present study was to better understand a relatively under-researched topic, namely, undergraduate students’ attitudes towards mistakes and how their attitudes relate to academic achievement. A series of online surveys were administered to a sample of 207 first- and second-year undergraduate students. Using structural equational modelling, a hypothesised model was proposed to evaluate the following four research questions: (1) What is the effect of students’ trust in their instructor on students’ achievement goals? (2) What is the relationship between students’ achievement goals and their attitudes towards mistakes? (3) Is students’ attitudinal behaviour towards mistakes predictive of their perception of feedback? (4) Is students’ openness to discussing mistakes (ODM) and attitudinal behaviours predictive of their academic achievement? Both direct and indirect effects were found. Direct effects indicated that students’ trust in their instructor predicted achievement goals, students’ achievement goals differentially predicted attitudes towards mistakes, students’ ODM predicted perceptions of feedback, and students’ attitudinal behaviours predicted academic achievement. Students’ trust in their instructor and achievement goals had indirect effects on students’ achievement.     

Feedback seeking behaviour in higher education: the association with students’ goal orientation and deep learning approach

To make sure that feedback fulfils its aspirations, students’ active role in feedback should be acknowledged in higher education: It is students’ uptake of feedback that determines its effectiveness. In this study, feedback seeking behaviour of students is introduced in order to enrich our knowledge about students’ active role in feedback. Goal orientation was studied as antecedent of feedback seeking behaviour, and students’ deep learning approach as a mediating factor. Results indicated that students use both monitoring and inquiry strategies of feedback seeking, but they preferred monitoring. The association between feedback seeking behaviour and goal orientation was stronger for mastery goals than for performance goals. The preference for monitoring is stronger for students with more performance goal orientation. Deep learning approach was found to be a mediator in the relationship between goal orientation and feedback seeking behaviour. It can be concluded that students with the goal to learn from the activity will use more deep learning strategies and will seek more feedback, both in an active and passive way. This effect is less present for students with performance goals.     

Fast and effective feedback: are model answers the answer?

Feedback to students is essential for effective learning, but there is little empirical information on what kind of feedback is best. This study compares student responses and performance after receiving two types of feedback, that provided by model answers and that provided by personal comments. In 2004 and 2005, a total of 183 students in first and honours years biology courses were provided with both types of feedback, and their perceptions and preferences were explored using a questionnaire. The examination marks of 155 students were analysed, comparing scores in questions relating to personal and model feedback given earlier in the course. Questionnaire results showed that a majority of students wanted both kinds of feedback, but that there was a preference for personal over model feedback. However, there were highly significant differences between the mean marks achieved in examinations, with students performing better in model answer questions in both 2004 and 2005. These results suggest that the best approach might be a hybrid one, drawing on the strengths of both kinds of feedback.     

Grudges and gratitude: the social-affective impacts of peer assessment

Abstract

Students’ dissatisfaction with peer assessment has been widely documented. While most relevant literature places focus on the cognitive (content and uptake of feedback) or structural (feedback design) dimensions, students’ emotions in peer assessment have received scant attention. This study investigates the social-affective impacts of peer assessment by analysing students’ appeal letters addressed to their tutors, reflective posts in the online discussion forum and responses to a survey. A thematic analysis of data indicated three main aspects of students’ (dis)satisfaction: content, scores and process of peer assessment. The most negative emotion that students expressed was related to ‘disrespectful’ behaviour and attitudes of peer reviewers, whereas the feeling of appreciation was triggered by the helpful feedback attributes which were perceived as reflecting reviewers’ respect to others’ works. Students generally held mixed feelings toward peer assessment, valuing learning in the process of providing and receiving feedback but showing resistance to using peer assessment for summative purposes. The findings highlight the significance of respect in peer assessment and argue that the perceived lack of mutual respect seems to underpin the nature of students’ dissatisfaction. This study carries implications for nurturing students’ respectful attitudes and behaviour in and through peer assessment.     

Using online peer assessment in an Instructional Technology and Material Design course through social media

This study was designed to investigate the student teachers perceptions about and benefits and challenges of using Facebook as an online peer assessment tool for the student teachers’ works. The study group included 24 student teachers in science education department of a state university located in the southeast region of Turkey. A case study approach of the qualitative method was employed in the research. Semi-structured interviews were conducted to collect the data. The interviews were audio recorded, and records of all the interviews were transcribed into full text in Turkish. Collected data were analyzed using an emergent coding approach. Codes, then, were categorized to constitute themes and subthemes. The findings indicated that the student teachers were able to give objective feedback on their peers’ work and engaged more actively in class after participating in online peer assessment. Additionally, the students found it exciting and productive to use Facebook as a peer assessment tool in their learning.     

Use of the ‘Stop,Start, Continue’ method is associated with the production of constructive qualitative feedback by students in higher education

Students in higher education are increasingly asked to give feedback on their education experience, reflecting an increase in the importance attached to that feedback. Existing literature demonstrates that qualitative student feedback is valued and important, yet there has been limited evaluation of the means by which qualitative student feedback is collected, and how collection method influences the depth of feedback from students. We evaluated the depth of feedback written by students on programmes at three different universities in the United Kingdom, using an established evaluation instrument. We found that the use of a structured pro forma (Stop, Start, Continue) was associated with feedback of greater depth than that produced using free text entry. We then evaluated the effect of switching from a free text to a structured pro forma at one institution and found, again, that the structured pro forma was associated with feedback of greater depth. In addition, students indicated a preference for the structured pro forma.     

Are they using my feedback? The extent of students’ feedback use has a large impact on subsequent academic performance

Feedback is known to have a large influence on student learning gains, and the emergence of online tools has greatly enhanced the opportunity for delivering timely, expressive, digital feedback and for investigating its learning impacts. However, to date there have been no large quantitative investigations of the feedback provided by large teams of markers, feedback use by large cohorts of students, nor its impact on students’ academic performance across successive assessment tasks. We have developed an innovative online system to collect large-scale data on digital feedback provision and use. Our markers (n = 38) used both audio and typed feedback modalities extensively, providing 388 ± 4 and 1126 ± 37 words per report for first- and second-year students, respectively. Furthermore, 92% of first year and 85% of second-year students accessed their feedback, with 58% accessing their feedback for over an hour. Lastly, the amount of time students spent interacting with feedback is significantly related to the rate of improvement in subsequent assessment tasks. This study challenges assertions that many students do not collect, or use, their feedback. More importantly, we offer novel insights into the relationships between feedback provision, feedback use and successful academic outcomes.