Developing a framework for effective audio feedback: a case study

The increase in the use of technology-enhanced learning in higher education has included a growing interest in new approaches to enhance the quality of feedback given to students. Audio feedback is one method that has become more popular, yet evaluating its role in feedback delivery is still an emerging area for research. This paper is based on a small-scale study which examined the perceptions of first and final-year undergraduates who received feedback from tutors in audio form and considers the impact of this method of feedback delivery as a formative process. The paper examines the extent to which students respond to and engage with audio feedback, and how the method might facilitate a better understanding of the role of feedback amongst teachers and students alike. The two cohorts in the study express differences, but also commonalities in what they require from audio feedback. A conceptual framework is developed from the study’s findings, which highlights best practice and guides practitioners in their effective utilisation of this form of feedback.     

Hearing you loud and clear: student perspectives of audio feedback in higher education

The use of audio feedback for students in a full-time community nursing degree course is appraised. The aim of this mixed methods study was to examine student views on audio feedback for written assignments. Questionnaires and a focus group were used to capture student opinion of this pilot project. The majority of students valued audio feedback as more detailed, personalised and supportive than written feedback. Lecturers were also consulted about their experience of audio feedback and its place within current assessment strategies. Further development of this innovative assessment feedback strategy and its integration into a post-registration nursing course is considered.     

A longitudinal,quantitative study of student attitudes towards audio feedback for assessment

This paper reports on the findings of a three-year longitudinal study investigating the experiences of postgraduate level students who were provided with audio feedback for their assessment. Results indicated that students positively received audio feedback. Overall, students indicated a preference for audio feedback over written feedback. No statistically significant differences were found between male and female students’ attitudes, suggesting that both sexes held similar attitudes towards audio feedback. Students also indicated a preference for audio feedback that was recorded simply and returned promptly over delayed, more sophisticatedly recorded and edited feedback.     

Content and timing of feedback in a web-based learning environment: effects on learning as a function of prior knowledge

This study investigated the effectiveness of different types of feedback content (elaborate versus global) and feedback timing (immediate versus delayed) for learning genetics in a web-based learning environment as a function of learners' prior knowledge. It was hypothesized that learning outcomes of students with low prior knowledge would be fostered by immediate elaborate feedback, whereas those of students with more prior knowledge would be enhanced by delayed global feedback. Students' perceptions of the feedback they received were explored. Results showed a significant positive effect of global feedback on learning outcomes for higher prior knowledge learners, although those who received elaborate feedback gave a higher appreciation rating. The findings are discussed in terms of implications for the design and delivery of feedback in web-based learning environments.     

A case study of inclusive school development: a journey of learning

A global recognition of students' rights requires school organizations to recognize, value and provide for diversity. The move towards more inclusive schooling in Queensland, Australia, requires schools to address professional development on two levels: reculturing of the school to reflect inclusive beliefs and values; and enhancement of teacher skills and knowledge to better address the learning needs of all students. The recently developed Index for Inclusion 2000) is one resource that can facilitate the process of professional development and facilitate change in school culture, policy and teaching practice. The process used incorporates a critical friend and peer mentoring model within an action research framework, which together provide benefits for all involved in the professional development process. The journey of learning incorporating the phases of the Index for Inclusion are reported along with discussions for future directions.     

Learner-focused evaluation cycles: facilitating learning using feedforward,concurrent and feedback evaluation

There is a growing trend to offer students learning opportunities that are flexible, innovative and engaging. As educators embrace student-centred agile teaching and learning methodologies, which require continuous reflection and adaptation, the need to evaluate students’ learning in a timely manner has become more pressing. Conventional evaluation surveys currently dominate the evaluation landscape internationally, despite recognition that they are insufficient to effectively evaluate curriculum and teaching quality. Surveys often: (1) fail to address the issues for which educators need feedback, (2) constrain student voice, (3) have low response rates and (4) occur too late to benefit current students. Consequently, this paper explores principles of effective feedback to propose a framework for learner-focused evaluation. We apply a three-stage control model, involving feedforward, concurrent and feedback evaluation, to investigate the intersection of assessment and evaluation in agile learning environments. We conclude that learner-focused evaluation cycles can be used to guide action so that evaluation is not undertaken simply for the benefit of future offerings, but rather to benefit current students by allowing ‘real-time’ learning activities to be adapted in the moment. As a result, students become co-producers of learning and evaluation becomes a meaningful, responsive dialogue between students and their instructors.     

Student access of online feedback is modified by the availability of assessment marks,gender and academic performance

We used educational data mining to quantify student access of online feedback files and explore the underlying drivers of feedback file access in a learning management system (LMS). We collated LMS access logs for 32 individual pieces of assessment representing 1462 feedback files for 484 students (males = 45%, females = 55%) that originated across three undergraduate years, from 20 different degree pathways. Over a third of assessment feedback files (38%, 553 files) were never accessed by students. When students could obtain their assessment mark without opening the associated feedback file, 42% of feedback files were not accessed by students (513 of 1224 files). When assessment marks were integrated into the feedback file (and not reported within the LMS), the proportion of unopened feedback dropped significantly to only 17% of files (40 of 238 files). We uncovered strong gender-specific differences in how students accessed feedback within the LMS that were dependent upon academic performance and the integration of marks within the feedback file. Poorly performing males were less likely to access feedback; however, integrating marks into the feedback files meant that males were over 27 times more likely to access the feedback file. In contrast, females exhibited a much weaker and more variable response to marks being reported within feedback files. Assessments with deadlines earlier in the semester were also viewed more often than those later in the semester.     

360 degree feedback: an integrative framework for learning and assessment

Feedback is widely acknowledged as the crux of a learning process. Multiplicities of research studies have been advanced to address the common cri de coeur of teachers and students for a constructive and effective feedback mechanism in the current higher educational settings. Nevertheless, existing pedagogical approaches in feedback are fragmented and ad hoc in nature. Taken in isolation, each approach fails to capture the full role and complexity of assessment feedback in the learning process. The paper provides a synthesis of existing practices in the field of assessment feedback and identifies the core guiding elements to develop a holistic and integrated feedback system. The 360 degree (360°) feedback system is proposed and its systematic implementation is demonstrated via the interplay between self-, peer and teacher assessment. It is concluded that the elements of 360° system when combined and integrated help to maximise the functions of feedback to enhance learning.     

Passive,active, and constructive engagement with peer feedback: A revised model of learning from peer feedback

To deepen understanding of learning through peer feedback, the current study investigated the relationships between different peer feedback activities (organized into constructive vs active activities) and learning (i.e., transfer to new tasks), examining the nature of activities within provided feedback, received feedback, and revisions in response to feedback. Across five US high schools, 367 students in Advanced Placement classes participated, implementing common assignments and peer assessment rubrics. Provided/received comments and revisions in one assignment, and writing improvements observed in a second assignment were exhaustively coded and subjected to hierarchical model regression analyses. Results showed that constructive activities (providing explanations and making revisions after receiving explanations or providing suggestions) were consistently associated with learning, whereas passive (e.g., receiving feedback without making revisions) or active activities (e.g., implementing specific suggestions) were not. Further, the effects of received feedback on learning were mediated by the number of revisions. Theoretical and practical implications of the findings are discussed.     

The synergy between research and practice: listening to the perspectives of key stakeholders about the development of an inclusive early years service

This paper analyses part of a consultation project a northern Early Years Development and Childcare Partnership (EYDCP) engaged with in the process of developing a charter for inclusion. This consultation included parents, families, service providers and service managers. Three main research strategies were employed including questionnaires, interviews and discussion groups. This project highlights the importance of listening to the various stakeholders and of allowing the voices of people at the sharp end of inclusive practice to be instrumental in the development of such services. Issues related to shared understandings of terminology and concepts, different perceptions of the drives for greater inclusive services, and the problematic nature of translating inclusive theory into practice in early years services for disabled children developed as important elements of this project. Although stakeholders enjoy some agreement regarding the philosophical notions of inclusion, there was some diversity in the perceptions of why inclusive services are being developed at all and also about how concepts of inclusion are translated into practice. Themes emerged about the organisation of an inclusive early years service relating to the 'adult factor' and the efficacy of a charter for inclusion. The partnership concluded that a pilot project following principles highlighted in this project was the next natural stage of developing a charter for inclusion: a charter of promises, rights and standards that is not rhetoric but realistic and, most importantly, is actually driven by the users and front-line service providers in the partnership.     

Written artefacts in post-conference feedback sessions: the running commentary as a support for teacher learning

Written artefacts often form a significant part of teacher education activities and play a crucial role in the dialogue between tutor and student teacher in a post-observation feedback session. However, although the dialogue of feedback sessions has been extensively researched, the role of the artefact has been less explored. This research examines how the written artefact of a running commentary guides or constrains the pedagogical conversation between tutor and student teachers, as well as how it represents the power and authority of the tutor and the teacher education establishment. The article concludes with implications for pre-service teacher education practice.     

Cultural dimensions of feedback at an Australian university: a study of international students with English as an additional language

International students with English as an additional language face transitional challenges when entering a new academic culture. One such challenge involves optimising feedback to help foster their academic development, bearing in mind that feedback is not a culturally neutral entity (Nazif, A., Biswas, D., &; Hilbig, R. (2004–2005). Towards an understanding of student perceptions of feedback. Carleton Papers in Applied Language Studies, 21/22, 166–192). The current study of 134 postgraduate international students examines pre-course and in-course perceptions, experiences and expectations of feedback at university in Australia. Responses to questionnaires and in focus groups revealed that students’ previous feedback experiences had largely been summative, with an emphasis on error correction, but they expected to receive more feedback, particularly formative, throughout their courses. They also had concerns about understanding feedback, and about potentially negative remarks. These concerns were partially borne out by a follow-up survey (n?=?43) in which only 29% said they understood everything their lecturers said. Teachers giving feedback to international students may, therefore, need to consider the nature of their comments, their method of delivery and how their feedback affects student development.     

Developing inclusive educators: enhancing the accessibility of teaching and learning in higher education

In light of the growing population of students with disabilities at colleges and universities worldwide, faculty development connected to accessible teaching is of paramount importance. Drawing from the existing literature and from the results of a qualitative study of educational accessibility at one Canadian university, this article offers a series of recommendations for academic developers hoping to establish effective development initiatives focused on accessible teaching and learning. Key issues considered include the need to support instructors in translating principles of inclusive teaching into practice, the value of discussion-based approaches that take up difficult questions about minimum standards, and the question of whether development initiatives should be discipline-specific or interdisciplinary, mandatory or optional. Recommendations for further research are also discussed.     

Relationships among sense of classroom community,perceived cognitive learning and satisfaction of students at an e-learning course

This study aims to determine whether there is a relationship between students' sense of community, perceived cognitive learning, and satisfaction in an e-learning course. Additionally, the relationship of these variables with Internet self-efficacy and final examination scores is investigated. The participants were 88 students enrolled in elementary level English as a Foreign Language course of the distance education program at a higher education institution in Turkey. The results of the study suggest that sense of community and course satisfactions are strongly related to each other. Moreover, students' course satisfaction is highly related to their perceived cognitive learning. Students' perceived cognitive learning was observed to have a very strong relationship with learner-to-content interaction, while learner-to-learner interaction was at medium level and learner-to-instructor interaction was weak.     

Establishing an inclusive educational system in Samara a partnership between West Lothian,Barnardo's and Samara

In this article Laura Ann Currie and Victoria Prudnikova describe a three–year Russian/Scottish partnership designed to take forward an inclusive educational policy in the Samara Region of Russia. Education staff from West Lothian Council and Barnardo's visited the Samara Region to train staff there to help take forward their inclusion programme. It was an ambitious project for our Russian colleagues. Their starting position was one where young disabled children were sent away to be ‘corrected’ in institutions miles from their family and friends. Disability was feared and shameful and the prevailing medical model presented philosophical and practical difficulties in taking forward an inclusive approach. Despite these difficulties colleagues in Samara have picked up the baton and are running with it. For West Lothian staff it has been an affirming, often humbling, but challenging experience.     

Technology enhanced learning as transformative innovation: a note on the enduring myth of TEL

ABSTRACT

The purpose of this paper is to offer a critical insight into the ubiquity of technology enhanced learning. The use of technology in higher education is underpinned by a promise that technology will enhance teaching and learning despite an apparent lack of systematic evidence. This raises questions of how this enhancement agenda persists, and of how technology has established a position of dominance within higher education. This orthodoxy is evident across a range of relevant actors, from commercial interests, universities, government, academics, and technologists. This paper utilises a critical logics approach, which problematises the competing interests of these different actors, exploring ways in which the social, political and fantasmatic practices between these actors contribute to the ubiquity and dominance of technology enhanced learning. This paper argues that the technology enhanced project resists in-depth critique, with the repeated failure of technology to transform education attributed towards academics, students and institutions.     

A review of thinking and research about inclusive education policy,with suggestions for a new kind of inclusive thinking

A range of changes, in politics and economics internationally as well as in thought about learning and society, now make the time right for a re‐think of inclusive education, a re‐think that ceases to employ the constructs and clichés of the past in explaining students' difficulties at school. There exists new discourse on difference, which throws fresh light on the ways that students at school are disadvantaged—there is a new psychology of difference emerging from work in varied social scientific fields that gives insights into the mechanisms by which inequality, relative poverty and contrastive judgment construct difficulty and closure on learning. In this review, both a history and a hope, I argue that no time has been better for such understandings to make themselves realized in policy and practice.     

Using mid-semester course evaluation as a feedback tool for improving learning and teaching in higher education

The way in which mid-semester course evaluations are structured, administered and reported is important for generating rich and high-quality student feedback for the enhancement of learning and teaching. Mid-semester evaluations usually contain open-ended questions that trigger more elaborative feedback about what is going on in a class than that from end-of-semester evaluations with Likert scale-type questions. The anonymity of the process for students and the confidentiality of the process for instructors make the process more reflective for students and less stressful for instructors. This study describes how the mid-semester course evaluation process can be used as a feedback tool for improving the quality of teaching and learning at an institutional level. Through a longitudinal analysis of 341 mid-semester course evaluation reports, positive areas and areas of concern with respect to learning and teaching were identified, and changes in student evaluations over the years were examined meticulously to make an overall evaluation of the quality of learning and teaching at a non-profit Turkish university. This research showed that the value of mid-semester course evaluations can go beyond course-level if we use open-ended questions and are able to gather the reports together to make some comprehensive analysis at university level.     

Measuring the perceived quality of an AR-based learning application: a multidimensional model

Augmented reality (AR) technologies could enhance learning in several ways. The quality of an AR-based educational platform is a combination of key features that manifests in usability, usefulness, and enjoyment for the learner. In this paper, we present a multidimensional model to measure the quality of an AR-based application as perceived by students. The model is specified by a second-order factor (perceived quality) and three dimensions: ergonomic quality, learning quality, and hedonic quality. The purpose of this model is to embody previous research into a coherent framework for the evaluation of AR-based educational platforms and to provide guidance for researchers and practitioners. The model was empirically validated on a Chemistry learning scenario and the results confirm the importance of both the learning and hedonic quality.     

Using statement banks to return online feedback: limitations of the transmission approach in a credit-bearing assessment

Electronic marking tools that incorporate statement banks have become increasingly prevalent within higher education. In an experiment, printed and emailed feedback was returned to 243 first-year students on a credit-bearing laboratory report assessment. A transmission approach was used, students being provided with comments on their work, but no guidance as to how they should use these remarks. A multiple-choice question test, undertaken before and after the return of feedback, was used to measure learning. Although returned comments included model answers, test scores showed no overall enhancement, even when students’ marks for their laboratory reports were initially hidden. A negative and significant (p = .010) linear trend between relative test scores and test date suggests that even modest improvements in subject knowledge were lost over time. Despite this, students could accurately guess their mark based on emailed feedback alone, estimated and awarded marks being linearly correlated (p < .001). It is concluded that statement banks organised according to published assessment criteria can ultimately help students to appreciate how their work was graded. However, students should be encouraged to produce a structured response to received feedback if self-assessment is to occur.