Assessment,feedback and marking guides in distance education

In higher education (HE), effective feedback on student assessments plays a vital role in retention and in the development of self‐regulating learners, particularly in the first year. In distance learning, where large population modules are common, assignment feedback is generally supported by standard marking guides, issued to the numerous tutors responsible for assessing student work. In this paper, we develop a taxonomy of feedback and report on the results of a survey of tutor attitudes to, and strategies for, providing feedback on a very large Level 1 Open University module. We analyse the extent to which the marking guides afford adequate support for truly effective feedback, and make a number of recommendations for reworking assessment regimes and marking guides.     

The quality of guidance and feedback to students

The paper presents research findings on students’ experiences of the provision both of guidance and feedback, and with respect to examinations as well as coursework assignments. A first‐ and a final‐year bioscience course unit were surveyed in each of three contrasting university departments. The resulting dataset comprised 782 completed student questionnaires and 23 group interviews with a total of 69 students. Although the questionnaire data provided a robust overall picture of the students’ perceptions of guidance and feedback across the six units, the interview data made possible a much finer‐grained analysis of their experiences. At the core of this analysis was a guidance and feedback loop, within which six interrelated steps have been picked out, beginning with the students’ prior experiences of cognate assessments and closing with the potential of what has been learned from a given task to feed forward into subsequent work. By pinpointing potential troublespots, the framework can serve as a valuable diagnostic as well as analytical tool.     

Impact of feedback request forms and verbal feedback on higher education students’ feedback perception,self-efficacy,and motivation

ABSTRACT

In higher education, students often misunderstand teachers’ written feedback. This is worrisome, since written feedback is the main form of feedback in higher education. Organising feedback conversations, in which feedback request forms and verbal feedback are used, is a promising intervention to prevent misunderstanding of written feedback. In this study a 2 × 2 factorial experiment (N = 128) was conducted to examine the effects of a feedback request form (with vs. without) and feedback mode (written vs. verbal feedback). Results showed that verbal feedback had a significantly higher impact on students’ feedback perception than written feedback; it did not improve students’ self-efficacy, or motivation. Feedback request forms did not improve students’ perceptions, self-efficacy, or motivation. Based on these results, we can conclude that students have positive feedback perceptions when teachers communicate their feedback verbally and more research is needed to investigate the use of feedback request forms.     

The challenges of feedback in higher education

Abstract

Assessment feedback is one of the most important components of the learning process. However, student and educator dissatisfaction with feedback practices continues to remain a significant problem in higher education. To better understand the barriers to effective feedback, the present study explores feedback challenges identified by 3807 students and 281 educators from two Australian universities. Open-response data were analysed using an inductively derived coding framework and thematic analysis. The findings reveal three major themes relating to the challenges of feedback from the perspective of students and educators: feedback practices, contextual constraints and individual capacity. In addition to confirming the persistence of many previously reported challenges in the literature, this paper also offers insights into challenges that are particular to feedback, especially relating to the production of useful comments and the perceived hurdles of both student and educator attitudes and capabilities. The findings also highlight the constrained nature of educators’ work, particularly in relation to time. While further research is needed, we propose that feedback needs to be understood as an interaction between practices, context and individuals.     

Self-regulation of learning and preference for written versus audio-recorded feedback by distance education students

Teacher feedback is critically related to student learning. This study sought to determine the relationships between distance education (DE) student level of self-regulated learning (SRL) and their preference for audio-recorded vs. written feedback from tutors. DE students (n = 102) enrolled in a first-year university course completed an online questionnaire that assessed eight dimensions of SRL as well as a personal evaluation of written vs. audio-recorded tutor feedback that was provided during the academic study period. In general, the participating DE students expressed preference for written over audio-recorded feedback. However, complex patterns of relationships emerged between dimensions of SRL and evaluation of written vs. audio-recorded feedback. For example, DE students who were most likely to listen to audio-recorded feedback appreciated peer interaction and personal challenges more than students who preferred written feedback. In DE learning environments, a variety of feedback formats may best meet the needs of all students, although exposure to various technologies may facilitate SRL.     

From copying to learning: using exemplars to engage students with assessment criteria and feedback

Feedback is central to pedagogic theory, and if feedback is to be effective, students need to engage with it and apply it at some point in the future. However, student dissatisfaction with feedback – as evidenced in the National Student Survey – suggests that there are problems which limit student engagement with feedback, such as their perception that much of their feedback is irrelevant to future assignments. This article reports on a study which sought to enhance engagement by giving students exemplar assignments annotated with feedback before submission of their final assignments. This was done by providing an online facility where students could view exemplars and post comments or questions to tutors and peers on a discussion board. The exemplar facility was highly valued by students, although there were no quantitative effects such as an increase in students’ assignment marks when compared with the previous cohort. The article reflects on possible reasons for this result and discusses ways to improve the exemplar facility, for example by facilitating dialogue between tutors and students. The article concludes with lessons learned about how to construct exemplars, and considers how exemplars might also be used within marking teams to improve consistency of marking.     

Making space for democracy through assessment and feedback in higher education: thoughts from an action research project in education studies

This paper reports on an action research project into the development of a ‘democratic feedback model’ with students on an education studies programme at a post-1992 university in the UK. Building on work that has explored the dialogic dimensions of assessment and feedback, the research explored the potential for more democratic practice in this area. Although much learning and teaching on the programme in question took a collaborative and dialogic approach, assessment and feedback were modelled entirely differently, around the concept of an ‘expert’ marker and ‘novice’ marked. The findings of the research indicate the elements necessary for ‘democratic feedback’, and illustrate the emotional impact of moving from more transmission-based models, grounded in notions of expertise, towards democratic practice. They also highlight the ways in which such work can alert students to the imperfect, messy and human nature of the assessment process. Although the model has limited applicability in its extant form, its constitutive elements might be usefully incorporated within existing practice to promote democratic learning.     

Transfer students in institutions of higher education

The primary purpose of this study is to describe the extent of college transfers over two years since initial matriculation and to examine differences in background characteristics between transfers and nontransfers (i.e., persisters, withdrawals, and graduates). Data involved a national probability sample of the 1972 entering class. Major findings include the following: 25% of the 2-year college students transferred to a 4-year institution, and 16% of 4-year college students moved to another 4-year institution. This later group of students tended to hold higher socioeconomic status and college grades but lower ability test scores than persisters. Implications of the findings are also discussed.     

Hearing you loud and clear: student perspectives of audio feedback in higher education

The use of audio feedback for students in a full-time community nursing degree course is appraised. The aim of this mixed methods study was to examine student views on audio feedback for written assignments. Questionnaires and a focus group were used to capture student opinion of this pilot project. The majority of students valued audio feedback as more detailed, personalised and supportive than written feedback. Lecturers were also consulted about their experience of audio feedback and its place within current assessment strategies. Further development of this innovative assessment feedback strategy and its integration into a post-registration nursing course is considered.     

Using technology to facilitate effective assessment for learning and feedback in higher education

The aims of this paper are to examine and critically evaluate a selection of different technological methods that were specifically chosen for their alignment with, and potential to enhance, extant assessment for learning practice. The underpinning perspectives are that: (a) both formative and summative assessment are valuable opportunities for learning, and (b) using technology may enhance learning in assessment and feedback processes. Drawing on the literature and empirical evidence from a research study in a Scottish university, the advantages and drawbacks of using technology are examined. It is asserted that, by adopting a flexible approach and taking small incremental steps, the use of different types of technology can be beneficial in facilitating effective assessment for learning and feedback in higher education.     

Special needs students in higher education

The topic in this paper is how former special needs students with academic competence from upper secondary school succeed in education on a higher level. The study concentrates on students who at their start in upper secondary education were registered with problems of concentration, difficulties in reading, writing or mathematics. The main part of this paper will base on qualitative interviews with nine former special needs students. Seven out of the nine informants were registered with reading and writing difficulties. However, it is also possible to compare these informants with longitudinal data from a larger group of students who have been followed prospectively since spring 1996. Theoretically the study is based on life course research with special emphasis on social transitions. In transitional processes between different educational arenas gatekeepers＇often play important roles. This study will examine how such gatekeepers, e.g. teachers, may facilitate or obstruct these transitions for a vulnerable group like former special needs students.     

Rethinking feedback practices in higher education: a peer review perspective

Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews or the learning mechanisms that this activates. Using accounts of their experiences of peer review, this study illuminates students’ perceptions of the different learning benefits resulting from feedback receipt and feedback production, and, importantly, it provides insight into the cognitive processes that are activated when students construct feedback reviews. The findings show that producing feedback reviews engages students in multiple acts of evaluative judgement, both about the work of peers, and, through a reflective process, about their own work; that it involves them in both invoking and applying criteria to explain those judgements; and that it shifts control of feedback processes into students’ hands, a shift that can reduce their need for external feedback. The theoretical and practical implications of these findings are discussed. It is argued that the capacity to produce quality feedback is a fundamental graduate skill, and, as such, it should receive much greater attention in higher education curricula.     

Taking a closer look at how higher education students process and use (discrepant) peer feedback

Little is known on how students process peer feedback (PF) and use it to improve their work. We asked 59 participants to read the feedback of two peers on a fictional essay and to revise it, while we recorded their gaze behaviour. Regarding the PF processing subphase, discrepant PF led to more transitions, but only for participants who reported the discrepancy afterwards. Counterintuitively, participants who did not report the discrepancy, showed longer first-pass reading times. Concerning the PF use subphase, dwell time on essay correlated positively with the quality of the revised essays assessed by professors. Participants with a high-quality revision spent more time addressing higher order comments, corrected one or two lower order aspects at a time and proofread in the end, in which they went beyond the suggestions provided in the PF. These insights can be used when designing training to foster students’ uptake of (discrepant) PF.     

UK initiatives to promote inclusion in higher education for students with disabilities

ABSTRACT

The inclusion in higher education of students with disabilities and learning difficulties has become a matter of concern within the past eight years. Recent Higher Education Funding Council initiatives to promote greater inclusion have had some success in improving access to higher education (HE) and raising awareness across the sector of the need to ensure full participation by students with disabilities in the learning environment once they enter the university. Hopes that the new UK disability rights legislation would help promote equality of access to HE were disappointed when it became apparent that the Disability Discrimination Act 1995 excluded education from its main provisions. The only requirement affecting post‐compulsory education is that institutions publish a statement on their provision for students with disabilities and learning difficulties. These disability statements confer no legal rights and it appeared that they would have little impact on access to HE for disabled people. This paper reports the findings of a survey of the anticipated effects upon the higher education sector in England of the requirement to produce disability statements. There may be some positive effects not only upon the nature and form of information available, but also on the provision offered in the sector.     

Student perceptions of quality feedback in teacher education

Many reports have identified a perceived lack of quality in regard to assessment feedback in higher education contexts. One research study in 2007 on undergraduate university students found that less than half of the students (46%) collected their formative feedback, suggesting that from their perspective feedback clearly was not fulfilling the role it should. This is a study of 465 graduate students and 101 undergraduate students studying teacher education at a major Australian university. The study investigated what students perceived to be effective, quality feedback based upon their extensive higher education experiences. Students identified preferences in regard to form, detail and timing of assessment feedback. The data were collected by means of pen and paper survey and identified which strategies the students perceived to be the most effective, particularly within the context of large cohort teaching and written assessment formats. Findings agreed with research elsewhere regarding problems with assessment feedback quality and quantity, but students also provided clear indications of how realistic improvements could be made in terms of assessment feedback processes and strategies.     

Oral presentations in higher education: a comparison of the impact of peer and teacher feedback

In this paper the authors analyse the competency of a sample of economics and business students in orally presenting academic content, as well as the changes that occurred after receiving feedback. The students’ presentations were videotaped, and a total of 96 were analysed at three stages: pre-test, post-test and follow-up. The participants were divided into two groups. In one, each student received feedback from a peer as part of a peer assessment with rubric activity. In the other, they received feedback from the teacher immediately after their presentation. In the post-test, the peer assessment with rubric students improved by 10% in the valuation of their presentation, while the teacher feedback students only improved by 5%. These results support the idea that undergraduates’ evaluations of their peers can be effective in improving oral presentation skills, especially when they are provided with some support instruments (videos and rubrics). However, the improvements in the peer assessment with rubric group were not maintained in the follow-up re-test. This suggests that a single session of peer assessment with rubric is insufficient to generalise any improvements in the said competency. The implications of these results with regard to the implementation of methods of formative peer assessment in higher education are discussed.     

An analysis of the effectiveness of feedback to students on assessed work

This paper presents the views of students, from a range of schools and disciplines, on the effectiveness of current assessment feedback practices at Flinders University. We also report on a workshop on feedback with teachers. Overall, individual written comments were found to be the most useful form of feedback. However, there was significant variation with the level of satisfaction with feedback and the relative usefulness of different forms of feedback across the different schools and disciplines. This research suggests both the need to improve the effectiveness of such feedback and to tailor the forms of feedback offered to students according to the distinctive teaching and learning environments in different schools and disciplines. To that end, innovation and further research on feedback are justified, and some suggestions are offered.     

Investigating non-engagement with feedback in higher education as a social practice

Quality in feedback processes rests on students’ engagement with them. A crucial question is therefore why students do not always engage. Scholars have defined engagement as a social practice, pointing to the influence of context but without explaining its nature. The purpose of this article is to argue that existing approaches without a theory of the social cannot fully explain non-engagement and that a practice theoretical approach may fill this gap. It introduces Stephen Kemmis' practice ontology and demonstrates how a feedback practice can be analysed to explain a weak engagement. The article’s contribution to research in engagement with feedback is a new ontology of practice and its methodological apparatus.