Feed-forward: students gaining more from assessment via deeper engagement in video-recorded presentations

Presentation feedback can be limited in its feed-forward value, as students do not have their actual presentation available for review whilst reflecting upon the feedback. This study reports on students’ perceptions of the learning and feed-forward value of an oral presentation assessment. Students self-marked their performance immediately after their presentation, after reviewing a video recording of their presentation and wrote a reflection relating to their experience. Survey data revealed that most students viewed all aspects of the assessment task positively and they rated the process as providing substantial learning value. They also indicated that the video review and overall assessment exercise provided valuable feed-forward information that would assist them to improve future presentations. These data were further supported by content analysis of the qualitative data. Students noted that they perceived the video review task as self-enabling. They also noted that the self-reflection and self-marking exercise provided time for thought although it was personally challenging. Therefore, via carefully designed assessment, it is possible to provide a deep learning opportunity from oral presentations that can feed-forward to enhance students’ future presentations.     

Effectively feeding forward from one written assessment task to the next

Most studies into lecturers’ written feedback focus on the types of feedback found to be effective when students have the opportunity to act on that feedback, revise their written assignment and improve the mark they receive. But often students do not have this opportunity. Typically, they receive a mark and feedback on an assignment that they will never be able to rework and resubmit. This can leave students unsure about what to do with the feedback they receive. This paper reports on the use of high impact written feedback from lecturers that significantly improved student outcomes and grades from one assessment task to the next. It examines a range of factors which together make feedback in this context effective including: assessment design, use of grading standards and tutor training. These findings from a very large unit have significant implications for teaching staff who want to use feedback to feed forward and make a real difference to their students’ learning.     

Master’s thesis projects: student perceptions of supervisor feedback

A growing body of research has investigated student perceptions of written feedback in higher education coursework, but few studies have considered feedback perceptions in one-on-one and face-to-face contexts such as master’s thesis projects. In this article, student perceptions of feedback are explored in the context of the supervision of master’s thesis projects, using review studies with respect to effective feedback in coursework situations. Online questionnaires were administered to collect data from three cohorts of master’s students who were either working on their thesis or had recently finished it (N?=?1016). The results of the study indicate that students perceive the focus of feedback in terms of a focus on task and self-regulation; they perceive the goal-relatedness of feedback in terms of feed up (goal-setting) and feed back-forward (how am I going and where to next?); and elaboration of feedback is perceived in terms of positive and negative feedback. Furthermore, students that perceive the feedback to be positive, and to provide information on how they are going and what next steps to take, are the most satisfied with their supervision and perceive they are learning most from their supervisor. The findings are discussed in relation to findings in coursework settings, and are explained using goal orientation theories.     

Improving the student learning experience through dialogic feed-forward assessment

Abstract

Assessment feedback from teachers gains consistently low satisfaction scores in national surveys of student satisfaction, with concern surrounding its timeliness, quality and effectiveness. Equally, there has been heightened interest in the responsibility of learners in engaging with feedback and how student assessment literacy might be increased. We present results from a five-year longitudinal mixed methods enquiry, thematically analysing semi-structured interviews and focus groups with undergraduate students who have experienced dialogic feed-forward on a course in a British university. We use inferential statistics to compare performance pre and post-assessment intervention. The assessment consisted of submitting a draft coursework essay, which was discussed and evaluated face-to-face with the course teacher before a self-reflective piece was written about the assessment process and a final essay was submitted for summative grading. We evidence that this process asserted a positive influence on the student learning experience in a number of inter-related cognitive and affective ways, impacting positively upon learning behaviour, supporting student achievement and raising student satisfaction with feedback. We advocate a cyclic and iterative approach to dialogic feed-forward, which facilitates learners’ longitudinal development. Programme teams should offer systematic opportunities across curricula for students to understand the rationale for and develop feedback literacy.     

Supporting writing for assessment in online learning

This article explores some specific issues involved in online learning and assessment. It draws on data from a postgraduate course for professional educators, delivered globally online, and highlights the relationship between students’ online discussion and their written assessed work, arguing that we need to focus on both of these in terms of the writing demands they make on students. In so doing it utilizes a theoretical framework which conceptualizes writing as contextualized social practice. The paper illustrates the complexity of the rhetorical demands being made on students in these new environments of teaching and learning and, in focusing on writing, complements present approaches to online learning which have, to date, tended towards collaborative and constructivist perspectives. The article highlights the relationship between pedagogy, technology and assessment. It concludes with a discussion of the design of an online writing resource to support student writers on this particular masters programme.     

Leveraging competency framework to improve teaching and learning: A methodological approach

A number of engineering education programs have defined learning outcomes and course-level competencies, and conducted assessments at the program level to determine areas for continuous improvement. However, many of these programs have not implemented a comprehensive competency framework to support the actual delivery and assessment of an individual course. This paper highlights how a competency framework can be used across the life cycle of a course to effectively deliver and assess course content, and give valuable, timely feedback to students thus, improving teaching, student motivation and learning. A framework for leveraging course competencies during course design and delivery is presented, and addresses the following five phases of a course, namely, content design, assessment design, content delivery and assessment, assessment results analysis and feedback, and content review. Using a large first-year core course of the BSc (Information Systems Management) program, at School of Information Systems, Singapore Management University, Singapore—called Information Systems Software Foundation (ISSF)—as an example, this paper shows how course competencies support the framework’s five phases. Data from a student survey indicates that the framework has contributed to enhancing their motivation to learn, provides enhanced learning experiences in terms of helping students prepare for each assessment, providing better feedback by raising awareness of what they know and do not know, and revisiting topics that relate to competencies that have not been fully acquired. Results from interviewing instructors revealed that the competency framework provides valuable and timely feedback on how students are performing, and additionally what changes are required to both the content and method of delivery in order to improve teaching. This contributes towards more effectively closing the “teaching and learning loop”.     

How student beliefs about knowledge and knowing influence their satisfaction with assessment and feedback

Students’ beliefs about the nature of knowledge and knowing frame how they interpret their educational experience and their approaches to, and perspectives on, learning, teaching and assessment. This paper draws on previous research identifying the ways of knowing of undergraduates on entry to a UK post-92 university, findings from which confirm the prevalence of absolute beliefs in which knowledge is viewed as certain, uncontested and students are largely authority-dependent. Student perspectives on assessment and feedback are explored based on thematic analysis of student responses within two main categories of beliefs, absolute/dualist versus contextual/pluralist. The paper teases out the implications of these perspectives for students’ satisfaction with their assessment and feedback experience in the context of today’s increasingly market-orientated higher education environment. Findings demonstrate that student perspectives on, and satisfaction with, assessment and feedback are strongly intertwined with their beliefs on knowledge and teaching. Students holding absolute/dualist beliefs considered ‘good’ assessment and feedback practice to entail clear and unambiguous assessment tasks, criteria and standards along with the receipt of unequivocal and corrective feedback. The paper concludes that faced with assessment tasks that move beyond established facts and demonstrable theories it may only be students who view knowledge as relative and mutable that will likely be satisfied with their assessment and feedback experience.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

Student voice in higher education: Opening the loop

UK national policy and the practices of university course boards tend to reduce understandings of ‘student voice’ to a feedback loop. In this loop, students express feedback, the university takes this on board, then they tell the students how they have responded to their feedback. The feedback loop is a significant element of the neoliberal imaginary of higher education globally. This qualitative research study drew on interviews with course representatives in three universities in England, and on policy analysis, to explore the discursive construction and enactment of student voice. It uses the feedback loop as an analytical frame. Drawing on Foucault’s later work, the article aims to open up the feedback loop by exploring its manifestation in the mundane everyday practices of universities. In opening the loop, we identify the following effects of the student voice policy ensemble: students have to construct feedback as it is not just waiting to be gathered; it promotes a dividing practice, where reps are positioned differently to other students; there is a focus on problems; an ‘us and them’ is reinforced between staff and students; the loop closes down discussion; and a managerial logic obscures political processes. The article articulates its opening of the loop as a way of unmasking the modes of power which work through discourses of ‘student voice’, and hence seeks to create possibilities for resistance to being governed this way.     

Comparing student learning experiences of in-text commentary and rubric-articulated feedback: strategies for formative assessment

This study compares students’ experiences of two types of criteria-based assessment: in-text commentary and rubric-articulated feedback, in an assessment design combining the two feedback channels. The main aim is to use students’ responses to shed light on how feedback strategies for formative assessment can be optimised. Following action research methodology, the study discusses key categories of student responses from three sources: reflective texts, a questionnaire, and interviews. Results show that different functions were attributed to the two feedback channels: in-text commentary to lower-order concerns related to language proficiency, and rubric-articulated feedback to higher-order concerns related to an overview of writing achievement. We argue that the different functions have the potential of creating a sufficiently balanced assessment design with the possibility of serving both short-term and continuous learning goals. On the other hand, some students found it difficult to navigate between the two feedback channels. The article therefore ends with a ‘lessons learned’ section where we list possible ways in which the current assessment design can be improved for optimal use of the synergy effects emanating from a combination of in-text commentary and rubric-articulated feedback for formative purposes.     

The development of student feedback literacy: enabling uptake of feedback

Student feedback literacy denotes the understandings, capacities and dispositions needed to make sense of information and use it to enhance work or learning strategies. In this conceptual paper, student responses to feedback are reviewed and a number of barriers to student uptake of feedback are discussed. Four inter-related features are proposed as a framework underpinning students’ feedback literacy: appreciating feedback; making judgments; managing affect; and taking action. Two well-established learning activities, peer feedback and analysing exemplars, are discussed to illustrate how this framework can be operationalized. Some ways in which these two enabling activities can be re-focused more explicitly towards developing students’ feedback literacy are elaborated. Teachers are identified as playing important facilitating roles in promoting student feedback literacy through curriculum design, guidance and coaching. The implications and conclusion summarise recommendations for teaching and set out an agenda for further research.     

Evaluate to improve: useful approaches to student evaluation

Many teachers in higher education use feedback from students to evaluate their teaching, but only some use these evaluations to improve their teaching. One important factor that makes the difference is the teacher’s approach to their evaluations. In this article, we identify some useful approaches for improving teaching. We conducted focus groups with award-winning university teachers who use student evaluations to improve their teaching, and we identified how they approach their evaluation data. We found that these teachers take a reflective approach, aiming for constant improvement, and see their evaluation data as formative feedback, useful for improving learning outcomes for their students. We summarise this as the improvement approach, and we offer it for other teachers to emulate. We argue that if teachers take this reflective, formative, student-centred approach, they can also use student evaluations to improve their teaching, and this approach should be fostered by institutions to encourage more teachers to use student evaluations to improve their teaching.     

The conundrum of low achievement and feedback for learning

Abstract

The literature on improving student engagement with assessment and feedback has a tendency to treat all students as if they are the same. Students with lower levels of attainment are generally under-represented within empirical studies and their feedback behaviours are less well understood. The recent drive to improve student assessment and feedback literacy and the move from ‘feedback’ being information about a task to being a process of understanding and using performance information is a larger conceptual leap for some students than others. In this paper, we consider issues surrounding the transition to new modes of feedback, focussing on what is needed for those who find study difficult and persistently are disappointed by their levels of attainment, to benefit from and take advantage of our feedback pedagogies. We examine literature advocating strategies such as increasing agency, using praise, developing feedback literacy and cultivating a growth mind-set. We argue that students who underachieve may benefit from strong relationships with educators and peers, exposure to feedback rich, low stakes environments, which permit repeated integrations of practice and feedback, and building feedback literacy through peer assessment activities.     

Understanding and using feedback – A review of empirical studies concerning feedback from external evaluations to teachers

To improve the quality of teaching, educational accountability needs to include periodic external evaluations of students’ performance. This requires evaluation formats which support the development of the educational process and provide information which is understandable for teachers. The aims of this study were to review: (i) how teachers understand the feedback they receive from external evaluations; (ii) how they use the feedback; and (iii) how teachers’ understanding and use of such feedback affects the achievement of their students. None of the papers included contained simultaneous a study with all three of these aspects of external evaluations; the review shows that teachers have many problems understanding feedback and mainly focus their use of it on developing strategic teaching tactics. Research that focuses on teachers’ understanding of external evaluation, their use of it, and how the use of the feedback can foster student achievement is needed.     

Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment

This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the training, students reviewed learning concepts, discussed marking criteria, graded example projects and compared their evaluations with the instructor’s evaluation. Data were collected in the form of initial and final versions of students’ projects, students’ scoring of example projects before and after the assessment training, and written feedback that students provided on peer projects. Results of data analysis indicate that the assessment training led to a significant decrease in the discrepancy between student ratings and instructor rating of example projects. In addition, the degree of student vs. instructor discrepancy was highly predictive of the quality of feedback that students provided to their peers and the effectiveness of revisions that they made to their own projects upon receiving peer feedback. Smaller discrepancies in ratings were associated with provision of higher quality peer feedback during peer assessment, as well as better revision of initial projects after peer assessment.     

The Support Model for interactive assessment

The two most common models for assessment involve measuring how well students perform on a task (the quality model), and how difficult a task students can succeed on (the difficulty model). By exploiting the interactive potential of computers we may be able to use a third model: measuring how much help a student needs to complete a task. We assume that every student can complete it, but some need more support than others. This kind of tailored support will give students a positive experience of assessment, and a learning experience, while allowing us to differentiate them by ability. The computer can offer several kinds of support, such as help with understanding a question, hints on the meanings of key concepts, and examples or analogies. A further type of support has particular importance for test validity: the computer can probe students for a deeper explanation than they have so far given. In subjects like geography or science, markers often would like to ask ‘yes, but why?’, suspecting that students understand more than they have written. We describe a series of studies in which students were given a high level task as an oral interview and then as an interactive computerised assessment with varying types of support. Implications of the support model for future modes of assessment are discussed.     

Constructive alignment in economics teaching: a reflection on effective implementation

The typical approach to student-centred learning in Economics has focused on innovation within the classroom, with little thought given to how this complements teaching and learning and, crucially, assessment. This paper reflects on the implementation of constructive alignment in a final year managerial economics course. It demonstrates how it is possible to design coursework assessment for economics which both encourages constructivist learning, while also limiting the potential for plagiarism. The successful assessment allows students’ autonomy in selecting what evidence matches the assessment requirements. Further, the teaching, learning and formative assessment activities recommended are crafted to directly align with the requirements of the summative assessment. This structured alignment process, by providing repeated formal and informal feedback, produces levels of student engagement and reflection that facilitates deeper learning.     

The impact of student feedback on teaching in higher education

Receiving feedback from students has become a normal part of life for university teachers worldwide. This puts pressure on them from several sides and may be an influential factor that leads them to tailor their teaching to students’ preferences. The aim of this study was to investigate teachers’ perceptions of student feedback and how it affects their teaching choices. A survey was sent out to all teachers at the School of Business, Economics and Law at the University of Gothenburg, Sweden. The study found that student feedback is perceived positively by university teachers, has a large impact on their teaching and helps improve courses. Student feedback pushes teaching in the direction of fewer lectures and more tutorials, seminars and case studies. Teachers receiving negative student feedback experience more negative feelings related to the feedback, and are also more likely to introduce unjustified changes to their teaching in order to please students. These teachers also tend to have less teaching experience. However, a very large majority of teachers have a high level of professional pride and integrity and do not make (as they perceive them) unjustified changes to their teaching.     

University lecturers’ emotional responses to and coping with student feedback: a Finnish case study

Lecturers often find themselves unable to appropriately interpret or deal with student feedback, which may consequently be essential to how they feel about teaching and students. Research into lecturers’ emotional responses to student feedback is scarce, despite the growing use of student feedback as a means of evaluating teachers’ work. This narrative study explores seven lecturers’ responses to student feedback. The lecturers had prior to the study participated in pedagogical training aimed at developing a deep understanding of learning and teaching in higher education. Interviews with the lecturers were conducted and the data was analysed using a categorical approach to narrative analysis. Building on positive psychology, particularly broaden-and-build theory, we consider lecturers’ emotional responses as spirals, and thus had identified upward and downward emotional spirals regarding student feedback. Our findings suggest that pedagogical training may act as an intervention, as it appeared to be meaningful in providing guidance for coping with student feedback. We finally argue that lecturers need to find ways to cope with student feedback as this is essential for their teaching.