The influence of student gender on the assessment of undergraduate student work

The aim of this study was to investigate the influence of perceived student gender on the feedback given to undergraduate student work. Participants (n = 12) were lecturers in higher education and were required to mark two undergraduate student essays. The first student essay that all participants marked was the control essay. Participants were informed that the control essay was written by Samuel Jones (a male student). Participants then marked the target essay. Although participants marked the same essay, half of the participants (n = 6) were informed that the student essay was written by Natasha Brown (a female student), while the remaining participants were informed that it was written by James Smith (a male student). In-text and end-of-text feedback were qualitatively analysed on six dimensions: academic style of writing; criticality; structure, fluency and cohesion; sources used; understanding/knowledge of the subject; and other. Analysis of feedback for both the control and target essay revealed no discernible differences in the number of comments (strengths of the essay, areas for improvement) made and the content and presentation of these comments between the two groups. Pedagogical implications pertaining to the potential impact of anonymous marking on feedback processes are discussed.     

A written,reflective and dialogic strategy for assessment feedback that can enhance student/teacher relationships

In response to the shortcomings of current assessment feedback practice, this paper presents the results of a study designed to examine students’ and teachers’ experience of engaging in a written, reflective and dialogic feedback (WRDF) strategy. The strategy was designed to enhance the learning experience of students undertaking a large first-year core course at a regional Australian university in semester 2, 2012. The evaluation consisted of three components: student surveys pre- and post-WRDF; a student focus group post-WRDF; and a teacher survey post-WRDF. Participating students’ and teachers’ perceptions of the WRDF assessment feedback suggested that students value feedback highly, and show a preference for feedback combining written, reflective and dialogic processes. The research findings suggest that the WRDF framework can be utilised to address the immediate, practical problem of students’ and teachers’ dissatisfaction with the practice of assessment feedback. Thus, WRDF may be used to nurture teacher/student relationships and enhance the learning process. Although a relatively intensive process, the WRDF strategy can serve an integral role in enhancing feedback practices and supporting students.     

Developing different forms of student feedback to promote teacher reflection: A 10-year collaboration

This paper describes a 10-year collaboration between a teacher educator and a high-school science teacher as they investigated different ways to gather student feedback to enhance teacher reflection. Four different procedures were developed during this time: (i) interviews by a teacher educator with students; (ii) learning logs written by students; (iii) observation schedules completed by students; and (iv) a survey completed by students and teachers. Of the four procedures, the most meaningful for teacher reflection was the student interviews because they were the most personal. However, other procedures for gathering student feedback may be more useful to initiate teacher reflection because they are less confronting.     

Are they using my feedback? The extent of students’ feedback use has a large impact on subsequent academic performance

Feedback is known to have a large influence on student learning gains, and the emergence of online tools has greatly enhanced the opportunity for delivering timely, expressive, digital feedback and for investigating its learning impacts. However, to date there have been no large quantitative investigations of the feedback provided by large teams of markers, feedback use by large cohorts of students, nor its impact on students’ academic performance across successive assessment tasks. We have developed an innovative online system to collect large-scale data on digital feedback provision and use. Our markers (n = 38) used both audio and typed feedback modalities extensively, providing 388 ± 4 and 1126 ± 37 words per report for first- and second-year students, respectively. Furthermore, 92% of first year and 85% of second-year students accessed their feedback, with 58% accessing their feedback for over an hour. Lastly, the amount of time students spent interacting with feedback is significantly related to the rate of improvement in subsequent assessment tasks. This study challenges assertions that many students do not collect, or use, their feedback. More importantly, we offer novel insights into the relationships between feedback provision, feedback use and successful academic outcomes.     

Peer feedback on academic writing: undergraduate students’ peer feedback role,peer feedback perceptions and essay performance

Within the higher education context, peer feedback is frequently applied as an instructional method. Research on the learning mechanisms involved in the peer feedback process has covered aspects of both providing and receiving feedback. However, a direct comparison of the impact that providing and receiving peer feedback has on students’ writing performance is still lacking. The current study compared the writing performance of undergraduate students (N = 83) who either provided or received anonymous written peer feedback in the context of an authentic academic writing task. In addition, we investigated whether students’ peer feedback perceptions were related to the nature of the peer feedback they received and to writing performance. Results showed that both providing and receiving feedback led to similar improvements of writing performance. The presence of explanatory comments positively related both to how adequate students perceived the peer feedback to be, as well as to students’ willingness to improve based upon it. However, no direct relation was found between these peer feedback perceptions and students’ writing performance increase.     

Response of students to statement bank feedback: the impact of assessment literacy on performances in summative tasks

Efficiency gains arising from the use of electronic marking tools that allow tutors to select comments from a statement bank are well documented, but how students use this type of feedback remains under explored. Natural science students (N = 161) were emailed feedback reports on a spreadsheet assessment that included an invitation to reply placed at different positions. Outcomes suggest that students either read feedback completely, or not at all. Although mean marks for repliers (M = 75.5%, N = 39) and non-repliers (M = 57.2%, N = 68) were significantly different (p < .01), these two groups possessed equivalent attendance records and similar submission rates and performances in a contemporaneous formatively assessed laboratory report. Notably, average marks for a follow-up summative laboratory report, using the same assessment criteria as the formative task, were 10% higher for students who replied to the original invite. It is concluded that the repliers represent a group of assessment literate students, and that statement bank feedback can foster learning: a simple ‘fire’ analogy for feedback is advanced that advocates high-quality information on progress (fuel) and a curricular atmosphere conducive to learning (oxygen). However, only if students are assessment literate (ignition) will feedback illuminate.     

Face Threat Mitigation in Feedback: An Examination of Student Feedback Anxiety,Self-Efficacy,and Perceived Emotional Support

This experimental study examined the effects of an instructor’s face threat mitigation tactics on student self-efficacy for learning and perceived emotional support from the instructor in a written feedback setting. Participants (N = 401) were randomly assigned to one of two feedback scenarios in which level of face threat was manipulated. Student feedback anxiety was measured prior to being exposed to the feedback scenario. Results indicate that high face threat mitigation is positively associated with student self-efficacy for learning and perceived emotional support from the instructor. Results also revealed that feedback anxiety predicts lower self-efficacy for learning and less perceived emotional support from the instructor. Implications regarding theory, the measurement of feedback apprehension, and student–instructor communication are discussed.     

Impact of feedback request forms and verbal feedback on higher education students’ feedback perception,self-efficacy,and motivation

ABSTRACT

In higher education, students often misunderstand teachers’ written feedback. This is worrisome, since written feedback is the main form of feedback in higher education. Organising feedback conversations, in which feedback request forms and verbal feedback are used, is a promising intervention to prevent misunderstanding of written feedback. In this study a 2 × 2 factorial experiment (N = 128) was conducted to examine the effects of a feedback request form (with vs. without) and feedback mode (written vs. verbal feedback). Results showed that verbal feedback had a significantly higher impact on students’ feedback perception than written feedback; it did not improve students’ self-efficacy, or motivation. Feedback request forms did not improve students’ perceptions, self-efficacy, or motivation. Based on these results, we can conclude that students have positive feedback perceptions when teachers communicate their feedback verbally and more research is needed to investigate the use of feedback request forms.     

Future time orientation and learning conceptions: effects on metacognitive strategies,self-efficacy beliefs,study effort and academic achievement

During the past decade, research on the constructive learning process has been conducted mainly from two perspectives: student approaches to learning (SAL) and self-regulated learning (SRL). The SAL perspective has highlighted the role of learning conceptions with respect to other topics involved in constructive learning processes, whereas recently the SAL perspective has emphasised the effects of the future time perspective (FTP) and self-efficacy beliefs about these topics. Based on these two lines of research (SRL and SAL), using path analysis, we explored the direct and indirect effects of FTP and learning conceptions on self-efficacy, metacognitive strategies, effort and academic performance. Likewise, we identified some patterns that combine specific factors related to these variables. Participants in the present study were 100 (84% females, 16% males) Spanish fourth year university students enrolled in the Social Sciences Degree Programme. The ages of the students ranged from 18 to 49 (M = 22.02; SD = 3.68) and their participation was voluntary and anonymous. Likert-scale inventories were used to obtain data from students: FTP; learning conceptions; metacognitive strategies scale; and self-efficacy beliefs for SAL. On the one hand, the path analysis showed interesting indirect and direct relationships between topics with regard to key constructs of each of these research perspectives (SRL/SAL). However, these results do not coincide with the body of knowledge about FTP. On the other hand, results obtained using cluster and discriminant analysis revealed three specific patterns: a meaning orientation to learning and the future, a reproductive orientation to learning and the present, and an unusual pattern explained by the influence of historical-cultural characteristics on learning practices in educational contexts. We consider that this last pattern presents relevant implications for educational practice.     

The influence of student learning characteristics on purchase of paper book and eBook for university study and personal interest

First-year university students (n = 199) completed an online questionnaire that queried their purchase of paper books and eBooks for university study and personal interest. The questionnaire also required students to rate their learning characteristics including reading strategies, study self-regulation, learning control beliefs and achievement motivation. Self-reported student learning characteristic scores were associated with self-reported book purchases. For example, as student extrinsic motivation scores increased, number of paper books purchased for university study tended to increase. As student learning control belief scores increased, purchase of eBooks for university study tended to increase. Collectively, such results lend support to the conclusion that education students who embrace emerging technologies such as eBooks and who read for leisure perceive themselves as more able learners than students who do not embrace emerging technologies such as eBooks and who do not read for leisure.     

Investigating expectations and experiences of audio and written assignment feedback in first-year undergraduate students

Previous research suggests that audio feedback may be an important mechanism for facilitating effective and timely assignment feedback. The present study examined expectations and experiences of audio and written feedback provided through turnitin for iPad^® from students within the same cohort and assignment. The results showed that although initially sceptical of audio compared to written feedback, there were no significant differences in students' experiences of audio and written feedback. Students' performance on the assignment was not associated with their experiences of audio feedback but first-class performing students (?>?70%) had more positive experiences of written feedback than those who received an upper second-class grade (60–69%). In general, the results imply that audio feedback provided through turnitin for iPad^® is a viable alternative to written feedback. The findings are discussed in relation to past research findings.     

Clay modeling versus written modules as effective interventions in understanding human anatomy

The effectiveness of clay modeling to written modules is examined to determine the degree of improvement in learning and retention of anatomical 3D relationships among students with different learning preferences. Thirty‐nine undergraduate students enrolled in a cadaver dissection course completed a pre‐assessment examination and the VARK questionnaire, classifying learning preference as visual, auditory, read/write, or kinesthetic. Students were divided into clay, module, and control groups with preference for learning style distributed among groups. The clay and module groups participated in weekly one‐hour classes using either clay models or answering written questions (modules) about anatomical relationships, respectively. The control group received no intervention. Post‐assessment and retention examinations were administered at the end of the semester, and three months later, respectively. Two variables (Δ1, Δ2) represented examination score differences between pre‐ and post‐assessment and between post‐assessment and retention examinations, respectively. The Δ1 for clay and module groups were each significantly higher than controls (21.46 ± 8.2 vs. 15.70 ± 7.5, P ≤ 0.05; and 21.31 ± 6.9 vs. 15.70 ± 7.5, P ≤0.05, respectively). The Δ2 for clay and module groups approached but did not achieve significance over controls (?6.09 ± 5.07 vs. ?8.80 ± 4.60, P = 0.16 and ?5.73 ± 4.47 vs. ?8.80 ± 4.60, P = 0.12, respectively). No significant differences were seen between interventions or learning preferences in any group. However, students of some learning styles tended to perform better when engaging in certain modalities. Multiple teaching modalities may accommodate learning preferences and improve understanding of anatomy. Anat Sci Educ. © 2013 American Association of Anatomists.     

Use of the ‘Stop,Start, Continue’ method is associated with the production of constructive qualitative feedback by students in higher education

Students in higher education are increasingly asked to give feedback on their education experience, reflecting an increase in the importance attached to that feedback. Existing literature demonstrates that qualitative student feedback is valued and important, yet there has been limited evaluation of the means by which qualitative student feedback is collected, and how collection method influences the depth of feedback from students. We evaluated the depth of feedback written by students on programmes at three different universities in the United Kingdom, using an established evaluation instrument. We found that the use of a structured pro forma (Stop, Start, Continue) was associated with feedback of greater depth than that produced using free text entry. We then evaluated the effect of switching from a free text to a structured pro forma at one institution and found, again, that the structured pro forma was associated with feedback of greater depth. In addition, students indicated a preference for the structured pro forma.     

What changes,and for whom? A study of the impact of learning analytics-based process feedback in a large course

Recent developments in educational technologies have provided a viable solution to the challenges associated with scaling personalised feedback to students. However, there is currently little empirical evidence about the impact such scaled feedback has on student learning progress and study behaviour. This paper presents the findings of a study that looked at the impact of a learning analytics (LA)-based feedback system on students' self-regulated learning and academic achievement in a large, first-year undergraduate course. Using the COPES model of self-regulated learning (SRL), we analysed the learning operations of students, by way of log data from the learning management system and e-book, as well as the products of SRL, namely, performance on course assessments, from three years of course offerings. The latest course offering involved an intervention condition that made use of an educational technology to provide LA-based process feedback. Propensity score matching was employed to match a control group to the student cohort enrolled in the latest course offering, creating two equal-sized groups of students who received the feedback (the experimental group) and those who did not (the control group). Growth mixture modelling and mixed between-within ANOVA were also employed to identify differences in the patterns of online self-regulated learning operations over the course of the semester. The results showed that the experimental group showed significantly different patterns in their learning operations and performed better in terms of final grades. Moreover, there was no difference in the effect of feedback on final grades among students with different prior academic achievement scores, indicating that the LA-based feedback deployed in this course is able to support students’ learning, regardless of prior academic standing.     

Effectively feeding forward from one written assessment task to the next

Most studies into lecturers’ written feedback focus on the types of feedback found to be effective when students have the opportunity to act on that feedback, revise their written assignment and improve the mark they receive. But often students do not have this opportunity. Typically, they receive a mark and feedback on an assignment that they will never be able to rework and resubmit. This can leave students unsure about what to do with the feedback they receive. This paper reports on the use of high impact written feedback from lecturers that significantly improved student outcomes and grades from one assessment task to the next. It examines a range of factors which together make feedback in this context effective including: assessment design, use of grading standards and tutor training. These findings from a very large unit have significant implications for teaching staff who want to use feedback to feed forward and make a real difference to their students’ learning.     

Reading,listening and feeling: audio feedback as a component of an inclusive learning culture at universities

Feedback on student performance is an important part of university assessment procedures. However, effective feedback is hampered by various obstacles. The growing heterogeneity of the student body increases these barriers, particularly with regard to the reception of feedback. One strategy to overcome these obstacles can be to communicate feedback in the form of audio files. The study presented here tested the possibilities of this procedure by giving students feedback, both as an audio file and in writing. The survey shows that some of the students find audio feedback particularly easy to assimilate, while others prefer written feedback. The aim of the study was to go beyond the level of simplistic evaluation (better–worse), and to be able to make more nuanced statements about the strengths and also the weaknesses of audio feedback. All the students stated that they felt the audio feedback was more personal and appreciative than the written feedback. It becomes clear that the different needs of students can best be catered for with a variety of forms of communication. Audio feedback cannot be considered a comprehensive solution to the different problems associated with feedback, but it can contribute to the development of an inclusive university.     

Patterns in the form of formative feedback and student response

Formative feedback currently receives attention as an effective means of increasing student learning. However, how to frame feedback to achieve the best effect is an ongoing debate. In this study we analyse a written data-set of 174 segments of teacher feedback and student response, coded using 10 emergent feedback and 14 response categories. As it is argued that feedback is a dialogue between students and teacher, links between feedback and response segments are viewed as a dialogical framework that we visualise and understand using network analysis. From this network we conclude that some ways of formulating feedback are more productive and likely to lead to types of responses that signify learning than others. We thus identify the reflection group of responses, consisting of the categories reflective response, explanation and students investigate own thinking. The feedback categories that link primarily to the reflection group are open question, wondering question and leading question, which we categorise as the questioning group of feedback. We discuss these patterns against a previously published framework, and by discussing specific examples we further our understanding of what makes feedback formative.     

Understanding student engagement with peer feedback on master’s theses: a Macau study

While research on peer feedback in second language (L2) writing at university/college level has proliferated, scholars have conducted less research on peer feedback in L2 academic and scholarly writing. Drawing upon multiple sources of data including semi-structured interviews, stimulated recalls, online interviews via WeChat, first and revised drafts of master’s theses, peer written feedback, audio-recordings of oral peer feedback conferences and the finalised master’s theses, this case study examines how three master’s students affectively, behaviourally and cognitively engaged with peer feedback on drafts of their thesis in a Master of Education programme at a Macau university. The findings show that the relationship between sub-constructs within each dimension and the relationships between the three dimensions of student engagement were interconnected in a dynamic and complex way. While there were individual differences among the three students’ engagement, their affective engagement could promote or negatively influence their behavioural and cognitive engagement. This study builds our understanding of the multifaceted nature of master’s students’ engagement with peer feedback. It provides pedagogical implications about how peer feedback can enhance the quality of master’s students’ academic writing and sheds light on how to guide students to establish scholarly learning communities in higher education.