A comparison of student feedback obtained from three methods of formative evaluation of instructional materials

The success of formative evaluation techniques to improve instructional materials is well documented. Researchers have found that materials revised on the basis of one-to-one sessions are equally effective as materials revised on the basis of small group sessions, and that both are superior to the unrevised, original versions. However, there is a paucity of research comparing the types of data obtained from these two recommended approaches to formative evaluation. This study compares the quantitative and qualitative nature of the problems identified by students in three conditions. Specifically, a one-to-one active, a small group active, and a small group passive were the conditions employed. Explanations for the observed differences are attributed to and described in terms of the instructional materials themselves and differences in the procedures or conditions employed. Finally, a number of more practical issues are raised and discussed in terms of their impact on the selection of a particular method or combination of methods for the formative evaluation of instructional materials.     

Toward a better understanding of student perceptions of writing feedback: a mixed methods study

This explanatory sequential mixed methods study investigated the writing feedback perceptions of middle and high school students (N = 598). The predictive and mediational roles of writing self-efficacy and perceptions of writing feedback on student writing self-regulation aptitude were examined using mediation regression analysis. To augment the quantitative findings, the explanations students provided for either liking or disliking writing feedback were explored using open-ended questions. Quantitative findings revealed that students’ perceptions of the feedback they receive about their writing partially mediated the relationship between writing self-efficacy and writing self-regulation aptitude. Qualitative data suggested ways in which students perceive writing feedback—both positive and negative. Collectively, the quantitative and qualitative data illustrate the influential role writing feedback perceptions plays in middle and high school student writing motivation and self-regulation beliefs.     

The development of student feedback literacy: enabling uptake of feedback

Student feedback literacy denotes the understandings, capacities and dispositions needed to make sense of information and use it to enhance work or learning strategies. In this conceptual paper, student responses to feedback are reviewed and a number of barriers to student uptake of feedback are discussed. Four inter-related features are proposed as a framework underpinning students’ feedback literacy: appreciating feedback; making judgments; managing affect; and taking action. Two well-established learning activities, peer feedback and analysing exemplars, are discussed to illustrate how this framework can be operationalized. Some ways in which these two enabling activities can be re-focused more explicitly towards developing students’ feedback literacy are elaborated. Teachers are identified as playing important facilitating roles in promoting student feedback literacy through curriculum design, guidance and coaching. The implications and conclusion summarise recommendations for teaching and set out an agenda for further research.     

Instruments for obtaining student feedback: a review of the literature

This paper reviews the research evidence concerning the use of formal instruments to measure students’ evaluations of their teachers, students’ satisfaction with their programmes and students’ perceptions of the quality of their programmes. These questionnaires can provide important evidence for assessing the quality of teaching, for supporting attempts to improve the quality of teaching and for informing prospective students about the quality of course units and programmes. The paper concludes by discussing several issues affecting the practical utility of the instruments that can be used to obtain student feedback. Many students and teachers believe that student feedback is useful and informative, but for a number of reasons many teachers and institutions do not take student feedback sufficiently seriously.     

Enhancing student engagement in student experience surveys: a mixed methods study

Background

Measuring the student experience is becoming increasingly important in higher education in the UK. Student experience surveys are used as indicators of quality and form the basis of rankings of higher education institutions. They are also used by them as tools to assist their quality enhancement initiatives. However, these surveys frequently suffer from low response rates, which can reduce the reliability and usefulness of their data. The UK Postgraduate Taught Experience Survey (PTES) is a relatively new survey and suffers from a low response rate. As this survey is new, little is known about why students do not respond to it.

Purpose

This study aimed to explore the reasons why postgraduate students do not respond to the PTES.

Sample

Three hundred and fifty-five postgraduate taught students from four health faculties in one UK higher education institution completed an online survey. Of these, seven participated in one of two focus groups.

Design and methods

The online survey was completed both by students who completed the PTES in 2011 and those who did not. This provided us with cross-sectional data to compare both groups’ knowledge of PTES and their reasons for completing or not completing it. We used multivariate regression analysis to explore which variables were associated with response to PTES. We led two focus groups to explore the themes that emerged from the survey in more depth. This data was analysed by two researchers using thematic analysis.

Results

The cross-sectional data found that students who were not clear about the purpose of PTES were less likely to respond, independent of other potential predictor variables. Focus group data indicated that if postgraduate students felt a stronger connection to the university community they may be more likely to respond to PTES.

Conclusions

This study suggests that higher education institutions may wish to review their strategies for advertising student experience surveys to focus more on their purpose rather than their impact.     

The development of student feedback literacy: the influences of teacher feedback on peer feedback

Abstract

Although the concept of student feedback literacy has drawn increasing attention in higher education, empirical research on this matter is still in its infancy. In the area of peer feedback, little research has investigated the role of teacher follow-up feedback on peer feedback in the development of student feedback literacy. To address the research gap, a multiple-case study of three Chinese master’s students enrolled in an academic writing course was conducted, drawing on the students’ drafts with peer feedback, teacher written feedback on that peer feedback, semi-structured interviews, retrospective verbal reports, observation field notes and class documents. Three students’ epistemological and practical knowledge about, attitudes towards, and self-efficacy beliefs in peer feedback were found to improve at different paces and to different degrees. However, considerable individual variations were observed with two high-achieving, highly motivated participants becoming more feedback-literate than their under-achieving, minimally motivated peer. Teacher feedback on peer feedback was found to have distinct impacts on individual students, depending on learner factors including language ability, beliefs and motivation. These findings suggest that teacher feedback on peer feedback, if consistently provided and compatible with learner factors, can scaffold both cognitive and social-affective aspects of student feedback literacy.     

The motivational paradox of feedback: teacher and student perceptions

The notion that future performance can be affected by information about previous performance is often expressed in terms of ‘closing the gap’. Feedback has long been recognised as a mechanism through which teaching and learning may be influenced. The current wave of support in the United Kingdom for assessment for learning echoes these sentiments. This paper examines the feedback strategies employed by two experienced literacy practitioners in England. Using data gathered from field observations, interviews and documentary sources, the paper presents evidence of espoused practice associated with feedback, demonstrating that whilst teachers may claim that they make effective use of some feedback strategies to support pupils’ learning and motivation, that this is not supported by empirical data. The paper also identifies that whilst some teachers aim to mark every piece of pupils’ written work for perceived motivational benefits; such a strategy can undermine pupils’ intrinsic motivation and lead to a culture of over-dependency, whereby the locus of control with regard to feedback lies solely with the teacher. The paper concludes by exploring some possible implications for practice with regard to the provision of written feedback in particular.     

Predicting student progression: The influence of race and other student and institutional characteristics on college student performance

In this study of college student retention and progression, significant differences were found between black and white student cohorts in terms of their attrition rates, overall progression rates (defined as length of time to graduate), and tendency to follow the prescribed progression pattern (sophomore in the second year, junior in the third year, senior in the fourth year, and graduate after the fourth year). However, multiple regression analyses show that racial differences disappear when the effects of other student and institutional characteristics are statistically controlled. Therefore, colleges and universities would do well to rethink special retention and counseling programs designed especially to serve minority group students.     

What makes for effective feedback: staff and student perspectives

Since the early 2010s the literature has shifted to view feedback as a process that students do where they make sense of information about work they have done, and use it to improve the quality of their subsequent work. In this view, effective feedback needs to demonstrate effects. However, it is unclear if educators and students share this understanding of feedback. This paper reports a qualitative investigation of what educators and students think the purpose of feedback is, and what they think makes feedback effective. We administered a survey on feedback that was completed by 406 staff and 4514 students from two Australian universities. Inductive thematic analysis was conducted on data from a sample of 323 staff with assessment responsibilities and 400 students. Staff and students largely thought the purpose of feedback was improvement. With respect to what makes feedback effective, staff mostly discussed feedback design matters like timing, modalities and connected tasks. In contrast, students mostly wrote that high-quality feedback comments make feedback effective – especially comments that are usable, detailed, considerate of affect and personalised to the student’s own work. This study may assist researchers, educators and academic developers in refocusing their efforts in improving feedback.     

A mixed methods comparison of teachers' lunar modeling lesson implementation and student learning outcomes

The authors compare three teachers' adaptations and implementation of a lunar modeling lesson to explain marked differences in student learning outcomes on a spatial-scientific lunar assessment. They used a modified version of the Practices of Science Observation Protocol (P-SOP; Forbes, Biggers, &; Zangori, 2013 Forbes C., Biggers, M., &; Zangori, L. (2013). Investigating essential characteristics of scientific practices in elementary science learning environments: The practices of science observation protocol (P-SOP). School Science and Mathematics, 113, 180–190.[Crossref] , [Google Scholar]) to identify ways in which features of inquiry were emphasized in each classroom. Additionally, classroom communities of practice were categorized as task-based or practice-based (Riel &; Polin, 2004 Riel, M. &; Polin, L. (2004). Learning communities: Common ground and critical differences in designing technical support. In S. Barab, R. Kling, &; J. Gray (Eds.), Designing for virtual communities in the service of learning (pp. 16–52). Cambridge, MA: Cambridge University Press.[Crossref] , [Google Scholar]). The authors found that student learning outcomes were related to the fidelity with which the teachers implemented the lesson. Teachers with higher P-SOP scores fostered more of a practice-based learning community than task-based one, which also paralleled greater student learning gains. Although the students' scores did not differ by teacher on the preassessment, they did differ significantly on the postassessment, indicating that the curricular choices and learning communities developed by the teachers impacted what students were able to learn.     

Teacher feedback to student oral presentations in EFL classrooms: a case study

Whilst much research has been conducted on teacher feedback in various teaching and learning contexts, little is known about how teachers give feedback on student oral presentations to enhance students’ oral communicative skills in second-language (L2) education. Drawing on data from semi-structured interviews, this case study investigated the methods used by an experienced Chinese teacher of English as a Foreign Language to provide feedback on student oral presentation tasks. Data analysis revealed that the teacher gave oral comments mainly on pronunciation, content and logical thinking, and focused on PowerPoint design in his written commentary. The analysis also revealed that the teacher used the specific pattern of ‘praise-criticism-suggestion’ to comment on the students’ oral presentations. Relevant pedagogical implications for L2 teacher feedback practices and teacher-education programmes are discussed in the paper.     

Issues and agency: postgraduate student and tutor experiences with written feedback

This paper examines the issues which postgraduate students and tutors experienced as they engaged in receiving, providing and requesting feedback, as well as the strategies which they adopted as they sought resolution of these issues. The study employed a case study approach, using data obtained from semi-structured and stimulated recall interviews with students and staff from three discipline areas at one university in the UK. The findings reinforce the conclusions that have been drawn in a number of previous studies in terms of the sources of dissatisfaction emerging from individual interactions and institutional practices. Additionally, however, the results expand on our current understanding of feedback and agency in higher education by illustrating how participants sought out imaginative solutions to the challenges they experienced, in order to enhance the effectiveness of the feedback process. The diversity of the strategies used provides evidence of student and tutor agency, and has implications for current feedback practices and future research in this area.     

The role of student feedback in evaluating and revising a blended learning course

A graduate level course in library and information science was revised from face-to-face instruction to a blended learning model utilizing on site, interactive television, and online classes. This study investigates three related questions: (1) Will students provide detailed feedback if given the opportunity to complete an anonymous survey? (2) Will embedding an online survey within the course management software be an effective method of gathering feedback? (3) Will student feedback contain constructive critical information that will prove useful in evaluating and revising the course? An online survey created within the WebCT course management software was administered in 2001, 2003, 2005, and 2007. The total number of responses was 71. Results indicate that students were willing to provide detailed feedback, readily accepted the embedded survey, and provided constructive criticism that proved useful in the evaluation and revision process. The study concludes that this method is effective and may be most appropriate for courses with small enrollments.     

大学生群体责任心问卷的编制及调查

通过文献分析和实证调查,构建群体责任心理论维度,并据此编制大学生群体责任心问卷,899名全日制大学生接受测试,结果显示,该问卷具有良好的信度和效度,可以作为大学生群体责任心测量工具。研究发现,大学生群体责任心呈现如下特点：①大学生群体责任心主要由家庭责任心、团体责任心、国家责任心和世界责任心构成。②大学生群体责任心与学校性质、家庭收入、是否独生、是否单亲差异显著,与性别、年级、专业、父母职业和家庭来源差异不显著。