Biology students’ utilization of tutors’ formative feedback: a qualitative interview study

Ramaprasad (1983 Ramaprasad, A. (1983). On the definition of feedback. Behavioural Sciences, 28: 4–13. [Crossref], [Web of Science ®] [Google Scholar]) defined feedback as information about the gap between actual performance level and the reference level, which is subsequently used to alter that gap. Feedback, therefore, needs to be meaningful, understood and correctly acted upon. Tutors not only have to give feedback; they should really evaluate how effective their feedback has been. This study reports the findings of semi‐structured interviews with third year biology students on their utilization of tutor feedback. We show that students use feedback in six ways. Four specific uses were (a) to enhance motivation; (b) to enhance learning; (c) to encourage reflection; and (d) to clarify understanding. Two further forms of usage were, firstly, to enrich their learning environment and, secondly, to engage in mechanistic enquiries into their study. The findings are discussed in the context of current literature and specific recommendations are given as to how the impact of tutors’ feedback could be enhanced.     

How do doctoral students experience supervision?

Supervision has been shown to have a high impact on doctoral students' development. However, little is known about how students perceive not only negative but also positive doctoral experiences, as well as their strategies for dealing with perceived problematic situations. The aim of this study is to analyse and relate doctoral students' significant supervision experiences to the strategies they use to cope with these experiences when they perceive them as challenging or negative. A total of 1173 doctoral students from different research-intensive Spanish universities responded to four open-ended questions about their most significant experiences in their doctoral journey, associated feelings and strategies to deal with them. We identified a total of 223 experiences related to supervision that were distributed into five categories: 1) central prerequisites for supervision, 2) supervisor choice, 3) supervision of the research process, 4) coaching and 5) project management. The results showed three distinct ways, as reported by the students, of handling the perceived negative supervision experiences: 1) no strategy, 2) local strategy and 3) regulatory strategy. The results suggest that analysing both positive and negative experiences may better capture variability in students' supervision experiences. A relation between experiences with supervision and students' satisfaction was also detected.     

How do students misunderstand number representations?

We used both student interviews and diagnostic testing to reveal students’ misconceptions about number representations in computing systems. This article reveals that students who have passed an undergraduate level computer organization course still possess surprising misconceptions about positional notations, two's complement representation, and overflow. Contrary to common opinion, these misconceptions are widespread and reveal the need for instruction that specifically targets these misconceptions. In addition, these misconceptions will serve as the basis for the creation of a standard assessment tool called the digital logic concept inventory. This concept inventory will provide a rigorous and quantitative metric to assess the effectiveness of new teaching methods.     

How do high school students solve probability problems? A mixed methods study on probabilistic reasoning

When studying a complex research phenomenon, a mixed methods design allows to answer a broader set of research questions and to tap into different aspects of this phenomenon, compared to a monomethod design. This paper reports on how a sequential equal status design (QUAN → QUAL) was used to examine students’ reasoning processes when solving probability problems. A select clustered sampling resulted in the inclusion of 168 high school students in a first, quantitative phase, in which a questionnaire was used to assess how they solved probability problems. This questionnaire included probability items that were based on the outcome orientation, the representativeness misconception, and the equiprobability bias. In a second, qualitative phase, 18 students who were purposefully sampled from the first research phase were interviewed in order to conduct an in-depth study of their probabilistic reasoning processes. In this paper, we illustrate and discuss how several mixed methods research purposes were realized throughout our study: development, expansion, and initiation.     

How do instructional designers evaluate? A qualitative study of evaluation in practice

This study employed a qualitative research design to investigate how instructional designers use evaluation in everyday design practice. While past research has examined how designers spend their time, how they generally make decisions, and expert-novice differences, little attention has been paid to use of context, input, process, or product evaluation, from the perspective of practicing designers. Based on interviews of practitioners, our findings included ten themes regarding how designers use evaluation to improve their products. While these results substantiate to some degree the claim that practitioners believe clients will not pay for formal evaluations, they also suggest that practitioners use evaluation in important but less formal ways. Other conclusions regarding the role of evaluation in design are provided and future directions for training and research are discussed.     

How do students perceive the educational value of peer assessment in relation to its social nature? A survey study in Flanders

This study explores the relationship between students’ perceptions of peer assessment (PA) and its social nature. A quantitative survey study (N = 3680) was conducted in secondary education in Flanders, examining the students’ perceptions of PA interpersonal variables and their beliefs on the educational value of PA. The structural equation modeling (SEM) results show that the educational value students attribute to PA was positively predicted through trust in their own and their peers’ evaluative capabilities, awareness of negative interpersonal processes (e.g. fear of disapproval and friendship marking), and beliefs about PA accuracy. The importance attributed to anonymity appeared to be a negative predictor of PA conceptions. Tests of mean latent differences were performed to explore the differences between educational levels, PA experience and gender.     

How do you make students learn more?

This article deals with the system of professional and vocational education and training in secondary schools in the Republic of Slovenia. It presents a research project, conducted on a sample of Slovene businesses. The purpose of the research was to establish whether companies that employ secondary school graduates are satisfied with their knowledge. It also shows one way to increase the knowledge of students in schools.     

To do or not to do with feedback. A study of undergraduate students’ engagement and use of feedback within a portfolio assessment design

Feedback is important for student learning; however, research shows that students can have a number of difficulties when attempting to learn from feedback. Based on an in-depth analysis of undergraduate students’ self-reported reflection logs, we present findings about students’ experiences with oral and written feedback and how they act upon this feedback when a portfolio is the main assessment and learning tool. Our findings indicate that, within our context, students’ overall experiences with receiving feedback are positive. Oral feedback was perceived as particularly valuable to the students while written feedback challenged their understanding. We identified four specific actions the students engaged in to create meaning from the feedback: internal feedback, using oral feedback, initiating dialogue and interacting with peers. The findings indicate that the students take responsibility in the feedback process. The findings are discussed in relation to current perspectives on feedback in higher education.     

How do students really feel about interactive television?

Conclusion I continue to believe that distance education through interactive television has merit. All participating students felt moderately satisfied with the quality of their education regardless of the classroom type. We as educators cannot ignore the areas of lower satisfaction, however. To improve the quality of ITV educational opportunities we must look to enhancing the strengths of ITV and compensating for the perceived weaknesses remote classroom students face. The primary factor relies heavily upon the instructor. Students tell us that the physical presence of the faculty member is important because it greatly improves the level of communication both in and out of the class period. If we as professors can enhance and magnify that communication through such avenues as online chat rooms, virtual office hours, responsive e-mail, and remote site visits, even students at remote sites may find higher satisfaction through education at a distance     

When peers agree,do students listen? The central role of feedback quality and feedback frequency in determining uptake of feedback

Prior research on the complex process of revision based upon peer feedback has focused on characteristics of each piece of feedback in isolation. Multipeer feedback allows for feedback to be repeated (or not), which could be a signal of feedback quality or be especially persuasive to peers. Separately, little research has examined how well peers select more impactful and accurate peer feedback in their revisions, whether repeated or not. We analyzed almost 2,000 peer comments received by 107 students in a secondary writing course in the US to determine whether feedback quality and feedback frequency predicted feedback implementation. Controlling for other feedback features and context factors, students were much more likely to implement feedback as both feedback quality and feedback frequency increased, surprisingly with no interaction (i.e., even low-quality comments were more likely to be implemented when repeated). However, low-quality comments often partially overlapped with high-quality comments, providing a potential explanation for the lack of an interaction. Finally, consideration of feedback frequency and feedback quality provides new insights into which feedback features are actually related to implementation. The results generally allay concerns about the blind-leading-the-blind in peer feedback as well as pushing for peer feedback arrangements that produce more overlapping comments.     

How and why do students of higher education participate in online seminars?

Online education is continuing to gain popularity in educational institutions and organizations. Hitherto, most research has occurred at aggregated levels, while few researchers have studied how and why individuals participate in online education. It is essential to examine individual perceptions and relationships in order to understand how students behave in relation to others. This paper investigates how students of higher education participate in online seminars and why they participate in certain ways. An online class that attended asynchronous and synchronous online seminars was studied. Electronic logs were used to examine how students participated and interviews were used to illustrate why they participated. It was revealed that the participation of students varied between aspects such as exchanging information, managing tasks and providing social support and the emphasis of these aspects were related to the tool they communicated through. A number of participation inhibitors were identified and it was also suggested how these inhibitors can be addressed.     

How do students prepare an application for a place in higher education?

Sources of help used by students when preparing an application for a place in higher education using the UCAS procedure were investigated, including how they may use Records of Achievement (RoAs). 178 sixth‐form students at three mixed comprehensives and one independent girls’ school were surveyed. In general, students consulted a good range of sources of help in preparing their application. Where a specialist careers adviser was available, this service was viewed very favourably. However, regard for the usefulness of RoAs was mixed. The major implications for those involved in student guidance with sixth‐formers are discussed.     

How do STEM-interested students pursue multiple interests in their higher educational choice?

Interest in science, technology, engineering and mathematics (STEM) has lately received attention in research due to a gap between the number of STEM students and the needs of the labour market. As interest seems to be one of the most important factors in deciding what to study, we focus in the present study on how STEM-interested students weigh multiple interests in making educational choices. A questionnaire with both open-ended and closed-ended items was administered to 91 STEM-interested students enrolled in a STEM programme of a Dutch University for secondary school students. Results indicate that students find it important that a study programme allows them to pursue multiple interests. Some students pursued multiple interests by choosing to enrol in two programmes at the same time. Most students chose one programme that enabled them to combine multiple interests. Combinations of pursued interests were dependent on the disciplinary range of interests of students. Students who were interested in diverse domains combined interests in an educational programme across academic and non-academic domains, whilst students who were mainly interested in STEM combined only STEM-focused interests. Together these findings stress the importance of taking a multiple interest perspective on interest development and educational choice.     

Sixth-grade students’ engagement in academic tasks

Student engagement is important for teachers and researchers because it is associated with student achievement. Guided by self-determination theory, this year-long case study used observations and interviews to examine six students’ behavioral, affective, and cognitive engagement in integrated literacy and social studies tasks. Task differences were rated according to the degree to which tasks were authentic, collaborative, challenging, student directed, and sustained. Results demonstrated that, overall, students were more engaged in tasks that include a higher degree of these elements. In particular, students reported that they were engaged in tasks that included collaboration, new learning, and teacher support.     

Students’ feedback preferences: how do students react to timely and automatically generated assessment feedback?

This study assesses whether or not undergraduate and postgraduate accounting students at an Australian university differentiate between timely feedback and extremely timely feedback, and whether or not the replacement of manually written formal assessment feedback with automatically generated feedback influences students’ perception of feedback constructiveness. The study demonstrates that students do not differentiate between timely feedback and extremely timely feedback. This result holds for both on-campus as well as off-campus students, although undergraduate on-campus students have significantly higher timeliness expectations than undergraduate off-campus students. In addition, the study demonstrates that a replacement of manually generated feedback with automatically generated feedback improves students’ perception of the constructiveness of the provided feedback substantially (undergraduate) or significantly (postgraduate). Instructors may consequently be able to exploit the advantages of automatic feedback tools without having to be concerned about the impact of such feedback on student perceptions. In addition, instructors should only aim to provide extremely timely feedback rather than timely feedback, if sound pedagogical reasons are available to justify the required effort.     

How do students define their roles and responsibilities in online learning group projects?

The goal of this study was to explore the processes of group role formation in online class settings. Qualitative analysis was used to code chat logs and discussion threads in six undergraduate Family and Consumer Sciences online courses that required online group projects. Four themes related to the process of group role formation emerged: testing the waters, apologies as being nice, tag – you’re it, and struggling to find one’s role. Students created roles of leader, wannabe, spoiler, agreeable enabler, coat‐tails, and supportive worker as the group process evolved over the course of the semester. Results lend support for a balance between allowing students to create and experience roles on their own and faculty assignment of roles. Questions are raised related to faculty approaches toward directing and scaffolding the group process.     

A role for technology in enhancing students’ engagement with feedback

This paper explores the potential of technology-enabled feedback to improve student learning. ‘Technology, Feedback, Action!: The impact of learning technology upon students’ engagement with their feedback’ aimed to evaluate how a range of technical interventions might encourage students to engage with feedback and formulate actions to improve future learning. The study used qualitative methods and worked in partnership with 23 undergraduate students to explore their experiences of receiving different forms of feedback with varying degrees of technical intervention including, but not limited to, electronic feedback with grades withheld; online grade publication; criteria-based feedback; and more traditional feedback methods. Through a series of semi-structured interviews, student participants were encouraged to articulate their experiences of feedback. The online publication of grades and feedback and the adaptive release of grades were found to significantly enhance students’ engagement with their feedback. Data were analysed using a thematic approach, and the main themes were used to inform the development of a series of good practice guides. The findings are discussed in the context of current literature.     

How is formative assessment related to students’ reading achievement? Findings from PISA 2009

Drawing on the programme for international student assessment 2009 US data-set, this study examines the relationship between formative assessment and students’ reading achievement using a structural equation modelling approach. We find that formative assessment is positively related to students’ reading achievement directly and indirectly (through teacher–student relationship and attitude towards reading) for all students. The direct relationship between formative assessment and reading achievement is significantly stronger for Black students than for White students, whether or not student socio-economic status (SES), gender and school mean SES are controlled for. The total relationship (the direct plus the indirect relationship) between formative assessment and reading achievement also appears to be stronger for Black students than for White students; however, the difference is not statistically significant whether or not we control for covariates. No significant difference is found between White and Hispanic students in terms of the direct and the total relationship between formative assessment and reading achievement. Using a nationally representative data-set, this study provides empirical evidence that formative assessment is positively related to students’ reading achievement in general. In addition, this study provides preliminary evidence to show the potential of formative assessment to help reduce achievement gaps between Black and White students. The implications and limitations of the study are also discussed.