Enhancing student engagement in student experience surveys: a mixed methods study

Background

Measuring the student experience is becoming increasingly important in higher education in the UK. Student experience surveys are used as indicators of quality and form the basis of rankings of higher education institutions. They are also used by them as tools to assist their quality enhancement initiatives. However, these surveys frequently suffer from low response rates, which can reduce the reliability and usefulness of their data. The UK Postgraduate Taught Experience Survey (PTES) is a relatively new survey and suffers from a low response rate. As this survey is new, little is known about why students do not respond to it.

Purpose

This study aimed to explore the reasons why postgraduate students do not respond to the PTES.

Sample

Three hundred and fifty-five postgraduate taught students from four health faculties in one UK higher education institution completed an online survey. Of these, seven participated in one of two focus groups.

Design and methods

The online survey was completed both by students who completed the PTES in 2011 and those who did not. This provided us with cross-sectional data to compare both groups’ knowledge of PTES and their reasons for completing or not completing it. We used multivariate regression analysis to explore which variables were associated with response to PTES. We led two focus groups to explore the themes that emerged from the survey in more depth. This data was analysed by two researchers using thematic analysis.

Results

The cross-sectional data found that students who were not clear about the purpose of PTES were less likely to respond, independent of other potential predictor variables. Focus group data indicated that if postgraduate students felt a stronger connection to the university community they may be more likely to respond to PTES.

Conclusions

This study suggests that higher education institutions may wish to review their strategies for advertising student experience surveys to focus more on their purpose rather than their impact.     

Relations between academic performance,student engagement and student burnout: A cross-lagged analysis of a two-wave study

Academic performance and student well-being are two desired outcomes of any learning and instruction process. The purpose of the present study was to test the temporal order of the relationships between academic performance and two forms of student well-being (i.e., student engagement and burnout) in a specific context. 142 psychology undergraduate students completed self-reported measures of student engagement and student burnout in two waves, during a semester. Also, we included their grades from two intermediate evaluations. Path analysis models suggested that academic grades could be considered antecedents of student engagement and student burnout, while the well-being measures cannot be considered antecedents of the academic performance. These findings provide additional knowledge regarding the relationships between academic well-being and academic performance.     

Student engagement and inclusive education: reframing student engagement

Engagement, or student engagement, is widely used in educational research and public discourse to refer to the problem of public education. The underlying ontological and epistemological assumptions buoying engagement are rarely, if ever, addressed by educational researchers. The ‘silent omission’ (Sidorkin 2014. “On the Theoretical Limits of Education.” In Making a Difference in Theory: The Theory Question in Education and the Education Question in Theory, edited by Julie Allan Gert Biesta and Richard Edwards, 121–137. New York: Routledge) of engagement’s metaphysics has implications for inclusive education. This paper finds that despite being employed with good intent, engagement operates in a paradigm of normativity. In a gesture of bifocality (Weis and Fine 2012. “Critical Bifocality and Circuits of Privilege: Expanding Critical Ethnographic Theory and Design.” Harvard Educational Review 82 (2): 173–201), I critique engagement discourse and its historical context to find that it reproduces a longstanding tradition of psychologising public problems (Fine and Cross 2015. “Critical Race, Psychology and Social Policy: Refusing Damage, Cataloguing Oppression, and Documenting Desire.” In Contextualizing the Costs of Racism, edited by A. Alvarez and H. Neville. Washington, DC: APA Publications), thereby displacing conversations about what may be the most influential issue of public education: social and economic inequality. A reframing of engagement as [student/teacher] engagement is proposed. Highlighted in the reframing is the educational relationship and the context in which it is nested. Mitigated is the pathologising and exclusionary effect of engagement discourse which operates within a dialectic of normal/engaged // ab/normal/disengaged.     

Evaluating student engagement and experiential learning in global classrooms: A qualitative case study

The global classroom is an emerging technology-based pedagogy used internationally by educational institutions. To evaluate a global classroom, we conducted a qualitative study using written reflections and semi-structured interviews of global classroom participants, based on two theoretical frameworks: Kearsley and Shneiderman’s engagement theory and Kolb’s experiential learning theory. We analyzed student reflections and transcribed interviews, using the software package, NVivo, with two objectives: (1) to evaluate if global classroom is engaging and experiential to students and (2) to elucidate how student engagement is fostered in the global classroom through experiential learning. Results illustrated a complex relationship between student engagement and experiential learning. During the experiential learning cycle, engagement theory (relate-create-donate) principles contributed to student engagement at varying levels and for different purposes. Based on the results of this study, we created a framework that demonstrates the interactivity of engagement theory and experiential learning theory to describe how student engagement featured in experiential learning during this global classroom, with strategies to maximize student engagement in experiential learning.     

Exploring anomalies in Indigenous student engagement: findings from a national Australian survey of undergraduates

Increases in participation by Aboriginal and Torres Strait Islander students in higher education across Australia continue to be promising. However, it is also known that Indigenous students' attrition, retention and completion rates remain areas of concern. In this paper, we report our findings from an analysis of Indigenous student responses to the 2009 Australasian Survey of Student Engagement. Overall, Indigenous Australian students express positive responses in relation to engagement, but are more likely than non-Indigenous students to be planning to depart. We explore this somewhat unexpected anomaly, whilst also suggesting that much more needs to be known about our Indigenous students, including, for example, whom they may interact with at university; where they turn for support; and why they may decide to leave. Our findings strongly indicate that better national and institutional data are needed to address the current gaps in knowledge relating to Indigenous student populations in Australia and around the world.? In this paper, the term ‘Indigenous’ refers to Australian students who are of self-declared Aboriginal and/or Torres Strait Islander background, while ‘non-Indigenous’ refers to all other Australians.     

Virtual carrots,sticks and student engagement: supporting student researchers

This article describes a three-year research project which aimed to introduce a technological innovation in working with three cohorts of undergraduate students to support them in completing their final-year dissertations through the use of a Virtual Research Environment (VRE). An additional aim of the project was to establish, amongst the students, a Community of Enquiry. Drawing on evidence from module evaluations, focus group interviews and user logs, the article highlights how students engaged with the VRE to support their research projects and their peers. By examining the activities of the three cohorts the authors were able to apply the seven key factors for building an educational Community of Enquiry outlined in previous research by the first author and colleagues to assert that the third cohort worked collaboratively to the degree that they could be said to have formed a Community of Enquiry.     

Leveraging student engagement for student and institutional success

We all know the importance of student engagement to student learning. Gavin W. Henning argues that the upside doesn't end there … the institution as a whole also benefits.     

Perceptions of student engagement in the flipped classroom: a case study

ABSTRACT

One of the blended learning strategies that researchers and educators commonly use in higher education is Flipped Classroom. The purpose of this case study was to explore how both professors and students perceive student engagement in flipped classrooms. Three college professors who implemented flipped classrooms and their 14 students participated in the study. Three individual faculty interviews and three student focus group interviewers were conducted. Five components of the utilization-focused evaluation model were used in the data coding. The findings revealed both positive and negative opinions depending on how they implemented the flipped classroom including the engagement of students and the environment. Faculty participants who fully implemented the flipped model had positive opinions about the implementation and student engagement, finding the model helped increase student performance and grades. In addition, the majority of student participants liked the challenges offered by the flipped classroom, which increased their engagement.     

Teacher ratings of student engagement with educational software: An exploratory study

The quality of students' learning engagement may significantly influence their learning. Can teachers accurately judge student learning engagement with educational software? In this exploratory study, 3 fifth-grade teachers used a seven-level taxonomy to rate the frequency of different forms of engagement among 42 students interacting with different types of educational software. Teachers spontaneously treated the seven levels of engagement as a continuum, rating students highest on one level or a set of contiguous levels. Teachers generally agreed when ranking students by their typical levels of engagement, but disagreed regarding the actual frequencies of different engagement types. Ratings of software engagement conceived of as interpretive activity were correlated significantly with student reading test scores. Given the authentic classroom conditions in which this study took place, the results are promising for the classroom utility of the seven-level conception of student engagement with software.     

Understanding student behavioral engagement: Importance of student interaction with peers and teachers

Recent theoretical conceptualizations of student engagement have raised questions about how to measure student engagement and how engagement varies not only across schools, but also within school and within classrooms. The authors build on existing research on student behavioral engagement and extend this research to emphasize a continuum of disengagement, active engagement, and passive engagement. They review common approaches to measuring engagement and highlight areas where new theoretical conceptualizations of engagement require new approaches to measurement. The authors analyze how student behavioral engagement changed depending on the context and demonstrate the need of a finer scale of engagement. They find there was not a uniform association of higher behavioral engagement and student interaction with peers, but it was the interaction with other students and the teacher that was predictive of increased engagement. Their work suggests that disaggregating behavioral engagement into disengagement, active engagement, and passive engagement has important research and conceptual implications.     

Pathways to student engagement: beyond triggers and mechanisms at the engagement interface

Higher Education - This paper, while conceptual in nature, is informed by both research and practice. Exploring the “engagement interface” as the site for student engagement (SE), we...     

Social learning spaces and student engagement

Notable gains have been made in understanding the factors that influence the student experience in higher education, particularly in the area of student engagement. While tremendous effort has been focused on identifying educationally beneficial activities for students, we must also consider where these activities are occurring. In recent years there have been technological advances that have paved the way for blended learning environments, however, physical learning environments continue to dominate the functionality of many universities. The development of purpose‐built informal social learning spaces as a strategy to enhance the student experience is becoming more prevalent, although empirical research in this area is lacking. This study explores the role of social learning spaces on the student experience using the student engagement framework within a qualitative research design. Informal interviews with 103 students were conducted within a social learning space. Findings reveal that social learning spaces can contribute to enhanced student engagement by fostering active learning, social interaction and belonging amongst tertiary students. The study also suggests that design is a contributing factor to students' perceptions of social learning spaces.     

Role-play and student engagement: reflections from the classroom

Role-play is viewed by scholars as an effective active learning strategy: it encourages participation among passive learners, adds dynamism to the classroom and promotes the retention of material. But what do students think of role-play? This study surveyed 144 students after a role-play activity in a history course and asked them to identify what they gained from the activity and if it encouraged them to learn more about the topic. The results found conflicting student views: though a large majority found the activity beneficial, a small minority gained little from the exercise. It is argued that role-play can be counterproductive for weak and/or unprepared students. Role-play may be a popular teaching method but teachers should consider how format and preparation can impact learning outcomes.     

Teaching practices and student engagement in early adolescence: A longitudinal study using the Classroom Assessment Scoring System

Student engagement in schoolwork is crucial for positive academic adjustment, particularly during early adolescence. We investigated how observations of teaching practices predicted change in student behavioral and emotional engagement. In the fall, we examined teacher behavior in 54 fifth and sixth grade classrooms through external observers' reports of 11 dimensions of teachers’ practices (Classroom Assessment Scoring System, CLASS). Students reported on their behavioral and emotional engagement in the fall and spring. We found quality feedback was the strongest predictor of behavioral engagement and regard for student perspective was the strongest emotional engagement. Our findings were more nuanced for what predicts behavioral engagement, as there is evidence that other teaching practices work in conjunction with quality feedback to predict behavioral engagement.     

A model of online and general campus‐based student engagement

Knowing how campus‐based students engage in key online and general learning practices can play a central role in managing and developing university education. Knowledge in this area is limited, however, despite recent advances in student engagement research, and widespread adoption of online learning systems. This paper responds to the need to develop such knowledge, by documenting the development and application of a typological model of online and general campus‐based student engagement. It reports the statistical analyses used to develop the model, and analyses the model’s structure and substance. The model is exemplified by considering what it says about how increasingly powerful and pervasive online technologies might be leveraged to enhance campus‐based student engagement.     

Opportunity to learn and student engagement: a HLM study on eighth grade science achievement

This study examined the individual, class, and school level variability of the students’ science achievement. It was hypothesized that there are school or teacher effects which contribute toward explaining achievement differences, besides the student level differences. Owing to the nested structure of the data in Trends in International Mathematics and Science Study, we used the Hierarchical Linear Modeling methodology. Besides the significant effect of engagement, the teachers’ teaching certification in science and the topic coverage were both significant factors as were the effect of school SES and availability of remedial and enrichment programs in science. The study makes a contribution to a better understanding of the opportunity to learn variables at classroom and school level in students’ science achievement.     

A national study examining the impact of SEVIS on international student and scholar advisors

The purpose of this research is to examine the impact that Student and Exchange Visitor Information System (SEVIS) is having on the professional worklives of international student and scholar advisors (ISSAs) on U.S. college and university campuses. ISSAs are clearly satisfied with their work and hold their institutions in high regard. However, SEVIS is having a profound effect on their morale, satisfaction, and their likelihood to leave the field. That is, SEVIS (i.e., reporting, training, time) and the quality of worklife (i.e., professional activities and career development, recognition for competence and their expertise, external and intra-department relationships, perceptions of discrimination) are important to ISSAs, and thus have a strong effect on their level of satisfaction and/or morale, and their subsequent intentions to stay or leave their career/profession.     

The ideology of student engagement research

In a series of recent papers, Nick Zepke has criticised those researching student engagement in higher education for uncritically supporting neoliberalism. The current highly politicised nature of higher education means that clarity about the political implications of engagement research is crucial. This conceptual paper argues that in focusing on literature on students’ engagement in learning, Zepke overlooks another substantial body of engagement literature, on students’ participation in decisions about learning and teaching. By exploring the political alignment of two of the key models used to conceptualise students’ engagement in decision-making, the paper argues that a central element of the research into student engagement is in fact directly opposed to neoliberal approaches to higher education. Student engagement has been deployed both for and against neoliberalism. Zepke has argued that the research on engagement sides with neoliberalism; I show that the research that focuses on student engagement in decision-making supports the opposition.     

Achievement and engagement: How student characteristics influence teacher judgments

Teachers' judgments of student characteristics are affected not only by the characteristic in question, but also by other factors. This article presents three studies examining whether students' achievement influences teachers' judgments of their engagement (as a proxy for motivation) and vice versa. First, a field study was conducted with N = 52 teachers and N = 1135 students. Structural equation modeling revealed an effect of student achievement on teacher judgments of student engagement and an effect of student engagement on teacher judgments of student achievement—above and beyond the association of each student characteristic with teacher judgments of that characteristic. These results were then replicated in two experimental studies involving a computer simulation of an instructional situation, the Simulated Classroom, with N = 40 and N = 181 teacher candidates, respectively. The psychological determinants of the effects observed are discussed, as are their practical implications.