Enhancing student engagement in student experience surveys: a mixed methods study

Background

Measuring the student experience is becoming increasingly important in higher education in the UK. Student experience surveys are used as indicators of quality and form the basis of rankings of higher education institutions. They are also used by them as tools to assist their quality enhancement initiatives. However, these surveys frequently suffer from low response rates, which can reduce the reliability and usefulness of their data. The UK Postgraduate Taught Experience Survey (PTES) is a relatively new survey and suffers from a low response rate. As this survey is new, little is known about why students do not respond to it.

Purpose

This study aimed to explore the reasons why postgraduate students do not respond to the PTES.

Sample

Three hundred and fifty-five postgraduate taught students from four health faculties in one UK higher education institution completed an online survey. Of these, seven participated in one of two focus groups.

Design and methods

The online survey was completed both by students who completed the PTES in 2011 and those who did not. This provided us with cross-sectional data to compare both groups’ knowledge of PTES and their reasons for completing or not completing it. We used multivariate regression analysis to explore which variables were associated with response to PTES. We led two focus groups to explore the themes that emerged from the survey in more depth. This data was analysed by two researchers using thematic analysis.

Results

The cross-sectional data found that students who were not clear about the purpose of PTES were less likely to respond, independent of other potential predictor variables. Focus group data indicated that if postgraduate students felt a stronger connection to the university community they may be more likely to respond to PTES.

Conclusions

This study suggests that higher education institutions may wish to review their strategies for advertising student experience surveys to focus more on their purpose rather than their impact.     

On the supranational spell of PISA in policy

Abstract

Background: PISA results appear to have a large impact upon government policy. The phenomenon is growing, with more countries taking part in PISA testing and politicians pointing to PISA results as reasons for their reforms.

Purpose: The aims of this research were to depict the policy reactions to PISA across a number of jurisdictions, to see whether they exhibited similar patterns and whether the same reforms were evident.

Sources of evidence: We investigated policy and media reactions to the 2009 and 2012 PISA results in six cases: Canada, China (Shanghai), England, France, Norway and Switzerland. Cases were selected to contrast high-performing jurisdictions (Canada, China) with average performers (England, France, Norway and Switzerland). Countries that had already been well reported on in the literature were excluded (Finland, Germany).

Design and methods: Policy documents, media reports and academic articles in English, French, Mandarin and Norwegian relating to each of the cases were critically evaluated.

Results: A policy reaction of ‘scandalisation’ was evident in four of the six cases; a technique used to motivate change. Five of the six cases showed ‘standards-based reforms’ and two had reforms in line with the ‘ideal-governance’ model. However, these are categorisations: the actual reforms had significant differences across countries. There are chronological problems with the notion that PISA results were causal with regard to policy in some instances. Countries with similar PISA results responded with different policies, reflecting their differing cultural and historical education system trajectories.

Conclusions: The connection between PISA results and policy is not always obvious. The supranational spell of PISA in policy is in the way that PISA results are used as a magic wand in political rhetoric, as though they conjure particular policy choices. This serves as a distraction from the ideological basis for reforms. The same PISA results could motivate a range of different policy solutions.     

Development and initial validation of the institutional child abuse processes and coping inventory among a sample of Irish adult survivors of institutional abuse

ObjectiveTo develop a psychometric instrument to evaluate psychological processes associated with institutional abuse and coping strategies used to deal with such abuse.MethodsAs part of a comprehensive assessment protocol, an inventory containing theoretically derived multi-item rational scales which assessed institutional abuse-related psychological processes and coping strategies were administered to 247 Irish adult survivors of institutional child abuse. Exploratory and confirmatory factor analyses were used to derive 6-factor scales, the reliability and validity of which were assessed.ResultsFactor scales to assess the following constructs were developed (1) traumatization, (2) re-enactment, (3) spiritual disengagement, (4) positive coping, (5) coping by complying, and (6) avoidant coping. There were varying degrees of support for the validity of the scales with most support for the traumatization and re-enactment scales.ConclusionsThe Institutional Child Abuse Processes and Coping Inventory (ICAPCI), particularly its traumatization and re-enactment scales, may be used in future research on adult survivors of institutional child abuse because they are currently the only scales that have been developed with this population to provide reliable and valid assessments of these constructs.Practice implicationsThe ICAPCI may be used, cautiously, to assess adult survivors of institutional child abuse.     

High school students’ scientific epistemological beliefs,self-efficacy in learning physics and attitudes toward physics: a structural equation model

Background: There are some theoretical evidences that explain the relationships between core beliefs (i.e., epistemological beliefs) and peripheral beliefs (self-efficacy in learning) in the literature. The close relationships of such type of beliefs with attitudes are also discussed by some researchers. Constructing a model that investigates these relationships by considering theoretical and empirical evidences can empower researchers to discuss these relationships more comprehensively.

Purpose: The purpose of this study is to explore the relationships among Turkish high school students’ scientific epistemological beliefs, self-efficacy in learning physics and their attitudes toward physics.

Sample: A total of 632 high school students participated in this study; however, 269 female and 229 male (a total of 498) high school students’ data were used.

Design and methods: Three distinct instruments that measure scientific epistemological beliefs, self-efficacy in learning physics and attitudes toward physics were combined into a unique questionnaire form and it was distributed to high school students. To explore the relationships among these variables, structural equation modeling was used.

Results: The results showed that scientific epistemological belief dimensions uncovered by the nature of knowing (source and justification) significantly and positively related to both self-efficacy in learning physics and attitudes toward other important physics dimensions. Additionally, self-efficacy in learning physics significantly and positively predicted attitudes toward multiple physics dimensions (importance, comprehension and requirement). However, epistemological belief dimensions related to the nature of knowledge (certainty and development) did not have significant impact on self-efficacy in learning physics or attitudes toward physics.

Conclusions: This study concludes that there are positive and significant relationships among Turkish high school students’ scientific epistemological beliefs, self-efficacy in learning physics and their attitudes toward physics.     

Figures of speech in the physics classroom: a process of conceptual change

Background: This study investigates the role of figures of speech in the process of conceptual change in the physics classroom. Purpose: Its objectives are to examine what teachers and students perceive to be the advantages in using figures of speech in teaching physics concepts, what they perceive to be the challenges in using them, and how teachers use these in their classrooms to minimize the challenges faced. Sample We chose a purposive sample of 95 students and nine teachers of physics, in four schools in Lebanon. Design and methods: A mixed-method approach was used. Interviews were conducted with physics teachers; questionnaires were distributed to students, and non-participant classroom observations were carried out. Results: Teachers viewed figures of speech as a tool that helps them transmit abstract physics concepts to students in a simpler and concrete way. Questionnaires and non-participant observations revealed several examples of figures of speech used and the positive responses of students towards them. Conclusions: The study suggests several ways to overcome the drawbacks. This study highlights the urgent need for all stakeholders to work collaboratively to include figures of speech in the curriculum to enhance the process of conceptual change in the physics classroom.     

Assessment of the quality and generalizability of the revised UCLA loneliness scale in Chinese and Korean community-dwelling elderly populations using item response theory (IRT)-Rasch modeling and hybrid IRT-logistic regression

ABSTRACT

Objectives: This study aims to test the dimensionality, reliability, and item quality of the revised UCLA loneliness scale as well as to investigate the differential item functioning (DIF) of the three dimensions of the revised UCLA loneliness scale in community-dwelling Chinese and Korean elderly individuals.

Method: Data from 493 elderly individuals (287 Chinese and 206 Korean) were used to examine the revised UCLA loneliness scale. The Research model based on item response theory (IRT) was used to test dimensionality, reliability, and item fit. The hybrid ordinal logistic regression-IRT test was used to evaluate DIF.

Results: Item separation reliability, person reliability, and Cronbach’s alpha met the benchmarks. The quality of the items in the three-dimension model met the benchmark. Eight items were detected as significant DIF items (at α < .01). The loneliness level of Chinese elderly individuals was significantly higher than that of Koreans in Dimensions 1 and 2, while Korean elderly participants showed significantly higher loneliness levels than Chinese participants in Dimension 3. Several collected demographic characteristics and loneliness levels were more highly correlated in Korean elderly individuals than in Chinese elderly individuals.

Conclusion: Analysis using the three dimensions is reasonable for the revised UCLA loneliness scale. Good item quality and the items of this measure suggest that the revised UCLA loneliness can be used to assess the preferred latent traits. Finally, the differences between the levels of loneliness in Chinese and Korean elderly individuals are associated with the factors of loneliness.     

Predictors of Parenting: Family-Wide and Child-Specific Factors

Objective. The goal of the study was to identify determinants of child perceptions of parenting. Design. By using two children per family, the current study predicted siblings’ (106 pairs) perceptions of mothering and fathering at ages 9–13 from children’s perceptions of parenting and parent ratings of child difficulty, parental emotionality, and household organization, when the children were 4–8 years old. Multi-level modeling was used to differentiate between- and within-family variation. Results. Stability in child perceptions was moderate, and this stability was due to family-wide parenting shared by siblings. Conversely, the majority of variance in the 9- to 13-year-olds’ perceptions indicated differential, rather than similar, parental treatment. Maternal anger predicted maternal hostility. In contrast, household chaos predicted paternal hostility. Conclusions. Relationships between individuals in the family are part of a larger system, and children are equally as likely as parents to reap the benefits of services or interventions directed toward enhancing maternal well-being.     

Facilitating the learning process in design-based learning practices: an investigation of teachers’ actions in supervising students

Background: In research on design-based learning (DBL), inadequate attention is paid to the role the teacher plays in supervising students in gathering and applying knowledge to design artifacts, systems, and innovative solutions in higher education.

Purpose: In this study, we examine whether teacher actions we previously identified in the DBL literature as important in facilitating learning processes and student supervision are present in current DBL engineering practices.

Sample: The sample (N=16) consisted of teachers and supervisors in two engineering study programs at a university of technology: mechanical and electrical engineering. We selected randomly teachers from freshman and second-year bachelor DBL projects responsible for student supervision and assessment.

Design and method: Interviews with teachers, and interviews and observations of supervisors were used to examine how supervision and facilitation actions are applied according to the DBL framework.

Results: Major findings indicate that formulating questions is the most common practice seen in facilitating learning in open-ended engineering design environments. Furthermore, other DBL actions we expected to see based upon the literature were seldom observed in the coaching practices within these two programs.

Conclusions: Professionalization of teachers in supervising students need to include methods to scaffold learning by supporting students in reflecting and in providing formative feedback.     

Conceptions and misconceptions about neuroscience in preschool teachers: a study from Argentina

Background: Teachers’ conceptions and misconceptions about neuroscience are crucial in establishing a proper dialogue between neuroscience and education. In recent years, studies in different countries have examined primary and secondary school teachers’ conceptions. However, although preschool education has proved its importance to later academic outcomes, there is limited investigation of neuroscience conceptions focused exclusively on preschool teachers.

Purpose: The present study sought to explore preschool teachers’ conceptions and misconceptions about neuroscience in an Argentine setting.

Sample, design and methods: We used quantitative and qualitative approaches to explore concepts about neuroscience, including specific neuromyths. Data were collected using a 24-statement questionnaire and 5 in-depth interviews. The survey was administered to 204 teachers of children between the ages of 0–5-years in Argentina.

Results and conclusions: Results from this exploratory study suggested a relatively high level of general knowledge of neuroscience amongst the preschool teachers in the study. However, three particular issues seemed unclear for teachers: memory, plasticity and the myth that ‘we only use 10% of the brain’. Specifically, ‘memory’ was understood as ‘learning by heart’; neural underpinnings of memory and plasticity processes were unknown; and the myth that we only use 10% of the brain was used to explain individual differences in intelligence in a straightforward way. In addition, anecdotal evidence was used by teachers to justify their conceptions about neuroscience. Finally, the wider implications of these results for bridging neuroscience and education are discussed.     

Extending poly-victimization theory: Differential effects of adolescents’ experiences of victimization on substance use disorder diagnoses upon treatment entry

BackgroundAlthough victimization is a known contributor to the development of substance use disorders, no research has simultaneously examined how characteristics of victimization experienced over time, such as the type of abuse, the presence of poly-victimization, closeness to perpetrator(s), life threat or fear, and negative social reactions to disclosing victimization, cluster into profiles that predict substance use disorders.ObjectiveThe aim of the current study is to assess how profiles of victimization and trauma characteristics are associated with substance use disorders and assess potential gender differences.Participants and SettingParticipants were 20,092 adolescents entering substance use treatment.MethodsWe used latent class and multi-group latent class analysis to extract classes of victimization and associated characteristics. Emergent classes were used to predicted substance use disorder status at treatment intake.ResultsFive classes were extracted: poly-victimization + high harmful trauma characteristics, sexual abuse + negative social reaction and perceived life threat, emotional abuse + trusted perpetrator, physical abuse and low all. Similar classes were found for the multi-group model. In both the overall and female-specific models, the poly-victimization + high harmful trauma characteristics class was more severe than all other classes in terms of opioid use disorder, tobacco use disorder, and dual diagnosis. Other class differences were found across gender.ConclusionsAdolescents entering treatment can be distinguished by their profiles of victimization experiences and associated characteristics, and these profiles evidence different associations with substance use disorder diagnoses. Results point to a need for more nuanced assessment of victimization experiences and gender-specific interventions.     

Promoting resilience and wellbeing in children exposed to intimate partner violence: A qualitative study with mothers

BackgroundChildren exposed to intimate partner violence (IPV) are at increased risk of disruptions to their health and development. Few studies have explored mothers’ perceptions of what helps their children cope throughout this experience.ObjectiveThe aim of the study was to explore mothers’ perceptions of their children’s resilience and coping following IPV exposure, and the strategies they have used to support their children and promote resilience.MethodsIn depth semi-structured interviews were conducted with nine women from the Maternal Health Study (MHS), a prospective study of women during pregnancy and following the birth of their first child. All women involved in the qualitative interviews reported experiencing IPV during their involvement in the MHS. Transcribed interviews were analysed using interpretative phenomenological analysis which has a focus on how individuals make meaning of their experience.ResultsWomen discussed parenting strategies such as role modelling, stable and consistent parenting, and talking with their children about healthy relationships to promote their children’s resilience. Mothers also spoke about the ways they tried to reduce their child’s direct exposure to IPV, as well as reflecting on the difficulty of attending to their child emotionally when they were experiencing distress.ConclusionsThis study highlights that there are many strategies used by mothers who experience IPV to promote resilience and wellbeing in their children. Understanding what mothers see as useful for their children is essential in providing appropriate services to families following experiences of family violence.     

Children's understanding of familiar astronomical events

In this paper I describe the notions used by children aged 9‐16 years to account for a number of easily observed astronomical events. General features in the development of the notions are identified and historical parallels are noted.

The data presented come from a wider study intended to develop materials and approaches for teaching astronomy as part of the science curriculum of all pupils. An indication is given as to how the findings of the survey are being used in developing appropriate curriculum materials.     

Emotion Dysregulation Mediates Relations Between Chinese Parents’ Histories of Childhood Emotional Abuse and Parenting Stress: A Dyadic Data Analysis

Objective. This study focused on the intrapersonal and interpersonal effects of parents’ histories of childhood emotional abuse and emotion dysregulation on parenting stress in a sample of school-age children’s fathers and mothers in Mainland China. Design. One hundred ninety-four Chinese couples participated. Structural equation modeling within the framework of the actor–partner interdependence mediation model was used to assess whether emotion dysregulation mediates relations between parents’ childhood emotional abuse and parenting stress of both individuals and their spouses. Results. The childhood emotional abuse of one parent was significantly associated with the parenting stress of both parents through the emotion dysregulation of the parent who was emotionally abused. Conclusions. Links between emotional abuse and parenting stress in the family system are complex, and both parents’ childhood histories of emotional abuse play roles in parenting.     

Review of measurements used in computing education research and suggestions for increasing standardization

Background and context: The variables that researchers measure and how they measure them are central in any area of research, including computing education. Which research questions can be asked and how they are answered depends on measurement.

Objective: To summarize the commonly used variables and measurements in computing education and to compare them to best practices in measurement for human-subjects research.

Method: Systematic literature review analyzing 197 papers published during 2013–2017 in computing education research venues.

Findings: The review illuminates common practices related to: variables measured (including learner characteristics), measurements used, and type of data analysis. The paper lists standardized measurements that were used and highlights commonly used variables for which no standardized measures exist.

Implications: The paper concludes with information about best practices currently being used in the community that should be continued, as well as pointing out practices that could be improved along with recommendations for how to begin to adopt those best practices.     

Bring your own device – a snapshot of two Australian primary schools

Background: The use of 1:1 and Bring Your Own Device strategies in schools is in its infancy and little is known about how mobile devices such as tablets are being used to support educational practice.

Purpose: In this article, two suburban primary schools in Sydney, Australia were focused on with an aim to understand how mobile device strategies were developed and implemented and how the devices were being used in the schools.

Design and method: This qualitative study uses a case study method. It draws upon questionnaires, interviews and classroom observations, and builds upon previous research in English and Australian schools.

Findings: Results of the research indicate that the devices have only recently been incorporated into the school and suggest that their usage has been generally embraced by both school staff and parents. Key issues highlighted by these two schools included the importance of the school’s vision and uncertainty about the differences between models of provision. Participant responses also referenced some positive impacts on classroom practice, which amplify constructivist pedagogy: there were examples of device use extending student learning by supporting peer assessment, collaboration, research skills and projects.