Complicating methodological transparency

A historical indicator of the quality, validity, and rigor of qualitative research has been the documentation and disclosure of the behind-the-scenes work of the researcher. In this paper, we use what we call methodological data as a tool to complicate the possibility and desirability of such transparency. Specifically, we draw on our disparate attempts to address calls for transparency about methodological processes in our respective dissertation studies in order to examine how novice researchers can explore transparency as a situated, ongoing, and philosophically informed series of decisions about how, when, and if to be transparent about our work. This work contributes to conversations about how qualitative researchers in education can understand, discuss, and teach qualitative inquiry while continuing to push the boundaries of the field.     

Student Assessment of Self-Efficacy and Practice Readiness Following Simulated Instruction in an Undergraduate Social Work Program

ABSTRACT

The use of simulated instruction is a growing trend in social work education. This study examined the effectiveness of simulated instruction with undergraduate social work students. In this mixed methods study, the extent to which simulated instruction improved self-efficacy and practice readiness was assessed. Results of the study suggest that simulated instruction helps improve key practice skills and increases recognition of diversity in practice. Moreover, students self-reported increased mastery in interviewing, managing emotions, and engaging in culturally competent practice.     

Evaluating the Social Validity of Project TEAM: A Problem-Solving Intervention to Teach Transition Age Youth with Developmental Disabilities to Resolve Environmental Barriers

Project TEAM teaches transition-age youth with developmental disabilities (DD) to identify physical and social environmental barriers and supports, generate solutions to barriers, and request modifications to increase participation. Establishing the social validity of this environment focused intervention with youth and their parents is critical, given the significant shift the intervention represents from rehabilitation’s more traditional focus on body structures and function. University researchers and youth research collaborators conducted a participatory evaluation of the purpose, procedures, and perceived benefits of Project TEAM. Youth with DD (n = 42) provided feedback using three methods: activity voting, a survey, and a focus group. Parents (n = 37) also provided feedback. Results suggest that both youth and parents find Project TEAM acceptable and relevant to youth’s current and future lives. The majority of youth and parents felt Project TEAM fostered independence and empowerment, although some youth and parents reported challenges with the unique environment-focused approach.     

Different teacher-level effectiveness estimates,different results: inter-model concordance across six generalized value-added models (VAMs)

In this study, researchers compared the concordance of teacher-level effectiveness ratings derived via six common generalized value-added model (VAM) approaches including a (1) student growth percentile (SGP) model, (2) value-added linear regression model (VALRM), (3) value-added hierarchical linear model (VAHLM), (4) simple difference (gain) score model, (5) rubric-based performance level (growth) model, and (6) simple criterion (percent passing) model. The study sample included fourth to sixth grade teachers employed in a large, suburban school district who taught the same sets of students, at the same time, and for whom a consistent set of achievement measures and background variables were available. Findings indicate that ratings significantly and substantively differed depending upon the methodological approach used. Findings, accordingly, bring into question the validity of the inferences based on such estimates, especially when high-stakes decisions are made about teachers as based on estimates measured via different, albeit popular methods across different school districts and states.     

Teacher–Child Interactions in Early Head Start Classrooms: Associations With Teacher Characteristics

ABSTRACT

Research Findings: The current study examined characteristics of 71 Early Head Start lead teachers in relation to classroom interactions with infants and toddlers. Measured teacher characteristics included education, years of experience, beliefs about child rearing, depressive symptoms, and the temperamental characteristics of positivity and frustration. Teacher–child interactions were measured using the Classroom Assessment Scoring System, Toddler Version (La Paro, Hamre, & Pianta, 2012). Results indicated that field of degree was directly associated with the majority of dimensions of teacher–child interactions. Examination of teachers’ years of experience and intrapersonal characteristics revealed a number of significant interactions, indicating that teacher experience and appropriate beliefs may serve as protective factors in the presence of psychosocial risk factors. Practice or Policy: Overall, our findings suggest that both early childhood education degrees and years of experience are directly or indirectly associated with multiple dimensions of teacher–child interactions, confirming that these patterns established for preschool teachers hold for teachers of infants and toddlers. These results also suggest that years of experience and progressive beliefs about children may be especially important for teachers who are depressed or who have low levels of positivity and high levels of frustration. Implications for future research, as well as preservice and in-service professional development, are discussed.     

Child abuse screening: Implications of the limited predictive power of abuse discriminants from a controlled family study of pediatric social illness

The predictive value of a child abuse screening instrument on unselected populations is illustrated for varying hypothesized levels of child abuse prevalence in order to demonstrate outcome of a hypothetical national screening program. At any level of application, the prediction of false positives and false negatives suggests a low practical utility for an unacceptably high social cost.     

Interactivity: Moving Beyond Terminology

Abstract Museum professionals strive to provide meaningful experiences for visitors. Meaningful experiences are those that provide choice and control in the exploration of ideas, concepts, and objects. In many cases, these experiences occur through an interactive component. Although a number of studies have focused on interactives in museums, the field would benefit from an intensive look at how visitors perceive of and learn from these experiences. Discussion about this topic has been sidetracked by conversations about the terminology that describes this type of experience. Drawing upon studies conducted in this area, this paper looks at the role of interactives in museums by exploring three broad themes: clarity of purpose and underlying assumptions; design factors; and social engagement and learning. In conclusion, suggestions are offered for ways that these studies might inform the development of interactive experiences.     

Students as political actors? Similarities and differences across six European nations

Drawing on data from students, higher education staff and policymakers from six European countries, this article argues that it remains a relatively common assumption that students should be politically engaged. However, while students articulated a strong interest in a wide range of political issues, those working in higher education and influencing higher education policy tended to believe that students were considerably less politically active than their predecessors. Moreover, while staff and policy influencers typically conceived of political engagement in terms of collective action, articulated through common reference to the absence of a ‘student movement’ or unified student voice, students’ narratives tended not to valorise ‘student movements’ in the same way and many categorised as ‘political’ action they had taken alone and/or with a small number of other students. Alongside these broad commonalities across Europe, the article also evidences some key differences between nation-states, institutions and disciplines. In this way, it contributes to the comparative literature on young people’s political engagement specifically, as well as wider debates about the ways in which higher education students are understood.     

Investigating Student Perceptions of a Dissection-Based Undergraduate Gross Anatomy Course Using Q Methodology

The demand for upper-level undergraduate dissection-based anatomy courses is growing, as professional programs require more advanced anatomy training prior to matriculation. To address this need, Indiana University School of Medicine (IUSM) partnered with Indiana University-Purdue University Indianapolis—a large, urban, life science-focused campus nearby to IUSM—to offer an undergraduate, dissection-based course in regional gross anatomy. Because this is a new course, a deeper post-course evaluation of student perceptions was conducted using Q methodology. In this study, Q methodology was used to evaluate student views of the overall course structure, pre-laboratory materials and activities, assessments, and quality of instruction. Of the 15 students in the spring semester 2018 cohort, 80% (n = 12) participated in the evaluation, and 10 of those students followed up with written explanations for their rationale in selecting the four statements with which they most strongly agreed and disagreed. The Q methodology sorted the students into one of three statistically significant groups: Motivated Dissectors (n = 6), Traditional Students (n = 3), and Inspired Learners (n = 3). Motivated Dissectors and Inspired Learners felt strongly that the course did not encourage self-directed learning and that the pre-laboratory materials were not adequate to prepare them for quizzes. Traditional Students, however, disagreed, having a favorable opinion of the pre-laboratory materials, even though this group felt most strongly that the amount of material covered in the course was overwhelming. This study demonstrates the utility of Q methodology to evaluate courses to elucidate student perspectives and inform future course modifications.