Examining the Rule of Thumb of Not Using Multilevel Modeling: The “Design Effect Smaller Than Two” Rule

Educational researchers commonly use the rule of thumb of “design effect smaller than 2” as the justification of not accounting for the multilevel or clustered structure in their data. The rule, however, has not yet been systematically studied in previous research. In the present study, we generated data from three different models (which differ in the location of the clustering effect). With a 3 (design effect) × 5 (cluster size) × 4 (number of clusters) Monte Carlo simulation study we found that the rule should not be applied when researchers: (a) are interested in the effects of higher-level predictors, or (b) have a cluster size less than 10. Implications of the findings and limitations of the study are discussed.     

The Student Perception of Wellbeing Questionnaire: Preliminary Investigation into its Psychometric Properties

An estimated 20% of all adolescents will experience a depressive disorder by the age of 18, with schools being at the forefront of initiatives to promote resilience and well-being. This study reports on the development of the 24-item Student Perception of Wellbeing Questionnaire (SPWQ), created as a measure of well-being in three areas: exercise, explanatory style, and conflict resolution. The SPWQ was administered to 235 male school students from Years 6–8 and 251 female students from Years 7–9, and a principal components analysis with varimax rotation was performed on the data obtained. A three-factor solution was identified dealing with explanatory style, conflict resolution, and exercise, which explained 31% of the total variance. The scale was found to have strong internal consistency with a Cronbach alpha coefficient of α = 0.80 for the male students and α = 0.84 for the female students.     

Dialogue with a conversational agent promotes children’s story comprehension via enhancing engagement

Dialogic reading, when children are read a storybook and engaged in relevant conversation, is a powerful strategy for fostering language development. With the development of artificial intelligence, conversational agents can engage children in elements of dialogic reading. This study examined whether a conversational agent can improve children's story comprehension and engagement, as compared to an adult reading partner. Using a 2 (dialogic reading or non-dialogic reading) × 2 (agent or human) factorial design, a total of 117 three- to six-year-olds (50% Female, 37% White, 31% Asian, 21% multi-ethnic) were randomly assigned into one of the four conditions. Results revealed that a conversational agent can replicate the benefits of dialogic reading with a human partner by enhancing children's narrative-relevant vocalizations, reducing irrelevant vocalizations, and improving story comprehension.     

Investigating science teacher educator identity through the politics of domestication and critical positional praxis

The focus on identity in the field of teaching and learning continues to grow, especially when it concerns equitable outcomes for students. While most attention is placed on students' identities and increasingly those of teachers, lesser addressed are the identities of the teacher educators and researchers broaching the issue of identity. Additionally, identity research is not often linked to relationships between self, others, and transformative action. We recognize these as gaps to be addressed and offer critical positional praxis (CPP) as a response. CPP is the public manifestation of the insights gained through our sense of identity and reflexivity. More specifically, CPP is the actions (or inactions) that express who we are in response to an event in any given social context—especially oppressive ones. In this article, we draw from our own critical autoethnographies, as a context for putting CPP into practice in identity research. Our collective analysis of these critical autoethnographies revealed how our identity development was inseparable from the ways in which we have each resisted the politics of domestication. Our autoethnographies further point to the role of dissent as central to our experiences of becoming critical science teacher educators committed to equity, diversity, and anti-racism in education. We draw from this analysis to offer recommendations for how identity and positionality can move beyond theoretical constructs toward transformative personal and collective change in science education.     

In search of systemic innovation for sustainable development: A design praxis emerging from a decade of social learning inquiry

Processes of designing for systemic innovation for sustainable development (SD) through the lens of three long-term case studies are reported. All case studies, which originated from the SLIM (Social Learning for the Integrated Management and Sustainable Use of Water at Catchment Scale) Project, funded within the EU Fifth Framework Program (2001–2004), constitute inquiry pathways that are explored using a critical incident approach. The initial starting conditions for each inquiry pathway are compared; significant pathway dependencies are identified which foster the development of social learning processes locally, but constrain their uptake and embedding across the wider system of interest. In the first case study, in England & Wales, promising developments in the application of social learning approaches to river basin planning over an initial 3-year period were subsequently marginalised, only to resurface towards the end of the 10-year period of study. In the second, South African case study, significant spaces for social learning and innovation in integrated water resources management were opened up over a five year period but closed down again, primarily as the result of lack of policy support by national government. The third, Italian, case study was designed to assess options for adapting to climate change by opening up new learning spaces between researchers, stakeholders and policy makers. A case for investing in local level systemic innovation through social-learning praxis design approaches and in learning processes around well contextualised case-studies is supported. However, concomitant investment by policy makers in social learning as an alternative, but complementary, governance mechanism for systemic innovation for SD is needed.