Measuring the impact of a new faculty program using institutional data

This paper presents a quasi-experimental evaluation of a required, teaching-focused, new faculty program at a large research university. The study makes use of institutional data, including student evaluations of teaching and faculty participation in educational development activities, which are available on many campuses yet rarely used in program evaluation. Results show positive impacts. Faculty found the program valuable and reported increases in their preparation for a range of teaching tasks. In comparison to earlier cohorts, program participants received stronger student evaluations on two global items, and demonstrated significantly more connections with the teaching center in their early careers.     

Redefining leadership in schools: the Cheshire Cat as unconventional metaphor

ABSTRACT

Moving away from the study of the principal as the central leader figure in schools, this article argues for an alternative narrative for school leadership. It draws on empirical data from a doctoral study to propose a new way of thinking about the school leader through the unusual metaphor of the Cheshire Cat.

Examining the stories of 11 school leaders from one independent PK-12 Western Australian school, including middle leaders who are often absent in school leadership literature, this article provides insights into school leaders’ perceptions of themselves as leaders, and their private processes of decision making. These leader stories challenge the notion of school leadership as an archetypal story of a central figure, showing that it can instead be quiet, subtle, fluid, and even deliberately invisible.

The visible-invisible Cheshire Cat school leader enacts collective vision, action, and transformation by acting as a deliberate and skilled collaborator in a complex, networked web. This reimagined school leader is one who makes careful decisions about how to best serve their communities, how to foster trust, and how to distribute power and agency, including when to appear and disappear, when to step forward and step back, when to direct and when to empower.     

Psychometric Properties of Scale Scores and Performance Levels for Performance Assessments Using Polytomous IRT

With a focus on performance assessments, this paper describes procedures for calculating conditional standard error of measurement (CSEM) and reliability of scale scores and classification consistency of performance levels. Scale scores that are transformations of total raw scores are the focus of these procedures, although other types of raw scores are considered as well. Polytomous IRT models provide the psychometric foundation for the procedures that are described. The procedures are applied using test data from ACT's Work Keys Writing Assessment to demonstrate their usefulness. Two polytomous IRT models were compared, as were two different procedures for calculating scores. One simulation study was done using one of the models to evaluate the accuracy of the proposed procedures. The results suggest that the procedures provide quite stable estimates and have the potential to be useful in a variety of performance assessment situations.     

Designing classroom spaces: Making the most of time

Research has shown that children's perception of the space around them is related to the quality of their play behaviors. Summaries of three research studies with preschoolers show that when children perceive themselves large, they enter complex play more quickly and stay for longer periods of time. The quality of children's play behavior changed when children played in small spaces. In these three studies, space was altered by: (a) creating a screened structure in the classroom, (b) changing the scale of the patterns on the wall of a learning center, and (c) altering the size of the block center. Each study is summarized and suggestions for designing classroom spaces are included. Implications of this program of research for increasing attention span and augmenting complex play and problem solving are discussed.     

Integration of Gamification into Course Design: A Noble Endeavor with Potential Pitfalls

In this article, we provide a commentary on the current state of gamification in higher education by reviewing the research literature, noting a lack of research focused on the design of gamified postsecondary courses. To address this issue, we discuss four potential pitfalls instructors may encounter when designing gamified learning activities. We conclude with suggestions related to how instructors can avoid these common stumbling blocks.     

Ecological influences on teachers’ well-being and “fitness”

The complex and ever-changing nature of teachers’ work challenges their well-being. Teacher well-being and “fitness” includes versatility, mental strength, and commitment to promote effective teaching and learning. In framing this notion, we seek to understand the ecological influences impacting on teacher well-being and “fitness” in the twenty-first century. Drawing on the ecological theory of Bronfenbrenner, this interpretive qualitative study explored the perceptions of pre-service teachers in relation to their teacher well-being and “fitness.” Data were collected from a teacher well-being survey completed by 120 final-year undergraduate pre-service teachers. The survey shed light on themes at four levels: the microsystem (individual and collective capacities); mesosystem (interrelationships between contexts); exosystem (organisational); and macrosystem (societal and legislative influences), compounded by the influence of time at the chronosystem level. These ecological influences were perceived to impact on teacher well-being and ability to be “fit” for sustained performance.     

Child Temperament and Home-Based Parent Involvement at Kindergarten Entry: Evidence From a Low-Income,Urban Sample

Research Findings: Home-based involvement—defined as the actions parents take to promote children’s learning outside of school—is often the most efficient way for low-income parents to be involved with their children’s education. However, there is limited research examining the factors predicting home-based involvement at kindergarten entry for low-income families. This is a notable oversight given established links between parent involvement and children’s educational outcomes. To learn more about this gap, we used data from 220 low-income, urban students to examine associations between 4 dimensions of child temperament—negative reactivity, task persistence, withdrawal/shyness, and motor activity—and home-based parent involvement. Parent–child conflict was also examined as a mechanism explaining associations between dimensions of child temperament and parent involvement. Hierarchical multiple regression analyses revealed that a withdrawn/shy temperament in children predicted lower levels of home-based parent involvement, whereas a task-persistent temperament predicted higher levels of home-based parent involvement. Parent–child conflict partially mediated the relationship between task persistence and home-based parent involvement. Practice or Policy: Results expand understanding of home-based involvement at kindergarten entry in low-income families and illuminate the need to consider child temperament within the context of early intervention programs.     

Students’ Independent Use of Screencasts and Simulations to Construct Understanding of Solubility Concepts

As students increasingly use online chemistry animations and simulations, it is becoming more important to understand how students independently engage with such materials and to develop a set of best practices for students’ use of these resources outside of the classroom. Most of the literature examining students’ use of animations and simulations has focused on classroom use with some studies suggesting that better outcomes are obtained when students use simulations with minimal guidance while others indicate the need for appropriate scaffolding. This study examined differences with respect to (1) student understanding of the concept of dissolution of ionic and covalent compounds in water and (2) student use of electronic resources when students were asked to complete an assignment either by manipulating a simulation on their own or by watching a screencast in which an expert manipulated the same simulation. Comparison of students’ pre- and posttest scores, answers to assignment questions, near-transfer follow-up questions, and eye-tracking analysis suggested that students who viewed the screencast gained a better understanding of the dissolving process, including interactions with water at the particulate level, particularly for covalent compounds. Additionally, the eye tracking indicated that there were significant differences in the ways that the different treatment groups (screencast or simulation) used the electronic resources.