A Comparison of Teacher Effectiveness Measures Calculated Using Three Multilevel Models for Raters Effects

This study examines the use of cross-classified random effects models (CCrem) and cross-classified multiple membership random effects models (CCMMrem) to model rater bias and estimate teacher effectiveness. Effect estimates are compared using CTT versus item response theory (IRT) scaling methods and three models (i.e., conventional multilevel model, CCrem, CCMMrem). Results indicate that ignoring rater bias can lead to teachers being misclassified within an evaluation system. The best estimates of teacher effectiveness are produced using CCrems regardless of scaling method. Use of CCMMrems to model rater bias cannot be recommended based on the results of this study; combining the use of CCMMrems with an IRT scaling method produced especially unstable results.     

The Misspecification of the Covariance Structures in Multilevel Models for Single-Case Data: A Monte Carlo Simulation Study

The impact of misspecifying covariance matrices at the second and third levels of the three-level model is evaluated. Results indicate that ignoring existing covariance has no effect on the treatment effect estimate. In addition, the between-case variance estimates are unbiased when covariance is either modeled or ignored. If the research interest lies in the between-study variance estimate, including at least 30 studies is warranted. Modeling covariance does not result in less biased between-study variance estimates as the between-study covariance estimate is biased. When the research interest lies in the between-case covariance, the model including covariance results in unbiased between-case variance estimates. The three-level model appears to be less appropriate for estimating between-study variance if fewer than 30 studies are included.     

Developing a student-led school mental health strategy

Although there is increasing interest in promoting mental health and wellbeing within education, to date, the voices of young people appear to have been almost completely overlooked in the development of school-based mental health practices. This is despite increasing focus on young people’s participation; and the fact that young people may be best positioned to understand the pressures of contemporary society. This paper, co-authored by educational psychologists (EPs), school students and the school vice-principal, documents the development of a student-led mental health initiative within a high-achieving girls’ grammar school, led by students aged 12–18. Following EP input, the students devised a whole-school, student-friendly mental health strategy with the support of the EPs and senior school staff. As the project progressed, it became evident that applying even carefully selected adult mental health models to school contexts might not be appropriate; instead the students advocated for young person-friendly, innovative, contemporary and creative ways of communicating information about mental health, which avoided stigma. The students involved were well-placed to identify environmental stressors and to disseminate their strategy. The authors conclude that mental health planning in schools should encourage greater student participation, show caution over applying adult mental health models and promote greater use of technology or visual resources.     

An Empirical Investigation Demonstrating the Multidimensional DIF Paradigm: A Cognitive Explanation for DIF

Differential Item Functioning (DIF) is traditionally used to identify different item performance patterns between intact groups, most commonly involving race or sex comparisons. This study advocates expanding the utility of DIF as a step in construct validation. Rather than grouping examinees based on cultural differences, the reference and focal groups are chosen from two extremes along a distinct cognitive dimension that is hypothesized to supplement the dominant latent trait being measured. Specifically, this study investigates DIF between proficient and non-proficient fourth- and seventh-grade writers on open-ended mathematics test items that require students to communicate about mathematics. It is suggested that the occurrence of DIF in this situation actually enhances, rather than detracts from, the construct validity of the test because, according to the National Council of Teachers of Mathematics (NCTM), mathematical communication is an important component of mathematical ability, the dominant construct being assessed. However, the presence of DIF influences the validity of inferences that can be made from test scores and suggests that two scores should be reported, one for general mathematical ability and one for mathematical communication. The fact that currently only one test score is reported, a simple composite of scores on multiple-choice and open-ended items, may lead to incorrect decisions being made about examinees.     

Scientific Collaboration with Educators: Practical Insights from an in‐Class Noise‐Reduction Intervention

Moving the field of Mind, Brain, and Education forward requires researchers and educators to reframe the boundaries of their own discipline in order to create knowledge that is both scientifically based, and of practical relevance for education. We believe that this could be done by co‐constructing research projects from the start. We present a case study of a noise‐reduction intervention in elementary classrooms, in which teachers and researchers worked together from the onset of study design. We examine the processes behind: (1) selecting research questions and measures, (2) planning interventions, (3) receiving ethical approval and funding, (4) recruiting schools, and (5) collecting data. At each step, our study provides suggestions for future collaborative efforts, keeping in mind broader theoretical and methodological implications. We believe that our concrete examples and suggestions will be useful for beginning and confirmed researchers, as well as teachers aiming to know more about research projects.     

A Qualitative Analysis of the Portrayal of Young People and Psychosis in Australian News Reports

ABSTRACT

News media plays an influential role in shaping society’s understanding of mental illness and can promote perspectives ranging from those that promote help-seeking behaviour to stigmatised associations with attributes such as danger and violence. Stigma has been found to have significant negative impacts on people with psychosis. No existing studies have explored how young people with psychosis are represented in newspapers. Targeting this gap, this study analysed news articles relating to youth psychosis to determine the types of discourses used. We searched the ProQuest Australia and New Zealand Newsstream database (2011-2016) for Australian newspaper articles related to young people and psychosis. Qualitative analysis was used to identify content and these were arranged into key themes. The recurring themes evident in the 27 articles linked youth psychosis to illicit drug use, violence and professional infighting about treatment options, and thus promoted significantly stigmatised perspectives of youth psychosis. Acknowledgement of these stigmatised discourses is important for encouraging responsible media reporting and for understanding the social messages impacting on treatment and help-seeking by young people. We discuss the conflicted role of journalists in presenting information about mental illness and recommend development of a more solutions-focused approach to reporting in this area.     

ICPSR meets OAIS: applying the OAIS reference model to the social science archive context

This paper reviews the archival process at the Inter-university Consortium for Political and Social Research (ICPSR), a repository of digital social science data, and maps ICPSR’s Ingest and Access operations to the Open Archival Information System (OAIS) Reference Model. The paper also assesses ICPSR’s conformance with the archival responsibilities of “trusted” OAIS repositories, with the proviso that audit criteria for archival certification are still under development. The ICPSR to OAIS mapping exercise has benefits for the larger social science archiving community because it provides an interpretation of the reference model in the quantitative social science environment and points to preservation-related issues that may be salient for other social science archives. Building on the archives’ long tradition of shared norms and cooperation, we may ultimately be able to design a federated system of trusted social science repositories that provides access to the global heritage.

An examination of gender and situational interest in multimedia learning environments

Existing research highlights conflicting results attempting to capture gender preferences with respect to unimodal versus multimodal designs in online learning. As online learning continues to expand, more research examining the role of gender in multimedia design holds considerable potential. However, the presence of multimedia in online learning contexts presents a more complex problem when taking into consideration the concept of learner interest. The current study sought to investigate gender differences in situational interest (SI) with respect to three different but related designs of an online, multimedia learning environment for continuing, professional education in emergency medical services. The content in these designs was identical, but applied different combinations of the redundancy and modality multimedia principles. A two-way analysis of variance was used to examine the types of SI by gender and type of multimedia design. While no significant difference or interaction effect was identified between gender and triggered SI, an interaction effect was observed for females and the different multimedia designs. Specifically, females reported a higher maintained SI when animation, narration and text were effectively combined. The findings of this study provide insight into best practices for instructional and media designers developing multimedia learning environments as well as future research implications.     

Transitioning from practicing teacher to teacher leader: a case study

Given US students’ lack of international competitiveness in mathematics and science, many states have adopted the Common Core State Standards for Mathematics (CCSSM). To help ensure that the Standards for Mathematical Practice within the CCSSM and effective teaching practices are implemented appropriately, many teachers are emerging as teacher leaders with the intent of supporting teachers with this implementation. Unfortunately, not all of these teachers are necessarily prepared in the field of teacher leadership. Recognizing the importance of having well-prepared teacher leaders, this article describes the case of Ms. Hodges, as she transitioned from mathematics teacher to teacher leader. Data revealed that several factors affected Ms. Hodges’ transition, some positively and others negatively. These results as well as implications for teacher leader development are provided.     

Nobility,women and historical narratives of the crusades and the latin east

Historical narratives of the crusades and Latin settlement in the Levant, like other medieval literature, provide slim details about women. In medieval society Latin literary education was dominated by a predominantly male and ecclesiastical hierarchy, which reflected the views of a patriarchal social system and marginalised the public role of women. Crusade narratives in particular have been criticised for their negative attitude towards women, mirroring a lack of ecclesiastical enthusiasm at their involvement in the crusade movement. Histories about crusading and events in the Latin East were often written for, and in some cases by, the lay nobility who took part in crusades and settled in the holy land. These texts were sometimes used as propaganda to encourage nobles to take the cross, and much of the imagery within them had didactic elements. In the case of women, they provided models for behaviour according to social and marital status. A consistently negative portrayal of women was doubtless impossible due to the number of important noblewomen who took the cross, and their value in cementing political alliances between western Europe and the Latin East through marriage. This article contends that it is the complex links between crusade narratives and the nobility, in terms of participation and patronage, audience, subject matter and values – crusade as a “noble” pursuit – which helps to explain the discrepancy between established ecclesiastical views and the portrayal of women in historical narratives about crusading and settlement in the East. In order to establish this idea effectively, several main themes must be addressed, including the role of crusade texts within the context of contemporary noble culture, and crusade narratives as source material for noble values concerning women. To begin, however, it is necessary to provide some background on attitudes towards women and crusade, as well as the concept of nobility and the noblewoman's place in medieval society.