From the Editor

Educational Assessment, Evaluation and Accountability -     

Managing What We Can Measure: Quantifying the Susceptibility of Automated Scoring Systems to Gaming Behavior

As methods for automated scoring of constructed‐response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct‐irrelevant response behavior may affect automated constructed‐response scoring, and aims to address a gap in that literature: the need to assess the degree of risk before operational launch. A general framework is proposed for evaluating susceptibility to gaming, and an initial empirical demonstration is presented using the open‐source short‐answer scoring engines from the Automated Student Assessment Prize (ASAP) Challenge.     

Religious Pluralistic Language in a Computer-Mediated Context: Effects of Intergroup Salience and Religious Orientation

This study investigated the degree to which religious pluralistic language varies as a function of the intergroup salience of a context and religious orientation. Based on a 2 (Religious Salience of Context) × 3 (Religious Salience of Topic) experimental design, participants (N = 239) were instructed to compose an e-mail to an interactional partner based on the randomly assigned condition. Messages were coded for religious pluralistic language, and participants completed measures of religious orientation and evaluations of the conversational partner. Modest effects were found for both intergroup salience of the context and topic as well as religious orientation.     

The relationship between school belonging,sibling aggression and bullying involvement: implications for students with and without disabilities

Bullying is grounded in the interactions between an individual and complex social–ecological systems. Therefore, bullying involvement is not just confined to the classroom or school. Recent research suggests that sibling aggression may be a predictor for peer-level aggression. These findings may be more relevant for students with disabilities because studies suggest that students with disabilities are disproportionately involved in the bullying dynamic. Therefore, this study explored the intersection between sibling aggression and school belonging on bullying, victimisation and fighting for 14,508 students, including 1183 students with disabilities and 13,325 students without disabilities in grades 6 through 12. As hypothesised, students with disabilities reported higher levels of victimisation, bullying and fighting. Additionally, high levels of school belonging partially buffered fighting and bullying behaviours for students with and without disabilities. These findings demonstrate the importance of establishing an inclusive and safe environment for school-aged youth.     

Opening classroom interaction: the importance of feedback

Efforts to encourage ‘interactive practice’ in the National Literacy (NLS) and Numeracy (NNS) Strategies in the UK, have led to an emphasis on teacher questions. Recent research into classroom interactions, however, indicate that the pattern of interaction remains largely unchanged since the introduction of these strategies in terms of the type and amount of questions teachers are asking, and the opportunities for extended pupil participation. This article uses evidence gathered from a large‐scale research project examining classroom interactions during literacy and numeracy lessons, and the researchers' critical reflections upon this process, to examine conceptions of interactive pedagogy. It is argued that in order to ‘open’ classroom interaction, emphasis should be less on the questions teachers ask, and more on the manner with which teachers react to pupils' responses to questions. Episodes of classroom interaction from video recorded literacy and numeracy lessons taken as part of the study are used to support this argument. They present evidence of teacher behaviours in reaction to pupils' responses which succeed in facilitating a more interactive learning environment. The implication that such behaviour will contribute towards a model of effective interactive practice is also discussed.     

IMPROVING OUTCOMES IN MATHEMATICS IN NEW ZEALAND: A DYNAMIC APPROACH TO THE POLICY PROCESS

Intervention at scale with the aim of improving student participation, engagement and outcomes in mathematics education is a challenge for educational policy makers and reformers. This article argues that an iterative annual cycle of policy formulation, implementation and evaluation enabled ongoing adjustments to the strategic focus, the professional development model and the system infrastructure as the New Zealand Numeracy Development Project was taken to scale. The analysis draws on the project’s evaluation data over a 6-year period to demonstrate how adjustments were made over time to the pedagogical tools and to the professional development processes. The ongoing development of knowledge supported the management of strategic risks in taking the project to scale: the ongoing appropriation of adequate levels of resourcing to support the school-based professional development model and the availability of system-wide expertise for effective implementation. The analysis suggests that conceptualising implementation as an interdependent and interrelated component of an iterative policy process and as an opportunity for knowledge building ensured a continuing focus on student outcomes. The dynamic approach to the policy process appeared central to building this intervention’s effectiveness and feasibility at scale.     

Anti-bullying procedures for schools in Ireland: principals’ responses and perceptions

The role of the principal is imperative in creating a school climate that nurtures differences and equality at the same time. Policy and legislation in Ireland dictates the responsibility of school principals in preventing and intervening in issues relating to bullying. The current research investigates the extent to which principals consider the impact of bullying on their students and the strategies they take to combat it in their schools. We consider how principals respond to bullying and what supports they feel are missing for them to adhere to relevant policy. A sample of 918 principals from a range of schools across Ireland completed an online survey. The results demonstrated some positive actions by principals such as the provision of anti-bullying policies. However, they also document areas that need more action such as increased access to counsellors and appointing a specific staff member to deal with and tackle bullying in each school. Guidance from the Department of Education and Skills in Ireland on the development and provision of an anti-bullying programme is called for. Results are discussed in light of the current Anti-Bullying Procedures established by the Department of Education and Skills and the Action Plan for Bullying 2013.     

Teacher Evaluation, Leadership and Learning Organizations

This article presents the argument that meaningful teacher evaluation in schools can be an important catalyst for organizational learning and school improvement when it is linked to broader conceptions of leadership in schools. A state-of-the-art teacher evaluation, assessment and professional growth system is described and the manner in which this system is linked to leadership density, organizational learning, and school improvement is detailed. Findings from two contrasting case studies of schools implementing this new system are presented and implications of the findings for linking teacher evaluation systems, newer conceptions of school leadership, and school improvement are described.     

Extinction and retraining of simultaneous and successive flavor conditioning

In three experiments, rats received pairings of flavor conditioned stimuli with polycose unconditioned stimuli, in either a simultaneous or a sequential relation. Both temporal relations produced excellent conditioned increases in consumption of the flavors. Separate presentation of the flavors resulted in extinction in both cases. However, restoring the pairing of the flavor with polycose resulted in reconditioning only with the sequential, not with the simultaneous, relation.