Managing What We Can Measure: Quantifying the Susceptibility of Automated Scoring Systems to Gaming Behavior

As methods for automated scoring of constructed‐response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct‐irrelevant response behavior may affect automated constructed‐response scoring, and aims to address a gap in that literature: the need to assess the degree of risk before operational launch. A general framework is proposed for evaluating susceptibility to gaming, and an initial empirical demonstration is presented using the open‐source short‐answer scoring engines from the Automated Student Assessment Prize (ASAP) Challenge.     

Special education in Romania

ABSTRACT

The purpose of this paper is to give a closer view of the realities in special education in Romania, as part of the general reform in the educational system. It outlines the most important features of the past that have led to the present problems which Romania has to face, and presents the main categories of disadvantaged children in the context of social protection guaranteed by the present laws. Where available, data with respect to the years 1991 to 1993 are given.     

Opening classroom interaction: the importance of feedback

Efforts to encourage ‘interactive practice’ in the National Literacy (NLS) and Numeracy (NNS) Strategies in the UK, have led to an emphasis on teacher questions. Recent research into classroom interactions, however, indicate that the pattern of interaction remains largely unchanged since the introduction of these strategies in terms of the type and amount of questions teachers are asking, and the opportunities for extended pupil participation. This article uses evidence gathered from a large‐scale research project examining classroom interactions during literacy and numeracy lessons, and the researchers' critical reflections upon this process, to examine conceptions of interactive pedagogy. It is argued that in order to ‘open’ classroom interaction, emphasis should be less on the questions teachers ask, and more on the manner with which teachers react to pupils' responses to questions. Episodes of classroom interaction from video recorded literacy and numeracy lessons taken as part of the study are used to support this argument. They present evidence of teacher behaviours in reaction to pupils' responses which succeed in facilitating a more interactive learning environment. The implication that such behaviour will contribute towards a model of effective interactive practice is also discussed.     

Against the current: A grounded theory study on the estrangement experiences of a select group of Filipino gay older persons

According to Healthy People (2011), in order to understand the health concerns of the Lesbian, Gay, Bisexual, and Transgender (LGBT), the oppression and discrimination that they have faced must be scrutinized. Among the many issues they face, their estrangement experiences are one of the most understudied. However, little is known about how it is experienced by the gay elderly population, hence, this investigation. This grounded theory purports to describe the process by which estrangement is experienced among the Filipino gay older adults. Strauss and Corbin’s Grounded Theory (1990) design was utilized. A total of 10 gay older persons were purposively chosen to participate in semi-structured interviews. Field texts were subjected to thematic analysis involving open, axial, and selective coding. The study generated The Sailing Model of Estrangement. Remarkably, three phases relative to estrangement emerged, namely: sequestering, striving, and surviving. Primarily, the sequestering phase involves the gay persons’ need to express self, search for acceptance, and its subsequent reactions. The striving phase typifies the struggle in dealing with estrangement leading to either feelings of depression, remorse and shame or positivity, hopefulness, and motivation. Finally, in the surviving phase, gay persons may either feel contented and fulfilled or sad, lonely, and remorseful as they acquiesce aging with estrangement. Findings of the study offer an understanding of how Filipino gay older adults employ coping strategies in response to estrangement.     

Mothers’ and Fathers’ Roles in Caring for an Adult Child with an Intellectual Disability

To date, there have been few studies of mothers’ and fathers’ roles in caring for their adult children with intellectual disabilities. The present study investigated the care-giving roles of mother and father couples caring for their adult offspring with an intellectual disability, their psychological health, and the demands and satisfaction of their care-giving roles. Twelve Anglo-Australian middle-aged mother and father couples with an adult child with intellectual disability (mean age?=?24 years) participated in semi-structured interviews about their care-giving roles and completed a series of questionnaires pertaining to care-giving difficulties and satisfaction, hassles and uplifts, and general health. Findings indicated that an extremely high proportion of both mothers and fathers were in the clinical range for social dysfunction, anxiety/insomnia, and somatic complaints, although levels of depression were relatively low. The present study found that mothers undertake more daily care-giving tasks than fathers, but that the range of tasks is similar. Mothers also reported significantly more care-giving difficulties and satisfaction than fathers. Associations between measures differed somewhat for the two parent groups, indicating the need for further exploration of both mothers’ and fathers’ experiences.     

IMPROVING OUTCOMES IN MATHEMATICS IN NEW ZEALAND: A DYNAMIC APPROACH TO THE POLICY PROCESS

Intervention at scale with the aim of improving student participation, engagement and outcomes in mathematics education is a challenge for educational policy makers and reformers. This article argues that an iterative annual cycle of policy formulation, implementation and evaluation enabled ongoing adjustments to the strategic focus, the professional development model and the system infrastructure as the New Zealand Numeracy Development Project was taken to scale. The analysis draws on the project’s evaluation data over a 6-year period to demonstrate how adjustments were made over time to the pedagogical tools and to the professional development processes. The ongoing development of knowledge supported the management of strategic risks in taking the project to scale: the ongoing appropriation of adequate levels of resourcing to support the school-based professional development model and the availability of system-wide expertise for effective implementation. The analysis suggests that conceptualising implementation as an interdependent and interrelated component of an iterative policy process and as an opportunity for knowledge building ensured a continuing focus on student outcomes. The dynamic approach to the policy process appeared central to building this intervention’s effectiveness and feasibility at scale.     

Validation of the elementary social behaviour assessment: teacher ratings of students’ social skills adapted to Norwegian,grades 1–6

This study investigated the psychometric properties of the Elementary Social Behaviour Assessment (ESBA), a teacher-report measure of students’ social skills and academic engagement adapted for use in Norwegian schools. At two times, 8 weeks apart, 151 teachers rated 793 students in Grades 1–6 on the ESBA and the Social Skills Rating System Teacher’s form (SSRS-T). Exploratory factor analysis with the first assessment suggested one or possibly two factors. Confirmatory factor analysis with the second assessment confirmed the one- or two-factor models but did not offer strong evidence for one over the other. The ESBA demonstrated good to excellent reliability. Strong concurrent and predictive correlations with the SSRS-T established criterion validity. The school and teacher levels explained only a limited amount of the total variance in ESBA scores, suggesting that teachers rate students quite similarly. The Norwegian-adapted ESBA paralleled the reliability and validity evidence from US samples.     

Enhancing quality with a research-based student feedback instrument: a comparison of veterinary students’ learning experiences in two culturally different European universities

This paper explores the value of a research-based student inventory from the quality assurance point of view in two culturally different European higher education institutions for veterinary education. Perceived heavy workload is a well-known problem in veterinary studies and is a challenge to the quality of learning. First- and third-year students in both institutions responded to an inventory consisting of items regarding their approaches to learning, self-efficacy, study workload and the teaching-learning environment. There were differences in students’ approaches to learning and perceived workload between the two institutions. In both contexts, the strongest predictor of the workload turned out to be the surface approach to learning. Self-efficacy showed a positive correlation with the deep approach to learning and organised studying. The strengths of the teaching-learning environment varied between the institutions. Moreover, the present study discusses how the gained information could be used in improving the teaching-learning environment and students’ learning.     

Anti-bullying procedures for schools in Ireland: principals’ responses and perceptions

The role of the principal is imperative in creating a school climate that nurtures differences and equality at the same time. Policy and legislation in Ireland dictates the responsibility of school principals in preventing and intervening in issues relating to bullying. The current research investigates the extent to which principals consider the impact of bullying on their students and the strategies they take to combat it in their schools. We consider how principals respond to bullying and what supports they feel are missing for them to adhere to relevant policy. A sample of 918 principals from a range of schools across Ireland completed an online survey. The results demonstrated some positive actions by principals such as the provision of anti-bullying policies. However, they also document areas that need more action such as increased access to counsellors and appointing a specific staff member to deal with and tackle bullying in each school. Guidance from the Department of Education and Skills in Ireland on the development and provision of an anti-bullying programme is called for. Results are discussed in light of the current Anti-Bullying Procedures established by the Department of Education and Skills and the Action Plan for Bullying 2013.