Managing What We Can Measure: Quantifying the Susceptibility of Automated Scoring Systems to Gaming Behavior

As methods for automated scoring of constructed‐response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct‐irrelevant response behavior may affect automated constructed‐response scoring, and aims to address a gap in that literature: the need to assess the degree of risk before operational launch. A general framework is proposed for evaluating susceptibility to gaming, and an initial empirical demonstration is presented using the open‐source short‐answer scoring engines from the Automated Student Assessment Prize (ASAP) Challenge.     

Tool Support for Teaching the Personal Software Process

Software engineering education can be viewed as a challenging task. Computer science students tend to focus on the programming aspects of a project, and take a “hacking approach” to completing a project, rather than viewing the process. Our course material includes teaching the Personal Software Process (PSP). Students are required to produce defect and effort metrics, as well as project summary reports. Tools to assist information recording and production of reports are difficult for students to access. The cost in terms of financial and learning time is usually too high at the educational level to justify using commercial tools that are available for the professional software engineer. We have developed a tool—Personal Assistant for Software Engineers—to aid students in the learning of the PSP. The tool has been successfully used in four subjects for a semester. Following feedback and evaluation, it has been redesigned, and is currently in stage two. The tool has been useful for students, and has automated the previous manual process of producing time and defect reports, along with project summaries, thus allowing them to focus on the meaning of the information.     

Opening classroom interaction: the importance of feedback

Efforts to encourage ‘interactive practice’ in the National Literacy (NLS) and Numeracy (NNS) Strategies in the UK, have led to an emphasis on teacher questions. Recent research into classroom interactions, however, indicate that the pattern of interaction remains largely unchanged since the introduction of these strategies in terms of the type and amount of questions teachers are asking, and the opportunities for extended pupil participation. This article uses evidence gathered from a large‐scale research project examining classroom interactions during literacy and numeracy lessons, and the researchers' critical reflections upon this process, to examine conceptions of interactive pedagogy. It is argued that in order to ‘open’ classroom interaction, emphasis should be less on the questions teachers ask, and more on the manner with which teachers react to pupils' responses to questions. Episodes of classroom interaction from video recorded literacy and numeracy lessons taken as part of the study are used to support this argument. They present evidence of teacher behaviours in reaction to pupils' responses which succeed in facilitating a more interactive learning environment. The implication that such behaviour will contribute towards a model of effective interactive practice is also discussed.     

IMPROVING OUTCOMES IN MATHEMATICS IN NEW ZEALAND: A DYNAMIC APPROACH TO THE POLICY PROCESS

Intervention at scale with the aim of improving student participation, engagement and outcomes in mathematics education is a challenge for educational policy makers and reformers. This article argues that an iterative annual cycle of policy formulation, implementation and evaluation enabled ongoing adjustments to the strategic focus, the professional development model and the system infrastructure as the New Zealand Numeracy Development Project was taken to scale. The analysis draws on the project’s evaluation data over a 6-year period to demonstrate how adjustments were made over time to the pedagogical tools and to the professional development processes. The ongoing development of knowledge supported the management of strategic risks in taking the project to scale: the ongoing appropriation of adequate levels of resourcing to support the school-based professional development model and the availability of system-wide expertise for effective implementation. The analysis suggests that conceptualising implementation as an interdependent and interrelated component of an iterative policy process and as an opportunity for knowledge building ensured a continuing focus on student outcomes. The dynamic approach to the policy process appeared central to building this intervention’s effectiveness and feasibility at scale.     

Anti-bullying procedures for schools in Ireland: principals’ responses and perceptions

The role of the principal is imperative in creating a school climate that nurtures differences and equality at the same time. Policy and legislation in Ireland dictates the responsibility of school principals in preventing and intervening in issues relating to bullying. The current research investigates the extent to which principals consider the impact of bullying on their students and the strategies they take to combat it in their schools. We consider how principals respond to bullying and what supports they feel are missing for them to adhere to relevant policy. A sample of 918 principals from a range of schools across Ireland completed an online survey. The results demonstrated some positive actions by principals such as the provision of anti-bullying policies. However, they also document areas that need more action such as increased access to counsellors and appointing a specific staff member to deal with and tackle bullying in each school. Guidance from the Department of Education and Skills in Ireland on the development and provision of an anti-bullying programme is called for. Results are discussed in light of the current Anti-Bullying Procedures established by the Department of Education and Skills and the Action Plan for Bullying 2013.     

Tribute to Dr Jacques Rogge: muscle activity and fatigue during hiking in Olympic dinghy sailing

‘A tribute to Dr J. Rogge’ aims to systematically review muscle activity and muscle fatigue during sustained submaximal quasi-isometric knee extension exercise (hiking) related to Olympic dinghy sailing as a tribute to Dr Rogge’s merits in the world of sports. Dr Jacques Rogge is not only the former President of the International Olympic Committee, he was also an orthopaedic surgeon and a keen sailor, competing at three Olympic Games. In 1972, in fulfilment of the requirements for the degree of Master in Sports Medicine, he was the first who studied a sailors’ muscle activity by means of invasive needle electromyography (EMG) during a specific sailing technique (hiking) on a self-constructed sailing ergometer. Hiking is a bilateral and multi-joint submaximal quasi-isometric movement which dinghy sailors use to optimize boat speed and to prevent the boat from capsizing. Large stresses are generated in the anterior muscles that cross the knee and hip joint, mainly employing the quadriceps at an intensity of 30–40% maximal voluntary contraction (MVC), sometimes exceeding 100% MVC. Better sailing level is partially determined by a lower rate of neuromuscular fatigue during hiking and for ≈60% predicted by a higher maximal isometric quadriceps strength. Although useful in exercise testing, prediction of hiking endurance capacity based on the changes in surface EMG in thigh and trunk muscles during a hiking maintenance task is not reliable. This could probably be explained by the varying exercise intensity and joint angles, and the great number of muscles and joints involved in hiking.

Highlights

• Dr Jacques Rogge, former president of the International Olympic Committee and Olympic Finn sailor, was the first to study muscle activity during sailing using invasive needle EMG to obtain his Master degree in Sports Medicine at the Ghent University.

• Hiking is a critical bilateral and multi-joint movement during dinghy racing, accounting for >60% of the total upwind leg time. Hiking generates large stresses in the anterior muscles that cross the knee and hip joint.

• Hiking is considered as a quasi-isometric bilateral knee extension exercise. Muscle activity measurements during sailing, recorded by means of EMG, show a mean contraction intensity of 30-40% maximal voluntary contraction with peaks exceeding 100%.

• Hiking performance is strongly related to the development of neuromuscular fatigue in the quadriceps muscle. Since maximal strength is an important determinant of neuromuscular fatigue during hiking, combined strength and endurance training should be incorporated in the training program of dinghy sailors.

     

Extinction and retraining of simultaneous and successive flavor conditioning

In three experiments, rats received pairings of flavor conditioned stimuli with polycose unconditioned stimuli, in either a simultaneous or a sequential relation. Both temporal relations produced excellent conditioned increases in consumption of the flavors. Separate presentation of the flavors resulted in extinction in both cases. However, restoring the pairing of the flavor with polycose resulted in reconditioning only with the sequential, not with the simultaneous, relation.