A Process for Reviewing and Evaluating Generated Test Items

Testing organization needs large numbers of high‐quality items due to the proliferation of alternative test administration methods and modern test designs. But the current demand for items far exceeds the supply. Test items, as they are currently written, evoke a process that is both time‐consuming and expensive because each item is written, edited, and reviewed by a subject‐matter expert. One promising approach that may address this challenge is with automatic item generation. Automatic item generation combines cognitive and psychometric modeling practices to guide the production of items that are generated with the aid of computer technology. The purpose of this study is to describe and illustrate a process that can be used to review and evaluate the quality of the generated item by focusing on the content and logic specified within the item generation procedure. We illustrate our process using an item development example from mathematics drawn from the Common Core State Standards and from surgical education drawn from the health sciences domain.     

Report on Day 2

Abstract

This is a ‘view from the coalface’ of someone who runs a large company responsible for the training of other member companies of the Group of which it forms a part. He gives examples from the day‐to‐day work of his company, and looks to the future of open and distance learning in the industrial world.     

Behavioural inhibition and hyperactivity: a commentary from alternative perspectives

Attention disorders in the school population include attention deficit, hyperactivity and conduct disorders. A key concept for distinguishing hyperactive from attention disorders is behavioural inhibition as advocated by Barkley, a prominent American researcher. However, the concept itself needs to be understood because, as argued in this paper, there are two kinds of inhibition: Pavlov's original concept and the American one. These should be differentiated if the abnormal conditions associated with attention and hyperactivity are to be rationally connected to cognitive characteristics, rather than to be solely based on clinical symptoms and behavioural ratings. We suggest a consensus on the concept of inhibition and a unified view of attention disorders integrating cognitive and behavioural manifestations. Finally, the importance of basing remediation on a theoretically supported and rationally derived set of cognitive training tasks for the amelioration of inattention and hyperactivity is offered.     

DIRECT NON‐VIOLENT ACTION AND THE LAW

This article was delivered as the plenary address at the Massachusetts Association for Bilingual Education Annual Conference, November, 1986. The style of the speech has been preserved.