Setting Performance Standards: Contemporary Methods

This module describes some common standard-setting procedures used to derive performance levels for achievement tests in education, licensure, and certification. Upon completing the module, readers will be able to: describe what standard setting is; understand why standard setting is necessary; recognize some of the purposes of standard setting; calculate cut scores using various methods; and identify elements to be considered when evaluating standard-setting procedures. A self-test and annotated bibliography are provided at the end of the module. Teaching aids to accompany the module are available through NCME.     

Assessment of Evidence in University Students' Scientific Writing

The purpose of the study presented in this paper is to examine uses of evidence inuniversity students' writing of scientific argument. The study was conducted in anintroductory level oceanography course in a large public university. In this course students draw on large-scale geological data sets provided by an interactive CD-ROM,`Our Dynamic Planet' (Prothero 1995), to write a scientific technical paper. We examined the uses of evidence in two ways. First, we conducted interviews with undergraduate oceanography students n = 9, non-oceanography undergraduate students n = 8 , and course instructors n = 4 to assess the differences in interpretation of uses of scientific evidence for high ranked and low ranked student papers from a previous academic year. Second, we applied our proposed argumentation analysis to student writing to examine the formulation of evidence in these high and low ranked papers. We draw on these findings to discuss ways of teaching students the construction of argument in scientific writing.     

The social and educational adjustment of abused children

Thirteen 6-year-old children who had been physically abused by their parents were assessed in school for language development, educational attainments and social adjustment, and compared with children from some of the same school classes who served as a comparison group. All the abused children had attended the Family Centre of the National Society for the Prevention of Cruelty to Children (NSPCC) in Manchester before starting school, and they and their parents had received social work support and supervision from the special unit team. Ten of the 13 abused children had made measurable progress in reading. There were no significant differences between the groups in language development or number skills, but the abused group did contain more high (maladjusted) scores on the Bristol Social Adjustment Guide. Monitoring educational progress and social adjustment in school would seem to be a useful method of following the progress of such children. Most of the children in this group are so far making progress within the ordinary school system despite the disturbances which have affected their home life.     

Constraints on the Calibration of Performance

We examined the effect of experimenter-controlled incentives and feedback on the calibration of performance. Subjects answered 36 reading comprehension and 8 mathematical multiple-choice questions and rated the accuracy of their responses. Perfect calibration was possible only when true and estimated test performance were approximately equal. Incentives for improved performance (i.e., doubling the credit people received for correct answers) adversely affected performance and calibration compared to the same incentives for improved calibration (i.e., doubling credit for minimizing the error between true and estimated performance). Feedback had no effect on performance or accuracy nor did it interact with the incentive variable. An examination of coefficient α suggested a strong response bias by individuals when calibrating their performance; individuals tended to rate their performance accuracy consistently regardless of item difficulty or whether they answered the item correctly. Educational implications were discussed.     

Encountering drawing

Abstract

This article divides into two roughly equal parts, both of which aim to address the act rather than the art of drawing. The second part focuses on a theoretical discussion of drawing. The first bears on a number of themes including the role of drawing in colonial history, drawing and data collection, and drawing and memory. It begins by describing an episode that unfolded as an encounter between two worlds, and two ages—an episode whose meaning and effects are still controversial today.     

Learning and study strategies correlate with medical students' performance in anatomical sciences

Much of the content delivered during medical students' preclinical years is assessed nationally by such testing as the United States Medical Licensing Examination^® (USMLE^®) Step 1 and Comprehensive Osteopathic Medical Licensing Examination^® (COMPLEX‐USA^®) Step 1. Improvement of student study/learning strategies skills is associated with academic success in internal and external (USMLE Step 1) examinations. This research explores the strength of association between the Learning and Study Strategies Inventory (LASSI) scores and student performance in the anatomical sciences and USMLE Step 1 examinations. The LASSI inventory assesses learning and study strategies based on ten subscale measures. These subscales include three components of strategic learning: skill (Information processing, Selecting main ideas, and Test strategies), will (Anxiety, Attitude, and Motivation) and self‐regulation (Concentration, Time management, Self‐testing, and Study aid). During second year (M2) orientation, 180 students (Classes of 2016, 2017, and 2018) were administered the LASSI survey instrument. Pearson Product‐Moment correlation analyses identified significant associations between five of the ten LASSI subscales (Anxiety, Information processing, Motivation, Selecting main idea, and Test strategies) and students' performance in the anatomical sciences and USMLE Step 1 examinations. Identification of students lacking these skills within the anatomical sciences curriculum allows targeted interventions, which not only maximize academic achievement in an aspect of an institution's internal examinations, but in the external measure of success represented by USMLE Step 1 scores. Anat Sci Educ 11: 236–242. © 2017 American Association of Anatomists.     

Some Consequences of Early Harsh Discipline: Child Aggression and a Maladaptive Social Information Processing Style

Although a number of studies have reported a relation between abusive parental behavior and later aggressive behavior in the victim, many of these investigations have had methodological limitations that make precise interpretation of their results problematic. In the present study, we attempted to determine whether harsh parental discipline occurring early in life was associated with later aggression and internalizing behavior in children, using a prospective design with randomly selected samples to avoid some of these methodological difficulties. Structural equation modeling indicated a consistent relation between harsh discipline and aggression in 2 separate cohorts of children. This relation did not appear to be due to possible confounding factors such as child temperament, SES, and marital violence, although there was some indication in our data that the latter variables were related to child aggression. In addition, our analyses suggested that the effect of harsh discipline on child aggression may be mediated at least in part by maladaptive social information processing patterns that develop in response to the harsh discipline.     

Relevance and Goal-Focusing in Text Processing

This article reviews the role of relevance in text processing. It argues that relevance instructions provided by instructors and texts help readers identify text segments that are germane to a reading goal. A taxonomy of relevance instructions is presented and four basic types of relevance manipulations are considered (i.e., targeted segments, elaborative interrogation, perspective, and purpose). This article also describes a four-stage goal-focusing model to explain how relevance affects attention allocation and text understanding. Directions for future research and educational implications are also discussed.