Looking Beyond the Overall Scores of NAEP Assessments: Applications of Generalized Linear Mixed Modeling for Exploring Value-Added Item Difficulty Effects

The central idea of differential item functioning (DIF) is to examine differences between two groups at the item level while controlling for overall proficiency. This approach is useful for examining hypotheses at a finer-grain level than are permitted by a total test score. The methodology proposed in this paper is also aimed at estimating differences at the item rather than the overall score level, yet with the innovation where item-level differences for many groups simultaneously are the focus. This is a straightforward generalization of DIF as variance rather than one or several group differences; conceptually, this can be referred to as item difficulty variation (IDV). When instruction is of interest, and "groups" is a unit at which instruction is determined or delivered, then IDV signals value-added effects that can be influenced by either demographic or instructional variables.     

Violence and Vigilance: The Acute Effects of Community Violent Crime on Sleep and Cortisol

The data combine objectively measured sleep and thrice‐daily salivary cortisol collected from a 4‐day diary study in a large Midwestern city with location data on all violent crimes recorded during the same time period for N = 82 children (M_age = 14.90, range = 11.27–18.11). The primary empirical strategy uses a within‐person design to measure the change in sleep and cortisol from the person's typical pattern on the night/day immediately following a local violent crime. On the night following a violent crime, children have later bedtimes. Children also have disrupted cortisol patterns the following morning. Supplementary analyses using varying distances of the crime to the child's home address confirm more proximate crimes correspond to later bedtimes.     

Generalization of visual matching and delayed matching by a California sea lion (Zalophus californianus)

Only a limited number of species have been found capable of generalized matching-to-sample (MTS) after exposure to relatively few training exemplars. We trained a juvenile, experimentally naive California sea lion (Zalophus californianus) in MTS, using a pair of three-dimensional objects as samples. Successful matching to a criterion of 90% correct or better over 2 successive sessions was attained in 12 sessions (269 trials and 70 errors). Two subsequent “partial” transfer tests, in which each of the two training objects was paired with a novel test object, and four additional transfer tests, all with novel objects, were presented following training. An 80% performance criterion over 2 successive sessions was reached, or closely approximated, in from 2 to 4 transfer sessions for all transfer tests; errors to criterion tended to be reduced across the successive novel transfer tests and were as few as five during the final two tests; and performance on the first 48 trials of the last two novel transfers was not significantly different from a near-ceiling level baseline performance measure. Neophobic responses of the sea lion to new objects precluded an unbiased evaluation of immediate (Trial 1) transfer. The sea lion’s short-term memory for sample objects was also measured. Matching performance was maintained at a level of 78% correct responses or better for delays through to 45 sec after removal of the sample object. At a 58-sec delay, the longest tested, performance declined to 69% correct responses. These retention levels are only somewhat below levels reported for dolphins and nonhuman primates tested on visual delayed MTS, but they are above levels typically reported for pigeon subjects.     

Built policy: school-building and architecture as policy instrument

ABSTRACT

School architecture is often taken for granted both in use (where it is naturalized) and in writing on education policy (tending to feature simply as policy setting.) Built policy instead points up the active and ongoing role of the material environment in shaping education. From financing and procurement to the design of individual classrooms, the paper works across architecture, sociology and policy studies to clarify the relationship between different dimensions of physical and social space and so provide a useful theoretical ground for future work. What is special about school-building and architecture that enables them to do policy? How are they used to do it? By whom? From city planners to students, a range of actors use different space-organizing resources to attempt the instantiation of (and challenges to) policy in built form. These processes are explored first theoretically, then empirically through a new Academy school in England. The paper deepens understanding of what policy is, emphasizing its intimate if taken for granted spatial characteristics, its ongoing-ness in built form and its travel by means of circulating images of buildings and spaces.     

Using generalizability analysis to estimate parameters for anatomy assessments: A multi‐institutional study

With integrated curricula and multidisciplinary assessments becoming more prevalent in medical education, there is a continued need for educational research to explore the advantages, consequences, and challenges of integration practices. This retrospective analysis investigated the number of items needed to reliably assess anatomical knowledge in the context of gross anatomy and histology. A generalizability analysis was conducted on gross anatomy and histology written and practical examination items that were administered in a discipline‐based format at Indiana University School of Medicine and in an integrated fashion at the University of Alabama School of Medicine and Rush University Medical College. Examination items were analyzed using a partially nested design in which items were nested within occasions (i:o) and crossed with students (s). A reliability standard of 0.80 was used to determine the minimum number of items needed across examinations (occasions) to make reliable and informed decisions about students' competence in anatomical knowledge. Decision study plots are presented to demonstrate how the number of items per examination influences the reliability of each administered assessment. Using the example of a curriculum that assesses gross anatomy knowledge over five summative written and practical examinations, the results of the decision study estimated that 30 and 25 items would be needed on each written and practical examination to reach a reliability of 0.80, respectively. This study is particularly relevant to educators who may question whether the amount of anatomy content assessed in multidisciplinary evaluations is sufficient for making judgments about the anatomical aptitude of students. Anat Sci Educ 10: 109–119. © 2016 American Association of Anatomists.     

Making a class act: as seen in one Year 8 English lesson

This article reports on active teaching and learning approaches taken by one English teacher and a secondary PGCE student‐teacher to bring about changes to the work culture in a Year 8 mixed‐ability class. It is written by the PGCE tutor, student‐teacher, class teacher and external examiner, following an observation of one lesson, in a series of lessons, given by the student‐teacher. This lesson is analysed through its motivating content, approach to critical reading, inherent creativity and active approaches to learning. It indicates how a challenging class has been changed by approaches that provide alternatives to currently advocated objectives‐driven and direct instructional approaches.     

The Development of Spatial Skills in Elementary School Students

Through five waves of data collection, this longitudinal study investigated the development of spatial skills in 304 elementary school children (M_age = 7.64 years) as they progressed from the second to fourth grade. The study focused on whether multiple latent classes with different developmental profiles best explain development. Spatial skills were measured by tests featuring two‐dimensional figures. Mathematics achievement was measured by the statewide end‐of‐year test and was included as a distal outcome variable. The role of covariates, including socioeconomic status, verbal working memory, and gender, was also explored. The results indicate a need to view two‐dimensional spatial skills development as multidimensional with two developmental profiles predicted by socioeconomic status, verbal working memory, and gender. The developmental profiles predicted differences in mathematics achievement.     

Encouraging Prospective Teachers to Engage Friends and Family in Exploring Physical Phenomena

Involving people outside of a science course can foster learning for students enrolled in the course. Assignments involving friends and family provided such opportunities in an undergraduate physics course for prospective teachers. These assignments included reflecting upon prior experiences, interviewing friends and family members, engaging them in exploring physical phenomena, and teaching them with relevant websites. The six strands of science learning articulated in Learning Science in Informal Environments (National Research Council in Learning science in informal environments: People, places, and pursuits. National Academies Press, Washington, DC, 2009) provided a framework for analyzing the prospective teachers’ responses. Through such assignments, the instructor created opportunities for the prospective teachers to use and build upon knowledge learned in class as well as to gain confidence and experience in facilitating the learning of others.     

Change Blindness as a Means of Studying Expertise in Physics

Previous studies examining expertise have used a wide range of methods. Beyond characterizing expert and novice behavior in different contexts and circumstances, many studies have examined the processes that comprise the behavior itself and, more recently, processes that comprise training and practice that develop expertise. Other studies, dating back more than 50 years, have used various recall memory tasks to compare experts and novices. In this article, we describe another method for investigating expertise that has its origin in the study of change blindness, a phenomenon within the field of visual cognition. We demonstrate how an incidental change detection paradigm can be used in the context of introductory physics in a way that allows for inferences regarding the formation of mental representations about physical situations. Possible uses in future learning sciences research are discussed.