The Extent of Mismeasurement for Aberrant Examinees

The person-fit literature assumes that aberrant response patterns could be a sign of person mismeasurement, but this assumption has rarely, if ever, been empirically investigated before. We explore the validity of test responses and measures of 10-year-old examinees whose response patterns on a commercial standardized paper-and-pencil mathematics test were flagged as aberrant. Validity evidence was collected through postexamination reflective interviews with 31 of the 80 pupils flagged as aberrant and their teachers, and teacher assessment (TA) judgments for the whole examination cohort of 674 examinees. Analysis suggested that interview-adjusted scores were significantly better fitting than expected by chance, but only some adjustments suggest serious mismeasurement. In addition, disagreement between TA and test scores was significantly greater for aberrant examinees, and partially predicted the interview adjustments. We conclude that person misfit statistics when combined with TA might be a useful antidote to mismeasurement, and we discuss the implications for assessment research and practice.     

Handling missing data: analysis of a challenging data set using multiple imputation

Missing data is endemic in much educational research. However, practices such as step-wise regression common in the educational research literature have been shown to be dangerous when significant data are missing, and multiple imputation (MI) is generally recommended by statisticians. In this paper, we provide a review of these advances and their implications for educational research. We illustrate the issues with an educational, longitudinal survey in which missing data was significant, but for which we were able to collect much of these missing data through subsequent data collection. We thus compare methods, that is, step-wise regression (basically ignoring the missing data) and MI models, with the model from the actual enhanced sample. The value of MI is discussed and the risks involved in ignoring missing data are considered. Implications for research practice are discussed.     

Social Pragmatics: Preschoolers Rely on Commonsense Psychology to Resolve Referential Underspecification

Four experiments show that 4- and 5-year-olds (total N = 112) can identify the referent of underdetermined utterances through their Naïve Utility Calculus—an intuitive theory of people’s behavior structured around an assumption that agents maximize utilities. In Experiments 1–2, a puppet asked for help without specifying to whom she was talking (“Can you help me?”). In Experiments 3–4, a puppet asked the child to pass an object without specifying what she wanted (“Can you pass me that one?”). Children’s responses suggest that they considered cost trade-offs between the members in the interaction. These findings add to a body of work showing that reference resolution is informed by commonsense psychology from early in childhood.     

Communication Research and General Media

William B. Fairley and Frederick Mosteller, eds. Statistics and Public Policy (Reading, Mass.: Addison-Wesley, 1977— price not given)

Julian L. Simon's Basic. Research Methods in Social Sciences: The Art of Empirical Investigation (New York: Random House, 1978—$14.95)

Delbert C. Miller's Handbook of Research Design and Social Measurement (New York: McKay, 1978—$14.95, with a paperback edition available)

James Monaco, ed. Media Culture and Celebrity: The Media as Image Makers (New York: Delta Books (Dell), 1978—$4.95 each, paper)     

Test-Based Learning: Inconsistent Effects Between Higher- and Lower-Level Test Questions

Providing test questions after an initial study phase is a common instructional technique. In theory, questions that require higher-level (deep) processing should be more beneficial than those that require lower-level (shallow) processing. However, empirical evidence on the matter is inconsistent. To shed light on two potential reasons for these inconsistencies, we conducted an experiment (N = 81) to analyze the role of (a) the share of information to which test questions direct learners and (b) the learning activities performed in the initial study phase with respect to the effects between higher- and lower-level test questions. We found that both the share of focused information and the initial learning activities moderated the effects between higher- and lower-level test questions.     

技术支持的"非正规学习"研究新进展

对大部分人来说,当我们讨论学习时,我们会不可避免地将其与正规的教育系统联系起来。但任何关于ICTs在儿童学习中角色的研究都使我们认识到,在校外情景中,儿童非常容易沉浸于ICTs相关的活动中,这就迫使我们必须用更广阔的视角来审视包括学校、家庭、休闲、图书馆、博物馆等在内的"教育生态学"。本综述首先对"非正规学习"进行了界定,指发生在学校环境之外,数字技术支持或与数字技术交互的非正规学习;接着讨论了本研究所依据的学习的核心理论以及在ICTs支持的关于学习的研究中不断产生的新的学习理论;勾勒出儿童在校外获取和使用数字技术的情景;然后基于已有的关于技术支持的非正规学习的案例,总结提炼出技术支持的非正规学习的关键特征;最后对这些研究的理论和政策含义进行了深入的研究和剖析。