Multiple‐Choice Tests and Student Understanding: What Is the Connection?

Instructors can use both “multiple‐choice” (MC) and “constructed response” (CR) questions (such as short answer, essay, or problem‐solving questions) to evaluate student understanding of course materials and principles. This article begins by discussing the advantages and concerns of using these alternate test formats and reviews the studies conducted to test the hypothesis (or perhaps better described as the hope) that MC tests, by themselves, perform an adequate job of evaluating student understanding of course materials. Despite research from educational psychology demonstrating the potential for MC tests to measure the same levels of student mastery as CR tests, recent studies in specific educational domains find imperfect relationships between these two performance measures. We suggest that a significant confound in prior experiments has been the treatment of MC questions as homogeneous entities when in fact MC questions may test widely varying levels of student understanding. The primary contribution of the article is a modified research model for CR/MC research based on knowledge‐level analyses of MC test banks and CR question sets from basic computer language programming. The analyses are based on an operationalization of Bloom's Taxonomy of Learning Goals for the domain, which is used to develop a skills‐focused taxonomy of MC questions. However, we propose that their analyses readily generalize to similar teaching domains of interest to decision sciences educators such as modeling and simulation programming.     

Measurement of infant difficultness.

The Infant Characteristics Questionnaire (ICQ) was developed as a short, factor-analytic screening device for difficultness. Responses of 322 mothers of 4-6-month-old infants suggested that they regard the fussy, hard-to-soothe, labile infant as difficult. Mother report on the ICQ, particularly on the main fussy-difficult factor was found to have adequate reliability over time and convergence with the Carey Survey of Temperamental Characteristics, with father report on the ICQ, and, to a lower degree, with home data collected by independent observers. It was also found that mother characteristics may affect perceptions of infant difficultness: multiparous, extraverted mothers tended to rate their infants as easy.     

Theory-building and theory-confirming observation in science and science education

A paper by Norris presents scientific observation as a highly inferential activity in which human senses have become secondary to instrumentation. Norris takes examples from elementary and secondary curricula to support his position. This paper examines Norris's contentions from two perspectives, that of cognitive psychology and that of the philosophy of science. It is argued here that Norris has discussed only one aspect of observation, theory-confirming observation. Another, pretheoretic or theory-building observation, is more closely related to the curriculum activities he criticized. From a cognitive psychology perspective the theory-confirming observation is of use to the expert, but for novices the absence of domain-specific knowledge and of sophisticated problem-solving processes may render theory-building observation more meaningful for instruction.     

Software to Promote Young Children’s Growth in Literacy: A Comparison of Online and Offline Formats

The primary goal of this research was to extend our understanding of the strengths and weaknesses inherent in online and offline early literacy software programs designed for young learners. A taxonomy of reading skills was used to contrast online software with offline closed system (compact disc) based programs with respect to number of skills taught, quality of instruction and scaffolding during instruction. Overall, online programs were more comprehensive and provided instruction for more skills than offline software at either the Kindergarten or Grade 1 level. However, offline programs demonstrated some developmentally appropriate selectivity in skills trained. Quality of instruction was variable within and across all programs. Scaffolding of instruction was also variable and surprisingly few programs, either online or offline, provided automatic movement across levels of difficulty. These outcomes have important implications for the selection of instructional materials by parents and educators involved in early literacy instruction and also for future software design.     

A static method for obtaining a calibration factor for SRM bicycle power cranks

Many scientists and coaches are interested in mechanical power produced during cycling, and use Schoberer Rad Me\technik (SRM) bicycle power cranks to obtain this data. However, it has been expensive and difficult to calibrate SRM cranks, causing much of the collected data to be unreliable. We present a static method, derived from first principles, for obtaining a calibration factor for SRM cranks. A known mass and lever arm (chainring of a known diameter) are used to apply a known torque load to the instrument in four positions, and the output frequencies are used to calculate the calibration factor in Hz/Nm. The reproducibility of this method is ±0.01 Hz/Nm, which is acceptable for the application of the instrument, which is measurement of mechanical power application by cyclists at the crank. The method is reliable, inexpensive, and easy to set up, and will allow higher confidence in data collected using SRM power cranks. We recommend calibration of the power meter once every six months because of the measured drift of the calibration factor over time.     

Inclusive education and best practice for children with autism spectrum disorder: an integrated approach

Many parents of children with autism spectrum disorder (ASD) have reported general discontent with the services offered by the education system and have advocated for increased ASD‐specific services to better meet their children’s educational needs. The elements of best practice offer an ideal model for educational support. There are, however, limitations to advocating ASD‐specific services. This paper describes how best practice for ASD as an educational model fits within what is described as authentic inclusion. Further, it is suggested that the ASD community align with the greater inclusive education reform movement. With the use of this unified model of education, all children will receive the educational support they require.     

Zoltán Bay on education and science teaching

The present article is based on Zoltán Bay's Old Education, New Teaching — an unpublished paper written for the XXVIIth National Meeting of Secondary School Physics Teachers (5–7th April, 1984 Veszprém, Hungary).     

Operationalizing and validating disciplinary literacy in secondary education

The goal of this study was to define the construct and establish the validity of disciplinary literacy, which has recently gained attention from the implementation of the Common Core State Standards (National Governors Association Center for Best Practices & Council of Chief State School Officers in Common Core State Standards for English language arts & literacy in history/social studies, science, and technical subjects [PDF]. Authors, Washington, DC, 2010). After defining disciplinary literacy in the four core disciplines of English language arts, science, history and social studies, and mathematics, scales were developed and administered to a snowball sample of professionals nationwide, with 857 respondents. The data showed evidence of disciplinary literacy as a multidimensional construct with three related factors: source literacy, analytic literacy, and expressive literacy. Based on EFA and CFA results, we can conclude that there are at least three types of literacy in operation among the four core disciplines. The three factors of literacy varied significantly by the four core disciplines of English/language arts (ELA), science, history and social studies, and mathematics, supporting the notion that each discipline uses literacy uniquely. This is the first study of its kind to attempt to define, quantify, and validate the construct of disciplinary literacy.