Knowledge of Traumatic Brain Injury among Educators

The purpose of this study is to determine knowledge of traumatic brain injury among educators. Few studies have examined knowledge of traumatic brain injury in this population and fewer still have included a substantial proportion of general education teachers. Examining knowledge of traumatic brain injury in educators is important as the vast majority of children with traumatic brain injury will return to school and many are likely to require support in the short term and some will require special education services in the long term. The Common Misconceptions of Traumatic Brain Injury questionnaire was completed by 94 educators. Participants demonstrated accurate knowledge on a number of questionnaire items associated with the identification of individuals with traumatic brain injury, common socio-emotional effects, and recovery from traumatic brain injury; however, a considerable degree of uncertainly was indicated on several items relevant to the school setting. In addition, substantial misconception rates were noted on only four items including one pertaining to recovery and another concerning the likelihood of additional brain injuries. Knowing someone with traumatic brain injury, participating in training and having taught a student with traumatic brain injury resulted in greater knowledge. Implications of these findings for educators are discussed.     

Using person response functions to investigate areas of person misfit related to item characteristics

Individual person fit analyses provide important information regarding the validity of test score inferences for an individual test taker. In this study, we use data from an undergraduate statistics test (N = 1135) to illustrate a two-step method that researchers and practitioners can use to examine individual person fit. First, person fit is examined numerically with several indices based on the Rasch model (i.e., Infit, Outfit, and Between-Subset statistics). Second, person misfit is presented graphically with person response functions, and these person response functions are interpreted using a heuristic. Individual person fit analysis holds promise for improving score interpretation in that it may detect potential threats to validity of score inferences for some test takers. Individual person fit analysis may also highlight particular subsets of items (on which a test taker performs unexpectedly) that can be used to further contextualize her or his test performance.     

Linus Pauling and the scientific debate over fallout hazards

From 1954 to 1963, numerous scientists engaged in a public debate over the possible hazards from radioactive fallout from nuclear weapons testing. Nobel laureate Linus Pauling, a California Institute of Technology chemist, was one of the most prominent. His scientific papers relating to the fallout debate reveal many of the scientific, social and political issues involved in the controversy. Although the public controversy ended after the signing of the 1963 Limited Test Ban Treaty, many of the scientific questions about the possible hazards of low-level radiation remain under debate within the scientific community. Moreover, the fallout debate was a prototype of current controversies over environmental and public-health hazards.     

Assessment of learning gains associated with independent exam analysis in introductory biology

This study evaluates the impact of an independent postmidterm question analysis exercise on the ability of students to answer subsequent exam questions on the same topics. It was conducted in three sections (～400 students/section) of introductory biology. Graded midterms were returned electronically, and each student was assigned a subset of questions answered incorrectly by more than 40% of the class to analyze as homework. The majority of questions were at Bloom's application/analysis level; this exercise therefore emphasized learning at these higher levels of cognition. Students in each section answered final exam questions matched by topic to all homework questions, providing a within-class control group for each question. The percentage of students who correctly answered the matched final exam question was significantly higher (p < 0.05) in the Topic Analysis versus Control Analysis group for seven of 19 questions. We identified two factors that influenced activity effectiveness: 1) similarity in topic emphasis of the midterm-final exam question pair and 2) quality of the completed analysis homework. Our data suggest that this easy-to-implement exercise will be useful in large-enrollment classes to help students develop self-regulated learning skills. Additional strategies to help introductory students gain a broader understanding of topic areas are discussed.     

Evaluating the Consistency of Angoff-Based Cut Scores Using Subsets of Items Within a Generalizability Theory Framework

The Angoff method requires experts to view every item on the test and make a probability judgment. This can be time consuming when there are large numbers of items on the test. In this study, a G-theory framework was used to determine if a subset of items can be used to make generalizable cut-score recommendations. Angoff ratings (i.e., probability judgments) from previously conducted standard setting studies were used first in a re-sampling study, followed by D-studies. For the re-sampling study, proportionally stratified subsets of items were extracted under various sampling and test-length conditions. The mean cut score, variance components, expected standard error (SE) around the mean cut score, and root-mean-squared deviation (RMSD) across 1,000 replications were estimated at each study condition. The SE and the RMSD decreased as the number of items increased, but this reduction tapered off after approximately 45 items. Subsequently, D-studies were performed on the same datasets. The expected SE was computed at various test lengths. Results from both studies are consistent with previous research indicating that between 40–50 items are sufficient to make generalizable cut score recommendations.     

Toward High-Performance Communications Interfaces for Science Problem Solving

From a theoretical viewpoint, educational interfaces that facilitate communicative actions involving representations central to a domain can maximize students’ effort associated with constructing new schemas. In addition, interfaces that minimize working memory demands due to the interface per se, for example by mimicking existing non-digital work practice, can preserve students’ attentional focus on their learning task. In this research, we asked the question: What type of interface input capabilities provide best support for science problem solving in both low- and high-performing students? High school students’ ability to solve a diverse range of biology problems was compared over longitudinal sessions while they used: (1) hardcopy paper and pencil (2) a digital paper and pen interface (3) pen tablet interface, and (4) graphical tablet interface. Post-test evaluations revealed that time to solve problems, meta-cognitive control, solution correctness, and memory all were significantly enhanced when using the digital pen and paper interface, compared with tablet interfaces. The tangible pen and paper interface also was the only alternative that significantly facilitated skill acquisition in low-performing students. Paradoxically, all students nonetheless believed that the tablet interfaces provided best support for their performance, revealing a lack of self-awareness about how to use computational tools to best advantage. Implications are discussed for how pen interfaces can be optimized for future educational purposes, and for establishing technology fluency curricula to improve students’ awareness of the impact of digital tools on their performance.     

Low-skilled adult readers look like typically developing child readers: a comparison of reading skills and eye movement behavior

Adults enrolled in basic education exhibit poor academic performance, often reading at elementary and middle-school levels. The current study investigated the similarities and differences of reading skills and eye movement behavior between a sample of 25 low-skilled adult readers and 25 first grade students matched on word reading skill. t tests for matched pairs found no significant differences on language comprehension, reading comprehension, or eye movement variables. Regression analyses revealed that language comprehension made greater contributions to reading comprehension for adults (verses children) in the simple view of reading model. Processing time (gaze duration) was found to account for unique variance in both passage reading comprehension and sentence comprehension efficiency after controlling for word reading and language skills for adults. For children, processing time was only a significant predictor for sentence comprehension efficiency.