Evidence,Evaluation and the ‘Tyranny of Effect Size’: a proposal to more accurately measure programme impacts in adult and family literacy

As literacy grows in importance, policymakers’ demands for programme quality grow, too. Evidence on the effectiveness of adult and family literacy programmes is limited at best: research gaps abound, and programme evaluations are more often than not based on flawed theories of programme impact. In the absence of robust evidence on the full range of short- and long-term programme impacts, it is difficult to accurately measure intervention effectiveness. Too frequently, researchers and policymakers focus only on short-term, easily measured outcomes, creating a ‘tyranny of effect size’ that may systematically underestimate impact while simultaneously distorting practice. However, the answer does not lie in turning away from quantitative research. Doing so will consign adult and family literacy to the margins of public policy, when they should be in the mainstream. Longitudinal research from Turkey and the US suggests a need for revised, more subtle theories of how adult literacy and family literacy programmes work, and the diverse ways they benefit participants. By working together more closely and intelligently, researchers, policymakers and practitioners can develop evaluation strategies that more accurately measure programme effects. The key is combining methodological rigour with fully fleshed out theories of literacy development and programme impact.     

Misconceptions in Van den Broeck's representation of misconceptions about learning disability research

The methods and conclusions of Van den Broeck (in this issue) are evaluated from two perspectives: (a) statistical considerations and (b) theoretical models of IQ and achievement, specifically reading achievement. We consider the statistical model proposed by Van den Broeck for the regression-based discrepancy model (RDM) to be either irrelevant or conceptually inconsistent with current models of IQ and achievement. The resulting simulation produced exemplar cases that are not realistic in terms of practice. The theoretical representations of IQ and achievement were, in our understanding, inconsistent with contemporary models of either. We suggest that acceptable models support the use of the RDM as it has been proposed by us and by others as one component of the determination of the presence or absence of a learning disability.     

More evidence of robust spatial associative memory in the pigeon,Columba livia

Willson and Wilkie (1993) developed a novel procedure for assessing pigeons’ memory for the spatial location of food. Only one of four locations (consisting of an illuminated pecking key and grain feeder) provided food each day. Over days, different locations provided food. The pigeons’ tendency to revisit the location that was profitable on the previous day demonstrated memory for food-spatiallocation associations over a period of 24 h, retention longer than previously reported for this species. This basic finding was replicated and extended in three experiments. Experiment 1 demonstrated that location-food discriminations were also remembered well when established with successive rather than concurrent procedures. Experiment 2 demonstrated that pigeons can remember two location-food associations over 24 h. Experiment 3 showed that the discrimination training inherent in this paradigm is important for retention; retention was impaired when only the rewarded location was presented. Overall, this research suggests that cross-species differences in spatial memory performance may be due to quantitative rather than qualitative differences in the memory system underlying performance.     

Bringing anatomy to life: Evaluating a novel ultrasound curriculum in the anatomy laboratory

As point-of-care ultrasound (POCUS) invades medical specialties, more students covet earlier ultrasound (US) training programs in medical school. Determining the optimal placement and format in the curriculum remains a challenge. This study uses student perceptions and confidence in interpreting and acquiring images to evaluate the effectiveness of an US curriculum and assesses their performance on US content. A unique US curriculum was incorporated into first-year clinical anatomy at Tufts University School of Medicine (TUSM). Students completed surveys evaluating changes in US confidence and perceptions. Mean ratings on pre- and post-surveys were compared using Mann–Whitney U tests. Performance on US examination questions was evaluated. Two independent evaluators coded narrative responses and NVivo software was used to identify common themes. Two hundred eleven students completed the US curriculum. Students reported higher post-curriculum mean confidence ratings on US comprehension, operation, image acquisition, artifact recognition, and normal image interpretation (P < 0.0001). US reinforced anatomy concepts and clinical correlates (9.56, ±0.97 SD; 9.60, ±1.05). Students disagreed with items stating learning US is too difficult (1.2, ±2.2) and that it interferes with learning anatomy (0.68, ±1.7). Students scored above passing on practical US knowledge questions, supporting survey data, and the relation to learning spatial relationships. Qualitative analysis identified seven major themes and additional subthemes. Limited integration of US breaks barriers in students' perceptions and confidence in performing POCUS. The TUSM US curriculum is a natural marriage of anatomy and POCUS applications, serving as a template for medical schools.     

Effect of attending to a ball during a side-cut maneuver on lower extremity biomechanics in male and female athletes

Many sports associated with anterior cruciate ligament (ACL) injury require athletes attend to a ball during participation. We investigated effects of attending to a ball on lower extremity mechanics during a side-cut maneuver and if these effects are consistent for males and females. Sagittal and frontal plane hip and knee kinematics and joint moments were measured during side-cut maneuvers in 19 male and 19 female National Collegiate Athletic Association division III basketball players. Participants also experienced two side-cut conditions that required attention to a ball. Our results did not indicate that the effect of attention varies with gender. However, during side-cut conditions while attending to a ball, internal knee adductor moment was 20% greater (p = 0.03) and peak knee flexion angle was 4 degrees larger (p < 0.01). Females demonstrated 5 degrees less hip flexion (p = 0.046), 12 degrees less knee flexion (p < 0.01), and 4 degrees more knee abduction (p = 0.026) at initial contact during all side-cut conditions than males. Attention to a ball may affect lower extremity mechanics relevant to ACL injury. The validity of laboratory studies of lower extremity mechanics for sports that include attention to a ball may be increased if participants are required to attend to a ball during the task.