The Evaluation Scale: Exploring Decisions About Societal Impact in Peer Review Panels

Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators’ values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes – the “quality-focused” evaluation and “societal impact-focused” evaluation. We show the wide range of evaluator views about impact, and that these views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel.     

Anatomical Sciences Education Vol. 5, Issue 1, 2012 Cover Image

Medical students at Durham University, United Kingdom receive instructions using ultrasound echocardiography . In this issue of ASE Dr. Finn and her colleagues compare the efficacy of ultrasound and cadaveric prosections for teaching gross anatomy of the heart.     

Applying early decision: Student and college incentives and outcomes

Colleges’ early decision (ED) admission policies require accepted students to commit to attend the school without comparing outside options. With data from two liberal arts schools we find evidence that students with higher willingness and ability to pay and lower measured ability levels are more likely to apply ED. Applying ED raises the probability of acceptance by 40 percentage points. We address the potential selection of students into ED, including estimating an upper bound of 46 percentage points following Altonji, Elder, and Taber (2005). One college appears to use the ED process to screen applicants with high SAT scores and female applicants, thereby avoiding the potential adverse selection of applicants in the regular decision process. Finally, even conditional on higher socioeconomic status and other observable characteristics, applying ED is correlated with higher financial aid packages, perhaps because the college's financial aid resources are higher earlier in the admission process.     

Transfer by very young children in the symbolic retrieval task

Cumulative experience with a variety of symbolic artifacts has been hypothesized as a source of young children's increasing sensitivity to new symbol-referent relations. Evidence for this hypothesis comes from transfer studies showing that experience with a relatively easy symbolic retrieval task improves performance on a more difficult task. Significant transfer was found for the 2(1/2)-year-old children in the 3 studies reported here, even with relatively low levels of contextual support (according to the taxonomy of transfer by Barnett & Ceci, 2002). Transfer occurred even though the 2 tasks were encountered in very different settings and there was a prolonged (1-week) delay interval between them. Transfer also occurred to a much more difficult task (one that even 3-year-olds typically fail).     

Exploring the Evidence in Evidence-Based Acquisition

ABSTRACT

This article explores the University of Colorado (CU) Libraries’ experiences with evaluating a patron-driven (PDA) program with Kanopy and an evidence-based (EBA) program with Alexander Street for streaming videos. The article includes a thorough comparison of EBA and PDA models, workflows, and outcomes. Three separately administered libraries within the CU system support campuses of different budgets, student and faculty demographics, programs, and exposure to streaming collections. Lessons in implementing and assessing streaming videos at each library and across the consortia are shared along with details on how to implement similar analysis at other libraries.     

Parental perceptions of the 2014 SEND legislation

The study researched parent’s experiences of The Children and Families Act 2014 in Hull and the East Riding of Yorkshire. A sample of parents using KIDS Services in the area were surveyed by questionnaire, both before and after the legislation came into force. Nearly half of the parents were aware of a change in Special Educational Needs and Disabilities (SEND) legislation; and a third noticed a change in support for their child. Professionals are now more involved in SEND early identification, and most SEND needs were identified at or before the early year stage. The majority of parents thought that the support for their child was either always or sometimes well coordinated. Parents generally felt more involved in the process since the Act, and perceived improvements in educational support. Professional support for parents at diagnosis had increased over the studies, and educational, health and social care needs were generally being met. However, some parents thought that Information, communication and school support needed to improve, and that the voluntary sector was highly regarded. Implications in relation to practice were also made.