The Evaluation Scale: Exploring Decisions About Societal Impact in Peer Review Panels

Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators’ values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes – the “quality-focused” evaluation and “societal impact-focused” evaluation. We show the wide range of evaluator views about impact, and that these views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel.     

Anatomical Sciences Education Vol. 5, Issue 1, 2012 Cover Image

Medical students at Durham University, United Kingdom receive instructions using ultrasound echocardiography . In this issue of ASE Dr. Finn and her colleagues compare the efficacy of ultrasound and cadaveric prosections for teaching gross anatomy of the heart.     

Hidden structure: Using network methods to map system architecture

In this paper, we describe an operational methodology for characterizing the architecture of complex technical systems and demonstrate its application to a large sample of software releases. Our methodology is based upon directed network graphs, which allows us to identify all of the direct and indirect linkages between the components in a system. We use this approach to define three fundamental architectural patterns, which we label core–periphery, multi-core, and hierarchical. Applying our methodology to a sample of 1286 software releases from 17 applications, we find that the majority of releases possess a “core–periphery” structure. This architecture is characterized by a single dominant cyclic group of components (the “Core”) that is large relative to the system as a whole as well as to other cyclic groups in the system. We show that the size of the Core varies widely, even for systems that perform the same function. These differences appear to be associated with different models of development – open, distributed organizations develop systems with smaller Cores, while closed, co-located organizations develop systems with larger Cores. Our findings establish some “stylized facts” about the fine-grained structure of large, real-world technical systems, serving as a point of departure for future empirical work.     

Second Graders Learn Animal Adaptations through Form and Function Analogy Object Boxes

This study examined the use of form and function analogy object boxes to teach second graders (n = 21) animal adaptations. The study used a pretest–posttest design to examine animal adaptation content learned through focused analogy activities as compared with reading and Internet searches for information about adaptations of animals followed by making an informative puppet play. Students participated in six week‐long lesson sets, each addressing adaptations of two animals, which alternated between the two conditions. In the analogy condition, students matched cards explaining form and function analogies of animal body parts or homes to analogous manufactured items. They mapped analogies, thought of alternate manufactured items, and created new analogies. Students scored similarly on material to be taught through both conditions on the pretest, but made significantly higher posttest mean scores (76.1% analogy versus 57.2% traditional condition) with large effect size (partial η² = 0.58) on animal adaptation content learned through the analogy activities. This study shows the usefulness of form and function analogies in teaching product innovations to second‐grade students, indicating that early childhood students are able to successfully engage in sophisticated analogy activities. Efficacy of the analogy activities was related to objects that focused attention, motivated, and gave concrete representations of concepts; to cards and graphic organizers for organization, connections, and memory; and to complex thinking activities that challenged students and promoted peer interaction.     

Transfer by very young children in the symbolic retrieval task

Cumulative experience with a variety of symbolic artifacts has been hypothesized as a source of young children's increasing sensitivity to new symbol-referent relations. Evidence for this hypothesis comes from transfer studies showing that experience with a relatively easy symbolic retrieval task improves performance on a more difficult task. Significant transfer was found for the 2(1/2)-year-old children in the 3 studies reported here, even with relatively low levels of contextual support (according to the taxonomy of transfer by Barnett & Ceci, 2002). Transfer occurred even though the 2 tasks were encountered in very different settings and there was a prolonged (1-week) delay interval between them. Transfer also occurred to a much more difficult task (one that even 3-year-olds typically fail).     

Exploring the Evidence in Evidence-Based Acquisition

ABSTRACT

This article explores the University of Colorado (CU) Libraries’ experiences with evaluating a patron-driven (PDA) program with Kanopy and an evidence-based (EBA) program with Alexander Street for streaming videos. The article includes a thorough comparison of EBA and PDA models, workflows, and outcomes. Three separately administered libraries within the CU system support campuses of different budgets, student and faculty demographics, programs, and exposure to streaming collections. Lessons in implementing and assessing streaming videos at each library and across the consortia are shared along with details on how to implement similar analysis at other libraries.     

Online Course Design in Higher Education: A Review of National and Statewide Evaluation Instruments

This research identifies six online course evaluation instruments used nationally or in statewide systems. We examined the characteristics (i.e., number of standards and criteria) and coded the criteria that guide the design of online courses. We discussed the focus of the instruments and their unique features.     

Parental perceptions of the 2014 SEND legislation

The study researched parent’s experiences of The Children and Families Act 2014 in Hull and the East Riding of Yorkshire. A sample of parents using KIDS Services in the area were surveyed by questionnaire, both before and after the legislation came into force. Nearly half of the parents were aware of a change in Special Educational Needs and Disabilities (SEND) legislation; and a third noticed a change in support for their child. Professionals are now more involved in SEND early identification, and most SEND needs were identified at or before the early year stage. The majority of parents thought that the support for their child was either always or sometimes well coordinated. Parents generally felt more involved in the process since the Act, and perceived improvements in educational support. Professional support for parents at diagnosis had increased over the studies, and educational, health and social care needs were generally being met. However, some parents thought that Information, communication and school support needed to improve, and that the voluntary sector was highly regarded. Implications in relation to practice were also made.     

Options for Change: A Flexible Vehicle for Curriculum Evolution and Reform

In this article we examine a flexible curricular approach known as the “Option.” The Option enables students to supplement traditional majors with a coherent set of courses and other educational experiences in a related, often interdisciplinary field. Options can act as curricular bridges between mainstream academic fields and problems of professional practice. They can also give students experience with emerging subject areas (e.g., biomedical engineering). Options serve as laboratories for experimenting with new subject areas before incorporating them fully into the curriculum as majors and minors. Hence, Options promote creativity and risk-taking by providing a proving ground for potential new academic programs.Roger G. Baldwin received his doctorate in higher education from the University of Michigan. He is currently Professor of Higher, Adult, and Lifelong Education at Michigan State University. His research interests include curriculum development and reform, faculty career development, and organizational change. Melissa J. Baumann received her doctorate in Materials Science and Engineering from Case Western Reserve University. She is currently Associate Professor of Engineering at Michigan State University. Her research interests include biomedical materials research, specifically ceramic scaffolds in bone tissue engineering and biomedical engineering education.