Impact case studies: what accounts for the need for numbers in impact evaluation?

ABSTRACT

The UK Research Excellence Framework (REF) introduced impact as an indicator in the evaluation of higher education research quality in 2014. Impact case studies (ICS) are the basis of this evaluation. ICS use narrative explanations of how research causes ‘benefits to society’. This article analyses the evolving roles of the ICS and the relationships of ICS with various stakeholders. It draws on insights from legitimacy theory, Porter’s analysis of the social meaning of objectivity, and the insight from economist Alan Goodhart on the dysfunctional transformation of indicators into targets. It highlights the challenges to ICS evaluators and shows how a spiral of mistrust can both undermine but also cause demand for numbers. It explores whether impact narratives represent an escape from dominant research evaluation metrics and concludes that they do not.     

Something old,not much new,and a lot borrowed: philanthropy,business, and the changing roles of government in global education policy networks

This paper focuses on the role of governments in contemporary networked political configurations. Such networks constitute policy communities, usually based upon shared conceptions of social problems and their solutions. By enabling social, political, and economic connections at local, regional, national, and international levels, such networks become key policy players as well as a policy technology in different spaces. More specifically, the paper is organised around three policy frameworks in the field of education. Each framework is based on a ‘network-case’. In the first framework, governments represent the main driver for political change in legislating a landscape that creates the conditions for networks to develop around different aspects within the public sphere (e.g. organisation, co-funding, delivery, etc.). The second policy framework focuses on the activities of an already organised network in order to engage with existing political configurations as a ‘political actor’ in its own right, what could be called ‘governing with/alongside networks’. The third policy framework focuses on instances where the network operates directly as a ‘state-maker’.     

Changing Criterion Designs: Integrating Methodological and Data Analysis Recommendations

Abstract

Changing criterion designs (CCD) are single-case experimental designs that entail a step-by-step approximation of the final level desired for a target behavior. Following a recent review on the desirable methodological features of CCDs, the current text focuses on an analytical challenge: the definition of an objective rule for assessing the correspondence between criterion levels and behavior. We review extensively applied research and methodological recommendations for establishing experimental control, such as the range-bound CCD, and integrate them into a proposal for a formal expression of an objective rule. We illustrate how this proposal can lead to establishing the acceptable level of behavior prior to gathering the intervention phase data and how it leaves space for professional judgment. A discussion of software implementing the suggested proposal is included.     

Effects of duration of feedback on signaled avoidance

Two experiments were carried out to study vertical jumping avoidance learning in rats. In particular, we examined the effects of the duration of a feedback stimulus and of the interval between the end of the feedback stimulus and the start of the next trial on acquisition and extinction of avoidance. In Experiment 1, the duration of feedback was manipulated while intertriai interval (feedback plus no-feedback) was held constant. Animals with feedback lasting more than 1 sec needed fewer trials to reach the acquisition criteria than did animals with no feedback or with 1-sec feedback. No differences were observed in extinction. In Experiment 2, the durations of both feedback and no-feedback were manipulated. Animals without feedback needed more trials to reach the acquisition criterion than did animals with feedback, but the performance of the feedback animals did not differ as a function of feedback duration, no-feedback duration, or total intertrial interval. Again, no differences were observed in extinction. These results indicate that the presentation of feedback improves the acquisition of vertical jumping avoidance, but that this effect is independent of the temporal characteristics of feedback.     

How the Role of Computing is Driving New Genetics' Public Policy

In this paper we will examine some ethical aspects of the role that computers and computing increasingly play in new genetics. Our claim is that there is no new genetics without computer science. Computer science is important for the new genetics on two levels: (1) from a theoretical perspective, and (2) from the point of view of geneticists practice. With respect to (1), the new genetics is fully impregnate with concepts that are basic for computer science. Regarding (2), recent developments in the Human Genome Project (HGP) have shown that computers shape the practices of molecular genetics; an important example is the Shotgun Method's contribution to accelerating the mapping of the human genome. A new challenge to the HGP is provided by the Open Source Philosophy (I computer science), which is another way computer technologies now influence the shaping of public policy debates involving genomics.     

“Don’t give up on me”: critical mentoring pedagogy for the classroom building students’ community cultural wealth

This one-year ethnographic case study focused on students of color from a West Coast High School who faced a variety of academic challenges. Collectively, they shared perspectives on school improvement, and among the recommendations was the importance of mentorship in the classroom to develop students’ aspirational, navigational, and informational capital for academic resiliency, high expectations, and success. This article highlights the perspectives of multiple stakeholders, such as students and teachers, on the qualities of mentorship practices. Using these data, a framework was developed to promote mentoring as an interrelated process in classroom instruction to ignite a new perspective on school reform. In this particular context, this study concludes that these students of color viewed mentorship as a critical component that was often missing in their high school careers. In an effort to improve students’ experiences in the classroom, this article argues that teachers must develop critical mentoring skills, beyond what is traditionally considered as mentoring services, as a pedagogical tool to assist students to overcome their academic challenges and achieve school success.     

Rocking of a rigid block freestanding on a flat pedestal

The seismic protection of objects contained within museums is a topic of great interest, especially with reference to how they are displayed or stored. This problem is the same as that of a large class of non-structural components, such as mechanical and electrical hospital and laboratory equipment that could lose their functionality because of earthquakes. Statues and ceramics simply supported on the floor represent a significant set of case. In some cases, like the Bronzes of Riace, isolation systems have been developed. However, in general museum exhibits are not equipped with devices capable of mitigating the oscillations induced by possible earthquakes. The case study of a marble statue placed on a freestanding squat rigid pedestal is examined. The system of algebraic differential equations governing the problem has been derived and included in an ad-hoc numerical procedure. It is shown that the insertion of a squat rigid body with low frictional resistance at the lower interface with the floor, and high frictional resistance at the upper interface with the artifact significantly reduces the amplitude of the rocking response. As a result the artifact rocks without sliding on the rigid base that slides without rocking with respect to the floor. The numerical analysis performed can be a tool to help in the choice of the optimal friction values in the surfaces of the flat block, designed as a simple isolation system.     

Technology as ‘a human practice with social meaning’–a new scenery for engineering education

In a world sustained and interconnected by technology, people make choices. Therefore, they have to consider that technology is subject to analysis and interpretation because it is designed by humans with varied histories, experiences and cultures. To generate an understanding of the technological phenomenon, this article proposes to view the technology as a human practice, with social meaning and an attending change in classical technology-related education. The hidden resumé of the professors, the development of contents and didactic methods to be used in the educational process are fundamental elements in the appropriation of knowledge. Modifying these elements requires paradigmatic shifts, especially in the education of engineers, which would have to be focused on the knowledge acquisition and capabilities to allow an adequate practice of the technology management.     

Introduction to the Treatment of Non-Linear Effects Using a Gravitational Pendulum

We show that the treatment of pendulum movement, other than the linear approximation,may be an instructive experimentally based introduction to the physics of non-lineareffects. Firstly the natural frequency of a gravitational pendulum is measured as functionof its amplitude. Secondly forced oscillations of a gravitational pendulum are investigatedexperimentally without limiting amplitudes. By this arrangement new phenomena, thebistability and the jump-effect, can be observed. In the case of bistability the drivengravitational pendulum can oscillate in two different stable modes. Either it oscillateswith a small amplitude and approximately in phase with the exciting torque or it oscillateswith a larger amplitude and approximately anti-phase. The jump effect is the spontaneoustransition from one mode of oscillation to the other. Both effects can be demonstrated andexplained.