Selling ‘impact’: peer reviewer projections of what is needed and what counts in REF impact case studies. A retrospective analysis

Abstract

The intensification of an audit culture in higher education is made no more apparent than with the growing prevalence of performance-based research funding systems like the UK’s Research Excellence Framework (REF) and the introduction of new measures of assessment like ‘impact’ or more specifically, the economic and societal impacts of research. Detractors of this regulatory intervention, however, question the legitimacy and credibility of such a system for, and focus within, the evaluation of research performance. Within this study, we specifically sought to understand the process of evaluating the impact of research by gaining unique access as observers of a simulated impact evaluation exercise populated by aproximately n = 90 senior academic peer reviewers and user assessors, undertaken within one UK research-intensive university prior to and in preparation of its submission to REF2014. Over an intensive two-day period, we observed how peer reviewers and user assessors grouped into four overarching disciplinary panels went about deliberating and scoring impact, presented in the form of narrative-based case studies. Among other findings, our observations revealed that in their efforts to evaluate impact, peer reviewers were indirectly promoting a kind of impact mercantilism, where case studies that best sold impact were those rewarded with the highest evaluative scores.     

Critical Thinking

Abstract

The process of critical thinking enables students to explore, analyze, and evaluate problems, theories, and interventions from divergent views and varying frames of reference. It requires a certain amount of skepticism and curiosity that will reflect upon accepted doctrines and protocols, in order to ascertain their credibility and utility in working with clients. This article presents the obstacles to acquiring critical thinking skills, as well as different strategies that can be utilized by educators to enhance its development and active usage. A theoretical construct and cognitive schema of learning describe the mechanisms of constructing meanings from experiences and advancing to critically assessing broader concepts. In this context, the importance of being introduced to new, empirically-based knowledge and critical thinking in substance abuse courses and practice is discussed, followed by an evaluation of students' advancing critical thinking skills.     

Do those who benefit the most need it the least? A four-year experiment in enquiry-based feedback

The aim of this paper is to report on an ongoing experiment in an enquiry-based approach to feedback. Over the course of four years, almost 1800 students have studied a final-year undergraduate module involving a mid-term assignment and end of module examination. Feedback on the assignment is delivered through a process which involves the provision of feedback resources and action planning rather than any individualised comments on the piece of work. The results of the experiment to date suggests that this approach to feedback can have a positive effect on student performance as they make the transition from formative assignment to summative examination but that the main beneficiaries of that performance improvement are students who did well in the assignment rather that students who had average or poor performance.     

Co-development of Conceptual Understanding and Critical Attitude: Analyzing texts on radiocarbon dating

This research documents the impact of a teaching interview aimed at developing a critical attitude in students, and focused on a particular topic: radiocarbon dating. This teaching interview is designed to observe students' reaction to limited written explanations of the phenomenon under study, and their possible frustration or intellectual satisfaction in relation to these texts. We aim to document the possible link between students’ developing conceptual understanding of a topic and their ability to express their frustration when presented with very incomplete explanations, or their intellectual satisfaction when presented with complete explanation. As a side product, we intend to observe some of their a priori ideas concerning this topic. Ten teaching interviews conducted with fourth-year University students were recorded, transcribed and coded. Beyond a series of results concerning students’ a priori understanding of the domain, the analysis of the interviews suggests that, when students are presented with texts of increasing completeness and discuss these with the interviewer, their critical reactions evolve in time in a very specific way. We propose a tentative model for this co-evolution of student conceptual command and critical stance. The discussion bears on possible interpretations for the ‘anesthesia of judgment’ observed in most students at the beginning of the interview, and for a few of them throughout the discussion. Keeping in mind the ‘competence vs concepts’ current alternative, the conditions that seem to free students’ critical potential are analyzed in relation to their evolving command of the topic and their degree of intellectual satisfaction.     

Practical media work and the curriculum of the future

This article considers the current range of contexts and pretexts for practical media work, principally in England. I argue that the current educational context in England requires us to broaden, rather than restrict the role that practical work is given in the curriculum. In particular I argue that practical media work has too often been associated with critical reflection (the ability to read between the lines of media texts) and critical authority (the ability to adopt the formal discourses of appreciation and judgement). It does this at the expense of critical autonomy (the ability to work with others to develop new, sustainable arguments) and critical action (the process of testing and refining these positions by applying them in real social settings). I argue that such a role is compatible with the development of pedagogies relevant to a ‘curriculum for the future’ (Young, 1998) which aims, among other things, to reconceptualize learning as a social, rather than an individual process.     

Thoughts on teaching thinking: perceptions of practitioners with a shared culture of thinking skills education

This article aims to outline the reported experiences of practitioners in a local authority in England where, since the mid-1990s, a high proportion of teachers have undertaken professional development in the field of teaching thinking skills. The article is based on the main findings from a questionnaire survey which was carried out among first, middle and high school teachers in this area. It was intended to explore their views on the use, benefits and challenges of teaching ‘Thinking for Learning’, a term which encompasses both the use of a range of thinking skills strategies and the Community of Enquiry/Philosophy for Children approaches.

The vast majority of respondents reported a range of positive effects on their pupils, including pupil motivation and cognitive, social and affective benefits. On the other hand, reported challenges mainly referred to a perceived lack of time and to some seemingly inherent difficulties in the teaching of thinking.

Conclusions from this study have the potential to inform professional development practice and policy far beyond this local authority's regional boundaries, and aim to contribute to the body of knowledge about forms of education that are based on dialogue and enquiry.     

批判性思维在图书馆服务实践中的应用

批判性思维是一种自觉的、有目的的、反思性的思维方式。文章主要论述了批判性思维在图书馆服务决策、服务管理、馆员能力与态度评价等方面的应用,并强调指出:要有理由有根据地怀疑,不能无限度怀疑;批判性思维只能保证结果在当前条件下最优,不能保证结果是正确的;要防止理科思维的负迁移。     

Reading the Web—Students' Perceptions about the Internet

This study explores the perceptions of Finnish 15‐year‐olds on the advantages and disadvantages of the Internet. The data, students' written responses (N = 3112), were gathered in the context of the OECD Programme for International Student Assessment (PISA) in the spring of 2000 as a national option. The data were analysed by close reading and using the Atlas.ti application for coding. Students regard easy access to a variety of current information as the most important advantage of the Internet. Finding new friends and chatting with old ones was also emphasised, as well as the downloading capacities of the Internet. Although problems of finding reliable and truthful information were recognised, students' main concerns were related to issues such as violations towards computers and people, and getting addicted or marginalised.     

Containment as Neocolonial Visual Rhetoric: Fashion,Yellowface, and Karl Lagerfeld's “Idea of China”

Grounding our evidence in Karl Lagerfeld's Paris-Shanghai: A Fantasy, a filmic homage to Coco Chanel, we theorize a “visual rhetoric of containment,” which limits the subjectivity of the racial Other and consolidates whiteness. The visual rhetoric of containment manifests in four ways: the creation and enactment of “the yellowface gaze,” which affirms whiteness through the eyes of the “native” Other, the affirmation of a post-feminist model of exchange, which objectifies the Chinese, the representation of Chanel as a master of place and order, and the conception of time as a constraint that Chanel, but not the Chinese people, can transcend.