The role of academic journal publications in the UK Research Assessment Exercise

This article explores the evolution of the role of academic journal articles submitted to the UK's Research Assessment Exercise (RAE). By reviewing their role, it is possible to see how the changes from quantitative to qualitative assessment (and the resulting problems surrounding the definition of ‘quality’ journals) has impacted both on the journals selected by academics for publishing their research and the assessment of them. Although only one part of RAE submissions, the listing of published research outputs provides the primary evidence for research quality to most RAE panels, and is a significant driver of the final grade awarded, and thus the funding received by submitting institutions. The RAE, being a peer‐reviewed assessment exercise, mirrors in some ways the peer‐review process immured within scholarly publication. The developing role of journal publications as a vehicle for academic research output is examined via the chronology of the RAE, before assessing the current situation in which published journal output formed almost 70% of all output assessed by RAE panels in the latest exercise. The impact of this increased importance of academic journals in the assessment process is considered not only for academics but also for the wider community, i.e. publishers and libraries.     

Organizational Power and the Institutional Review Board

In this essay, we respond to the narratives and essays in this issue by examining organizational power issues related to researchers and institutional research boards (IRBs). Rather than taking a singular perspective on power, we use multiple perspectives and suggest that the cumulative analyses provide the best understanding of IRBs and organizational power.     

Analysis of Statistical Question Classification for Fact-Based Questions

Question classification systems play an important role in question answering systems and can be used in a wide range of other domains. The goal of question classification is to accurately assign labels to questions based on expected answer type. Most approaches in the past have relied on matching questions against hand-crafted rules. However, rules require laborious effort to create and often suffer from being too specific. Statistical question classification methods overcome these issues by employing machine learning techniques. We empirically show that a statistical approach is robust and achieves good performance on three diverse data sets with little or no hand tuning. Furthermore, we examine the role different syntactic and semantic features have on performance. We find that semantic features tend to increase performance more than purely syntactic features. Finally, we analyze common causes of misclassification error and provide insight into ways they may be overcome.     

A post-American world? Assessing the cognitive and attitudinal impacts of challenges to American exceptionalism

A number of voices have emerged in U.S. political discourse questioning the legitimacy of American exceptionalism, suggesting we are in a “post-American world.” Our research examines the effects that political messages that explicitly challenge American exceptionalism can have on U.S. public opinion. Drawing upon social identity theory, we find that explicit challenges to American exceptionalism significantly impact Americans’ views toward their own nation, their willingness to denigrate foreign publics, and their broader foreign policy preferences.     

Finding the common ground: Teachers' and employers' representations of English in an assessment context

There has been a long‐standing debate about how ‘English’ can be defined. Educational policy changes have typically been driven by differing representations of the subject, and have ranged from broad ‘aesthetic’ definitions to more narrow ‘functional’ views. The present study aims to analyse areas of consensus and contention in stakeholders' discourse regarding English. A questionnaire‐based survey and focus groups were used to explore how teachers and employers viewed English as a subject. Their views were conceptualised into three themes: the importance of functional English; English as atomistic versus holistic study; and English as critical thought. These themes are discussed in relation to historical definitions of ‘English’, and their implications for the future reform of English qualifications.