Assessing basic research: Some partial indicators of scientific progress in radio astronomy

As the costs of certain types of scientific research have escalated and as growth rates in overall national science budgets have declined, so the need for an explicit science policy has grown more urgent. In order to establish priorities between research groups competing for scarce funds, one of the most important pieces of information needed by science policy-makers is an assessment of those groups' recent scientific performance. This paper suggests a method for evaluating that performance.After reviewing the literature on scientific assessment, we argue that, while there are no simple measures of the contributions to scientific knowledge made by scientists, there are a number of ‘partial indicators’ — that is, variables determined partly by the magnitude of the particular contributions, and partly by ‘other factors’. If the partial indicators are to yield reliable results, then the influence of these ‘other factors’ must be minimised. This is the aim of the method of ‘converging partial indicators’ proposed in this paper. We argue that the method overcomes many of the problems encountered in previous work on scientific assessment by incorporating the following elements: (1) the indicators are applied to research groups rather than individual scientists; (2) the indicators based on citations are seen as reflecting the impact, rather than the quality or importance, of the research work; (3) a range of indicators are employed, each of which focusses on different aspects of a group's performance; (4) the indicators are applied to matched groups, comparing ‘like’ with ‘like’ as far as possible; (5) because of the imperfect or partial nature of the indicators, only in those cases where they yield convergent results can it be assumed that the influence of the ‘other factors’ has been kept relatively small (i.e. the matching of the groups has been largely successful), and that the indicators therefore provide a reasonably reliable estimate of the contribution to scientific progress made by different research groups.In an empirical study of four radio astronomy observatories, the method of converging partial indicators is tested, and several of the indicators (publications per researcher, citations per paper, numbers of highly cited papers, and peer evaluation) are found to give fairly consistent results. The results are of relevance to two questions: (a) can basic research be assessed? (b) more specifically, can significant differences in the research performance of radio astronomy centres be identified? We would maintain that the evidence presented in this paper is sufficient to justify a positive answer to both these questions, and hence to show that the method of converging partial indicators can yield information useful to science policy-makers.     

Building parallel corpora by automatic title alignment using length-based and text-based approaches

Cross-lingual semantic interoperability has drawn significant attention in recent digital library and World Wide Web research as the information in languages other than English has grown exponentially. Cross-lingual information retrieval (CLIR) across different European languages, such as English, Spanish, and French, has been widely explored; however, CLIR across European languages and Oriental languages is still in the initial stage. To cross language boundary, corpus-based approach is promising to overcome the limitation of the knowledge-based and controlled vocabulary approaches but collecting parallel corpora between European language and Oriental language is not an easy task. Length-based and text-based approaches are two major approaches to align parallel documents. In this paper, we investigate several techniques using these approaches and compare their performances in aligning English and Chinese titles of parallel documents available on the Web.     

Mindset change in a cross-cultural context

Imagine you are Thai and a member of a management team from a European company that acts in an Asian emerging market. Imagine you are a European expat with the assignment to double the turnover from that Asian company in a few years. Imagine you are a Change Maker and they ask you to facilitate the (multinational) management team of that Asian company to develop a market strategy and translate it into a business plan, and you have to deal with cultural differences. How do you manage a small-scale change process based on the principles of action learning in that specific multinational context? That's the essence of this account of practice.     

Effects of national policies on teachers' sense of professionalism: findings from an empirical study in Portugal and in England

This paper reports on research aimed at investigating the ways in which teachers in Portugal and in England are experiencing recent changes in the policy environment which have affected their sense of professionalism and their professional identity. Data were collected through questionnaires and focus group interviews. Findings suggest the existence of some strengths in teachers' views on their professionalism, namely the importance of vocationalism, continuing learning and collaborative cultures, the relevance of project‐oriented work at school and an integrated perspective of the curriculum. However, a number of limitations also emerged, such as feelings of ambivalence and conflict, associated with increased bureaucracy, qualities of school leadership, cultures of loneliness and the lack of understanding and ownership of the process of change.

Cet article rend compte des données sur une étude réalisée au Portugal et en Angleterre sur la manière dont les enseignants des deux pays vivent les plus récents changements dans leur travail en résultat des politiques nationales. Plus concrètement, l'étude a analysé la manière dont les enseignants des deux pays caractérisent leur professionnalisme et leur identité professionnelle. Les données ont été recueillies à travers des questionnaires et des entretiens en groupe. Les résultats suggèrent quelques points forts, notamment l'importance du sentiment de vocation, de l'apprentissage continu, des cultures de collaboration et du travail de projet ainsi qu'une perspective intégrée du curriculum. Par contre, les points plus faibles ont été les sentiments d'ambivalence et de conflit, ainsi que la bureaucratie, la culture de solitude et l'absence de compréhension du processus de changement.

El artículo se basa en un estudio realizado por las Universidades del Minho (Portugal) y Nottingham (Inglaterra) sobre la forma como los profesores de los dos países han reaccionado a los recientes cambios en la política curricular, bien como sobre sus implicaciones en su profesionalismo y su identidad. Los datos fueron recogidos a través de cuestionario y entrevista de grupo. La lectura que surge de los datos indica un conjunto de puntos fuertes en la definición del profesionalismo de los profesores, especialmente la importancia atribuida al aprendizaje continuo y a las culturas de colaboración, así como la importancia del trabajo de proyecto y un entendimiento más amplio de los papeles de la escuela y de los profesores. Sin embargo, también surgieron algunas limitaciones, sobretodo en lo que respecta a sentimientos de alguna manera ambivalentes y conflictivos, determinados por el aumento de la burocracia, de la cultura individualista y la falta de comprensión y asimilación de los procesos de cambio.

Dieser Artikel berichtet über eine Studie, welche untersucht hat, inwiefern Lehrer aus Portugal und England die jüngsten Veränderungen im politischen Umfeld erleben, und inwiefern sich diese Veränderungen auf die berufliche Einstellung und Identität der Lehrer auswirken. Die Daten wurden durch Fragebögen und Fokusgruppeninterviews erhoben. Die Untersuchungsergebnisse zeigen, dass die Lehrer ihre Weiterbildung und Mitarbeitskultur, projektorientierte Schularbeit, eine integrierte Perspektive des Curriculums und ein breites Verständnis für die Schule und für die Lehrerarbeit als wichtig erachten. Es wurden jedoch auch einige Schwachpunkte identifiziert, wie beispielsweise mit erhöhtem Bürokratismus verbundene Ambivalenz‐ und Konfliktgefühle, Einsamkeitskultur, sowie Verständnislosigkeit gegenüber dem Veränderungsvorgang.     

Context-Sensitive Instructional Design Models: A Response to Design Research,Studies, and Criticism

Instructional design, as it is traditionally conceptualized, is being challenged on several fronts, through surveys of design practice, cross-disciplinary studies of design practice, and practical criticism focusing on issues of design models' flexibility and efficiency. Collectively these challenges raise questions about the viability of the instructional design enterprise. This paper reviews these challenges and attempts to respond by offering alternative approaches to instructional design.     

Evaluation of adverse drug reaction formatting in drug information mobile phone applications

Objective:To evaluate the differences in presentation (formatting) of adverse drug reaction (ADR) information within drug monographs in commonly used drug information (DI) mobile device applications.Methods:A cross-sectional analysis of ADR formatting of twenty commonly prescribed oral medications within seven DI mobile applications was performed. Databases were assessed for ADR information, including presence of placebo comparisons, severity of ADR, onset of ADR, formatting of ADRs in percentile (quantitative) format or qualitative format, whether references were used to cite information, and whether ADRs are grouped by organ system. Data was collected by two study investigators and discrepancies were resolved via consensus.Results:The seven DI mobile applications varied significantly on every analyzed ADR variable with the exception of ADR onset, which was absent in all databases. Significant differences were found for variables known to impact clinical judgment such as placebo comparisons and qualitative versus quantitative formatting. Placebo comparisons were most common among monographs in Lexicomp (30%) but were absent among monographs within other applications. Quantitative information was commonly used in most databases but was absent in Epocrates. Qualitative formatting was present in all Epocrates and Micromedex applications but absent in the majority of other applications. Substantial variations were also found in severity and grouping information.Conclusion:Substantial variation in ADR formatting exists among the most common DI mobile applications. These differences may translate into alternative interpretations of medical information and thus impact clinical judgment. Health care librarians and clinicians should consider ADR formatting when choosing between DI applications.     

The biomechanical characteristics of high-performance endurance running

The biomechanical profile of high-level endurance runners may represent a useful model that could be used for developing training programmes designed to improve running style. This study, therefore, sought to compare the biomechanical characteristics of high-performance and recreational runners. Kinematic and kinetic measurements were taken during overground running from a cohort of 14 high-performance (8 male) and 14 recreational (8 male) runners, at four speeds ranging from 3.3 to 5.6?m?s^?1. Two-way ANOVA analysis was then used to explore group and speed effects and principal component analysis used to explore the interdependence of the tested variables. The data showed the high-performance runners to have a gait style characterised by an increased vertical velocity of the centre of mass and a flight time that was 11% longer than the recreational group. The high-performance group were also observed to adopt a forefoot strike pattern, to contact the ground with their foot closer to their body and to have a larger ankle moment. Importantly, although observed group differences were mostly independent of speed, the tested variables showed a high degree of interdependence suggesting an underlying unitary phenomenon. This is the first study to compare high-performance and recreational runners across a full range of kinematic and kinetic variables. The results suggest that high-performance runners maintain stride length with a prolonged aerial phase, rather than by landing with a more extended knee. These findings motivate future intervention studies that should investigate whether recreational runners could benefit from instruction to decrease shank inclination at foot contact.     

¡No lucro! … from protest catch cry to presidential policy: is this the beginning of the end of the Chilean neoliberal model of education?

This paper surveys the delivery of school education in Chile over the last half-century. It focuses on evidence provided by recent academic studies on the impact of neoliberal education policies introduced by the military regime in the 1980s, and continued by successive democratic governments. It offers insights into recent popular critiques of the neoliberal model, as reported in the Chilean press, and reflected by significant popular support for student protest movements demanding the end of for-profit schools, and the revitalisation of the public school system – encapsulated in the protesters’ catch cry of ¡No lucro! It considers possible consequences of the adoption, as policy, of that catch cry, by the recently elected Bachelet government.     

CERN: Past performance and future prospects: II. The scientific performance of the CERN accelerators

In a series of three papers, we attempt to evaluate the past scientific performance of the three main particle accelerators at the Geneva-based European Organization for Nuclear Research (CERN) over the period since 1960, and to assess the future prospects for CERN and its users during the next ten to fifteen years.We concerned ourselves in a previous paper (Paper 1 - Martin and Irvine [51] with the position of the CERN accelerators in world high-energy physics relative to those at other large laboratories working in the field. We dealt primarily with the period from 1969 to 1978, and attempted to establish how the experimental output from the three principal CERN accelerators, taken as a whole, compared with that from other major facilities. In undertaking this comparative evaluation, we drew on the method of “converging partial indicators” used in previous studies of three Big Science specialties.In contrast, this paper (Paper II) focuses in detail on the scientific performance of each of the CERN accelerators taken individually. In particular, it asks, first, how the outputs from the CERN 28 GeV (giga or billion electron-volts) Proton Synchrotron compare with those from a very similar 33 GeV American accelerator at Brookhaven National Laboratory over the past two decades? Second, how great have been the experimental achievements of the Intersecting Storage Rings in world terms? And, third, how do the outputs from the CERN 400 GeV Super Proton Synchrotron and from a rival American machine at Fermi National Accelerator Laboratory compare? Attempts are then made to identify the main factors responsible for determining the relative scientific performance of each CERN machine.These factors are of relevance to the subject of a third paper (Paper III - Martin and Irvine [52]) which sets out to assess the future prospects for CERN and in particular for LEP, the large electron-positron collider scheduled for completion in the latter part of the 1980s. What are the construction requirements (financial and technical) associated with LEP, and how easily will they be met? How does the scientific potential of LEP compare with that of other major accelerators under construction around the world? And, in the light of the previous record of the CERN accelerators, to what extent is this potential likely to be realized? The paper concludes with a discussion of the extent to which predictive techniques can be utilized in the formulation of scientific priorities, and of the problems in current science policy-making that such techniques might help address.