Tasks, topics and relevance judging for the TREC Genomics Track: five years of experience evaluating biomedical text information retrieval systems

With the help of a team of expert biologist judges, the TREC Genomics track has generated four large sets of “gold standard” test collections, comprised of over a hundred unique topics, two kinds of ad hoc retrieval tasks, and their corresponding relevance judgments. Over the years of the track, increasingly complex tasks necessitated the creation of judging tools and training guidelines to accommodate teams of part-time short-term workers from a variety of specialized biological scientific backgrounds, and to address consistency and reproducibility of the assessment process. Important lessons were learned about factors that influenced the utility of the test collections including topic design, annotations provided by judges, methods used for identifying and training judges, and providing a central moderator “meta-judge”.     

The impact of library services in primary care trusts in NHS North West England: a large‐scale retrospective quantitative study of online resource usage in relation to types of service

Background: Within NHS North West England there are 24 primary care trusts (PCTs), all with access to different types of library services. This study aims to evaluate the impact the type of library service has on online resource usage. Methodology: We conducted a large‐scale retrospective quantitative study across all PCT staff in NHS NW England using Athens sessions log data. We studied the Athens log usage of 30 381 staff, with 8273 active Athens accounts and 100 599 sessions from 1 January 2007 to 31 December 2007. Results: In 2007, PCTs with outreach librarians achieved 43% penetration of staff with active Athens accounts compared with PCTs with their own library service (28.23%); PCTs with service level agreements (SLAs) with acute hospital library services (22.5%) and with no library service (19.68%). This pattern was also observed when we looked at the average number of Athens user sessions per person, and usage of Dialog Datastar databases and Proquest full text journal collections. Discussion: Our findings have shown a correlation of e‐resource usage and type of library service. Outreach librarians have proved to be an efficient model for promoting and driving up resources usage. PCTs with no library service have shown the lowest level of resource usage.     

‘Please remember we are not all brilliant’: undergraduates’ experiences of an elite,research‐intensive degree at a research‐intensive university

Undergraduate research experiences are being incorporated into degree programs with increasing frequency. However, there has been little study into their effectiveness in preparing students for research or into the learning gains that students realise from one or more research experiences. We surveyed science students in an elite, research‐based undergraduate degree program at a research‐intensive university. These students complete six research projects during their degree and we aimed to delineate factors that students perceive as leading to either good or bad experiences. Two factors stand out as contributing to a successful research experience: the supervisor, with students reporting both pedagogic and affective benefits of good supervision; and the feeling that they are doing authentic science. Surprisingly, given the research‐intensive nature of this degree, the learning gains students report relate to both an appreciation of what research is like and life skills, such as time management, rather than scientific thinking skills.     

Church schools,educational markets and the rural idyll

Researchers have begun to explore the role that faith schools play in contemporary educational markets but the emphasis to date has been on urban rather than rural contexts. This article approaches the issue of marketisation through a qualitative case-study comparison of two Anglican primary schools in contrasting rural localities in England and Wales. Engaging with a range of stakeholders, including parents and pupils, the article explores reasons why the schools were valued, drawing on wider constructions of childhood, religion and rurality. The consequences of the schools’ popularity on factors such as traffic, parking, school ethos and local community ties are also considered. The findings of the study problematise some of the prevalent assumptions about marketisation, including the role of social class and geography in these processes. As such, the article makes an important contribution to the sociological literature on faith schools, rural schools and educational markets.     

Causal Attributions following Success and Failure at an Achievement Motor Task

Abstract

Past research has shown that success is predominantly attributed to internal factors and failure attributed to external factors. The purpose of the present experiment was to determine whether this attributional pattern was also found when subjects were performing a motor task. The degree of ego involvement in the task (evaluation) and the effect of prior practice (novelty) were also investigated in order to determine the extent to which these variables affect subjects' self-attributions. Thus, the effects of ego involvement and past experience following success and failure on causal attributions were investigated in a 2 × 2 × 2 (evaluation × novelty × outcome) factorial design with 80 college undergraduates. The task was a motor maze. Consistent with past research, subjects showed a relative tendency toward internal attributions over external attributions and a tendency toward stable attributions over unstable attributions. Moreover, success increased the relative bias toward internal attributions. However, evaluation apprehension and experience with the motor task did not interact with outcome to affect internal and external attributions.     

Joggers versus Nonexercisers: An Analysis of Knowledge,Attitudes and Beliefs about Jogging

Abstract

The Health Belief Model was utilized to examine the knowledge, attitudes and beliefs of individuals regarding regular jogging. Based on an elicitation procedure developed by Martin Fishbein, a questionnaire was developed according to the theoretical tenets of the Health Belief Model and was found to be valid and reliable. Responses from 124 joggers and 96 nonexercisers were analyzed, and significant differences were found. Factors which accounted for the largest portion of predictable variance (40%) were barriers to action such as lack of time, job or family responsibilities, or weather constraints. As a whole, the results provided support for the Health Belief Model in that 61% of the variance in jogging behavior was determined. The study suggests that physical and health educators might more effectively change the behavior of sedentary individuals by utilizing strategies which address perceived obstacles to jogging.     

Free operant avoidance behavior in hooded rats: IRTs and response chains

Twenty-five hooded rats were given 50 avoidance training sessions with leverpress IRTs obtained during as well as between sessions. Five qualitatively different shapes to the IRT profiles were found: single- or double-peaked shapes, positively or negatively accelerated shapes, and U-shaped distributions. Both the specific shape of the profile and the stability of that shape during a session were related to the avoidance proficiency of an individual rat. Six rats received two additional training sessions, with the final 30 min of each videotaped to obtain frequency counts of nine behavior categories. The observational data showed that avoidance-proficient rats typically incorporated the leverpress requirement into repetitive response chains.     

Do individual differences in children’s curiosity relate to their inquiry-based learning?

This study investigates how individual differences in 7- to 9-year-olds' curiosity relate to the inquiry-learning process and outcomes in environments differing in structure. The focus on curiosity as individual differences variable was motivated by the importance of curiosity in science education, and uncertainty being central to both the definition of curiosity and the inquiry-learning environment. Curiosity was assessed with the Underwater Exploration game (Jirout, J., & Klahr, D. (2012). Children's scientific curiosity: In search of an operational definition of an elusive concept. Developmental Review, 32, 125–160. doi:10.1016/j.dr.2012.04.002), and inquiry-based learning with the newly developed Scientific Discovery task, which focuses on the principle of designing informative experiments. Structure of the inquiry-learning environment was manipulated by explaining this principle or not. As intelligence relates to learning and possibly curiosity, it was taken into account. Results showed that children's curiosity was positively related to their knowledge acquisition, but not to their quality of exploration. For low intelligent children, environment structure positively affected their quality of exploration, but not their knowledge acquisition. There was no interaction between curiosity and environment structure. These results support the existence of two distinct inquiry-based learning processes – the designing of experiments, on the one hand, and the reflection on performed experiments, on the other – and link children's curiosity to the latter process.