Measuring Search Engine Quality

The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.     

The Provision for Personal, Social, Health Education (PSHE) and Citizenship in School-based Elements of Primary Initial Teacher Education

This small-scale research study looks at the PSHE/Citizenship framework and the opportunities for student teachers to understand and experience within school the relationship between values, personal and social development and learning. A questionnaire was given to two sets of student teachers on their final school-based placements. The research suggests that there needs to be greater recognition of the centrality of multi-cultural awareness and understanding within the political literacy section of the PSHE/Citizenship framework. This is the counterpart to a previous study of the opportunities for values education within the university-based elements of Primary Initial Teacher Education ( Mead, 2003 ).     

Personal reactions to ‘strange’ situations: Attachment styles and acculturation attitudes of immigrants and majority members

A growing number of studies examine the influence of individual factors on acculturation attitudes of immigrants, but few studies focus on majority members’ attitudes. In this paper, two studies are reported on the relation between attachment styles and acculturation attitudes of both immigrants (N=177) and majority members (N=243) in the Netherlands. Until now very few studies have associated cultural adjustment with attachment styles. This is remarkable, because attachment theory refers to interaction with others in new situations. Four different styles of attachment (the secure, dismissing, preoccupied and fearful attachment styles) are related to Berry's classification of acculturation attitudes. People, both immigrants and majority members, with a secure attachment style were positive towards integration, whereas people with a dismissing attachment style were not. Dismissing immigrants were more positive towards separation. Whereas both immigrants and majority members with a secure attachment style showed a similar pattern of correlations between attachment and acculturation, they seem to react quite differently, and even in opposite ways, when they have a preoccupied attachment style. Yet, the different reactions may be caused by the same psychological process: The existential ambivalence of preoccupied people may lead to diverse reactions.     

Public library trends

Public libraries tend to be taken for granted. They can be found in nearly every community and are used by a substantial proportion of the population, particularly the young and the old. Yet the public library service, as it is today, is a relatively recent phenomenon. Despite their origins in the mid-19th century, the widespread network of public libraries is largely the product of the post-war welfare state. The demand for the service grew rapidly during the war and in the immediate post-war period. Provision to meet the demand was constrained initially by the competing demands for reconstruction, but by 1960 the service was ready to expand. The growth was consolidated by the 1964 Public Libraries and Museums Act and was given further emphasis by the 1962 Bourdillon standards (Ministry of Education, 1962). The Act and the standards provided the impetus for what might be described as the golden age of public libraries. This brief period was brought to an abrupt end by the economic crises of the mid-1970s and the subsequent downward pressure on public expenditure. The service managed to hold its own during the late 1970s and early 1980s but since then it has been in decline, with the rate of decline accelerating during the 1990s as new requirements and increasing costs stretched diminishing resources even further, to the point where the overall level of provision now falls well short of the basic standards that were considered to be essential in the early 1960s.     

Quality and relevance of domain-specific search: A case study in mental health

When searching for health information, results quality can be judged against available scientific evidence: Do search engines return advice consistent with evidence based medicine? We compared the performance of domain-specific health and depression search engines against a general-purpose engine (Google) on both relevance of results and quality of advice. Over 101 queries, to which the term ‘depression’ was added if not already present, Google returned more relevant results than those of the domain-specific engines. However, over the 50 treatment-related queries, Google returned 70 pages recommending for or against a well studied treatment, of which 19 strongly disagreed with the scientific evidence. A domain-specific index of 4 sites selected by domain experts was only wrong in 5 of 50 recommendations. Analysis suggests a tension between relevance and quality. Indexing more pages can give a greater number of relevant results, but selective inclusion can give better quality.     

Reinventing the public value of libraries

ABSTRACT

Libraries worldwide have had to re-think their purpose and adapt to changing community needs and expectations. They are no longer simply repositories for old books. Rather, they are vital components of a community’s social and economic infrastructure that connects communities and fosters creativity and innovation. This paper explores the changing role of libraries—and public value organizations more broadly—in creating positive social, economic, and environmental outcomes for individuals and communities.