Measuring Search Engine Quality

The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.     

The Provision for Personal, Social, Health Education (PSHE) and Citizenship in School-based Elements of Primary Initial Teacher Education

This small-scale research study looks at the PSHE/Citizenship framework and the opportunities for student teachers to understand and experience within school the relationship between values, personal and social development and learning. A questionnaire was given to two sets of student teachers on their final school-based placements. The research suggests that there needs to be greater recognition of the centrality of multi-cultural awareness and understanding within the political literacy section of the PSHE/Citizenship framework. This is the counterpart to a previous study of the opportunities for values education within the university-based elements of Primary Initial Teacher Education ( Mead, 2003 ).     

Assessing School Readiness: Validity and Bias in Preschool and Kindergarten Teachers' Ratings

As a part of efforts to evaluate and monitor the increasing public investment in early childhood education, teachers are being asked to assess children's school readiness. In this study, preschool teachers and kindergarten teachers rated children's skills in three areas (kindergarten readiness, academic skills, and communication skills), and these ratings were compared with direct assessments of the children's skills. Ratings by both groups of teachers tended to be more highly related to basic skills, such as counting and number naming, than to abilities such as solving applied problems and using expressive and receptive vocabulary. Preschool teachers' ratings had a lower association with children's observed skills and abilities than kindergarten teachers' ratings. Ratings of children attending Head Start were systematically inflated, but this relationship was mediated to a significant extent by the teachers' levels of education. More educated teachers rated children in a manner consistent with the children's directly assessed skills. Implications of these findings for informing future efforts to assess school readiness by using teacher ratings are discussed.     

Public library trends

Public libraries tend to be taken for granted. They can be found in nearly every community and are used by a substantial proportion of the population, particularly the young and the old. Yet the public library service, as it is today, is a relatively recent phenomenon. Despite their origins in the mid-19th century, the widespread network of public libraries is largely the product of the post-war welfare state. The demand for the service grew rapidly during the war and in the immediate post-war period. Provision to meet the demand was constrained initially by the competing demands for reconstruction, but by 1960 the service was ready to expand. The growth was consolidated by the 1964 Public Libraries and Museums Act and was given further emphasis by the 1962 Bourdillon standards (Ministry of Education, 1962). The Act and the standards provided the impetus for what might be described as the golden age of public libraries. This brief period was brought to an abrupt end by the economic crises of the mid-1970s and the subsequent downward pressure on public expenditure. The service managed to hold its own during the late 1970s and early 1980s but since then it has been in decline, with the rate of decline accelerating during the 1990s as new requirements and increasing costs stretched diminishing resources even further, to the point where the overall level of provision now falls well short of the basic standards that were considered to be essential in the early 1960s.