Measuring Search Engine Quality

The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.     

Medical history for tomorrow—preserving the record of today

This paper addresses the need to recognize the importance, and the challenges, of preserving the hugely expanding record of medicine today for historians of the future. We are faced not only with an increase in traditional publishing formats, but also with the rapid growth in electronic communications. Two celebrated medical cases, one from the late seventeenth century and one from the late twentieth, are used to illustrate the differences and the difficulties. The need for active and effective professional collaboration is stressed; libraries should work together to address these issues.     

Integration Factors Related to the Academic Success and Intent to Persist of College Students with Learning Disabilities

Despite increased enrollment, outcomes such as grade point average (GPA), persistence, and graduation rates for college students with learning disabilities (LD) continue to lag behind those of their nondisabled peers. Reasons for the differences vary but may include academic and social integration, factors identified as important to the success of college students in general. This research investigated the relative influence of background characteristics, precollege achievement, and college integration variables on the academic success and intent to persist of college freshmen and sophomores with LD. While academic and social integration were not unique predictors of college GPA, both integration variables were unique predictors of intent to persist. The findings suggest that beyond high school achievement and background characteristics, college experiences as captured by academic and social integration are promising constructs to help explain the persistence of college students with LD. Implications for future research and practices for high school and college personnel are discussed.