Measuring Search Engine Quality

The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.     

Reprographic rights in Singapore: the story of CLASS

The Copyright Licensing and Administration Society of Singapore was established in 1999. It is now profitable and commercially significant, perhaps uniquely so in Asia. Critical factors in its growth have included a statutory (non‐voluntary) photocopying licence provision for educational institutions in the Copyright Act; and widespread support from the local and international communities of rightsholders. Tentative consensus has been established with educators over a fair level of remuneration for copying. Further work needs to be done to extend or amend the current model for electronic copying, for the private sector and for other countries in the region.     

OPINION RESEARCH, LIBERALISM AND THE FRENCH RIGHT

During the rewriting of its program in the early 1980s, theRassemblement pour la République (RPR) carried out anumber of opinion surveys. The person in charge of this wasnot a member of the inner leadership circle; he warned the partyleader, Jacques Chirac, that themes forming a coherent ‘liberal’program for the transformation of the relationship between citizens,state, and the economy, were not popular with public opinion,which remained attached to progressive taxation and a comprehensivesocial welfare system. The party leadership ignored these warnings.Rather than attempting to align their policies with voter aspirations,their principal use of political communications techniques aimedat improving their leader's image. The person in charge of thiswork was a stranger to politics whose understanding of the waycultural or political attitudes are changed led him to interpretvery fatalistically the chances of influencing election outcomesby communications techniques. His methods were treated withfrank skepticism by party communications colleagues, his client'spersonality was particularly unamenable to his efforts, andhis one successful initiative—the rejuvenation of theexecutive committee—was operated at the cost of a rowin the party. In the case of the RPR, opinion research seemsto have played no role at all in an important party policy review,the causes of which should be sought elsewhere.     

Chaos theory, informational needs, and natural disasters

This study applies chaos theory to a system-wide analysis of crisis communication in a natural disaster. Specifically, we analyze crisis communication during the 1997 Red River Valley flood in Minnesota and North Dakota. This flood, among the worst in modern American history, consumed entire metropolitan areas, displacing thousands of people. The conditions and decisions leading to the disaster, and the subsequent reactions are retraced. Communication related to river crest predictions (fractals), the shock at the magnitude of the crisis (cosmology episode), novel forms of reorganizing (self-organization), and agencies that aided in establishing a renewed order (strange attractors) are evaluated. Ultimately, we argue that preexisting sensemaking structures favoring rationalized, traditional views of a complex system led officials to make inappropriately unequivocal predictions and ultimately diminished the effectiveness of the region's crisis communication and planning.