Measuring Search Engine Quality

The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.     

Effects of Manipulative Instruction on Solving Area and Perimeter Problems by Students with Learning Disabilities

Abstract. A multiple baseline design was employed to test the effect of manipulative instruction on the perimeter and area problem‐solving performance of middle and high school students who had been diagnosed with LD in the area of mathematics. Modeling, prompting/guided practice, and independent practice in conjunction with manipulative training were employed to teach both perimeter and area problem‐solving skills. Analysis of data revealed that the students rapidly acquired the problem‐solving‐skills, maintained these skills over a two‐month period, and transferred these skills to a paper and pencil problem‐solving format. This research extends previous findings by revealing that use of concrete manipulatives promotes the long‐term maintenance of skills.     

Reprographic rights in Singapore: the story of CLASS

The Copyright Licensing and Administration Society of Singapore was established in 1999. It is now profitable and commercially significant, perhaps uniquely so in Asia. Critical factors in its growth have included a statutory (non‐voluntary) photocopying licence provision for educational institutions in the Copyright Act; and widespread support from the local and international communities of rightsholders. Tentative consensus has been established with educators over a fair level of remuneration for copying. Further work needs to be done to extend or amend the current model for electronic copying, for the private sector and for other countries in the region.     

OPINION RESEARCH, LIBERALISM AND THE FRENCH RIGHT

During the rewriting of its program in the early 1980s, theRassemblement pour la République (RPR) carried out anumber of opinion surveys. The person in charge of this wasnot a member of the inner leadership circle; he warned the partyleader, Jacques Chirac, that themes forming a coherent ‘liberal’program for the transformation of the relationship between citizens,state, and the economy, were not popular with public opinion,which remained attached to progressive taxation and a comprehensivesocial welfare system. The party leadership ignored these warnings.Rather than attempting to align their policies with voter aspirations,their principal use of political communications techniques aimedat improving their leader's image. The person in charge of thiswork was a stranger to politics whose understanding of the waycultural or political attitudes are changed led him to interpretvery fatalistically the chances of influencing election outcomesby communications techniques. His methods were treated withfrank skepticism by party communications colleagues, his client'spersonality was particularly unamenable to his efforts, andhis one successful initiative—the rejuvenation of theexecutive committee—was operated at the cost of a rowin the party. In the case of the RPR, opinion research seemsto have played no role at all in an important party policy review,the causes of which should be sought elsewhere.