Measuring Search Engine Quality

The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.     

Connecting the Dots in a Research Program to Develop,Implement, and Evaluate Strategic Literacy Interventions for Struggling Readers and Writers

This article follows the development of three literacy programs that were designed by researchers at Michigan State University to support struggling readers and writers. The literacy interventions focus on strategy instruction in both writing and reading, and they culminate in the development of an integrated reading‐writing program to support the acquisition of read‐to‐learn and write‐to‐learn strategies in the content areas. The common thread that unifies the programs is an emphasis on text structure instruction with the provision of instructional scaffolds to support students' participation in a literacy discourse and strategies in advance of independent performance.     

Reprographic rights in Singapore: the story of CLASS

The Copyright Licensing and Administration Society of Singapore was established in 1999. It is now profitable and commercially significant, perhaps uniquely so in Asia. Critical factors in its growth have included a statutory (non‐voluntary) photocopying licence provision for educational institutions in the Copyright Act; and widespread support from the local and international communities of rightsholders. Tentative consensus has been established with educators over a fair level of remuneration for copying. Further work needs to be done to extend or amend the current model for electronic copying, for the private sector and for other countries in the region.     

OPINION RESEARCH, LIBERALISM AND THE FRENCH RIGHT

During the rewriting of its program in the early 1980s, theRassemblement pour la République (RPR) carried out anumber of opinion surveys. The person in charge of this wasnot a member of the inner leadership circle; he warned the partyleader, Jacques Chirac, that themes forming a coherent ‘liberal’program for the transformation of the relationship between citizens,state, and the economy, were not popular with public opinion,which remained attached to progressive taxation and a comprehensivesocial welfare system. The party leadership ignored these warnings.Rather than attempting to align their policies with voter aspirations,their principal use of political communications techniques aimedat improving their leader's image. The person in charge of thiswork was a stranger to politics whose understanding of the waycultural or political attitudes are changed led him to interpretvery fatalistically the chances of influencing election outcomesby communications techniques. His methods were treated withfrank skepticism by party communications colleagues, his client'spersonality was particularly unamenable to his efforts, andhis one successful initiative—the rejuvenation of theexecutive committee—was operated at the cost of a rowin the party. In the case of the RPR, opinion research seemsto have played no role at all in an important party policy review,the causes of which should be sought elsewhere.     

The experience of professional autonomy among psychotherapists in Korea and the United States

This study investigates professional autonomy as experienced by psychotherapists in Korea and in the United States using data collected as part of a collaborative international study of the development of psychotherapists (Orlinsky et al. (1999). Psychotherapy Research, 9(2), 127–153; Orlinsky & Rønnestad, (2005). How psychotherapists develop: A study of therapeutic work and professional growth. Washington, DC: American Psychological Association). The major aims are: to compare the extent of professional autonomy experienced by psychotherapists in Korea and by their counterparts in the USA; and to explore the professional and social correlates of the professional autonomy experienced by Korean therapists and compare these with the correlates of autonomy experienced by American therapists. These aims are pursued through analyses of a database of questionnaire responses. Results indicate that Korean therapists, compared to American therapists in our sample experience significantly lower levels of professional autonomy. For Korean therapists, whether they have a salient theoretical orientation in their practice is the single most important influence in their experience of work autonomy. Seniority and work setting are also significant correlates of autonomy for the Korean therapists. Similar to Korean therapists, seniority and having a salient orientation are also important influences on the way American therapists experience professional autonomy. American therapists, who work in independent practice experience higher work autonomy, whereas American social workers tend to experience lower professional autonomy.     

Defining appropriate criteria for the assessment of master's level TESOL assignments

In this paper I argue the rationale for the assessment criteria currently in use on the Aston University MSc in TESOL/TESP. These assessment criteria were revised in 1998–1999; here I discuss the goals of the revision project and argue that they have been successfully met by the assessment scheme which was developed. The discussion is offered for two main purposes. Firstly, the framework itself may be of interest to other departments who assess similar research reports to the course assignments discussed here. Secondly, and more importantly, the paper offers a position on the kinds of questions that should be asked and the sorts of places to look for answers for any project to (re)define assessment criteria in an academic programme.