Measuring Search Engine Quality

The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.     

Occupational Knowledge and Practice amongst UK University Research Administrators

With the exception of lecturing staff, research on occupational groups and cultures within the UK higher education system is relatively sparse. This paper focuses upon one specialist group, to-date under-researched but which plays a central role in contemporary higher education administration: graduate research administrators. This occupational group is of particular interest as its members administer and manage an increasing complex and key area of university life, which in many cases appears to span the putative occupational divide between 'academic' and 'administrative' work. Based upon qualitative interviews with 27 research administrators, and using some of Bourdieu's conceptual devices, the paper analyses particular kinds of informal occupational knowledge and practice, necessary in order effectively to 'do' the complex task of research administration in the pressurized environment of contemporary British higher education.     

Should Children Attend Their Parent's Funerals?

The paper discusses elements of the findings of 'Iceberg', a doctoral study at the University of York addressing many issues of child bereavement through a retrospective study of nearly one hundred individuals who had either experienced the death of a parent when they were at school, or were the surviving parent of such a child. The research revealed issues of lack of control and information for children after a parental death. Forty-seven per cent of those in the study attended the funeral of their parent. There was correlation between the age of children and attendance at the funeral. Of the fifty-three per cent of children not attending, twenty-four per cent of them were forbidden to attend, whilst eleven per cent of them were distracted from attending the funeral, such as being sent to school or a neighbours and being unaware that it was taking place. None of the children attending the funeral reported any negative experiences, and two thirds of them reported it as a positive or helpful event. In contrast, over three-quarters of those not attending later wished that they had. Over a third had feelings of regret, others feeling that they had been excluded from the family at the time of the death, and felt anger, hurt, and frustration. The conclusion was that the best strategy is to give children informed choice about whether or not to attend. If children do attend a negative outcome seems unlikely, but it would be prudent to prepare them as to what to expect at the ceremony.