Character N-Gram Tokenization for European Language Text Retrieval

The Cross-Language Evaluation Forum has encouraged research in text retrieval methods for numerous European languages and has developed durable test suites that allow language-specific techniques to be investigated and compared. The labor associated with crafting a retrieval system that takes advantage of sophisticated linguistic methods is daunting. We examine whether language-neutral methods can achieve accuracy comparable to language-specific methods with less concomitant software complexity. Using the CLEF 2002 test set we demonstrate empirically how overlapping character n-gram tokenization can provide retrieval accuracy that rivals the best current language-specific approaches for European languages. We show that n = 4 is a good choice for those languages, and document the increased storage and time requirements of the technique. We report on the benefits of and challenges posed by n-grams, and explain peculiarities attendant to bilingual retrieval. Our findings demonstrate clearly that accuracy using n-gram indexing rivals or exceeds accuracy using unnormalized words, for both monolingual and bilingual retrieval.     

让我们更多地认识城市与城市研究(二)

本文是美国圣地亚哥大学教授詹姆斯·A·克莱普2008年4月在北京城市学院的演讲,演讲共三场。为便于读者全面地理解克莱普教授的演讲内容,全部演讲内容被编译成一篇。本文是根据演讲记录稿整理后,经克莱普教授本人审定英文稿编译。     

Identification with sport teams as a function of the search for certainty

Based on ideas from subjective uncertainty reduction theory, we examined the extent to which individuals hold similar sport team preferences to their family and friends. We also assessed the extent to which perceived sport importance and personal need for structure are influential in the development of team identification. Australian high school students aged 15.5+/-1.0 years (mean+/-s) completed questionnaires containing the Personal Need for Structure Scale, the Relational-Interdependent Self-Construal scale, a Team Identification Scale, and items assessing perceptions of sport importance and team preferences. As expected, correlations indicated that preferences for sport teams were significantly related to the preferences of family and friends. Separate analyses of variance confirmed the remaining hypotheses. More specifically, individuals who perceived that sport was important identified with the team more than individuals who perceived sport to be less important. Also, individuals high in personal need for structure scored higher in cognitive/affective team identification than those low in this need. Individuals with differing needs for structure did not differ in their scores on other dimensions of team identification. The results support the notion that cognitive/emotional attachments to sport teams are influenced by perceptions of the importance of sport and by needs for subjective structure. It is possible that other psychological motives, such as the desire for self-esteem, facilitate the development of evaluative dimensions of team identification.