Character N-Gram Tokenization for European Language Text Retrieval

The Cross-Language Evaluation Forum has encouraged research in text retrieval methods for numerous European languages and has developed durable test suites that allow language-specific techniques to be investigated and compared. The labor associated with crafting a retrieval system that takes advantage of sophisticated linguistic methods is daunting. We examine whether language-neutral methods can achieve accuracy comparable to language-specific methods with less concomitant software complexity. Using the CLEF 2002 test set we demonstrate empirically how overlapping character n-gram tokenization can provide retrieval accuracy that rivals the best current language-specific approaches for European languages. We show that n = 4 is a good choice for those languages, and document the increased storage and time requirements of the technique. We report on the benefits of and challenges posed by n-grams, and explain peculiarities attendant to bilingual retrieval. Our findings demonstrate clearly that accuracy using n-gram indexing rivals or exceeds accuracy using unnormalized words, for both monolingual and bilingual retrieval.     

Validating the Willingness to Self-Censor Scale: Individual Differences in the Effect of the Climate of Opinion on Opinion Expression

Hayes, Glynn, and Shanahan (2005) defined self-censorship asthe withholding of one’s opinion around an audience perceivedto disagree with that opinion. They argued that people differin their willingness to self-censor and introduced an 8-itemself-report instrument, the Willingness to Self-Censor scale,to measure this individual difference. The results of an experimentalstudy presented here provide further evidence of the constructvalidity of the scale. Each participant in the study was presentedwith a hypothetical scenario that contained information suggestinga group of people the participant was conversing with abouta controversial topic held opinions that were either uniformlysimilar to or different from the participant’s own opinion.Four weeks prior, each participant had responded to the Willingnessto Self-Censor scale and a measure of dispositional shyness.As expected, the manipulation of the climate of opinion affectedwillingness to express an opinion to the group, but more soamong those who scored relatively high on the Willingness toSelf-Censor scale. These results support the notion that somepeople rely on information about the climate of opinion moreso than do others when they decide whether or not to voice theiropinion publicly, and they suggest that the Willingness to Self-Censorscale measures this individual difference.     

From Archive,to Access,to Experience––Historical Documents as a Basis for Immersive Experiences

Libraries have been the key to preserving culture and historic legacy for centuries. One such treasure cataloged in The Pennsylvania State University (Penn State) Libraries is a collection of over 33,000 Sanborn? Fire Insurance Maps. Originally kept safe in metal drawers, the library has embarked on a journey to digitize this abundance of information, combine it with other media such as photographs, and make it accessible through a web interface. Inspired by these efforts, we accessed this information and took it to the next level. Using state of the art 3D modeling and immersive technologies, we created a historic 3D model and immersive experiences of Penn State, exemplarily for the 1922 campus. The resulting experiences can be accessed through the web but also through head mounted displays (HMDs) and mobile phones in combination with VR viewers such as the Google Cardboard. Additionally, they can be used anywhere in the world or on the campus itself as a way to enable remote and in situ experiences and learning. Immersive experiences let us connect to the past, the present and the future, and as such offer value to digital cultural heritage efforts.     

Storytime with Fresh Professor,Part One

I wasn't always the Fresh Professor. At one point, I was just another starving actor, trying to make a living. But stories change over time, as do professional desires.     

Am I a Teaching Artist or an Administrator?

James Miles writes about his transition from teaching artist to administration. Is it for everyone?