The effect of user characteristics on search effectiveness in information retrieval

This paper investigates the influence of user characteristics (e.g. search experience and cognitive skills) on user effectiveness. A user study was conducted to investigate this effect, 56 participants completed searches for 56 topics using the TREC test collection. Results indicated that participants with search experience and high cognitive skills were more effective than those with less experience and slower perceptual abilities. However, all users rated themselves with the same level of satisfaction with the search results despite the fact they varied substantially in their effectiveness. Therefore, information retrieval evaluators should take these factors into consideration when investigating the impact of system effectiveness on user effectiveness.     

Characterising and evaluating information seeking behaviour in a digital environment: Spotlight on the ‘bouncer’

The paper delineates and explains an emerging, but significant, form of digital information seeking behaviour among information consumers, which the authors have called ‘bouncing’. The evidence for this behaviour has emerged from five years of deep log analysis studies – an advanced form of transaction log analysis – of a wide range of users of digital information resources. Much of the evidence and discussion provided comes from the scholarly communication field. Two main bouncing metrics were applied in the log studies: site penetration, which is the number of items or pages viewed in a session, and return visits. The evidence shows that (1) a high proportion of people view just a few items or pages during a visit to a site and, (2) a high proportion of visitors either do not come back to the site or they did so infrequently. Typically those who penetrated a site least tended to return the least frequently. These people are termed ‘bouncers’. They bounce into the site and then bounce out again, presumably, to another site, as a high proportion of them do not appear to come back again. Possible explanations – negative and positive, for the form of behaviour are discussed.     

Let’s search together,but not too close! An analysis of communication and performance in collaborative information seeking

Communication is considered to be one of the most essential components of collaboration, but our understanding as to which form of communication provides the most optimal cost-benefit balance lacks severely. To help investigate effects of various communication channels on a collaborative project, we conducted a user study with 30 pairs (60 participants) in three different conditions – co-located, remotely located with text chat, and remotely located with text as well as audio chat, in an exploratory search task. Using both quantitative and qualitative data analysis, we found that teams with remotely located participants were more effective in terms of being able to explore more diverse information. Adding audio support for remote collaboration helped participants to lower their cognitive load as well as negative emotions compared to those working in the same space. We also show how these findings could help design more effective systems for collaborative information seeking tasks using adequate and appropriate communication. We argue that collaboration is an important aspect of human-centered IR, and that our work provides interesting insights into people doing information seeking/retrieval in collaboration.     

The role of digital information use on student performance and collaboration in marginal universities

Using technology to facilitate learning in universities and other higher education institutions (HEIs) has become common practice due to its ability to reduce barriers related to time and space in traditional learning environments. However, current literature mostly focuses on the use of the technology and not on the use of the information it conveys. Also, very few studies focus on technology adoption in universities and HEIs in developing countries, especially those in Africa. Thus, we propose a model that explains the changing information behaviors of students in this digital age and the effect this has on their learning outcomes. We collected questionnaire data from 303 students and analyzed the data using structural equation modelling partial least squares (SEM-PLS). We found that our proposed model explains 60.2 % of student satisfaction, 24.2 % of academic performance, 24.1 % of information sharing, and 19.8 % of their information exchange behavior. This study confirms that the use of digital information and its antecedent factors have significant effects on the college experience of students. This has several implications for information systems research and practice, especially in the design and assessment of technology use in learning environments.