Evaluating epistemic uncertainty under incomplete assessments

The thesis of this study is to propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new methodology aims to identify potential uncertainty during system comparison that may result from incompleteness. The adoption of this methodology is advantageous, because the detection of epistemic uncertainty – the amount of knowledge (or ignorance) we have about the estimate of a system’s performance – during the evaluation process can guide and direct researchers when evaluating new systems over existing and future test collections. Across a series of experiments we demonstrate how this methodology can lead towards a finer grained analysis of systems. In particular, we show through experimentation how the current practice in Information Retrieval evaluation of using a measurement depth larger than the pooling depth increases uncertainty during system comparison.     

Breaking up is hard to do: the resilience of the rock group as an organizational form for creating music

Though there is a long tradition of band members quitting the group or taking a hiatus, the rock group as an organization to produce music continues to be both popular and economically viable. The research question addressed in this paper is whether or not it is a good idea to quit or take a hiatus from the group. We begin with a discussion of the framework for understanding why groups are formed and why they may be difficult to keep together. We then discuss differences between groups in the decade of the 1960s versus today. We argue that there is something unique about the output of the group even with the changes in the structure of contracts, compensation, and consumer focus on the artist that explain the resilience of the rock band as an organizational form within which to create music. We compare the charting success of bands that have members leave the group with the charting success of the members who left the group. We identified the groups in five representative years: 1965, 1975, 1985, 1995, and 2005. We then analyzed the entire Billboard Hot 100 charting careers of those groups and the artists who quit those groups. Our main finding is that when charting success is divided equally among members, going solo pays off—there is a clear economic rationale because solo acts have greater average charting success than the original bands they started in. The other ensuing side projects: duos, collaborations, and other groups are not as lucrative as the original bands. These findings are valid for members of charting groups from each of the 5 years examined. Despite the difficulties in keeping a rock band together, there are fewer band breakups today and remaining with the group generally results in a longer and more productive charting career. Thus, the rock group remains an important organization for producing contemporary music. However, there remains a compelling incentive to go solo. Superstars may benefit from solo projects, but for the average, non-superstar group member, in many circumstances it is better for the band to stay together if the income is divided equally.     

Community,identity and contested notions of place: a study of Haitian recreational soccer players in the Dominican Republic

Soccer is a sport not commonly associated with the Dominican Republic given the positioning of baseball as the national game. Yet, for some migrant groups in the country, such as those from Haiti, soccer plays an important part in their lives. Haitians have used soccer as a way to unite their communities and establish a sense of place. This paper assesses how these Haitian migrants use the game as a means of creating a community and developing a common focal point. Through participant observations and semi-structured interviews, this work may help us construct new understandings of the ways in which migrants use sport to assimilate to new surroundings and retain links to home.     

Constituting information technology research: the experience of IT researchers

The collective consciousness of effective groups of researchers is characterized by shared understandings of their research object or territory. In this study, we adopted a phenomenographic approach to investigate information technology (IT) research, and its objects and territories, as they are constituted in the experience of IT researchers. Semi‐structured interviews were conducted with researchers representing different sub‐disciplines. Analysis revealed the variation in meaning associated with the idea of IT research; and the awareness structures through which participants experience variation in ways of seeing the object and territories of IT research. Eight ways of seeing IT research were found. The outcomes of our project appear to make visible the changes and developments that are an essential part of the character and experience of contemporary IT research.     

Increasing the uptake of peer feedback in primary school writing: findings from an action research enquiry

This article reports on how an action research strategy was used to increase children's uptake of feedback during peer assessment in primary school writing. Several different strategies were used in the study that had been successful in increasing students’ uptake of peer feedback in contexts such as higher education. In order to evaluate how successful these actions were, several different data collection methods were drawn upon to triangulate findings including children's work, observations, informal interviews and mind mapping. Thematic analysis was used to analyse the data generated. Findings are consistent with those from research in other settings which suggest that pupils make better use of feedback if: it is task-involving and useful; there is sufficient time given for them to act on it and discuss it with their peers; and they are asked to reflect on how it has been used to improve the quality of the assessed work.     

Essential elements of successful child abuse and neglect treatment

Not all child abuse is preventable. Society faces an ongoing need to support programs that treat the members of families in which abuse occurs. There is little systeamatically generated knowledge on the most efficient and effective ways to assist parents and children faced with abuse. The purpose of our 40-month study of eleven child abuse and neglect demonstration service programs in the United States was to expand the knowledge base in this area by determining, through evaluative research, the essential elements of successful treatment programs. This paper highlights our findings that pertain to more effective delivery of services to abusive and neglectful parents.