MEASURING THE THIRD-PERSON EFFECT OF NEWS: THE IMPACT OF QUESTION ORDER, CONTRAST AND KNOWLEDGE

This study investigated the extent to which the third-personeffect—the tendency of people to estimate greater impactof media messages on ‘other people’ than on themselves—mightdepend upon question-contrast effects (i.e. self-serving comparisonstriggered by back-to-back questions dealing with effect on othersand oneself), the order of questions, and respondents' levelsof background political knowledge. Two hundred and eighty-sevensubjects participated in two experimental studies involvingquestions about media coverage of President Clinton's possiblerole in the ‘Whitewater Affair’, his alleged frequentpolicy reversals, the O. J. Simpson murder trial, and childmolestation charges against Michael Jackson. Both experimentsresulted in significant third-person effects that did not dependupon having the same respondents answer both questions; meansfor single-question (no contrast) conditions did not differsignificantly from comparable means in two-question (contrast)conditions. No significant main effects of question order wereobserved. In Experiment 1 a significant interaction betweenpolitical knowledge and question order was found, such thata negative relationship between knowledge and perceived impacton oneself emerged when the ‘self’ question followeda question about perceived effects on others. Experiment 2 replicatedthe interaction for two of three news stimuli, and indicatedthat it was not a product of differences in the personal importanceof issues. Implications of these results for understanding thethird-person effect are discussed.     

'NO OPINION'-FILTERS: A COGNITIVE PERSPECTIVE

Research on the use of ‘no opinion’-filters suggeststhat respondents are the less likely to offer a substantiveresponse the more strongly the filter question is worded. Aseries of experiments is reported that demonstrates that filterquestions influence respondents' perception of their task: themore strongly the filter question is worded, the more respondentsassume that they will have to answer difficult questions, andthat they may not have the required knowledge. Accordingly,filter questions discourage respondents from offering globalopinions that they may hold. In line with this assumption, allrespondents who reported not having an opinion in response toa filter question, subsequently provided substantive responseson a global opinion question—presumably because the globalquestion asked was less demanding than expected on the basisof the filter. Analyses of these substantive responses indicatedthat respondents who initially reported not having an opiniondiffered from respondents who reported having one. Methodologicalimplications of these findings for the use of filter questionsand for research on the nature of ‘floating’ arediscussed.     

RANDOM PROBES OF GSS QUESTIONS

Survey analysts frequently know little about the validity oftheir questions. They often have no direct evidence that respondentsunderstand the questions being posed and that shared understandingexists between the analyst and the respondent. Using the ‘randomprobe’ technique developed by Howard Schuman, about 30questions from the 1984 General Social Survey are examined.Overall there appears to be few validity problems with thesequestions, but some alternative understandings and problemsare examined. The random probes also can be used to gain substantiveinsight into the issue under investigation and their value inthis area is illustrated.     

Research workflow skills for education doctoral students and postdocs: A qualitative study

This paper is a qualitative study of how doctoral students and post-doctoral researchers construct their research workflows. The purpose of this study is to examine how doctoral students are constructing their scholarly workflows and to recommend best practices for supporting such early-career scholars. This study will also provide preliminary answers to these questions to help with programming, training, and identifying how academic libraries can support doctoral students and postdoc research work.     

OPINION QUALITY IN PUBLIC OPINION RESEARCH

In recent years, a number of new techniques have been developed—includingdeliberative polls and educational surveys—that attemptto gather measures of public opinion that is of higher quality(i.e. better informed or more deliberative) than that recordedin typical mass opinion surveys. This paper addresses severalgeneral sets of questions. What is meant by ‘quality’in public opinion? What criteria can be enumerated by whichthe quality of public opinion can be assessed? In grapplingwith these questions, the paper argues that conceptions of qualityin public opinion are inextricably bound to broader conceptionsof quality in democratic decision making, a complex processinvolving multiple phases and collective participants. In addition,a number of important contradictions and ambiguities underlieconceptions of quality in public opinion.     

THE GULF CRISIS: A BRITISH PERSPECTIVE

This paper presents the results of a relatively large numberof public opinion surveys conducted in Britain during the Gulfcrisis—August 1990 to February 1991—many at weeklyintervals. The questions detailed here not only dealt with publicattitudes to the crisis itself but on its impact on the perceptionof the superpowers and the Arab world; again comparative trends,stretching back for almost forty years. There is also a discussionof the Gulf crisis and the British domestic political situation—wouldthe so-called ‘Falklands effect’ of 1982-1983 bereplicated by a ‘Gulf effect’ in 1991? This collectionof surveys probably represents one of the largest databaseson the topic in Britain. The paper shows a fairly stable positionof public opinion during the crisis; an improvement in the imageof the United States but a deterioration in that of the SovietUnion; but no significant effect on the British domestic politicalscene.     

IMPACT OF QUESTION ORDER ON THE THIRD-PERSON EFFECT

A nationwide telephone survey in the United States was conductedto investigate the impact of question order on the perceptualand behavioral hypotheses of the third-person effect. The perceptualhypothesis posits that individuals perceive other people tobe more vulnerable than themselves to persuasive media messages,whereas the behavioral hypothesis predicts that perceiving othersas more vulnerable increases support for message restrictions.Key questions included estimated effects of media issues onself, perceived effects on others, and support for restrictionson media content. Four question-order condition (restrictions—others-self,restrictions-self-others, others-self-restrictions, and self—others—restrictions)were tested with three media issues (television violence, televisedtrials, and negative political advertising). In line with pastresearch, the order of the self, others, and restrictions questionsdid not affect the perceptual hypothesis. However, the sequencingof the self, others, and restrictions questions affected supportfor the behavioral hypothesis in some conditions. The resultssuggest that, consistent with a saliency effect, placement ofself and others questions prior to the restrictions questionmight heighten respondents' willingness to endorse restrictionson the media and increase support for the behavioral hypothesis.     

THE IMPACT OF THE PRESENCE OF OTHERS ON A RESPONDENT'S ANSWERS TO QUESTIONS

Although interviewers in survey research are usually instructedto interview the respondent alone, third parties are a commonenough occurrence to have a potentially serious impact on responses.This article examines the effect of third parties present (spouses,children, and in general) on a respondent's answers. Data fromthe 1994 General Social Survey were used. Results show that,for married respondents, answers on 15 questions about marriage,sexual matters and miscellaneous items are hardly affected bythe presence of a spouse. Differences on gender role items emergeas spurious when proper controls for differences in family andhousehold structure and organization are entered. Among 13 questionsabout child values, sexual matters concerning youths, and otheritems, answers are mostly not influenced by the presence ofa child. When controls are applied, only one difference emerges:Respondents appear less approving of premarital sex when anolder child (6 years or more) is present. Among 13 items onsex, religion, personal evaluations and evaluations of people,only self-reported health is affected by the presence of thirdparties. Overall, the impact of third parties on survey responsesis fairly rare and mostly small. Most apparent impacts of thepresence of others turn out to be spurious. Though they areof limited extent, third-party effects need to be better understood.Specific steps toward this end are suggested.     

Reliability and Validity of Real-Time Response Measurement: a Comparison of Two Studies of a Televised Debate in Germany

This paper investigates the reliability and validity of real-timeresponse measurements (RTR). It is based on a comparison oftwo quasi-experimental studies independently conducted on thesecond televised debate of the two major candidates for chancellorin the 2002 German federal election campaign. Participants inBamberg and Mainz—two mid-sized German cities—followedthe debate on a large-scale screen. The viewers’ immediatereactions to the candidates were measured in real-time. In termsof technicalities and substance, both quasi-experiments differedin several important respects. For example, the system usedin Mainz was based on a control unit with a 7-point scale andyielded one merged metric dimension for both candidates. TheBamberg system measured positive and negative impressions ofthe candidates independently, yielding categorical data. Despitethese operational differences, the results show that both methodsrender reliable results that also meet the criteria of face,construct, and criterion validity. Hence, RTR measurements providevaluable, unique insights into subjective immediate reactionsto candidates in televised debates and help to explain post-debateperceptions and attitudes. Received for publication March 23, 2005. Revision received December 14, 2005.     

Enhancing web search in the medical domain via query clarification

The majority of Internet users search for medical information online; however, many do not have an adequate medical vocabulary. Users might have difficulties finding the most authoritative and useful information because they are unfamiliar with the appropriate medical expressions describing their condition; consequently, they are unable to adequately satisfy their information need. We investigate the utility of bridging the gap between layperson and expert vocabularies; our approach adds the most appropriate expert expression to queries submitted by users, a task we call query clarification. We evaluated the impact of query clarification. Using three different synonym mappings and conducting two task-based retrieval studies, users were asked to answer medically-related questions using interleaved results from a major search engine. Our results show that the proposed system was preferred by users and helped them answer medical concerns correctly more often, with up to a 7 % increase in correct answers over an unmodified query. Finally, we introduce a supervised classifier to select the most appropriate synonym mapping for each query, which further increased the fraction of correct answers (12 %).     

Effect of an evidence-based answering service on GPs and their patients: a pilot study

Objectives: For general practitioners (GPs), an important obstacle to practising evidence‐based medicine is lack of time. An evidence‐based answering service was developed that took over searching and appraisal of medical evidence from the GPs. GPs sent in questions, and the informationist formulated the answers. Our objectives were to find out if such an evidence‐based answering service was feasible, including assessing the effect of the answers on GPs and their patients, as reported by the GPs. Methods: After attending a workshop on building well‐formulated questions from daily practice, the GPs sent in questions to the informationist. The literature was searched, the relevant information was appraised, and the answers to the questions were formulated. With a questionnaire, the effect of the answers on the GP and the patient was assessed, as well as the perceived barriers to implementing the answers. Results: From 26 GPs, 61 questions were received. For 12% of questions, information was found with the highest evidence level, while for 36%, no information was found. However, for 89% of the questions for which no information could be found, the answer ‘no information found’ did have an effect on the GP concerned. In total, 81% of all the answers had an effect on the GP, and, according to the GP, 52% had an effect on the patient. Few barriers to implementing the evidence were perceived. Most of the answers were found in Pubmed/Medline, the Cochrane Library and Embase. Conclusions: This study indicates that an evidence‐based answering service can have an impact on GPs and their patients. Librarians can provide an evidence‐based answering service for GPs and their patients. The evidence‐based answering service for GPs in this study had an impact on 81% of the GPs and on 52% of their patients. Although for one‐third of the questions no evidence‐based answer was found, this message in itself had an impact on 89% of the GPs. An informationist as mediator between medical information and doctors can save doctors’ time.     

Barron's Online (barrons.com)

ABSTRACT

In this article Jenkins and Beall, librarians at Auburn University, have identified free Web sites for providing answers to business reference questions most frequently asked in academic libraries. The authors determined these questions by polling other business librarians, researching the topic on the Internet and in business literature, and drawing upon their business reference backgrounds. Web sites were selected by searching the Internet extensively, querying other business librarians and business faculty, combing numerous business academic library Web pages, and experience by the authors in answering business reference questions via the Web. The researchers sought answers and noted productive sites for each question. Jenkins and Beall expect this article will help other librarians determine the most useful Internet sites for answering business reference questions. They also hope this research will provide guidelines for librarians in developing solid lists of essential Web sites for business researchers.     

Methods for automatically evaluating answers to complex questions

Evaluation is a major driving force in advancing the state of the art in language technologies. In particular, methods for automatically assessing the quality of machine output is the preferred method for measuring progress, provided that these metrics have been validated against human judgments. Following recent developments in the automatic evaluation of machine translation and document summarization, we present a similar approach, implemented in a measure called POURPRE, an automatic technique for evaluating answers to complex questions based on n-gram co-occurrences between machine output and a human-generated answer key. Until now, the only way to assess the correctness of answers to such questions involves manual determination of whether an information “nugget” appears in a system's response. The lack of automatic methods for scoring system output is an impediment to progress in the field, which we address with this work. Experiments with the TREC 2003, TREC 2004, and TREC 2005 QA tracks indicate that rankings produced by our metric correlate highly with official rankings, and that POURPRE outperforms direct application of existing metrics.

THE RISE OF POSTMATERIALIST VALUES AND CHANGING RELIGIOUS ORIENTATIONS, GENDER ROLES AND SEXUAL NORMS

This article investigates the relationship between Materialistand Postmaterialist values, and attitudes towards religiousand social norms as well as behavioral indicators in industrialsocieties. It focusses on the question whether Postmaterialistvalues—indicated through a greater emphasis on such goalsas self-expression, quality of life and belonging—arerelated to a decline of traditional orientations. The empiricalpart is based on the data of a unique cross-national dataset,the World Values Survey 1981–1982, which compares religiousand moral beliefs of populations of sixteen countries with variouspolitical, cultural and ethnic characteristics. It also takesinto account behavioral indicators related to these norms, e.g.birth and divorce rates in these countries. According to theresults, Post-materialist values are closely related to a declineof traditional values. There also exist strong linkages betweenindividual-level values and the actual behavior of the peoplesin the given societies. But besides their detachment from traditionalreligion, Postmaterialists are significantly more likely thanMaterialists to spend time thinking about the meaning of lifeand, thus, may even have more potential interest in religion.     

FIDJI: using syntax for validating answers in multiple documents

This article presents FIDJI, a question-answering (QA) system for French. FIDJI combines syntactic information with traditional QA techniques such as named entity recognition and term weighting; it does not require any pre-processing other than classical search engine indexing. Among other uses of syntax, we experiment in this system the validation of answers through different documents, as well as specific techniques for answering different types of questions (e.g., yes/no or list questions). We present several experiments which show the benefits of syntactic analysis, as well as multi-document validation. Different types of questions and corpora are tested, and specificities are commented. Links with result aggregation are also discussed.     

How Do I Get a Campus ID? The Other Role of the Academic Library in Student Retention and Success

Academic libraries have long gathered data at the reference desk to facilitate informed development of services and collections, and have long known that regardless of whether questions are related to doing research, the library is a safe place a student may go to find answers. This article highlights the role of the library and information commons service desks as valuable windows into the student experience. The authors suggest that librarians share with campus stakeholders information about students’ non-research-related questions to aid in the development of programs and services designed to help students adjust to campus life and, ultimately, succeed.     

Multicenter randomized comparative trial of Micromedex,Micromedex with Watson,or Google to answer drug information questions

Objective:The purpose of this study was to compare pharmacy students’ ability to correctly answer drug information questions using Micromedex with Watson, Micromedex without Watson, or Google.Methods:This multicenter randomized trial compared pharmacy student responses to drug information questions using Micromedex with Watson, Micromedex without Watson, or Google from January to March of 2020. First- to fourth-year pharmacy students at two institutions were included. The primary outcome was the number of correct answers. Secondary outcomes were the time taken to answer the questions and differences in number of correct answers by pharmacy student year and institution.Results:The analysis included 162 participants: 52 students in the Micromedex group, 51 students in the Watson group, and 59 students in the Google group. There was a significant difference among groups in the total number of questions answered correctly (p=0.02). Post-hoc analysis revealed that participants in the Micromedex group answered more questions correctly than those in the Google group (p=0.015). There were no significant differences between Micromedex and Watson groups (p=0.52) or between Watson and Google groups (p=0.22). There was also no difference in time to complete the questions among groups (p=0.72).Conclusion:Utilizing Google did not save students time and led to more incorrect answers. These findings suggest that health care educators and health sciences librarians should further reinforce training on the appropriate use of drug information resources.     

A question documentation model on the needs of comparative research

A questionnaire, as a basic tool of organization of scientific observation, consists of two schemas: a data schema that corresponds to the specifications and the conceptual determinations of scientific vocabulary and a communicative schema that organizes the communication between the scientists and respondents depending on the particular characteristics of the asked population. The objective of this paper is the design of a documentation model for the questions of a questionnaire that would allow the detection of similar questions throughout a database. Such a model can successfully manage the documentation problems of comparative longitudinal research, whereas the questions of a questionnaire are repeated and changed slightly or go unchanged through the waves. It can also help researchers that are concerned with secondary analysis, for the detection of similar questions of similar or even different studies.     

WAPOR News

DINERMAN AWARD FOR DON A. DILLMAN The 2006 Helen Dinerman Award for outstanding contributionsto survey research methodolgy was given to Professor Don A.Dillman at the WAPOR Annual Conference in Montréal inMay. Professor Dillman’s achievements in the fields aresummarized in the award citation read at the conference. DINERMAN AWARD CITATION Don Dillman’s work spans the entire field of survey research—fromthe mailed questionnaire to the internet surveys of the future—allwith