Is That Even Checkable? An Experimental Study in Identifying Checkable Statements in Political Discourse

The first step in journalistic fact-checking of political discourse is identifying whether statements contain “checkable facts” (i.e., not opinions). This randomized controlled experiment investigated how different demographic factors (age, gender, education, profession, and political affiliation) are associated with the ability to discern if statements contained checkable or noncheckable facts, as well as what impact training in identifying checkable facts can have on overall outcomes. A total of 3,357 participants identified checkable and noncheckable statements from a fictional political speech extract containing eight statements. Overall, participants were able to correctly identify an average of 69% of statements. Specific demographic factors (being male, young, and university educated) were positively associated with increased performance as well as working in professions that commonly analyze data, such as research. Participating in a short training session significantly increased participants’ performance. Initial political affiliation slightly reduces the ability to assess whether statements made by named politicians contained checkable facts.     

Information-seeking behavior of basic science researchers: implications for library services

Objectives:

This study examined the information-seeking behaviors of basic science researchers to inform the development of customized library services.

Methods:

A qualitative study using semi-structured interviews was conducted on a sample of basic science researchers employed at a university medical school.

Results:

The basic science researchers used a variety of information resources ranging from popular Internet search engines to highly technical databases. They generally relied on basic keyword searching, using the simplest interface of a database or search engine. They were highly collegial, interacting primarily with coworkers in their laboratories and colleagues employed at other institutions. They made little use of traditional library services and instead performed many traditional library functions internally.

Conclusions:

Although the basic science researchers expressed a positive attitude toward the library, they did not view its resources or services as integral to their work. To maximize their use by researchers, library resources must be accessible via departmental websites. Use of library services may be increased by cultivating relationships with key departmental administrative personnel. Despite their self-sufficiency, subjects expressed a desire for centralized information about ongoing research on campus and shared resources, suggesting a role for the library in creating and managing an institutional repository.

Highlights

• Basic science researchers rely on a small network of individuals in their institution and at other institutions to satisfy their information needs.
• Basic science researchers tend to ignore institutional boundaries when searching for information and do not necessarily view the library as the primary source of scholarly information.
• Basic science researchers use the interlibrary loan service regularly but otherwise rarely use traditional library services such as mediated literature searching and instruction.

Implications

• The library must establish a presence in researchers'' work environments, rather than expect them to seek out library resources and services.
• The increased emphasis by funding agencies on clinical translational science may impact the information needs of basic science researchers in the future.
• Libraries have an opportunity to capitalize on their positive reputation and basic scientists'' desire for more centralized information to create new information resources and services such as institutional repositories.

     

Jo Handelsman

Note from the Editor

Educator Highlights for CBE-LSE show how professors at different kinds of institutions educate students in life sciences with inspiration and panache. If you have a particularly creative teaching portfolio yourself, or if you wish to nominate an inspiring colleague to be profiled, please e-mail Laura Hoopes at lhoopes@pomona.edu.LH: You are deeply involved with the HHMI Teaching Fellows Program at Wisconsin and the Wisconsin Program for Scientific Teaching (Pfund et al., 2009 ), and you''ve coauthored a book about scientific teaching (Handelsman et al., 2006 ). How do you teach people to teach in your summer institutes?Handelsman: The HHMI Graduate Teaching Fellows Program teaches graduate students and postdoctoral fellows to apply theories of learning to classroom practice. The fellows set learning goals and assess whether they''re achieved. It''s theory, then practice.LH: Can you explain a little more about how it works?Handelsman: The program starts with eight weeks of a course, “Teaching Biology” in which the fellows learn about education principles and then practice on each other applying those principles. Then they go on to design their own materials, and finally, in the second semester, use that material in teaching students. In our qualitative and quantitative analysis of their teaching philosophy, we see little change after the first semester. But there is radical improvement after they put their ideas into practice in the second part. People learn by doing.LH: How about a specific example of how the fellows develop materials.Handelsman: There''s a choice of venues, but let''s say one picks the honors biology course. They identify a technical problem, such as explaining Southern, Northern, and Western blotting. Our fellows then develop active-learning materials to address a challenging concept and test them in the classroom, often in multiple sections of a class. They refine and retest them. Another fellow might choose “Microbes Rule,” a course developed by fellows, which teaches about bacteria, viruses, and fungi. That fellow develops learning goals about antibiotic resistance, flu, or contaminated peanut butter, and designs classroom materials to achieve these goals.Open in a separate windowJo Handelsman, HHMI Professor, Department of Bacteriology, University of Wisconsin–Madison, Madison, WI.LH: Do the teaching fellows find the work difficult?Handelsman: It''s a challenge for them to narrow down to a workable subtopic. We work with them to focus on the learning goals, asking “The students will know and be able to do what at the end of this unit?”LH: Did you learn this method of focusing on goals when you were being trained?Handelsman: No, most of us were never taught to consider goals for learning. So in training our fellows, we direct them to focus on that over and over, and ask how their plans relate to the goals. It''s backward design—think about what you want to achieve, then think about how to get there.LH: Assessment is becoming more important at universities and colleges all over the country. How do you teach the fellows to use it?Handelsman: Students design their own instruments. They develop skills to determine whether their goals are being met. We go over the tools with them repeatedly, identify potential downfalls, let them implement, and then review the results to see if they obtained the information needed to determine whether their teaching worked.LH: What kind of questions do they tend to use for assessment?Handelsman: Exam-type questions are important, whether taken as an examination or in a questionnaire. Videos of student presentations with reviewers who score on effectiveness are also useful. We ask how the fellows know if the students understood the material, and how the evidence relates to each of their learning goals.LH: How do they evaluate and incorporate input from past assessment?Handelsman: Before using an instrument for assessment, the fellows develop a rubric to score the quality of the answers. Often they decide to share this rubric with the students. They want to show the students what goal the assessment is addressing, what is an adequate answer, what is an outstanding answer. Then they discuss with their peers how to use this feedback to improve their teaching.LH: I''ve heard faculty members at other places saying that they do lots of assessment but don''t know what to do with it after they are forced to collect the information.Handelsman: I''d suggest that they do less and use it more! Not using assessment results is like designing a new experiment but ignoring your earlier results. If we have the information to improve our teaching, we should use it.LH: A lot of interviews for faculty positions ask for a teaching philosophy. It sounds like your fellows are well-positioned to answer these questions.Handelsman: Yes, they have to write their teaching philosophy several times, discuss it with the other fellows, and rewrite. The fellows have been very successful in obtaining positions.LH: Have you had undergraduate research students?Handelsman: Yes, it''s one of the most important academic activities in which students take part—anything hands-on is good, but undergraduate research is the best because it incorporates inquiry, discovery, real scientific processes. It plays into curiosity. It''s such a rewarding process to watch a student in the research lab! It''s a powerful thing to see them learn and grow into scientists over the course of a semester or two.LH: What motivated you to take on undergraduate research students at the start?Handelsman: I started undergraduate research myself in my first year of college—I walked into a lab and asked to do experiments. The difference between doing research and reading about it is so dramatic. I''ve always assumed that part of the structure of an academic lab is undergraduate involvement. Interestingly, I sometimes give the undergraduates riskier projects than the graduate students, who have more to lose if their projects fail.LH: Thanks for sharing your insights into teaching with CBE-LSE.     

Ron Hoy

Note from the Editor     

Learning to lead: Self‐ and peer evaluation of team leaders in the human structure didactic block

Increasing emphasis on leadership in medical education has created a need for developing accurate evaluations of team leaders. Our study aimed to compare the accuracy of self‐ and peer evaluation of student leaders in the first‐year Human Structure block (integrated gross anatomy, embryology, and radiology). Forty‐nine first‐year medical students at Mayo Medical School were assigned to learning teams of three or four members. Teams worked together on daily laboratory dissection, clinical projects, embryology presentations, and daily group quizzes. Student team leaders were responsible for leading laboratory dissection, reviewing radiographic findings, and organizing group assignments. Weekly electronic surveys were administered to evaluate team leaders on altruism, compassion, respect, integrity, responsibility, commitment to excellence, and self‐reflection. Results demonstrated that team leaders rated themselves lower than their peers rated them in multiple aspects of leadership. Peer evaluation of team leaders was statistically higher than self‐evaluation in all traits measured except respect. Female leaders were rated higher by their peers in the areas of responsibility and self‐reflection compared to male leaders. This study demonstrates the need for increased communication between team leaders and members, along with creation of a mutually respectful environment, to improve leader awareness of their abilities and foster team success. Anat Sci Educ 2:210–217, 2009. © 2009 American Association of Anatomists.     

Trends in Female Authorships, Editorial Board Memberships, and Editorships in Educational Psychology Journals from 2003 to 2008

Robinson, McKay, Katayama, and Fan (Contemporary Educational Psychology, 23, 331–343, 1998) reported that women were underrepresented in terms of authorships, editorial board memberships, and editorships in the field of educational psychology based on membership trends. More recently, Evans, Hsieh, and Robinson (Educational Psychology Review, 17, 263–271, 2005) reported that women had made gains as editors but had not kept pace with organizational membership in terms of authorships and editorial board memberships. Our goal in this paper was to further examine women’s participation in educational psychology journals by extending the datasets of Robinson et al. and Evans et al. The number of female authors per article, particularly those from non-US institutions, has continued to increase. However, consistent with Evans et al., although females are continuing to make numerical gains in both authorships—both primary and secondary—and editorial board memberships, their involvement has not kept pace in relation to membership trends.     

Evaluating the impact of an environmental education programme: an empirical study in Mexico

This study draws on information from 11 in‐depth interviews, two focus groups and 72 written questionnaires to evaluate an extra‐curricular environmental education programme on forestry designed for preparatory school students from a small rural community in Mexico. Specifically, the study assessed the impact of the programme on the ecological knowledge of 72 students. Qualitative feedback suggests that students learnt about forestry, acquired greater awareness of the importance of conservation for the local environment and enjoyed the participatory teaching methods used in the programme. Quantitative results show a positive and significant association between the number of times a student participated in the programme and the student’s ecological knowledge. Students who participated in the programme once had a 16.3% higher knowledge on ecological concepts and knew, on average, 1.5 more local forest plants than students who never attended it (p<.001). Findings suggest that the inclusion of participatory environmental education programmes in preparatory schools would improve the acquisition of ecological knowledge. Further research could consider the consistency of the findings by replicating participatory methods presented here and by using an experimental research design.     

Effectiveness of psychological intervention following sport injury

With increasing attention given to the development and implementation of psychological interventions during the sport injury rehabilitation process, there is a need to document the effectiveness of these interventions. The purpose of this review was to summarize the empirical findings of the effects of psychological interventions in reducing post-injury psychological consequences and improving psychological coping during the injury rehabilitation process among competitive and recreational athletes. In February 2012, utilizing a comprehensive search strategy, we conducted electronic searches of multiple electronic databases for randomized and nonrandomized control trials that evaluated interventions targeting populations of injured competitive and recreational athletes age 17 years and older. We included interventions that directly intervene on injured athletes' psychological outcomes (e.g., psychological consequences, psychological coping and re-injury anxiety) and utilized psychological strategies including imagery, goal-setting, relaxation, and other common techniques during the post-injury rehabilitation period. Six studies, described in seven peer-reviewed published articles, met study inclusion criteria and were included in this review. Of those studies, two included randomized control trials, two used before and after study designs and two were case study designs. Two interventions utilized guided imagery and relaxation, two interventions utilized goal-setting and one each utilized microcounseling, written disclosure, and acceptance and commitment therapy. Guided imagery/relaxation was shown to be associated with improved psychological coping and reduced re-injury anxiety. Goal setting, however, was not directly associated with the reduction of negative psychological consequences. Other psychological techniques such as microcounseling skills, acceptance and commitment therapy, and written disclosure have demonstrated effectiveness in reducing negative psychological consequences, improving psychological coping, and reducing re-injury anxiety. Our findings suggest a significant need to develop and implement well-designed intervention studies that target improvement of post-injury psychological outcomes in order to assist injured athletes successfully recovery from sport injury.