Researching learning outcomes: building confidence in our conclusions

The ESRC Teaching and Learning Research Programme is expected to produce knowledge of high social scientific quality and practical pedagogic value. It faces, in a particularly acute form, the issue of how confidence in its conclusions can be built. This article begins with some conceptual clarification of the notion of a ‘warrant’ for research findings and distinguishes between warrants in social research and warrants for educational policy and practice. It then, in the specific context of research on learning outcomes, proposes an integrated model that recognizes the importance of, and relationships among, criteria associated with research design and empirical work, theoretical coherence, relationship with other research, and user affirmation. It concludes by emphasizing the need for continuing debate about, and development of, the roles and relationships of ‘researchers’ and ‘users’.     

UpToDate versus DynaMed: a cross-sectional study comparing the speed and accuracy of two point-of-care information tools

Objective:To compare the accuracy, time to answer, user confidence, and user satisfaction between UpToDate and DynaMed (formerly DynaMed Plus), which are two popular point-of-care information tools.Methods:A crossover study was conducted with medical residents in obstetrics and gynecology and family medicine at the University of Toronto in order to compare the speed and accuracy with which they retrieved answers to clinical questions using UpToDate and DynaMed. Experiments took place between February 2017 and December 2019. Following a short tutorial on how to use each tool and completion of a background survey, participants attempted to find answers to two clinical questions in each tool. Time to answer each question, the chosen answer, confidence score, and satisfaction score were recorded for each clinical question.Results:A total of 57 residents took part in the experiment, including 32 from family medicine and 25 from obstetrics and gynecology. Accuracy in clinical answers was equal between UpToDate (average 1.35 out of 2) and DynaMed (average 1.36 out of 2). However, time to answer was 2.5 minutes faster in UpToDate compared to DynaMed. Participants were also more confident and satisfied with their answers in UpToDate compared to DynaMed.Conclusions:Despite a preference for UpToDate and a higher confidence in responses, the accuracy of clinical answers in UpToDate was equal to those in DynaMed. Previous exposure to UpToDate likely played a major role in participants'' preferences. More research in this area is recommended.     

Instance-based cognitive mapping: a process for discovering a knowledge worker's tacit mental model

This paper addresses tacit-to-explicit knowledge externalization, arguably the most critical, and yet problematic, phase of Nonaka's knowledge creation theory. Specifically, we propose and describe instance-based cognitive mapping (ICM), a unique externalization process that analyzes multiple decision instances using the inductive learning algorithms of artificial intelligence to generate a polynomial representation of the knowledge worker's mental model, explicitly relating how the knowledge worker implicitly selects and weighs key factors in making decisions within a specific problem domain. After reviewing current externalization techniques, we describe the characteristics, and evaluate the advantages, of the ICM process. An exploratory test of the process suggests that inductive learning algorithms, such as the group method of data handling, can be used to discover a reasonable polynomial estimate of a knowledge worker's tacit mental model. This estimate can then be compared with other explicit models and standards, updated with new information and knowledge, and internalized by all interested knowledge workers.     

Academic users’ interactions with ScienceDirect in search tasks: Affective and cognitive behaviors

This article presents part of phase 2 of a research project funded by the NSF-National Science Digital Library Project, which observed how academic users interact with the ScienceDirect information retrieval system for simulated class-related assignments. The ultimate goal of the project is twofold: (1) to find ways to improve science and engineering students’ use of science e-journal systems; (2) to develop methods to measure user interaction behaviors. Process-tracing technique recorded participants’ processes and interaction behaviors that are measurable; think-aloud protocol captured participants’ affective and cognitive verbalizations; pre- and post-search questionnaires solicited demographic information, prior experience with the system, and comments. We explored possible relationships between affective feelings and cognitive behaviors. During search interactions both feelings and thoughts occurred frequently. Positive feelings were more common and were associated more often with thoughts about results. Negative feelings were associated more often with thoughts related to the system, search strategy, and task. Learning styles are also examined as a factor influencing behavior. Engineering graduate students with an assimilating learning style searched longer and paused less than those with a converging learning style. Further exploration of learning styles is suggested.     

By 4.5 Months,Linguistic Experience Already Affects Infants’ Talker Processing Abilities

Contemporary models of adult speech perception acknowledge that the processing of linguistic and nonlinguistic aspects of the speech signal are interdependent. But when in development does this interdependence first emerge? In the adult literature, one way to demonstrate this relationship has been to examine how language experience affects talker identification. Thus, in this study, 4- to 5-month-old infants (N = 96) were tested on their ability to tell apart talkers in a familiar language (English) compared to unfamiliar languages (Polish or Spanish). Infants readily distinguished between talkers in the familiar language but not in the unfamiliar languages, supporting the hypothesis that the integrated processing of linguistic and nonlinguistic information in speech is early emerging and robust.     

UX and Your Library: A Scalable Model

User experience is immeasurably important for your patrons as they access your Web site. This article presents tips and strategies for testing user experience, suggests a number of different popular technologies and tools that are used in the UX field, and lays out a plan for sharing and utilizing data to make improvements on your Web site. It is the goal of this article to present a model for improving Web site usability that can be scaled up or down depending on the resources available at your institution.     

Developing the Librarians' Role in Supporting Grant Applications and Reducing Waste in Research: Outcomes From a Literature Review and Survey in the NIHR Research Design Service

ABSTRACT

Librarians and information specialists' involvement during the development of grant applications for external funding can save researchers' time, provide specialist support, and contribute to reducing avoidable waste in research. This article presents a survey of information specialists working for the National Institute for Health Research's Research Design Service within English applied health services research and a scoping review to identify other examples of librarians supporting grant applications. The survey found that support included: verifying proposed research has not already been performed; searching literature to provide background for the project; and advising on or writing systematic review methods. The scoping review found three examples where librarians were involved: in writing sections of the application; conducting reviews, and becoming a co-applicant. We recommend librarians engage with researchers by checking whether search requests are to support an application and by becoming familiar with resources and techniques to support grant proposal development.     

The cultural politics of religious defiance in Islam: how pseudonyms and media can destigmatize

Religious defiance that results in publicly leaving religion (apostasy) is an enormous taboo in Arab communities despite the recent surge in apostates’ numbers. Drawing from research on stigma, apostasy, authorship, and critical studies, I explore how a transnational Arab community, which emerges in the crossfire among democratizing politics of self-expression, regulation of public identity by digital technologies, and vast opposition networks, uses digital technologies and the politics of naming to destigmatize its identity. Extending the literatures of stigma and apostasy to ex-Muslims, I conclude that this case reveals religious and nonreligious Arabs’ common struggle against violence and the need for structural changes to protect digital technologies’ emancipatory potential.