Developing a generic tool to routinely measure the impact of health libraries

Background

Health libraries contribute to many activities of a health care organisation. Impact assessment needs to capture that range of contributions.

Objectives

To develop and pilot a generic impact questionnaire that: (1) could be used routinely across all English NHS libraries; (2) built on previous impact surveys; and (3) was reliable and robust.

Methods

This collaborative project involved: (1) literature search; (2) analysis of current best practice and baseline survey of use of current tools and requirements; (3) drafting and piloting the questionnaire; and (4) analysis of the results, revision and plans for roll out.

Findings

The framework selected was the International Standard Methods And Procedures For Assessing The Impact Of Libraries (ISO 16439). The baseline survey (n = 136 library managers) showed that existing tools were not used, and impact assessment was variable. The generic questionnaire developed used a Critical Incident Technique. Analysis of the findings (n = 214 health staff and students), plus comparisons with previous impact studies indicated that the questionnaire should capture the impact for all types of health libraries.

Conclusions

The collaborative project successfully piloted a generic impact questionnaire that, subject to further validation, should apply to many types of health library and information services.     

Searching MEDLINE for Aboriginal and Torres Strait Islander health literature: questionable sensitivity

Objective

The extent to which existing and future research can impact on reducing health disparities relates not only to the evidence available, but the ability to find that evidence. Our objective is to quantify experts' literature searching effectiveness with respect to Aboriginal and Torres Strait Islander people's health.

Methods

Nine journals were dual reviewed, and a ‘gold standard’ set of relevant articles was identified. Health librarians (n = 25) completed a standardised searching task using OVID MEDLINE, and results were compared with the gold standard. Sensitivity, specificity and precision rates were calculated.

Results

The gold standard comprised 136 of 1469 (9.3%) records from nine journals. Searches achieved a mean sensitivity of 53.2% (median = 64.7%, range 0.0–93.4%), specificity of 97.4% (median = 99.4%, range 52.6–100%) and precision of 83.3% (median = 91.0%, range 16.7–100%). Self‐estimates of search sensitivity (post hoc) were significantly higher than observed (M = 78.9%, t = 4.812, P < 0.001).

Conclusions

Even expert searchers struggle to find the relevant peer‐reviewed literature in MEDLINE.

Implications

A search filter may improve searching effectiveness for Aboriginal and Torres Strait Islander health literature. Assessment of health librarians' searching competencies warrants further professional debate and consideration.     

Development of a validated search filter for Ovid Embase for degenerative cervical myelopathy

Background

Degenerative cervical myelopathy (DCM) is a recently proposed umbrella term for symptomatic cervical spinal cord compression secondary to degeneration of the spine. Currently literature searching for DCM is challenged by the inconsistent uptake of the term ‘DCM’ with many overlapping keywords and numerous synonyms.

Objectives

Here, we adapt our previous Ovid medline search filter for the Ovid embase database, to support comprehensive literature searching. Both embase and medline are recommended as a minimum for systematic reviews.

Methods

References contained within embase identified in our prior study formed a ‘development gold standard’ reference database (N = 220). The search filter was adapted for embase and checked against the reference database. The filter was then validated against the ‘validation gold standard’.

Results

A direct translation was not possible, as medline indexing for DCM and the keywords search field were not available in embase . We also used the ‘focus’ function to improve precision. The resulting search filter has 100% sensitivity in testing.

Discussion and Conclusion

We have developed a validated search filter capable of retrieving DCM references in embase with high sensitivity. In the absence of consistent terminology and indexing, this will support more efficient and robust evidence synthesis in the field.     

Adopting evidence-based practice in clinical decision making: nurses' perceptions, knowledge, and barriers

Objective:

Evidence-based practice (EBP) provides nurses with a method to use critically appraised and scientifically proven evidence for delivering quality health care to a specific population. The objective of this study was to explore nurses'' awareness of, knowledge of, and attitude toward EBP and factors likely to encourage or create barriers to adoption. In addition, information sources used by nurses and their literature searching skills were also investigated.

Method:

A total of 2,100 copies of the questionnaire were distributed to registered nurses in 2 public hospitals in Singapore, and 1,486 completed forms were returned, resulting in a response rate of 70.8%.

Results:

More than 64% of the nurses expressed a positive attitude toward EBP. However, they pointed out that due to heavy workload, they cannot keep up to date with new evidence. Regarding self-efficacy of EBP-related abilities, the nurses perceived themselves to possess moderate levels of skills. The nurses also felt that EBP training, time availability, and mentoring by nurses with EBP experience would encourage them to implement EBP. The top three barriers to adopting EBP were lack of time, inability to understand statistical terms, and inadequate understanding of the jargon used in research articles. For literature searching, nurses were using basic search features and less than one-quarter of them were familiar with Boolean and proximity operators.

Conclusion:

Although nurses showed a positive attitude toward EBP, certain barriers were hindering their smooth adoption. It is, therefore, desirable that hospital management in Southeast Asia, particularly in Singapore, develop a comprehensive strategy for building EBP competencies through proper training. Moreover, hospital libraries should also play an active role in developing adequate information literacy skills among the nurses.

Highlights

• Nurses in Singapore, as in other countries, support the idea of evidence-based practice (EBP) but have limited skills in the area of literature searching and understanding evidence, which limits their use of evidence-based practice.
• Only a small number of nurses were able to pick an appropriate search strategy for a given topic, indicating a lack of basic literature searching skills.
• Sufficient literature searching knowledge is essential to retrieve current, relevant, and accurate evidence. However, a majority of nurses do not know how to properly use Boolean and proximity operators, indexing, truncation, or limits.

Implications

• Librarians need to be part of providing ongoing training for clinical nurses in searching the evidence, especially in hospitals promoting EBP or seeking Magnet status.
• Training is needed for clinical nurses to be able to achieve the use of EBP, and librarians can support this goal by teaching the search strategies portion of an EBP skills course.
• This study''s instrument could be used by librarians as a needs assessment tool to measure their own clinical nurses'' information literacy skills, if justification is needed locally.

     

Linking research to practice: the rise of evidence-based health sciences librarianship

Purpose:

The lecture explores the origins of evidence-based practice (EBP) in health sciences librarianship beginning with examples from the work of Janet Doe and past Doe lecturers. Additional sources of evidence are used to document the rise of research and EBP as integral components of our professional work.

Methods:

Four sources of evidence are used to examine the rise of EBP: (1) a publication by Doe and research-related content in past Doe lectures, (2) research-related word usage in articles in the Bulletin of the Medical Library Association and Journal of the Medical Library Association between 1961 and 2010, (3) Medical Library Association activities, and (4) EBP as an international movement.

Results:

These sources of evidence confirm the rise of EBP in health sciences librarianship. International initiatives sparked the rise of evidence-based librarianship and continue to characterize the movement. This review shows the emergence of a unique form of EBP that, although inspired by evidence-based medicine (EBM), has developed its own view of evidence and its application in library and information practice.

Implications:

Health sciences librarians have played a key role in initiating, nurturing, and spreading EBP in other branches of our profession. Our close association with EBM set the stage for developing our own EBP. While we relied on EBM as a model for our early efforts, we can observe the continuing evolution of our own unique approach to using, creating, and applying evidence from a variety of sources to improve the quality of health information services.     

Determining where physical therapists get information to support clinical practice decisions

Objective

To determine the information sources utilised by physical therapists (PTs) to support clinical decisions.

Methods

Physical therapists in the United States were invited via professional listservs and electronic newsletters to participate in an online survey.

Results

Journal articles were the most frequently utilised source of information, followed by databases (PubMed was most frequent). The frequency of utilising evidence‐based resources was not significantly affected by the number of years of experience as a physical therapist (PT), working in a state that allows direct access to PT services or doctoral vs masters/bachelors degree.

Conclusions

Compared with a previous study (1994), there has been a transition in physical therapy information seeking, with greater reliance on evidence‐based information.     

Updated generic search filters for finding studies of adverse drug effects in Ovid medline and Embase may retrieve up to 90% of relevant studies

Background

The most current objectively derived search filters for adverse drug effects are 15 years old and other strategies have not been developed and tested empirically.

Objective

To develop and validate search filters to retrieve evidence on adverse drug effects from Ovid medline and Ovid Embase.

Methods

We identified systematic reviews of adverse drug effects in Epistemonikos. From these reviews, we collated their included studies which we then randomly divided into three tests and one validation set of records. We constructed a search strategy to maximise relative recall using word frequency analysis with test set one. This search strategy was then refined using test sets two and three and validated on the final set of records.

Results

Of 107 systematic reviews which met our inclusion criteria, 1948 unique included studies were available from medline and 1980 from Embase. Generic adverse drug effects searches in medline and Embase achieved 90% and 89% relative recall, respectively. When specific adverse effects terms were added recall was improved.

Conclusion

We have derived and validated search filters that retrieve around 90% of records with adverse drug effects data in medline and Embase. The addition of specific adverse effects terms is required to achieve higher recall.     

Analysis of reference sources used in drug-related Wikipedia articles

Objective

References from drug-related Wikipedia articles and a drug information database were compared.

Methods

Drugs in Food and Drug Administration (FDA) MedWatch alerts from January–July 2013 were searched in Wikipedia and Lexicomp to compare reference types and to assess the time for drug safety information to be incorporated into Wikipedia articles.

Results

Wikipedia most commonly cited peer-reviewed journal articles (49.2%) and news articles (12.0%). MedWatch citations were incorporated into Wikipedia on average in 5.9 days.

Conclusions

Wikipedia cited various sources but may not be a reliable, up-to-date resource for drug safety information.     

Selective Attention to Online Political Information

Selective attention is a key concept in communication research despite equivocal supporting evidence. This study focuses on methodological concerns in the study of selective attention. Using unobtrusive measures of selective attention to online political content this study found consistent support for the selective attention hypothesis. Three within-subjects quasi experiments were conducted (n = 29, n = 36, and n = 75) that measured subjects' attention to information consistent with and counter to their beliefs. Two other measures of selective attention were also used: (1) whether subjects turned first to consistent or counter information, and (2) how deeply into the material they read.     

Infectious diseases citation patterns: mapping the literature 2008–2010

Objectives:

The research identified the publication types and ages most frequently cited in the infectious diseases literature and the most commonly cited journals.

Methods:

From 2008–2010, 5,056 articles in 5 infectious diseases journals cited 166,650 items. Two random samples were drawn: one (n = 1,060) from the total set of citations and one (n = 1,060) from the citations to journal articles. For each sample citation, publication type and date, age of cited item, and inclusion of uniform resource locator (URL) were collected. For each item in the cited journal articles sample, journal title, publication date, and age of the cited article were collected. Bradford zones were used for further analysis.

Results:

Journal articles (91%, n = 963) made up the bulk of cited items, followed by miscellaneous items (4.6%, n = 49). Dates of publication for cited items ranged from 1933–2010 (mean = 2001, mode = 2007). Over half (50.2%, n = 483) of cited journal articles were published within the previous 5 years. The journal article citations included 358 unique journal titles.

Discussion:

The citations to current and older publications in a range of disciplines, heavy citation of journals, and citation of miscellaneous and government documents revealed the depth and breadth of resources needed for the study of infectious diseases.

Highlights

• Literature on infectious diseases is multidisciplinary, encompassing medical specialties, public health, and the medical sciences.
• Infectious disease publications cite journal articles more than 90% of the time. Cited journal articles greatly range in age at citation: more than a quarter were over 10 years old.
• Infectious disease citation patterns resemble clinical medicine citation patterns more than public health citation patterns.

Implications

• Infectious disease professionals need access to general medicine titles as well as infectious disease, immunology, virology, microbiology, and public health literature.
• Librarians serving infectious disease researchers and practitioners should provide access to older materials, especially journal back files, to support the cyclical needs of their patrons.

     

Localising and tailoring research evidence helps public health decision making

Background

Published research evidence is typically not readily applicable to practice but needs to be actively mobilised.

Objectives

This paper explores the mechanisms used by information professionals with a specific knowledge mobilisation role to make evidence useful for local decision making and planning of public health interventions.

Methods

Data are drawn from a NIHR project that studied how, when, where and by whom published research evidence is used in commissioning and planning across two sites (one in England and one in Scotland). Data included 11 in‐depth interviews with information professionals, observations at meetings and documentary analysis.

Results

Published research evidence is made fit for local commissioning and planning purposes by information professionals through two mechanisms. They localise evidence (relate evidence to local context and needs) and tailor it (present actionable messages).

Discussion

Knowledge mobilisation roles of information professionals are not recognised and researched. Information professionals contribute to the ‘inform’ and ‘relational’ functions of knowledge mobilisation; however, they are less involved in improving the institutional environment for sustainable knowledge sharing.

Conclusion

Information professionals are instrumental in shaping what evidence enters local decision making processes. Identifying and supporting knowledge mobilisation roles within health libraries should be the focus of future research and training.

     

Making the Critical Appraisal for Summaries of Evidence (CASE) for evidence-based medicine (EBM): critical appraisal of summaries of evidence

Objectives:

Standards for evaluating evidence-based medicine (EBM) point-of-care (POC) summaries of research are lacking. The authors developed a “Critical Appraisal for Summaries of Evidence” (CASE) worksheet to help assess the evidence in these tools. The authors then evaluated the reliability of the worksheet.

Methods:

The CASE worksheet was developed with 10 questions covering specificity, authorship, reviewers, methods, grading, clarity, citations, currency, bias, and relevancy. Two reviewers independently assessed a random selection of 384 EBM POC summaries using the worksheet. The responses of the raters were then compared using a kappa score.

Results:

The kappa statistic demonstrated an overall moderate agreement (κ = 0.44) between the reviewers using the CASE worksheet for the 384 summaries. The 3 categories of evaluation questions in which the reviewers disagreed most often were citations (κ =  0), bias (κ = 0.11), and currency (κ = −0.18).

Conclusions:

The CASE worksheet provided an effective checklist for critically analyzing a treatment summary. While the reviewers agreed on worksheet responses for most questions, variation occurred in how the raters navigated the tool and interpreted some of the questions. Further validation of the form by other groups of users should be investigated.

Highlights

• Few critical appraisal tools have been evaluated with inter-rater reliability testing.
• The ways that users of evidence-based medicine (EBM) point-of-care (POC) tools interpret how to appraise an evidence summary—particularly when defining the grading of evidence, currency, and bias—may vary even when a standard evaluation sheet is used.
• The Critical Appraisal for Summaries of Evidence (CASE) worksheet had a moderate level of inter-rater reliability, similar to previous evaluative studies of critical appraisals tools.

Implications

• Medical librarians can develop tools useful for librarians, students, and clinicians to guide them in appraising clinical evidence summaries.
• The CASE worksheet can be a valuable tool to consider the quality of individual evidence summaries and to see patterns of overall quality in EBM POC tools.

     

The effectiveness of the practice of correction and republication in the biomedical literature

Objective:

This research measures the effectiveness of the practice of correction and republication of invalidated articles in the biomedical literature by analyzing the rate of citation of the flawed and corrected versions of scholarly articles over time. If the practice of correction and republication is effective, then the incidence of citation of flawed versions should diminish over time and increased incidence of citation of the republication should be observed.

Methods:

This is a bibliometric study using citation analysis and statistical analysis of pairs of flawed and corrected articles in MEDLINE and Web of Science.

Results:

The difference between citation levels of flawed originals and corrected republications does not approach statistical significance until eight to twelve years post-republication. Results showed substantial variability among bibliographic sources in their provision of authoritative bibliographic information.

Conclusions:

Correction and republication is a marginally effective biblioremediative practice. The data suggest that inappropriate citation behavior may be partly attributable to author ignorance.

Highlights

• The citation of flawed articles occurs at a rate nearly equal to that of corrected versions.
• The practice of correction and republication is only marginally effective and does not prevent the continued citation of flawed articles post-correction, with the analysis finding only a slight reduction in the citation of flawed articles after publication of the corrected version.
• Neither MEDLINE nor Web of Science consistently alert users when dealing with corrected and republished literature.

Implications

• The practice of correction and republication would be more effective if prominent sources of bibliographic information were more consistent in providing users with information about the status of corrected and republished articles and the existence of post-publication modifications to the literature.
• It is incumbent upon the scientific community to raise the profile of post-publication changes to the literature to prevent the wasteful and potentially tragic consequences of scientists and medical professionals applying flawed information. Failure to do so will surely result in a reduction of public trust in the reliability of the scientific literature and its users.

     

Weather-Talk,Cynicism, and Agriculture

For the agriculturist, weather-talk performs two significant rhetorical acts that display cynicism toward nature: first, a faith in technology; and second, a conviction in the cultural myths associated with stewardship toward nature. This study explores these two themes by discussing the results of ethnographic interviews conducted with farmers. Whereas Aldo Leopold (1949 Leopold , A. ( 1949 ). A sand county almanac . London : Oxford University Press . [Google Scholar]) articulated a need for a moral relationship with nature, this study illustrates that contemporary weather-talk amends stewardship with rhetorical cynicism. The stewardship ethic embodied by agriculture is transcended into a cynicism whereby nature is distrusted and elusive.     

Emerging roles for biomedical librarians: a survey of current practice,challenges, and changes

Objective:

This study is intended to (1) identify emerging roles for biomedical librarians and determine how common these roles are in a variety of library settings, (2) identify barriers to taking on new roles, and (3) determine how librarians are developing the capacity to take on new roles.

Methods:

A survey was conducted of librarians in biomedical settings.

Results:

Most biomedical librarians are taking on new roles. The most common roles selected by survey respondents include analysis and enhancement of user experiences, support for social media, support for systematic reviews, clinical informationist, help for faculty or staff with authorship issues, and implementation of researcher profiling and collaboration tools. Respondents in academic settings are more likely to report new roles than hospital librarians are, but some new roles are common in both settings. Respondents use a variety of methods to free up time for new roles, but predominant methods vary between directors and librarians and between academic and hospital respondents. Lack of time is the biggest barrier that librarians face when trying to adopt new roles. New roles are associated with increased collaboration with individuals and/or groups outside the library.

Conclusion and Implications:

This survey documents the widespread incorporation of new roles in biomedical libraries in the United States, as well as the barriers to adopting these roles and the means by which librarians are making time for them. The results of the survey can be used to inform strategic planning, succession planning, library education, and career development for biomedical librarians.     

Scite

Scite. Scite Inc., 334 Leonard St., Brooklyn, NY 11211; https://scite.ai/; tiered pricing model with free, basic ($7.99/month), premium ($19.99/month or $100/year), premium+ ($59.99/month), and enterprise plans.

Scite (https://scite.ai/) was founded by Josh Nicholson and Yuri Lazebnik and previously funded by the National Science Foundation (NSF) and National Institute on Drug Abuse (NIDA) [1, 2, 3]. The Scite database contains over 800 million citation statements [4] tagged by a machine learning algorithm as supporting, mentioning, or contrasting the findings of cited articles [5] and by their locations in the citing articles (introduction, results, methods, discussion, or other). Scite also provides a count of editorial notices for each article. Users can search the website and install plug-ins for browsers Chrome and Firefox and reference management tools such as Zotero. Additional tools include reports and dashboards, badges, and automated reference checks. Scite can be used by researchers to locate evidence and evaluate references; librarians to enhance research impact projects; publishers and editors to check reference lists of submissions [6, 7]; and journals, publishers, and databases to create context and showcase impact [4, 8, 9].     

A case study: planning a statewide information resource for health professionals: an evidence-based approach

Question:

What is the best approach for implementing a statewide electronic health library (eHL) to serve all health professionals in Minnesota?

Setting:

The research took place at the University of Minnesota Health Sciences Libraries.

Methods:

In January 2008, the authors began planning a statewide eHL for health professionals following the five-step process for evidence-based librarianship: formulating the question, finding the best evidence, appraising the evidence, assessing costs and benefits, and evaluating the effectiveness of resulting actions.

Main Results:

The authors identified best practices for developing a statewide eHL for health professionals relating to audience or population served, information resources, technology and access, funding model, and implementation and sustainability. They were compared to the mission of the eHL project to drive strategic directions by developing recommendations.

Conclusion:

EBL can guide the planning process for a statewide eHL, but findings must be tailored to the local environment to address information needs and ensure long-term sustainability.     

Case study: the Health SmartLibrary experiences in web personalization and customization at the Galter Health Sciences Library,Northwestern University

Question:

How can the user''s access to health information, especially full-text articles, be improved? The solution is building and evaluating the Health SmartLibrary (HSL).

Setting:

The setting is the Galter Health Sciences Library, Feinberg School of Medicine, Northwestern University.

Method:

The HSL was built on web-based personalization and customization tools: My E-Resources, Stay Current, Quick Search, and File Cabinet. Personalization and customization data were tracked to show user activity with these value-added, online services.

Main Results:

Registration data indicated that users were receptive to personalized resource selection and that the automated application of specialty-based, personalized HSLs was more frequently adopted than manual customization by users. Those who did customize customized My E-Resources and Stay Current more often than Quick Search and File Cabinet. Most of those who customized did so only once.

Conclusion:

Users did not always take advantage of the services designed to aid their library research experiences. When personalization is available at registration, users readily accepted it. Customization tools were used less frequently; however, more research is needed to determine why this was the case.