MELVYL MEDLINE: a library services perspective

The MELVYL MEDLINE project resulted in the addition of a full five-year subset of MEDLINE to the University of California's (UC) MELVYL online union catalog. As one of the nation's largest MEDLINE end-user searching systems, MELVYL MEDLINE provides online bibliographic access to the biomedical journal literature for all UC personnel at over seventy library sites or by remote access. This paper summarizes the project's accomplishments, reports MELVYL MEDLINE use and its impact on library services, and provides insights for other end-user search systems. The project serves as a model for adding databases to the MELVYL catalog and demonstrates the potential for use by other disciplines of a specialized database when readily accessible. Evaluation results report high user satisfaction and high usage. However, many advanced searching features of the interface are little used by searchers. Effects on library services include marked increases in reference transactions and interlibrary loans, with significant declines in mediated search services. Future MELVYL MEDLINE enhancements include matching search retrievals to journal locations, linkage to an online document delivery system, and consideration of building a superset of databases by combining MELVYL MEDLINE with citations from another database in the MELVYL catalog.     

MEDLINE光盘检索软件性能及用户界面比较研究

本文以作者几年来应用MEDLINE CD－ROM进行检索服务的经验为基础，运用软件性能分析方法，对银盘、剑桥、EBSCCO、DIALOG四种主要MEDLINE光盘产品的检索软件及其用户界面进行了详细地剖析，总结了其优缺点，最后，对未来MEDLINE光盘产品的用户界面作出了一些预测。     

An evaluation of four end-user systems for searching MEDLINE

This study compared features and determined which of four end-user systems (PaperChase, GRATEFUL MED, Med-Base, or Compact Cambridge: MEDLINE) would best serve the Medical Sciences and Optometry Libraries of Indiana University in providing biomedical information to faculty and graduate students through MEDLINE. Cost, ease of use, retrieval, training needs, equipment requirements, and adequacy of documentation were examined. The study consisted of a comparison of the features of each system based on available documentation; a controlled search performed by the investigators on each system and on regular NLM MEDLINE; and a user study based on observations, questionnaires, and interviews with eleven library patrons who performed the same search of their choice on each of the four systems.     

An evaluation of four end-user systems for searching MEDLINE

This study compared features and determined which of four end-user systems (PaperChase, GRATEFUL MED, Med-Base, or Compact Cambridge: MEDLINE) would best serve the Medical Sciences and Optometry Libraries of Indiana University in providing biomedical information to faculty and graduate students through MEDLINE. Cost, ease of use, retrieval, training needs, equipment requirements, and adequacy of documentation were examined. The study consisted of a comparison of the features of each system based on available documentation; a controlled search performed by the investigators on each system and on regular NLM MEDLINE; and a user study based on observations, questionnaires, and interviews with eleven library patrons who performed the same search of their choice on each of the four systems.     

The effect of CD-ROM MEDLINE on online end user and mediated searching.

Since 1970, Indiana University School of Medicine Library (IUSML) has traditionally been a high volume online searching institution. The library recently implemented an end user searching program which includes MEDLINE on CD-ROM. The effect of CD-ROM on online end user and mediated searching is discussed. Comparative statistics are provided by category of search service. CD-ROM has had a dramatic lowering effect on online end user searching and has had little effect on mediated searching. IUSML's experience with CD-ROM technology has been a positive one. Trained end users have become IUSML's greatest asset.     

MEDLINE and MeSH: challenges for end users

Through casual observations, formal consultations, and educational sessions, the authors have identified various indexing features of the National Library of Medicine's Medical Subject Headings (MeSH) that pose challenges to end users while attempting to obtain relevant retrieval when searching MEDLINE. These problematic features include the use of Explodes, Tree structures, subheadings, Text Word vs. subject heading searching, and central concept searching. End-user search software is becoming more sophisticated with an increasing number of choices offered for search strategy formulation. Methods of instruction to orient the end user to these systems will also have to become more detailed. A review of the literature, that discusses end-user problems with using MEDLINE and MeSH, is included.     

BRS Colleague MEDLINE end user training follow-up survey.

The amount of recent literature describing end user training programs is substantial, yet there are few reports evaluating the effectiveness of such training. This article reports on a follow-up survey of the first seventy-five trainees of a four-hour BRS Colleague MEDLINE training program at the Health Sciences Library of East Carolina University. The 90.7 percent response rate to the questionnaire provided information about both those who performed searches and those who had not. It indicated how trainees felt about their training, their ability to perform searches or reason for not performing searches, and types of additional training the trainees desired. Survey results are discussed in terms of effectiveness of the training for the end user with infrequent search needs, possible modifications to improve the effectiveness of the training, and possible alternatives to BRS Colleague MEDLINE.     

BRS Colleague MEDLINE End User Training Follow-up Survey

The amount of recent literature describing end user training programs is substantial, yet there are few reports evaluating the effectiveness of such training. This article reports on a follow-up survey of the first seventy-five trainees of a four-hour BRS Colleague MEDLINE training program at the Health Sciences Library of East Carolina University. The 90.7 percent response rate to the questionnaire provided information about both those who performed searches and those who had not. It indicated how trainees felt about their training, their ability to perform searches or reason for not performing searches, and types of additional training the trainees desired. Survey results are discussed in terms of effectiveness of the training for the end user with infrequent search needs, possible modifications to improve the effectiveness of the training, and possible alternatives to BRS Colleague MEDLINE.     

A pilot survey of user satisfaction with the online search service in South West Thames Regional libraries

相似文献   

Testing the new technology: MEDLINE on CD-ROM in an academic health sciences library.

The UCLA Biomedical Library tested a six-month portion of the MEDLINE database on compact disc to determine its potential application in a large, university health sciences library environment. Patron response to the system, previous search experience, and actual search strategies were recorded. Although the overwhelming user response was positive in spite of little previous experience with online searching, results show underutilization of the system because of both software and hardware problems. The implications of this test underline the important role libraries must take in guaranteeing that new reference tools like CD-ROM be made genuinely user-friendly.     

Online access to MEDLINE in clinical settings: impact of user fees

The effect of introducing user fees on the frequency and quality of MEDLINE searching with GRATEFUL MED by physicians in clinical settings was tested. After training and free use (prior study), consenting participants were randomly allocated to pay searching costs (pay group) or continue without fees (no pay group). Fifty-nine physicians participated. Among the prior study's frequent searchers, the pay group searched at less than one third of the rate of those assigned to no pay. For less frequent searchers in the prior study, only 48% of those assigned to pay did any searches, compared with 85% for the no pay group (P = 0.006), and for those who did search, their frequency was almost half. However, there was no significant difference in the quality of searches; both groups demonstrated about equivalent recall (P = 0.77), but significantly lower precision (P = 0.03) than for the librarian's independent searches. Similarly, there was no difference in the proportion of searches affecting clinical decisions for the two groups. Thus, imposing user charges for online searching in clinical settings after a period of free use adversely affects searching quantity, but not quality. MEDLINE providers should consider whether user fees will undermine its benefits.     

MEDLINE evaluation study

MEDLINE (MEDLARS-ON-LINE) is the new on-line, interactive bibliographic searching system which was recently developed by the National Library of Medicine. The system provides users with lists of bibliographical citations and other information from a three-year file of over 1,250 biomedical journals. A survey testing user reactions was conducted at the University of Virginia Medical Library. The results of the survey are based on replies by 246 users who requested one or more MEDLINE searches between September 1972 and March 1973. The findings indicate that over 93% believe that MEDLINE is a substantial improvement over the traditional methods of searching through the printed indexes. These respondents also stated that the results of MEDLINE searches had assisted them in their clinical or research work, or both. Asked whether they would continue to use MEDLINE after the imposition of user charges on July 1, 1973, about 75% said that they would. The remaining 25% expressed some reservations and doubts. The survey gives reason to believe that with the imposition of user charges the use of MEDLINE will decline.     

A user study of manual and MEDLINE literature searches in the hospital library

To determine possible uses for MEDLINE in the hospital library, health practitioners requesting literature searches were provided with both a manual and a MEDLINE search. Patron receptivity to MEDLINE was good, but the manual search was more often preferred. The health practitioners responding to a questionnaire apparently had delegated literature searching and evaluation of material to the hospital librarians, especially when clinically related information was needed. In the community hospitals where both the search and the selection of material are the responsibility of the librarian, MEDLINE can be used as the primary search tool or to supplement material provided.     

Comparison of three web-scale discovery services for health sciences research

Objective

The purpose of this study was to investigate the relative effectiveness of three web-scale discovery (WSD) tools in answering health sciences search queries.

Methods

Simple keyword searches, based on topics from six health sciences disciplines, were run at multiple real-world implementations of EBSCO Discovery Service (EDS), Ex Libris''s Primo, and ProQuest''s Summon. Each WSD tool was evaluated in its ability to retrieve relevant results and in its coverage of MEDLINE content.

Results

All WSD tools returned between 50%–60% relevant results. Primo returned a higher number of duplicate results than the other 2 WSD products. Summon results were more relevant when search terms were automatically mapped to controlled vocabulary. EDS indexed the largest number of MEDLINE citations, followed closely by Summon. Additionally, keyword searches in all 3 WSD tools retrieved relevant material that was not found with precision (Medical Subject Headings) searches in MEDLINE.

Conclusions

None of the 3 WSD products studied was overwhelmingly more effective in returning relevant results. While difficult to place the figure of 50%–60% relevance in context, it implies a strong likelihood that the average user would be able to find satisfactory sources on the first page of search results using a rudimentary keyword search. The discovery of additional relevant material beyond that retrieved from MEDLINE indicates WSD tools'' value as a supplement to traditional resources for health sciences researchers.     

MEDLINE and MeSH

Through casual observations, formal consultations, and educational sessions, the authors have identified various indexing features of the National Library of Medicine's Medical Subject Headings (MeSH) that pose challenges to end users while attempting to obtain relevant retrieval when searching MEDUNE. These problematic features include the use of Explodes, Tree structures, subheadings, Text Word vs. subject heading searching, and central concept searching. End-user search software is becoming more sophisticated with an increasing number of choices offered for search strategy fomalation. Methods of instruction to orient the end user to these systems will also have to become more detailed. A review of the literature, that discusses end-user problems with using MEDLINE and MeSH, is included.     

Retrieval comparison of EndNote to search MEDLINE (Ovid and PubMed) versus searching them directly

Using EndNote version 7.0, the authors tested the search capabilities of the EndNote search engine for retrieving citations from MEDLINE for importation into EndNote, a citation management software package. Ovid MEDLINE and PubMed were selected for the comparison. Several searches were performed on Ovid MEDLINE and PubMed using EndNote as the search engine, and the same searches were run on both Ovid and PubMed directly. Findings indicate that it is preferable to search MEDLINE directly rather than using EndNote. The publishers of EndNote do warn its users about the limitations of their product as a search engine when searching external databases. In this article, the limitations of EndNote as a search engine for searching MEDLINE were explored as related to MeSH, non-MeSH, citation verification, and author searching.     

Sensitivity and precision of adverse effects search filters in MEDLINE and EMBASE: a case study of fractures with thiazolidinediones

Background: Search filters have been developed in MEDLINE and EMBASE to help overcome the challenges of searching electronic databases for information on adverse effects. However, little evaluation of their effectiveness has been carried out. Objectives: To measure the sensitivity and precision of available adverse effects search filters in MEDLINE and EMBASE. Methods: A case study systematic review of fracture related adverse effects associated with the use of thiazolidinediones was used. Twelve MEDLINE search strategies and three EMBASE search strategies were tested. Results: Nineteen relevant references from MEDLINE and 24 from EMBASE were included in the review. Four search filters in MEDLINE achieved high sensitivity (95 or 100%) with an improved level of precision from searches without any adverse effects filter. High precision in MEDLINE could also be achieved (up to 53%) using search filters that rely on Medical Subject Headings. No search filter in EMBASE achieved high precision (all were under 5%) and the highest sensitivity in EMBASE was 83%. Conclusions: Adverse effects search filters appear to be effective in MEDLINE for achieving either high sensitivity or high precision. Search filters in EMBASE, however, do not appear as effective, particularly in improving precision.     

Information-seeking behavior changes in community-based teaching practices.

A National Library of Medicine information access grant allowed for a collaborative project to provide computer resources in fourteen clinical practice sites that enabled health care professionals to access medical information via PubMed and the Internet. Health care professionals were taught how to access quality, cost-effective information that was user friendly and would result in improved patient care. Selected sites were located in medically underserved areas and received a computer, a printer, and, during year one, a fax machine. Participants were provided dial-up Internet service or were connected to the affiliated hospital's network. Clinicians were trained in how to search PubMed as a tool for practicing evidence-based medicine and to support clinical decision making. Health care providers were also taught how to find patient-education materials and continuing education programs and how to network with other professionals. Prior to the training, participants completed a questionnaire to assess their computer skills and familiarity with searching the Internet, MEDLINE, and other health-related databases. Responses indicated favorable changes in information-seeking behavior, including an increased frequency in conducting MEDLINE searches and Internet searches for work-related information.     

A validated search assessment tool: assessing practice-based learning and improvement in a residency program

Objective:

The objective of this study was to validate an assessment instrument for MEDLINE search strategies at an academic medical center.

Method:

Two approaches were used to investigate if the search assessment tool could capture performance differences in search strategy construction. First, data from an evaluation of MEDLINE searches from a pediatric resident''s longitudinal assessment were investigated. Second, a cross-section of search strategies from residents in one incoming class was compared with strategies of residents graduating a year later. MEDLINE search strategies formulated by faculty who had been identified as having search expertise were used as a gold standard comparison. Participants were presented with a clinical scenario and asked to identify the search question and conduct a MEDLINE search. Two librarians rated the blinded search strategies.

Results:

Search strategy scores were significantly higher for residents who received training than the comparison group with no training. There was no significant difference in search strategy scores between senior residents who received training and faculty experts.

Conclusion:

The results provide evidence for the validity of the instrument to evaluate MEDLINE search strategies. This assessment tool can measure improvements in information-seeking skills and provide data to fulfill Accreditation Council for Graduate Medical Education competencies.

Highlights

• The University of Michigan MEDLINE Search Assessment tool can be used to assess search skills in residency education.
• Five elements were identified as critical elements in the development of an effective MEDLINE search strategy: inclusion of all search concepts, appropriate use of Medical Subject Headings, appropriate use of search limits, successful combination of all concepts, and search efficiency.

Implications

• This validated assessment tool can serve as an effective means to measure improvements in residents'' information-seeking skills and provide data to fulfill Accreditation Council for Graduate Medical Education competencies.

     

Evaluating CD-ROM versions of the MEDLINE database: a checklist

The emergence of CD-ROM (compact disc/read-only memory) versions of the MEDLINE database requires experienced MEDLINE searchers to examine assumptions about searching MEDLINE, since some expectations may not be fulfilled by this new technology. When applied to a particular CD-ROM MEDLINE product, the evaluation procedure involves testing assumptions concerning database contents; mechanics of searching; display, print, and download capabilities; and user-friendly features. The extent to which a CD-ROM product preserves and exploits important MEDLINE strengths should be assessed, e.g., the MeSH controlled vocabulary, the designation of major and minor MeSH emphasis, and the use of subheadings. Search software characteristics that affect ease of searching and quality of results also need to be examined, e.g., the ability to truncate search terms and the order of precedence in which Boolean operators are evaluated. A checklist to assist in the evaluation process is presented, including search examples for use in testing search functions.