Program Evaluation in Libraries: Relating Operations and Clients

Evaluators of library programs have different perspectives on why to conduct an evaluation and also how to do so. The author suggests that a minimal approach to conducting a library program evaluation is to prove that the program exists. But this perspective has expanded to include different degrees of interest in the client and operations, culminating in a combined focus that leads evaluators to conduct outcome assessments. The chapter includes speculation on what motivates managers to undertake an evaluation, a review of some ways that library evaluations are conducted, and a discussion of several examples of program evaluations. Though there are not single directives for undertaking a library program evaluation, there are a variety of tools and advice to entice librarians to do more of them as a way to improve understanding the value of a library to its clientele and in society.     

Design and evaluation of a personal digital assistant- based alerting service for clinicians.

PURPOSE: This study describes the system architecture and user acceptance of a suite of programs that deliver information about newly updated library resources to clinicians' personal digital assistants (PDAs). DESCRIPTION: Participants received headlines delivered to their PDAs alerting them to new books, National Guideline Clearinghouse guidelines, Cochrane Reviews, and National Institutes of Health (NIH) Clinical Alerts, as well as updated content in UpToDate, Harrison's Online, Scientific American Medicine, and Clinical Evidence. Participants could request additional information for any of the headlines, and the information was delivered via e-mail during their next synchronization. Participants completed a survey at the conclusion of the study to gauge their opinions about the service. RESULTS/OUTCOME: Of the 816 headlines delivered to the 16 study participants' PDAs during the project, Scientific American Medicine generated the highest proportion of headline requests at 35%. Most users of the PDA Alerts software reported that they learned about new medical developments sooner than they otherwise would have, and half reported that they learned about developments that they would not have heard about at all. While some users liked the PDA platform for receiving headlines, it seemed that a Web database that allowed tailored searches and alerts could be configured to satisfy both PDA-oriented and e-mail-oriented users.     

Organizational Power and the Institutional Review Board

In this essay, we respond to the narratives and essays in this issue by examining organizational power issues related to researchers and institutional research boards (IRBs). Rather than taking a singular perspective on power, we use multiple perspectives and suggest that the cumulative analyses provide the best understanding of IRBs and organizational power.     

Analysis of Statistical Question Classification for Fact-Based Questions

Question classification systems play an important role in question answering systems and can be used in a wide range of other domains. The goal of question classification is to accurately assign labels to questions based on expected answer type. Most approaches in the past have relied on matching questions against hand-crafted rules. However, rules require laborious effort to create and often suffer from being too specific. Statistical question classification methods overcome these issues by employing machine learning techniques. We empirically show that a statistical approach is robust and achieves good performance on three diverse data sets with little or no hand tuning. Furthermore, we examine the role different syntactic and semantic features have on performance. We find that semantic features tend to increase performance more than purely syntactic features. Finally, we analyze common causes of misclassification error and provide insight into ways they may be overcome.     

Standards for the academic veterinary medical library.

The Standards Committee of the Veterinary Medical Libraries Section was appointed in May 2000 and charged to create standards for the ideal academic veterinary medical library, written from the perspective of veterinary medical librarians. The resulting Standards for the Academic Veterinary Medical Library were approved by members of the Veterinary Medical Libraries Section during MLA '03 in San Diego, California. The standards were approved by Section Council in April 2005 and received final approval from the Board of Directors of the Medical Library Association during MLA '04 in Washington, DC.     

Staff development planning in an academic health sciences library.

OBJECTIVE: A staff development committee (SDC) was convened to implement staff development opportunities for an academic health sciences library system comprised of three separate facilities. The charge for the SDC was to: (1) develop programs to enhance workplace skills and personal growth, (2) communicate the availability of existing programs at the university and medical center, and (3) encourage the staff to participate in these opportunities. PROGRAM: The committee created goals and objectives and developed a survey designed to give staff the opportunity to provide input for this initiative. With an 80% response rate, the survey results were used to plan 15 events based on staff needs and preferences. First-year attendance for SDC-sponsored events was 459. Committee members served as liaisons for each event. Two forms were developed to facilitate event planning. A monthly announcement sheet, email reminders, and the library's local area network are used to communicate upcoming SDC events and encourage attendance. CONCLUSION: This approach can serve as a useful model for similar program planning in any organization.