Measuring Medical Student Preference: A Comparison of Classroom Versus Online Instruction for Teaching Pubmed

Objective:

The research analyzed evaluation data to assess medical student satisfaction with the learning experience when required PubMed training is offered entirely online.

Methods:

A retrospective study analyzed skills assessment scores and student feedback forms from 455 first-year medical students who completed PubMed training either through classroom sessions or an online tutorial. The class of 2006 (n = 99) attended traditional librarian-led sessions in a computer classroom. The classes of 2007 (n = 120), 2008 (n = 121), and 2009 (n = 115) completed the training entirely online through a self-paced tutorial. PubMed skills assessment scores and student feedback about the training were compared for all groups.

Results:

As evidenced by open-ended comments about the training, students who took the online tutorial were equally or more satisfied with the learning experience than students who attended classroom sessions, with the classes of 2008 and 2009 reporting greater satisfaction (P<0.001) than the other 2 groups. The mean score on the PubMed skills assessment (91%) was the same for all groups of students.

Conclusions:

Student satisfaction improved and PubMed assessment scores did not change when instruction was offered online to first-year medical students. Comments from the students who received online training suggest that the increased control and individual engagement with the web-based content led to their satisfaction with the online tutorial.

Highlights

• First-year medical students at Mount Sinai School of Medicine responded positively to an online PubMed tutorial and skills assessment created by librarians.
• Students who took the online tutorial passed the PubMed skills assessment at the same high rate as students who attended in-class training led by librarians.
• Feedback suggests that students preferred the individual control of the web-based content and the ease with which the online training fit into their crowded schedules.

Implications

• Interactive online training encourages students to direct their own learning experience and can lead to greater student satisfaction.
• Medical students of the Millennial generation may prefer flexible, self-paced assignments that can be completed at times and locations convenient to them.
• Medical librarians can create online tutorials to successfully engage and instruct the next generation of medical students.

     

Designing an Interactive Web-based Tutorial for Health Sciences Students: A Collaborative Library Project

This column describes the creation of an online interactive tutorial for health sciences students in a general library at a large, urban university. The project was a collaborative effort among the health sciences subject librarian, the library’s web programmer, an assessment and user services librarian, and an instructional support specialist. The column details the initial exploration, design, web programming, student usability study, and subsequent upgrades to the tutorial. Implementation of the tutorial is discussed as well as sampled student input. The effort resulted in the design of improved and more versatile open access coding available for any library to use.     

Making Generic Tutorials Content Specific: Recycling Evidence-based Practice (EBP) Tutorials for Two Disciplines

Librarians at the Boston University Medical Center constructed two interactive online tutorials, “Introduction to EBM” and “Formulating a Clinical Question (PICO),” for a Family Medicine Clerkship and then quickly repurposed the existing tutorials to support an Evidence-based Dentistry course. Adobe's ColdFusion software was used to populate the tutorials with course-specific content based on the URL used to enter each tutorial, and a MySQL database was used to collect student input. Student responses were viewable immediately by course faculty on a password-protected Web site. The tutorials ensured that all students received the same baseline training and allowed librarians to tailor a subsequent library skills workshop to student tutorial answers. The tutorials were well-received by the medical and dental schools and have been added to mandatory first-year Evidence-based Medicine (EBM) and Evidence-based Dentistry (EBD) courses, meaning that every medical and dental student at BUMC will be expected to complete these tutorials.     

Assessing the Effectiveness of Online Information Literacy Tutorials for Millennial Undergraduates

This article reports on the findings of a study that evaluated the effectiveness of redesigning online information literacy tutorials in order to meet the learning needs and preferences of Millennial students. Using both quantitative and qualitative measures, this study compared two different online tutorials—a static, HTML-based tutorial and a dynamic, interactive, audio/video tutorial. This study found that, contrary to generalizations made in the library and education literature, Millennial students learned equally well from both tutorials. However, students expressed a much higher level of satisfaction from the tutorial designed to be “Millennial friendly.”     

Assessing the Effectiveness of Online Library Instruction with Finance Students

ABSTRACT

Many academic librarians use online information literacy tutorials as an alternative or a supplement to in-class library instruction. Tutorials created with streaming media software such as Camtasia Studio have become increasingly popular. Librarians at a mid-sized Midwestern university have created several such tutorials demonstrating various library resources. The value of streaming-media tutorials is supported by key learning theories such as cognitive load theory, dual coding theory, and multimedia learning theory. However, studies measuring the impact of online tutorials on student learning of information-literacy skills have shown mixed results. The authors tested the effectiveness of an online information literacy tutorial on a group of undergraduate business students. About 140 students in three undergraduate finance classes rated a Value Line online tutorial. Students were also invited to complete a follow-up survey online with Blackboard. This survey measured student knowledge retention of Value Line and interest in online tutorials. The results showed that while students viewed the tutorial positively, they preferred face-to-face instruction from a librarian. Also, while most students could locate the proper links in Value Line, only 30 percent were able to successfully look up a company. Indicators point to a future for online instruction coexisting with, yet not replacing, traditional classroom library instruction.     

The effects of subtitles and captions on an interactive information literacy tutorial for English majors at a Turkish university

Subtitles and captions have been used to aid second language learning. This study focuses on the effects of subtitles and captions on English Language Learners' ability to learn information literacy skills and apply those skills using an interactive tutorial. Three groups of Turkish university students majoring in English Language and Literature completed a tutorial on ACRL's Framework scholarly conversations. One group completed the tutorial with an English soundtrack and no titling; the second group completed the tutorial with an English soundtrack and English captions; and the third group completed the tutorial with an English soundtrack and Turkish subtitles. Using Morae software, the students were recorded and evaluated for time-on-task and correct completion of the interactive practice elements. The group that viewed the tutorial with an English soundtrack and Turkish subtitles completed tasks at a statistically significant faster pace than other groups and with statistically significant more success.     

Enhancing Library Instruction to Undergraduates: Incorporating Online Tutorials into the Curriculum

ABSTRACT

Librarians can replace or supplement traditional in-class instruction with course-specific online tutorials. The literature demonstrates how tutorials customized for specific courses are more beneficial than tutorials on basic research skills. Many authors discuss creating online tutorials but do not design one devoted to a specific course. With increasing demand for instruction services, online tutorials can ease staffing concerns prevalent at many libraries and otherwise enhance the quality of instruction and its application to varied learning styles. Using the Blackboard course management system, the authors created an online tutorial tailored to the required World Civilizations course at the University at Buffalo. The tutorial incorporated elements of successful online tutorials described in the literature: clear terminology, a quiz for self-assessment, opportunities for active learning, and individual e-mail feedback between students and librarians, and applied them to a specific course. The authors discuss student and librarian reaction to the tutorial and make recommendations for how the tutorial can be improved and implemented in everyday instruction services.     

A Review of “Information Literacy Meets Library 2.0”

This study compared two common types of online information literacy tutorials: a streaming media tutorial using animation and narration and a text-based tutorial with static images. Nine sections of an undergraduate biology lab class (234 students total) were instructed by a librarian on how to use the BIOSIS Previews database. Three sections watched a brief video tutorial, three sections used an interactive HTML tutorial, and three sections received live instruction only. The content of instruction was the same across all nine sections. Immediately after instruction, each class was encouraged to complete a brief survey and quiz. One hundred and fifty-four students completed the survey and quiz. In all three conditions, students reported feeling more confident searching the BIOSIS Previews database after instruction. However, the increase in confidence was less for the HTML group. The students who watched the video tutorial scored higher on all five quiz questions than the other two groups. Comparing the HTML and video groups, the difference in scores was statistically significant (p < .05) for questions 1, 2, and 5. Students may learn more from video tutorials than tutorials that use static Web pages. Also, interactivity in tutorials may not necessarily enhance learning.     

A Kaleidoscope of Learning Styles

Abstract

Our library intends to create a tutorial to assist students in library research. In preparation, we need to understand the diverse learning needs of students. Some students seem to thrive in the online environment while others feel at a loss. A review of learning styles literature reveals that many adult learners require personalized, interactive learning environments. The author reviewed library tutorials to identify models of library instruction that meet the needs of such students. This paper serves as background and literature review for an interactive workshop on learning styles and the Internet, which was presented at the conference.     

Tools and Principles for Effective Online Library Instruction: Andragogy and Undergraduates

The library literature evaluating the efficacy of online tutorial methods and delivery tools is a valuable resource for librarians looking for information to inform their choices for developing asynchronous online instruction. This literature, however, examines a wide variety of delivery tools, methods, and student populations. As a result, it is difficult to draw definitive conclusions about any one tutorial tool or method. This article compares selected research and concludes that the consensus in the literature suggests that applying adult learning principles to library tutorials has a larger impact on effective online instruction than the individual tool.     

Experiential and self-discovery learning in digital literacy: Developing the discernment to evaluate source reliability

Abstract

In our modern digital and information-rich educational contexts, students are increasingly faced with conflicts between popular media and scholarly content. As a result, discerning source reliability can be considered as a key threshold concept in tertiary information literacy curricula. In this study, the author describes the development of an online tutorial designed to teach this threshold concept using experiential and self-discovery learning. Evaluation of students’ learning journeys as they progressed through the tutorial provided insight into students understanding of the concept of discerning source reliability. Therefore, the author proposes that this online tutorial is an effective pedagogical tool to help students develop their personal epistemology regarding source reliability.     

Graduate student research instruction: Testing an interactive Web-based library tutorial for a health sciences database

Interactive electronic tutorials offer flexibility in delivering library instruction; however, questions linger regarding their effectiveness compared to traditional librarian-led classroom lectures. This study examines a tutorial introducing health science students to the Cumulative Index to Nursing and Allied Health Literature database. Half the student sample completed the tutorial and half attended a parallel lecture. A pre/post-test instrument measured mastery of the material. While results varied by subject focus tested, students completing the tutorial demonstrated greater improvement in post-test scores than those attending the lecture.     

Are online tutorials effective? A comparison of online and classroom library instruction methods

Librarians are conducting instruction sessions outside the traditional classroom setting using online tutorials with increasing frequency. Online tutorials seem like an obvious solution to meet the growing need for instruction to users in a time when resources are shrinking. Can librarians effectively teach library skills using an online tutorial? Approximately 300 students enrolled in an undergraduate psychology course at the University of South Florida Tampa Campus attended either a library research class or completed an online tutorial as part of their coursework. Participants were given a post-test and were surveyed about their confidence levels and preferred method of library instruction. Analysis of the test scores indicated that there was no significant difference in the learning outcomes between in-person and online library instruction. The majority of students indicated a preference for online instruction over classroom instruction. A rise in confidence levels was noted across both groups.     

Get the cite right: Design and evaluation of a high-quality online citation tutorial

As part of a library initiative to foster information literacy, promote academic integrity, and prevent inadvertent plagiarism, a high-quality online tutorial was designed to teach students to cite sources properly. The development of this tutorial, APA Exposed: Everything You Always Wanted to Know About APA Format but Were Afraid to Ask, was a collaborative endeavor among research and instruction librarians, learning technology specialists, and an instructor. This study employs a mixed-methods research approach that combines the use of multiple data sources – an online survey, website visitor-tracking software, e-mail correspondence, and a Google search – to evaluate the quality and efficacy of the tutorial. Analyses of online survey data indicate 98% of survey respondents found the tutorial useful or very useful. All of the respondents reported the tutorial improved their understanding of APA style. In addition, 93% of respondents said they planned to use this tutorial as a reference resource in the future and 99% said they would recommend the tutorial to others. The online tutorial received an average of 1055 visits per month. The findings of this study indicate that there is a need for high-quality online citation instruction and that the tutorial meets this need. Providing effective citation instruction online not only benefits tutorial participants but also research and instruction librarians as they can now allocate limited library resources to areas of instruction other then proper citation techniques.     

LibGuides and Web-Based Library Guides in Comparison: Is There a Pedagogical Advantage?

This study investigates whether the platform used to deliver a tutorial matters in online information literacy instruction and assesses the overall quality of an information literacy tutorial assignment given to an undergraduate survey class. The study asks whether there is any pedagogical advantage between information literacy tutorials created in the LibGuides library guide creation software and tutorials created as Web pages. This research question is relevant to current studies of online information literacy tutorials, particularly given the increasingly dominant but under-researched position of LibGuides in the academic library world for delivering guides and tutorials. Two separate groups of students completed LibGuides and Web page versions of the same information literacy tutorial assignment in a university undergraduate communication course. Survey results of these 89 students indicated that both the LibGuides and Web page platforms deliver online instruction content effectively and achieve learning objectives almost equally well. Results also indicated content areas within the assignment that could be strengthened.     

The Role of Cooperation in Creating a Library Online Tutorial

SUMMARY

Reference librarians at St. Charles Community College discovered the benefits of cooperation when they began the process of creating an online library tutorial. In the fall of 1999, librarians realized that their walk-in library sessions were becoming ineffective due to poor attendance by students. The tours didn't fit into on-campus students' busy schedules, and failed to serve distance students at all. Two reference librarians decided to work together to create a web-based tutorial introducing students to library online resources. It was an informal process that started with information gathering on what tutorials exist, how they were developed and what type of software was used. After the librarians decided on the format and appropriate software, they brought together their creative and technical strengths to design an appealing and functional tutorial. To create a “virtual tour” of the library's physical layout, the librarians also collaborated with the Instructional Support Center, a group of educational technology specialists who are part of SCC's community college consortium. The tutorial was completed in only a year, partly because working in a small library allows for constant contact between the librarians, but also due to the efficiency of using cooperation. This successful collaborative project eventually won the Missouri Community College Association's 2001 Technology Innovation Award.     

Developing and evaluating an interactive information skills tutorial

OBJECTIVE: To develop and evaluate a web-based interactive information skills tutorial integrated into the curriculum. To determine whether the tutorial was acceptable to students and explore the use of a skills assessment tool in identifying whether the tutorial improved skills. METHODS: The development of a tutorial on OVID medline to teach transferable information skills. A small cohort study to evaluate students' views on the tutorial and its effects on information skills. RESULTS: Thirteen objective assessments were usable. There was a statistically significant improvement in mean final assessment scores, compared with mean pre-training scores, F(2,14) = 11.493, P = 0.001. Eleven (85%) students had improved their overall information skills. The improvement in overall searching skills was enhanced by referral to the tutorial. CONCLUSIONS: The tutorial was successfully developed and integrated into a Masters programme curriculum. In this setting, it appears to reinforce active learning, and was well received by students, who developed core generic searching skills and demonstrated improved information skills in the short and longer term. Students could use the tutorial for revision and study at a time and place of their choosing. Further evaluation is required to assess the impact of using the tutorial with large groups of students, and as a stand-alone teaching medium.     

Too Many Students,Too Little Time: Creating and Implementing a Self-Paced,Interactive Computer Tutorial for the Libraries' Online Catalog

The goal of the project presented in this article was to create a tutorial for the University of Louisville's online catalog, Minerva, using an authoring software program. This article describes the thought process behind this decision, how the appropriate software was chosen, how the tutorial was designed and implemented, and how the project was evaluated. The tutorial is the first step in helping all students become information literate and works in coordination with the library session, which furthers the process by helping them learn how to evaluate and use the information they find.     

Library Lab:

Library Lab is a one-on-one research tutorial. Students initiate it when they have a specific assignment. Most sessions take from one hour (the norm) to a maximum of four hours to do background research and thirty minutes to one hour for an interactive meeting. This is a win-win situation; the librarian has time to prepare and the student receives quality, uninterrupted assistance.