Toward a Usable Academic Library Web Site: A Case Study of Tried and Tested Usability Practices

Usability testing is an important element when designing useful, usable academic library Web sites. Since 2001, members of the Florida International University Libraries Web team have worked toward establishing a process that identifies user needs through usability testing. Starting with the libraries’ first Web site redesign project in 2001, the team has taken an active part in improving Web site user experience. After engaging in multiple redesign efforts, the Web team has developed a process that supports awareness of user experience through continual usability testing and feedback gathering. This article presents strategies and practices to measure Web site user experience, including classic usability testing methods (e.g., card sorting activities, focus groups, and task-based user testing), as well as the team's latest effort to assess Web site analytics and content to identify Web site usage patterns and areas of concern. A history of the Florida International University Libraries’ Web site redesign process is presented to illustrate lessons learned and best practices to facilitate future redesign and testing efforts. Taking a longitudinal look at usability testing at one institution, the study aims to inform the development of an effective strategy for user research and content management.     

Focus Groups and Usability Testing in Redesigning an Academic Library's Web Site

ABSTRACT

As the World Wide Web has advanced since its inception, librarians have endeavored to keep pace with this progress in the design of their library Web pages. User recommendations collected from focus groups and usability testing have indicated that the University of Scranton's Weinberg Memorial Library's Web site was not working as intended, and the library's home page, in particular, was cluttered. Focus groups indicated that the process of accessing the library's databases from off-campus took too many steps, key resources were not located in key areas of the page, links were too close together, and the font was too small. Library staff determined it was necessary to rethink and redesign its pages. Self-reports from focus groups were insufficient to get at the mechanics of Web page use. Through usability testing, librarians were able to observe students and faculty completing simple research and directional tasks. Before “going live” with the new page in January 2007, users who had participated in the focus groups and in the usability testing were surveyed about the redesigned library Web page. The users indicated that the new Web page was less confusing, easier to use, and somewhat more intuitive than the previous library Web page. Web sites are always works in progress, and academic librarians should be proactive about making changes to their library Web sites to take advantage of emerging technology and to meet user expectations.     

Side by Side: What a Comparative Usability Study Told Us About a Web Site Redesign

Library Web sites must compete against easy-to-use sites, such as Google Scholar, Google Books, and Wikipedia, for students’ time and attention. Library Web sites must therefore be designed with aesthetics and user perceptions at the forefront. The Music and Performing Arts Library at Urbana-Champaign's Web site was overcrowded and in much need of a user-focused redesign. This article presents a usability study that compared participants’ use of the old site versus the new site to determine if performance improved on the redesigned site. Participants were asked to complete library-related tasks on both the old Web site and on the redesigned Web site to determine if they could both complete more tasks and complete tasks more quickly on the new site. Participants showed a marked improvement on the new site, and their “think-out-loud” responses to the tasks helped further improve site design and wording. Participants were also surveyed about their perceptions of ease of use and navigation on the old and new sites, and in general, the new site was preferred by participants and seen as a great improvement. Future studies will aim to further involve students and faculty in addressing terminology and site organization.     

User-Centered Design in Practice: The Brown University Experience

ABSTRACT

This article presents a case study in user-centered design that explores the needs and preferences of undergraduate users. An analysis of LibQual+ and other user surveys, interviews with public service staff, and a formal American with Disabilities Act accessibility review served as the basis for planning a redesign of the Brown University Library's Web site. Three testing phases were conducted: individual usability testing of the existing site and baseline data collection on Web use preferences; focus groups to respond to a functional prototype and search prototypes; and individual usability testing and interviews on revised functional prototypes. The delicate task of obtaining staff buy-in without letting their opinion drive the redesign was accomplished by keeping the project team small and nonrepresentational, submitting all conflicts to user testing, and promising an intranet that would meet the specialized needs of staff. A commitment to experimentation and a willingness to jettison design and functional elements which did not meet user approval kept the design process agile and flexible. Prototype testing of a variety of search options clearly demonstrated that the lack of integration in a library's information system makes it difficult to rationalize and optimize the user's search experience. Difficulties enlisting staff to edit existing Web content were solved by outsourcing content review and editing for Web-appropriate length and format. Except for this content review, the Web site redesign and usability testing were all conducted in-house with limited resources and a nine-month time-frame. The study's focus on user expectations and nomenclature largely confirmed the results of previous studies.     

A Student-Focused Usability Study of the Western Michigan University Libraries Home Page

Abstract

Three sources indicated the need for designing a usability study of the Western Michigan University Libraries' Web site: the results of the 2004 LibQUAL+ survey; the completion of the library's new strategic planning document; and suggestions by library customers and library staff. LibQUAL+ findings and customer comments suggested customers desired more independent use of the library site; better and easier electronic access to library resources, allowing customers to search for and find content on their own; and improved online help. A usability analysis was conducted with graduate and undergraduate students. The results from a task-based questionnaire, observations by investigators, and follow-up discussion sessions are presented. Investigators found usability testing alone may not be adequate to gain the qualitative data necessary for ascertaining the site's ease of use and usefulness and that a multipronged approach might be needed when evaluating a library Web site.     

Usability Studies and User-Centered Design in Digital Libraries

ABSTRACT

Digital libraries continue to flourish. At the same time, the principles of user-centered design and the practice of usability testing have been growing in popularity, spreading their influence into the library sphere. This article explores the confluence of these two trends by surveying the current literature on usability studies of digital libraries. This article focuses on the methodology of studies of multimedia digital libraries.     

Designing Search: Effective Search Interfaces for Academic Library Web Sites

ABSTRACT

Academic libraries customize, support, and provide access to myriad information systems, each with complex graphical user interfaces. The number of possible information entry points on an academic library Web site is both daunting to the end-user and consistently challenging to library Web site designers. Faced with the challenges inherent in designing online search interfaces and the ever-growing amount of resources available online, Virginia Commonwealth University Libraries sought to explore how to build effective search interfaces that, at the same time, support a wide variety of computer users and provide comprehensive access to assorted collections of electronic resources. Over a nine-month period, the libraries designed, implemented, and tracked the usage of two different search interfaces on their home page. Each interface allowed users to choose between four different search targets. In this case study, the authors discuss the complexities of designing search interfaces, outline findings from the nine-month study, evaluate the effectiveness of the two interface designs, and talk about future research in these areas.     

One Site to Rule Them All,Redux: The Second Round of Usability Testing of a Responsively Designed Web Site

This article examines the usability testing of a responsively redesigned library Web site. Responsive design provides a unified user experience regardless of the device used to view a site. The study's aim is twofold: to determine if the responsively designed site and its external online services support users’ information seeking needs, and to discover if there is a singular experience across different devices. A cognitive walkthrough was the main testing instrument used in gathering input. Over two rounds of testing, students of various class years and technological skill from the New York City of Technology (City Tech), CUNY participated in the study. The first round of testing for this usability study on the library Web site was previously documented (Tidal 2015 Tidal, J. (2015) “One Site to Rule Them All: Usability Testing of a Responsively Designed Library Web Site.” In Creating Sustainable Community: The Proceedings of the ACRL 2015 Conference, edited by D. Mueller. Paper presented at the Association of College and Research Libraries, Portland, OR, 25–28 March (pp. 593–604). Chicago: Association of College and Research Libraries. [Google Scholar]). This article presents the findings and comparisons between the first and second round of usability testing. The study found not only numerous improvements that could enhance the library Web site, but also the lack of a unified experience between tablet, smartphone, and desktop users, despite using a responsive design. Smartphone users were at a disadvantage in utilizing library resources. The study also found there was a significant usability impact in using a mobile-optimized discovery tool among users in comparison to its Web OPAC predecessor.     

The Perfect Storm: Examining User Experience and Conducting a Usability Test to Investigate a Disruptive Academic Library Web Site Redevelopment

Abstract

The researchers conducted a task-based usability test of the effectiveness of online research beginning on the library Web site homepage. The participants included five university faculty members, six graduate students, and six undergraduate students. All participants reported feeling satisfied with their overall research experience, though most were unable to effectively complete all the research tasks of the test. The researchers identified weaknesses in the approach and process of many participants, and overall usability issues of the library discovery tool and other library Web site pages and research interfaces. Findings indicate the need to strategically incorporate self-service information literacy and research skills help into the library Web site, and to implement navigation and design changes to the library homepage, discovery tool interface, online catalog, and across all the library's Web services.     

The Researcher's Journey: Scholarly Navigation of an Academic Library Web Site

A qualitative study of the Maureen and Mike Mansfield Library's Web site identified the ways in which students and faculty of the University of Montana used the site for research purposes. This study employed open-ended interview questions and observations to spontaneously capture a user's experience in researching topics in which they specialized. Four thematic recommendations emerged from nine study participants: increase the readability and consistency of the library's Web site, provide research guidance and ease of navigation, offer task-based services that maximize technology, and enable customization. The study led to Web site modifications and a formalized process by which the library will approach subsequent Web site design.     

高校图书馆OPAC中的分面搜索对用户体验的影响——基于不同任务的对比实验分析

[目的/意义] 研究高校图书馆OPAC中引入分面搜索技术给用户带来怎样的搜索体验。[方法/过程] 主要通过对用户在两种界面下(传统列表界面和基于列表与分面的界面)进行两种搜索任务(已知任务和探寻式任务)时所表现出的行为和喜好进行实验与观察,从搜索时间、搜索结果准确度、用户评价3方面对比分析搜索界面、搜索任务对用户搜索体验的影响。[结果/结论] 通过研究发现:相对于传统列表界面,受试者在使用基于列表与分面的界面时,搜索用时更短、用户评价更高。     

Services for Graduate Students: A Review of Academic Library Web Sites

A library's Web site is well recognized as the gateway to the library for the vast majority of users. Choosing the most user-friendly Web architecture to reflect the many services libraries offer is a complex process, and librarians are still experimenting to find what works best for their users. As part of a redesign of the Oregon State University Libraries’ Web site, entry points for specific user groups were created. One of these user groups was graduate students. The purpose of this study was to explore the ways other academic libraries design their Web sites for particular user groups, specifically graduate students, in order to determine how the Oregon State University Libraries Web site compared to peer institutions. This study analyzed 112 Association of Research Libraries’ Web sites and 26 Oregon academic libraries’ Web sites to determine the availability of resources and services specifically promoted to graduate students. Since graduate students may view the library Web site through the lens of new student, researcher, or instructor, Web sites were also examined to see if sites were created with any or all of these roles in mind. Nearly a quarter of Association of Research Libraries' Web sites that were examined contained a link on the homepage for graduate students, and another 20 percent provided graduate-student information at a lower level in their site hierarchy. A majority of sites had events, subject guides, or course guides for graduate students. Information for graduate students was typically framed in the context of graduate students as researchers. Ideas and examples are given for ways to improve Web site design to better serve this user group. In order to provide improved services to these students, future studies will explore what graduate students need from academic libraries and the ways these students conduct themselves in their various roles of researchers, instructors, and new students.     

Improving Access to Electronic Resources (ER) Through Usability Testing

SUMMARY

Electronic resources (ER) constitute an increasingly significant portion of library collections, both in usage and cost. It is vital to design easy, efficient access to these collections as users have other online options to meet their information needs. Thus, an important goal for ER librarians is to provide a usable ER site. Formal usability testing is a powerful tool to help librarians create the most useful site for their customers. This chapter will cover the basic components of usability testing and suggest ways in which ER librarians can lead efforts in their institution to improve the customer experience with library Web sites. ER librarians can create buy-in from library staff for usability testing as a worthwhile method to improve access to ER through involvement in the process and sharing results of the testing. The responsibilities of ER librarians vary from one institution to another, but all share in the mission of the profession to serve its customers' information needs. This chapter addresses the possibilities of usability testing as a force to maximize the user experience with the collections ER librarians manage.     

Our Experience with User Experience: Exploring Staffing Configurations to Conduct UX in an Academic Library

ABSTRACT

A research project was undertaken by a university library system to develop a sustainable user experience strategy. A task force was convened to conduct a pilot project with members from both libraries in the system to assess staffing responsibilities, guidelines, processes, and data-gathering procedures. The team tested an electronic resources list common to both libraries. In describing the methods employed by the task force in their research, this article outlines the benefits and drawbacks of staffing configurations to initiate user experience practices in an academic library setting.     

Work of the Web Weavers: Web Development in Academic Libraries

Although the library's Web site has become a standard tool for seeking information and conducting research in academic institutions, there are a variety of ways libraries approach the often challenging—and sometimes daunting—process of Web site development and maintenance. Three librarians at Western Michigan University explored issues related to this topic by conducting a Web-based survey, which was sent to two librarians—Web services and reference/public services—at 149 academic institutions. Survey findings are discussed, including references to Web departments and committees, priority setting, Web authoring, soliciting input, outsourcing, content management systems, redesigns, and user involvement. The participants’ insights regarding the greatest challenges and what seems to be working or not working well are also outlined, in addition to the authors’ suggestions for future research in this area.     

Benefits of Batch Reclamation: The Kent State University Libraries Experience

Bibliographic records in the Innovative library catalog at Kent State University Libraries had fallen out of synchronization with the Libraries’ holdings represented on OCLC's WorldCat database. The Libraries made a decision to undertake a batch reclamation project with OCLC to re-synch their holdings on WorldCat. This project was beneficial for both parties. OCLC received a clean copy of the Libraries’ database, while the Libraries were able to improve the quality of their local bibliographic data and address problem areas in the catalog. This case study is intended to provide a reference for other libraries considering OCLC batch reclamation projects.     

Business Library Web Sites Revisited: An Updated Review of the Organization and Content of Academic Business Library Web Sites

This article updates the findings from a study by Hal Kirkwood in 2000 of the organization and content of academic business library Web sites. The authors examined 75 sites, focusing on five general aspects of the sites: organization, terminology, instructional elements, integration of resources across formats, and annotations. Results of the study show that business library Websites have dramatically improved in the 7 years since the original study.     

Librarians Do It Differently: Comparative Usability Testing with Students and Library Staff

Usability testing on library search tools was conducted with ten students and eighteen library staff members at Syracuse University. The study addressed three research questions: (1) Do the ways in which librarians carry out search tasks on the library Web site vary from those of student users?; (2) Are those variations indicative of different mental models, i.e. different experience with and knowledge about the content and search tools on the Web site?; and (3) If there are differences, what are the implications of those different models for the usability of the site by students? Participants were tasked by using the library's Web site to locate both known items and items about a subject in the library's collection. The two groups differed in the success with which they were able to complete the tasks, as well as the time used. There were differences in the selection of search tools, the syntax used within the search box, the expectations of how library resources are organized, and the level of persistence as tasks were performed. Students’ behavior is characteristic of different mental models for how search tools work. The results are applicable to the design of the library's Web site and have implications for how library staff conduct reference and instruction services.     

Promoting and Teaching Information Literacy on the Internet: Surveying the Web Sites of 264 Academic Libraries in North America

A survey was conducted between July and November 2012 to determine how academic libraries in the United States and Canada marketed and delivered information literacy on the Web. A random sample of 264 institutions was taken from Peterson's Four-Year Colleges 2012, and the authors checked each Web site of the academic libraries of the institutions in the sample for instruction-related activities. Only 65 percent of the libraries in the sample advertised library instruction as a service on the Web, while 64 percent of the libraries boasted research guides and tutorials. Sixteen percent of the libraries provided direct links to ACRL's Information Literacy Competency Standards for Higher Education, and 24 percent made an effort to explain and define the term “information literacy” to their users. The authors hope the findings can help determine how academic libraries are currently using the Internet to increase information literacy on the Web and set a new platform for better strategies for advocating information literacy.