Usability test results for a discovery tool in an academic library

Information Technology and Libraries

Volumn 31, Issue 1, 2012, Pages 83-112

  Fagan, Jody Condit ^a   Mandernach, Meris ^b   Nelson, Carl S ^c   Paulo, Jonathan R ^d   Saunders, Grover ^e  

^a Scholarly Content Systems   (United States)

^b Collection Management Librarian ^*  (United States)

^c Digital User Experience Specialist   (United States)

^d Education Librarian   (United States)

^e JAMES MADISON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84864334008     PISSN: 07309295     EISSN: None     Source Type: Journal    
DOI: 10.6017/ital.v31i1.1855     Document Type: Article

References (86)

1. Emily Alling and Rachael Naismith, "Protocol Analysis of a Federated Search Tool: Designing for Users," Internet Reference Services Quarterly 12, no. 1 (2007): 195, http://scholarworks.umass.edu/librarian-pubs/1/ (accessed Jan. 11, 2012)
2. Frank Cervone, "What We've Learned From Doing Usability Testing on OpenURL Resolvers and Federated Search Engines," Computers in Libraries 25, no. 9 (2005): 10 ;
3. Sara Randall, "Federated Searching and Usability Testing: Building the Perfect Beast," Serials Review 32, no. 3 (2006): 181-82, doi:10.1016/j.serrev.2006.06.003; (Pubitemid 44356367)
4. Ed Tallent, "Metasearching in Boston College Libraries-A Case Study of User Reactions," New Library World 105, no. 1 (2004): 69-75, DOI: 10.1108/03074800410515282.
5. S. C. Williams and A. K. Foster, "Promise Fulfilled? An EBSCO Discovery Service Usability Study," Journal of Web Librarianship 5, no. 3 (2011), http://www.tandfonline.com/doi/pdf/10.1080/19322909.2011.597590 (accessed Jan. 11, 2012).
6. Janet K. Chisman, Karen R. Diller, and Sharon L. Walbridge, "Usability Testing: A Case Study," College & Research Libraries 60, no. 6 (November 1999): 552-69, http://crl.acrl.org/content/60/6/552.short (accessed Jan. 11, 2012);
7. Frances C. Johnson and Jenny Craven, "Beyond Usability: The Study of Functionality of the 2.0 Online Catalogue," New Review of Academic Librarianship 16, no. 2 (2010): 228-50, DOI: 10.1108/00012531011015217 (accessed Jan, 11, 2012);
8. Jennifer E. Knievel, Jina Choi Wakimoto, and Sara Holladay, "Does Interface Design Influence Catalog Use? A Case Study," College & Research Libraries 70, no. 5 (September 2009): 446-58, http://crl.acrl.org/ content/70/5/446.short (accessed Jan. 11, 2012);
9. Jia Mi and Cathy Weng, "Revitalizing the Library OPAC: Interface, Searching, and Display Challenges," Information Technology & Libraries 27, no. 1 (March 2008): 5-22, http://0-www.ala.org.sapl.sat.lib.tx.us/ala/mgrps/ divs/lita/publications/ital/27/1/mi.pdf (accessed Jan. 11, 2012).
10. Karen Calhoun, "The Changing Nature of the Catalog and its Integration with Other Discovery Tools," http://www.loc.gov/catdir/calhoun- report-final.pdf (accessed Mar. 11, 2011).
11. Dee Ann Allison, "Information Portals: The Next Generation Catalog," Journal of Web Librarianship 4, no. 1 (2010): 375-89, http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1240&context= libraryscience (accessed January 11, 2012)
12. Marshall Breeding, "The State of the Art in Library Discovery," Computers in Libraries 30, no. 1 (2010): 31-34
13. C. P Diedrichs, "Discovery and Delivery: Making it Work for Users . . . Taking the Sting out of Serials!" (lecture, North American Serials Interest Group, Inc. 23rd Annual Conference, Phoenix, Arizona, June 5-8, 2008), DOI: 10.1080/03615260802679127;
14. Ian Hargraves, "Controversies of Information Discovery," Knowledge, Technology & Policy 20, no. 2 (Summer 2007): 83, http://www.springerlink.com/content/au20jr6226252272/fulltext.html (accessed Jan. 11, 2012);
15. Jane Hutton, "Academic Libraries as Digital Gateways: Linking Students to the Burgeoning Wealth of Open Online Collections," Journal of Library Administration 48, no. 3 (2008): 495-507, DOI: 10.1080/ 01930820802289615;
16. OCLC, "Online Catalogs: What Users and Librarians Want: An OCLC Report," http://www.oclc.org/reports/onlinecatalogs/default.htm (accessed Mar. 11 2011).
17. Judith Z. Emde, Sara E. Morris, and Monica Claassen-Wilson, "Testing an Academic Library Website for Usability with Faculty and Graduate students," Evidence Based Library & Information Practice 4, no. 4 (2009): 24-36, http://kuscholarworks.ku.edu/dspace/bitstream/1808/5887/1/emdee- morris-CW.pdf (accessed Jan. 11,2012);
18. Karla Saari Kitalong, Athena Hoeppner, and Meg Scharf, "Making Sense of an Academic Library Web Site: Toward a More Usable Interface for University Researchers," Journal of Web Librarianship 2, no. 2/3 (2008): 177-204, http://www.tandfonline.com/doi/abs/10.1080/19322900802205742 (accessed Jan. 11, 2012);
19. Ed Tallent, "Metasearching in Boston College Libraries-A Case Study of User Reactions," New Library World 105, no. 1 (2004): 69-75, DOI: 10.1108/03074800410515282;
20. Rong Tang, Ingrid Hsieh-Yee, and Shanyun Zhang, "User Perceptions of MetaLib Combined Search: An Investigation of How Users Make Sense of Federated Searching," Internet Reference Services Quarterly 12, no. 1 (2007): 211-36, http://www.tandfonline.com/doi/abs/10.1300/J136v12n01-11 (accessed Jan. 11, 2012).
21. Jody Condit Fagan, "Usability Studies of Faceted Browsing: A Literature Review," Information Technology & Libraries 29, no. 2 (2010): 58-66, http://web2.ala.org/ala/mgrps/divs/lita/publications/ital/29/2/ fagan.pdf (accessed Jan. 11, 2012).
22. Birong Ho, Keith Kelley, and Scott Garrison, "Implementing VuFind as an Alternative to Voyager's Web Voyage Interface: One Library's Experience," Library Hi Tech 27, no. 1 (2009): 8292, DOI: 10.1108/07378830910942946 (accessed Jan. 11, 2012).
23. Dee Ann Allison, "Information Portals: The Next Generation Catalog," Journal of Web Librarianship 4, no. 1 (2010): 375-89, http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1240&context= libraryscience (accessed January 11, 2012)
24. Marshall Breeding, "The State of the Art in Library Discovery," Computers in Libraries 30, no. 1 (2010): 31-34
25. C.P Diedrichs, "Discovery and Delivery: Making it Work for Users . . . Taking the Sting out of Serials!" (lecture, North American Serials Interest Group, Inc. 23rd Annual Conference, Phoenix, Arizona, June 5-8, 2008), DOI: 10.1080/03615260802679127;
26. Ian Hargraves, "Controversies of Information Discovery," Knowledge, Technology & Policy 20, no. 2 (Summer 2007): 83, http://www.springerlink.com/content/au20jr6226252272/fulltext.html (accessed Jan. 11, 2012)
27. Jane Hutton, "Academic Libraries as Digital Gateways: Linking Students to the Burgeoning Wealth of Open Online Collections," Journal of Library Administration 48, no. 3 (2008): 495-507, DOI: 10.1080/01930820802289615
28. OCLC, "Online Catalogs: What Users and Librarians Want: An OCLC Report," http://www.oclc.org/reports/onlinecatalogs/default.htm (accessed Mar. 11 2011).
29. C. J. Belliston, Jared L. Howland, and Brian C. Roberts, "Undergraduate Use of Federated Searching: A Survey of Preferences and Perceptions of Value-Added Functionality," College & Research Libraries 68, no. 6 (November 2007): 472-86, http://crl.acrl.org/content/68/6/472.full. pdf+html (accessed Jan. 11, 2012);
30. Judith Z. Emde, Sara E. Morris, and Monica Claassen-Wilson, "Testing an Academic Library Website for Usability with Faculty and Graduate students," Evidence Based Library & Information Practice 4, no. 4 (2009): 24-36, http://kuscholarworks.ku.edu/dspace/bitstream/1808/5887/1/emdee- morris-CW.pdf (accessed Jan. 11,2012);
31. Karla Saari Kitalong, Athena Hoeppner, and Meg Scharf, "Making Sense of an Academic Library Web Site: Toward a More Usable Interface for University Researchers," Journal of Web Librarianship 2, no. 2/3 (2008): 177-204, http://www.tandfonline.com/doi/abs/10.1080/19322900802205742 (accessed Jan. 11, 2012);
32. Ed Tallent, "Metasearching in Boston College Libraries-A Case Study of User Reactions," New Library World 105, no. 1 (2004): 69-75, DOI: 10.1108/03074800410515282;
33. Rong Tang, Ingrid Hsieh-Yee, and Shanyun Zhang, "User Perceptions of MetaLib Combined Search: An Investigation of How Users Make Sense of Federated Searching," Internet Reference Services Quarterly 12, no. 1 (2007): 211-36, http://www.tandfonline.com/doi/abs/10.1300/J136v12n01-11 (accessed Jan. 11, 2012).
34. Jody Condit Fagan, "Usability Studies of Faceted Browsing: A Literature Review," Information Technology & Libraries 29, no. 2 (2010): 58-66, http://web2.ala.org/ala/mgrps/divs/lita/publications/ital/29/2/ fagan.pdf (accessed Jan. 11, 2012).
35. Birong Ho, Keith Kelley, and Scott Garrison, "Implementing VuFind as an Alternative to Voyager's Web Voyage Interface: One Library's Experience," Library Hi Tech 27, no. 1 (2009): 8292, DOI: 10.1108/07378830910942946 (accessed Jan. 11, 2012).
36. Tamar Sadeh, "User Experience in the Library: A Case Study," New Library World 109, no. 1 (2008): 7-24, DOI: 10.1108/03074800810845976 (accessed Jan. 11, 2012).
37. Tod A. Olson, "Utility of a Faceted Catalog for Scholarly Research," Library Hi Tech 25, no. 4 (2007): 550-61, DOI: 10.1108/07378830710840509 (accessed Jan. 11, 2012).
38. Allison, "Information Portals," 375-89.
39. Marshall Breeding, "Plotting a New Course for Metasearch," Computers in Libraries 25, no. 2 (2005): 27.
40. Dennis Brunning and George Machovec, "Interview About Summon with Jane Burke, Vice President of Serials Solutions," Charleston Advisor 11, no. 4 (2010): 60-62;
41. Dennis Brunning and George Machovec, "An Interview with Sam Brooks and Michael Gorrell on the EBSCOhost Integrated Search and EBSCO Discovery Service," Charleston Advisor 11, no. 3 (2010): 62-65, http://www.ebscohost. com/uploads/discovery/pdfs/topicFile-121.pdf (accessed Jan. 11, 2012).
42. Ronda Rowe, "Web-Scale Discovery: A Review of Summon, EBSCO Discovery Service, and WorldCat Local," Charleston Advisor 12, no. 1 (2010): 5-10;
43. K. Stevenson et al., "Next-Generation Library Catalogues: Reviews of Encore, Primo, Summon and Summa," SERIALS 22, no. 1 (2009): 68-78.
44. Jason Vaughan, "Chapter 7: Questions to Consider," Library Technology Reports 47, no. 1 (2011): 54;
45. Paula L. Webb and Muriel D. Nero, "OPACs in the Clouds," Computers in Libraries 29, no. 9 (2009): 18.
46. Jason Vaughan, "Investigations into Library Web Scale Discovery Services," Articles (Libraries), paper 44 (2011), http://digitalcommons. library.unlv.edu/lib-articles/44.
47. Marshall Breeding, "The State of the Art in Library Discovery," 31-34;
48. Sharon Q. Yang and Kurt Wagner, "Evaluating and Comparing Discovery Tools: How Close are We Towards Next Generation Catalog?" Library Hi Tech 28, no. 4 (2010): 690-709.
49. Allison, "Information Portals," 375-89.
50. Breeding, "The State of the Art in Library Discovery," 31-34.
51. Galina Letnikova, "Usability Testing of Academic Library Websites: A Selective Bibliography," Internet Reference Services Quarterly 8, no. 4 (2003): 53-68.
52. Jeffrey Rubin and Dana Chisnell, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, 2nd ed. (Indianapolis, IN: Wiley, 2008);
53. Joseph S. Dumas and Janice Redish, A Practical Guide to Usability Testing, rev. ed. (Portland, OR: Intellect, 1999).
54. Nicole Campbell, ed., Usability Assessment of Library-Related Web Sites: Methods and Case Studies (Chicago: Library & Information Technology Association, 2001);
55. Elaina Norlin and C. M. Winters, Usability Testing for Library Web Sites: A Hands-On Guide (Chicago: American Library Association, 2002).
56. Jennifer L. Ward, Steve Shadle, and Pam Mofield, "User Experience, Feedback, and Testing," Library Technology Reports 44, no. 6 (2008): 17.
57. Michael Boock, Faye Chadwell, and Terry Reese, "WorldCat Local Task Force Report to LAMP," http://hdl.handle.net/1957/11167 (accessed Mar. 11 2011).
58. Bob Thomas and Stefanie Buck, "OCLC's WorldCat Local Versus III's WebPAC: Which Interface is Better at Supporting Common User Tasks?" Library Hi Tech 28, no. 4 (2010): 648-71.
59. OCLC, "Some Findings from WorldCat Local Usability Tests Prepared for ALA Annual," http://www.oclc.org/worldcatlocal/about/213941usf-some- findings-about-worldcat-local.pdf (accessed Mar. 11, 2011).
60. Doug Way, "The Impact of Web-Scale Discovery on the Use of a Library Collection," Serials Review 36, no. 4 (2010): 21420.
61. North Carolina State University Libraries, "Final Summon User Research Report," http://www.lib.ncsu.edu/userstudies/studies/2010-summon/ (accessed Mar. 28, 2011).
62. Alesia McManus, "The Discovery Sandbox: Aleph and Encore Playing Together," http://www.nercomp.org/data/media/Discovery%20Sandbox%20McManus. pdf (accessed Mar. 28, 2011);
63. PRWeb, "Deakin University in Australia Chooses EBSCO Discovery Service," http://www.prweb.com/releases/Deakin/ChoosesEDS/prweb8059318.htm (accessed Mar. 28, 2011)
64. University of Manitoba, "Summon Usability: Partnering with the Vendor," http://prezi.com/icxawthckyhp/summon-usability-partnering-with- the-vendor (accessed Mar. 28, 2011).
65. Williams and Foster, "Promise Fulfilled?"
66. Jakob Nielsen, "Why You Only Need to Test with 5 Users," http://www.useit.com/alertbox/20000319.html (accessed Aug. 20, 2011).
67. John Brooke, "SUS: A 'Quick and Dirty' Usability Scale," in Usability Evaluation in Industry, ed. P. W. Jordanet al. (London: Taylor & Francis, 1996), http://www.usabilitynet.org/trump/documents/Suschapt.doc (accessed Apr. 6, 2011).
68. Williams and Foster, "Promise Fulfilled?"
69. Seikyung Jung et al., "LibraryFind: System Design and Usability Testing of Academic Metasearch System," Journal of the American Society for Information Science & Technology 59, no. 3 (2008): 375-89;
70. Williams and Foster, "Promise Fulfilled?"; Laura Wrubel and Kari Schmidt, "Usability Testing of a Metasearch Interface: A Case Study," College & Research Libraries 68, no. 4 (2007): 292-311.
71. Williams and Foster, "Promise Fulfilled?"
72. Letnikova, "Usability Testing of Academic Library Websites," 53-68;
73. Tom Ipri, Michael Yunkin, and Jeanne M. Brown, "Usability as a Method for Assessing Discovery," Information Technology & Libraries 28, no. 4 (2009): 181-86;
74. Susan H. Mvungi, Karin de Jager, and Peter G. Underwood, "An Evaluation of the Information Architecture of the UCT Library Web Site," South African Journal of Library & Information Science 74, no. 2 (2008): 171-82.
75. Williams and Foster, "Promise Fulfilled?"
76. Ward et al., "User Experience, Feedback, and Testing," 17.
77. Giannis Tsakonas and Christos Papatheodorou, "Analysing and Evaluating Usefulness and Usability in Electronic Information Services," Journal of Information Science 32, no. 5 (2006): 400-419. (Pubitemid 44564376)
78. Williams and Foster, "Promise Fulfilled?"
79. Bob Thomas and Stefanie Buck, "OCLC's WorldCat Local Versus III's WebPAC: Which Interface is Better at Supporting Common User Tasks?" Library Hi Tech 28, no. 4 (2010): 648-71.
80. Williams and Foster, "Promise Fulfilled?"
81. Tracy Gabridge, Millicent Gaskell, and Amy Stout, "Information Seeking through Students' Eyes: The MIT Photo Diary Study," College & Research Libraries 69, no. 6 (2008): 510-22;
82. Yan Zhang, "Undergraduate Students' Mental Models of the Web as an Information Retrieval System," Journal of the American Society for Information Science & Technology 59, no. 13 (2008): 2087-98;
83. Brenda Reeb and Susan Gibbons, "Students, Librarians, and Subject Guides: Improving a Poor Rate of Return," Portal: Libraries and the Academy 4, no. 1 (2004): 123-30; (Pubitemid 38582793)
84. Alexandra Dimitroff, "Mental Models Theory and Search Outcome in a Bibliographic Retrieval System," Library & Information Science Research 14, no. 2 (1992): 141-56.
85. Birong Ho, Keith Kelley, and Scott Garrison, "Implementing VuFind as an Alternative to Voyager's Web Voyage Interface: One Library's Experience," Library Hi Tech 27, no. 1 (2009): 8292, DOI: 10.1108/07378830910942946 (accessed Jan. 11, 2012).
86. Jody Condit Fagan, "Usability Studies of Faceted Browsing: A Literature Review," Information Technology & Libraries 29, no. 2 (2010): 58-66, http://web2.ala.org/ala/mgrps/divs/lita/publications/ital/29/2/ fagan.pdf (accessed Jan. 11, 2012).