Evaluating the usability and usefulness of a digital library

Library Review

Volumn 58, Issue 9, 2009, Pages 638-651

  Buchanan, Steven ^a   Salako, Adeola ^a  

^a UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

Digital libraries; Systems analysis; User studies

Indexed keywords

EID: 70350308058     PISSN: 00242535     EISSN: None     Source Type: Journal    
DOI: 10.1108/00242530910997928     Document Type: Article

References (65)

1. Aborg, C., Sandblad, B., Gulliksen, J. and Lif, M. (2002), Integrating work environment considerations into usability evaluation methods- the ADA approach, Interacting with Computers, Vol. 15 No. 3, pp. 453-71.
2. Abran, A., Khelifi, A. and Suryn, W. (2003), Usability meanings and interpretations in ISO standards, Software Quality Journal, Vol. 11 No. 4, pp. 325-38.
3. Ahmed, S.M.Z., McKnight, C. and Oppenheim, C. (2006), A user-centred design and evaluation of IR interfaces, Journal of Librarianship and Information Science, Vol. 38 No. 3, pp. 157-72.
4. Aitta, M., Kaleva, S. and Kortelainen, T. (2008), Heuristic evaluation applied to library web services, New Library World, Vol. 109 Nos. 1/2, pp. 30-43.
5. Barry, C.L. and Schamber, L. (1998), Users' criteria for relevance evaluation: a cross-situational comparison, Information Processing and Management, Vol. 34 Nos. 2/3, pp. 219-36.
6. Benbunan-Fich, R. (2001), Using protocol analysis to evaluate the usability of a commercial web site, Information and Management, Vol. 39 No. 2, pp. 151-63.
7. Borlund, P. (2000), Experimental components for the evaluation of interactive information retrieval systems, The Journal of Documentation, Vol. 53 No. 1, pp. 71-90.
8. Borlund, P. and Ingwersen, P. (1997), The development of a method for the evaluation of interactive information retrieval systems, The Journal of Documentation, Vol. 53 No. 3, pp. 225-50.
9. Burgoon, J.K., Bonito, J.A., Bengtsson, B., Cederberg, C., Lundeberg, M. and Allspach, L. (2000), Interactivity in human-computer interaction: a study of credibility, understanding, and influence, Computers in Human Behaviour, Vol. 16 No. 6, pp. 553-74.
10. Burns, C.M., Vicente, K.J., Christoffersen, K. and Pawlak, W.S. (1997), Towards viable, useful and usable human factors design guidance, Applied Ergonomics, Vol. 28 Nos. 5/6, pp. 311-22.
11. De Angeli, A., Sutcliffe, A. and Hartmann, J. (2006), Interaction, usability and aesthetics; what influences users' preferences?, Proceedings of the Sixth Conference on Designing Interactive Systems, ACM, Sewickley, PA, pp. 271-80.
12. Dicks, R.S. (2002), Mis-usability: on the uses and misuses of usability testing, Proceedings of the 20th Annual International Conference on Computer Documentation, ACM, Toronto, pp. 26-30.
13. Dillon, A. (2001), Beyond usability: process, outcome and affect in human computer interactions, Canadian Journal of Information Science, Vol. 26 No. 4, pp. 57-69.
14. Dzida, W. (1995), Standards for user interfaces, Computer Standards and Interfaces, Vol. 17 No. 1, pp. 89-96.
15. Flavian, C., Guinaliu, M. and Gurrea, R. (2005), The role played by perceived usability, satisfaction and consumer trust on website loyalty, Information and Management, Vol. 43 No. 1, pp. 1-14.
16. Folmer, E. and Bosch, J. (2004), Architecting for usability: a survey, The Journal of Systems and Software, Vol. 70 Nos. 1/2, pp. 61-78.
17. Frokjaer, E., Hertzum, M. and Hornbak, K. (2000), Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press, The Hague, pp. 345-52.
18. Glosiene, A. and Manzhukh, Z. (2005), Towards a usability framework for memory institutions, New Library World, Vol. 106 Nos. 7/8, pp. 303-19.
19. Gonçalves, M.A., Moreira, B.L., Fox, E.A. and Watson, L.T. (2006), What is a good digital library? - A quality model for digital libraries, Information Processing and Management, Vol. 43 No. 5, pp. 1416-37.
20. Gordon, M. and Pathak, P. (1999), Finding information on the world wide web: the retrieval effectiveness of search engines, Information Processing and Management, Vol. 35 No. 2, pp. 141-80.
21. Granic, A. (2008), Experience with usability evaluation of e-learning systems, Universal Access in the Information Society, Vol. 7 No. 4, pp. 209-21.
22. Greenberg, S. and Buxton, B. (2008), Usability evaluation considered harmful (some of the time), Proceedings of the Twenty-sixth Annual SIGCHI Conference on Human Factors in Computing Systems, ACM, Florence, pp. 111-20.
23. Greisdorf, H. (2002), Relevance thresholds: a multi-stage predictive model of how users evaluate information, Information Processing and Management, Vol. 39 No. 3, pp. 403-23.
24. Hanson, K. and Castleman, W. (2006), Tracking ease-of-use metrics: a tried and true method for driving adoption of UCD in different corporate cultures, in Sherman, P. (Ed.), Usability Success Stories: How Organizations Improve by Making Easier-to-Use Software and Websites, Gower, Aldershot.
25. Hartmann, J. (2006), Assessing the attractiveness of interactive systems, CHI'06 Extended Abstracts on Human Factors in Computing Systems, ACM, Montreal, pp. 1755-6.
26. Hartson, H.R., Shivakumar, P. and Perez-Quinones, M.A. (2004), Usability inspection of digital libraries: a case study, International Journal of Digital Libraries, Vol. 4, pp. 108-23.
27. Hassan, S. and Li, F. (2005), Evaluating the usability and content usefulness of web sites: a benchmarking approach, Journal of Electronic Commerce in Organizations, Vol. 3 No. 2, pp. 48-64.
28. Haynes, S.R., Purao, S. and Skattebo, A.L. (2004), Situating evaluation in scenarios of use, Proceedings of the 2004 Conference on Computer Supported Cooperative Work, ACM, Chicago, IL, pp. 92-101.
29. Holzinger, A. (2005), Usability engineering methods of software developers, Communications of the ACM, Vol. 48 No. 1, pp. 71-4.
30. Hornbaek, K. (2006), Current practice in measuring usability: challenges to usability studies and research, International Journal of Human-Computer Studies, Vol. 64 No. 2, pp. 79-102.
31. Hu, P.J., Ma, P. and Chau, P.Y.K. (1999), Evaluation of user interface designs for information retrieval systems: a computer-based experiment, Decision Support Systems, Vol. 27 Nos. 1/2, pp. 125-43.
32. Kan, S.H. (2003), Metrics and Models in Software Quality Engineering, Pearson Education, Boston, MA.
33. Karat, C.M., Campbell, R. and Fiegel, T. (1992), Comparison of empirical testing and walkthrough methods in user interface evaluation, Proceedings of the SIGCHI Conference in Human Factors in Computing Systems, ACM, Monterey, pp. 397-404.
34. Kelly, D., Harper, D.J. and Landau, B. (2008), Questionnaire mode effects in interactive information retrieval experiments, Information Processing and Management, Vol. 44 No. 1, pp. 122-41.
35. Kirmani, S. and Rajasekaran, S. (2005), Heuristic evaluation quality score (HEQS): a measure of heuristic evaluation skills, Journal of Usability Studies, Vol. 2 No. 2, pp. 61-75.
36. Kushniruk, A.W. and Patel, V.L. (2004), Cognitive and usability engineering methods for the evaluation of clinical information systems, Journal of Biomedical Informatics, Vol. 37 No. 1, pp. 56-76.
37. Lavery, D., Cockton, G. and Atkinson, M.P. (1997), Comparison of evaluation methods using structured usability problem reports, Behaviour and Information Technology, Vol. 16 No. 4, pp. 246-66.
38. Lewis, R.J. (1993), IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use, International Journal of Human-Computer Interaction, Vol. 7 No. 1, pp. 57-78.
39. Liu, Z. (2004), Perceptions of credibility of scholarly information on the web, Information Processing and Management, Vol. 40 No. 6, pp. 1027-38.
40. Molich, R. and Jeffries, R. (2003), Comparative expert reviews, CHI'03 Extended Abstracts in Human Factors in Computing Systems, ACM, pp. 1060-1.
41. Nielsen, J. (1993), Usability Engineering, Morgan Kaufmann, San Francisco, CA.
42. Nielsen, J. (2000), Designing Web Usability, New Riders, Indianapolis, IN.
43. Otter, M. and Johnson, H. (2000), Lost in hyperspace: metrics and mental models, Interacting with Computers, Vol. 13 No. 1, pp. 1-40.
44. Pearson, J.M., Pearson, A. and Green, D. (2007), Determining the importance of key criteria in web usability, Management Research News, Vol. 30 No. 11, pp. 816-28.
45. Petrelli, D. (2008), On the role of user-centred evaluation in the advancement of interactive information retrieval, Information Processing and Management, Vol. 44 No. 1, pp. 22-38.
46. Pipino, L.L., Lee, Y.W. and Wang, R.Y. (2002), Data quality assessment, Communications of the ACM, Vol. 45 No. 4, pp. 211-8.
47. Rubin, J. (1994), Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, Wiley, Toronto.
48. Savolainen, R. (2008), Source preferences in the context of seeking problem-specific information, Information Processing and Management, Vol. 44 No. 1, pp. 274-93.
49. Seffah, A., Donyaee, M., Kline, R.B. and Padda, H.K. (2006), Usability measurement and metrics: a consolidated model, Software Quality Journal, Vol. 14 No. 2, pp. 159-78.
50. Smith, P.A. (1996), Towards a practical measure of hypertext usability, Interacting with Computers, Vol. 8 No. 4, pp. 365-81.
51. Thornley, C. and Gibb, F. (2007), A dialectical approach to information retrieval, Journal of Documentation, Vol. 63 No. 5, pp. 755-64.
52. Tombros, A., Ruthven, I. and Jose, J.M. (2004), How users assess web pages for information- seeking, Journal of the American Society for Information Science and Technology, Vol. 56 No. 4, pp. 327-44.
53. Tractinsky, N. (1997), Aesthetics and apparent usability: empirically assessing cultural and methodological issues, CHI 97, Atlanta, 22-27 March, p. 116.
54. Tractinsky, N., Katz, A.S. and Ikar, D. (2000), What is beautiful is usable?, Interacting with Computers, Vol. 13 No. 2, pp. 127-45.
55. Tsakonas, G. and Papatheodorou, C. (2006), Analyzing and evaluating usefulness and usability in electronic information services, Journal of Information Science, Vol. 32 No. 5, pp. 400-19.
56. Tsakonas, G. and Papatheodorou, C. (2008), Exploring usefulness and usability in the evaluation of open access digital libraries, Information Processing and Management, Vol. 44 No. 3, pp. 1234-50.
57. Vakkari, P. and Hakala, P. (2000), Changes in relevance criteria and problem stages in task performance, Journal of Documentation, Vol. 56 No. 5, pp. 540-62.
58. Wathen, C.N. and Burkell, J. (2002), Believe it or not: factors influencing credibility on the web, Journal of the American Society for Information Science and Technology, Vol. 53 No. 2, pp. 134-44.
59. Wang, R.Y., Reddy, M.P. and Kon, H.B. (1995), Toward quality data: an attribute-based approach, Decision Support Systems, Vol. 13 Nos. 3/4, pp. 349-72.
60. Webster, R. and Williams, P. (2005), An evaluation of the NHS direct online health information e-mail enquiry service: quality of health information on the internet, Aslib Proceedings: New Information Perspectives, Vol. 57 No. 1, pp. 48-62.
61. Xie, H. (2006), Evaluation of digital libraries: criteria and problems from users' perspectives, Library and Information Science Research, Vol. 28 No. 3, pp. 433-52.
62. Xie, H. (2008), Users' evaluation of digital libraries (DLs): their uses, their criteria, and their assessment, Information Processing and Management, Vol. 44 No. 3, pp. 1346-73.
63. Yang, Z., Cai, S., Zhou, Z. and Zhou, N. (2005), Development and validation of an instrument to measure user perceived service quality of information presenting web portals, Information and Management, Vol. 42 No. 4, pp. 575-89.
64. Yu, H. and Kaufman, D. (2007), A cognitive evaluation of four online search engines for answering definitional questions posed by physicians, Proceedings of the Pacific Symposium on Biocomputing, World Scientific, Maui, pp. 328-39.
65. Yushiana, M. and Rani, W.A. (2007), Heuristic evaluation of interface usability for a web-based OPAC, Library Hi Tech, Vol. 25 No. 4, pp. 538-49.