Exploring usefulness and usability in the evaluation of open access digital libraries

Information Processing and Management

Volumn 44, Issue 3, 2008, Pages 1234-1250

  Tsakonas, Giannis ^a   Papatheodorou, Christos ^a  

^a Laboratory on Digital Libraries and Electronic Publishing   (Greece)

Author keywords

Digital libraries evaluation; e Prints; Interaction; Open access; Usability; Usefulness

Indexed keywords

DATA PROCESSING; ECONOMIC ANALYSIS; INFORMATION MANAGEMENT; INFORMATION RETRIEVAL;

DIGITAL LIBRARIES EVALUATION; E-PRINTS; INTERACTION; OPEN ACCESS;

DIGITAL LIBRARIES;

EID: 40649099823     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2007.07.008     Document Type: Article

References (67)

1. Allen M. A case study of the usability testing of the University of South Florida's virtual library interface design. Online Information Review 26 1 (2002) 40-53
2. Allen, J. (2005). Interdisciplinary differences in attitudes towards deposit in institutional repositories. Master Thesis in Department of Information and Communications, Manchester Metropolitan University (UK). http://eprints.rclis.org/archive/00005180/ (retrieved 27.04.07).
3. Andrew T. Trends in self-posting of research material online by academic staff. Ariadne 37 (2003). http://www.ariadne.ac.uk/issue37/andrew/intro.html http://www.ariadne.ac.uk/issue37/andrew/intro.html (retrieved 27.04.07)
4. Bertot J.C., Snead J.T., Jaeger P.T., and McClure C.R. Functionality, usability, and accessibility: Iterative user-centered evaluation strategies for digital libraries. Performance Measurement and Metrics 7 1 (2006) 17-28
5. Brennan P.B.M., Burkhardt J., McMullen S., and Wallace M. What does electronic full-text really mean? A comparison of database vendors and what they deliver. Reference Services Review 27 2 (1999) 113-126
6. Center for Research Libraries. General factors to consider in evaluating digital repositories. Focus 25 2 (2006) 3-4
7. Chowdhury S., Landoni M., and Gibb F. Usability and impact of digital libraries: A review. Online Information Review 30 6 (2006) 656-680
8. Cockrell B.J., and Jayne E.A. How do I find an article? Insights from a web usability study. Journal of Academic Librarianship 28 3 (2002) 122-132
9. Correia A.M.R., and Castro Neto M. The role of eprint archives in the access to, and dissemination of, scientific grey literature: LIZA-a case study by the National Library of Portugal. Journal of Information Science 6 28 (2002) 231-241
10. Covey D.T. Usage and usability assessment: Library practices and concerns (2002), Digital Library Federation, CLIR, Washington, DC
11. Davis P.M., and Connolly M.J.L. Institutional repositories: Evaluating the reasons for nonuse of Cornell University's installation of DSpace. D-Lib Magazine 13 3/4 (2007). http://dlib.org/dlib/march07/davis/03davis.html http://dlib.org/dlib/march07/davis/03davis.html (retrieved 29.05.07)
12. Delone W.H., and McLean E.R. Information systems success: The quest for the depending variable. Information Systems Research 3 1 (1992) 60-95
13. Ebenezer C. Usability evaluation of an NHS library website. Health Information and Libraries Journal 20 3 (2003) 134-142
14. Ferreira S.M., and Pithan D.N. Usability of digital libraries: A study based on the areas of information science and human-computer interaction. OCLC Systems and Services 21 4 (2005) 311-323
15. Fuhr N., Hansen P., Mabe M., Micsik A., and Sølvberg I. Digital libraries: A generic classification and evaluation scheme. Proceedings of the 5th European conference on Digital Libraries 2001: LNCS Vol. 2163 (2002), Springer, Berlin 187-199
16. Fuhr, N., Tsakonas, G., Aalberg, T., Agosti, M., Hansen, P., Kapidakis, S., et al. (in press). Evaluation of digital libraries. International Journal on Digital Libraries, doi:10.1007/s00799-007-0011-z.
17. Fuller D.M., and Hinegardner P.G. Ensuring quality website redesign: The University of Maryland's experience. Bulletin of the Medical Library Association 89 4 (2001) 339-345
18. Goh D.H., Chua A., Khoo D.A., Khoo E.B., Mak E.B., and Ng M.P. A checklist for evaluating open source digital library software. Online Information Review 30 4 (2006) 360-379
19. Hartson R.H., Shivakumar P., and Pérez-Quiñones M.A. Usability inspection of digital libraries: A case study. International Journal on Digital Libraries 4 2 (2004) 108-123
20. Heery, R., & Anderson, S. (2005). Digital repositories review. Report by UKOLN and AHDS. http://www.jisc.ac.uk/uploaded_documents/digital-repositories-review- 2005.pdf (retrieved 24.01.07).
21. Hitchcock, S., Woukeu, A., Brody, T., Carr, L., Hall, W., & Harnad, S. (2002). Evaluating Citebase, an open access Web-based citation-ranked search and impact discovery service. http://opcit.eprints.org/evaluation/Citebase-evaluation/evaluation- report.html (retrieved 24.01.07).
22. Hong W., Thong J.Y.L., Hong W., and Tam K. Determinants of user acceptance of digital libraries: an empirical examination of individual differences and system characteristics. Journal of Management Information Systems 18 3 (2002) 97-124
23. Jackson M. A user centered approach to the evaluation of a hybrid library. Performance Measurement and Metrics 2 2 (2001) 97-107
24. Järvelin K., and Ingwersen P. Information seeking research needs extension towards tasks and technology. Information Research 10 1 (2004). http://InformationR.net/ir/10-1/paper212.html http://InformationR.net/ir/10-1/paper212.html (retrieved 24.01.07)
25. Jeng J. What is usability in the context of digital library and how it can be measured?. Information Technology and Libraries 24 2 (2005) 47-56
26. Kani-Zabihi E., Ghinea G., and Chen S.Y. Digital libraries: What do users want?. Online Information Review 30 4 (2006) 395-412
27. Kengeri R., Seals C.D., Harley H.D., Reddy H.P., and Fox E.A. Usability study of digital libraries: ACM, IEEE-CS, NCSTRL, NDLTD. International Journal on Digital Libraries 2 2-3 (1999) 157-169
28. Kim, K. (2002). A model-based approach to usability evaluation for digital libraries. In A. Blandford & G. Buchanan (Eds.) JCDL'02 Workshop on usability of Digital Libraries. http://www.uclic.ucl.ac.uk/annb/docs/Kim33.pdf (retrieved 27.04.07).
29. Kim J. Finding documents in a digital institutional repository: DSpace and Eprints. Proceedings of the American Society for Information Science and Technology 42 1 (2005)
30. Kim, J. (2006). Motivating and impeding factors affecting faculty contribution to institutional repositories. In Digital curation and trusted repositories: Seeking success workshop, June 15, 2006 in conjunction with Joint conference on Digital Libraries (JCDL 2006, June 11-15, 2006 - Chapel Hill, NC, USA). http://sils.unc.edu/events/2006jcdl/digitalcuration/Kim-JCDLWorkshop2006.pdf (retrieved 29.05.07).
31. Kobayashi M., and Takeda K. Information retrieval on the web. ACM Computing Surveys 32 2 (2000) 144-173
32. Koohang A., and Ondracek J. Users' views about the usability of digital libraries. British Journal of Educational Technology 36 3 (2005) 407-423
33. Krottmaier H. Current and future features of digital journals. In: Shafazand M.H., and Tjoa A.M. (Eds). EurAsia-ICT 2002: Information and communication technology: First EurAsian Conference: LNCS. Vol. 2510 (2002), Springer, Berlin 495-502
34. Kurata K., Matsubayashi M., Mine S., Muranushi T., and Ueda S. Electronic journals and their unbundled functions in scholarly communication: Views and utilization by scientific, technological and medical researchers in Japan. Information Processing and Management 43 5 (2006) 1402-1415
35. Kyrillidou M., and Giersch S. Developing the DigiQUAL protocol for digital library evaluation. Proceedings of the 5th ACM/IEEE-CS joint conference on Digital Libraries (2005), ACM Press, New York, NY 172-173
36. Landoni M., and Bell S. Information retrieval techniques for evaluating search engines: A critical overview. Aslib Proceedings 52 3 (2000) 124-129
37. Liaw S., and Huang H. An investigation of user attitudes towards search engines as an information retrieval tool. Computers in Human Behavior 19 6 (2003) 751-762
38. Liu Z. Perceptions of credibility of scholarly information on the web. Information Processing and Management 40 6 (2004) 1027-1038
39. Luce (2001). E-prints intersect the digital library: Inside the Los Alamos arXiv. Issues in Science and Technology Librarianship (29). http://www.istl.org/01-winter/article3.html (retrieved 29.05.07).
40. McMullen S. Usability testing in a library Web site redesign project. Reference Services Review 29 1 (2001) 7-22
41. Mercer, L. S. (2000). Measuring the use and the value of electronic journals and books. Issues in science and technology librarianship, 25, (retrieved 11.08.07).
42. Moyo L.M. Collections on the Web: Some access and navigation issues. Library Collections, Acquisitions, and Technical Services 26 1 (2002) 47-59
43. Nicholas D., Huntington P., and Rowlands I. Open access journal publishing: the views of some of the world's senior authors. Journal of Documentation 61 4 (2005) 497-519
44. Nunnaly J.C., and Bernstein I.H. Psychometric theory. 3rd ed. (1994), McGraw-Hill, New York
45. Park S. Usability, user preferences, effectiveness, and user behaviors when searching individual and integrated full-text databases: Implications for digital libraries. Journal of the American Society for Information Science 51 5 (2000) 456-468
46. Rowlands I., and Nicholas D. Scholarly communication in the digital environment: The 2005 survey of journal author behaviour and attitudes. Aslib Proceedings: New Information Perspectives 57 6 (2005) 481-497
47. Saracevic, T. (2004). Evaluation of digital libraries: An overview. In Notes of the DELOS WP7 workshop on the evaluation of Digital Libraries, Padua, Italy. http://dlib.ionio.gr/wp7/workshop2004_program.html (retrieved 30.04.07).
48. Shearer K. Institutional repositories: Towards the identification of critical success factors. Canadian Journal of Information and Library Science 27 3 (2003). http://hdl.handle.net/1880/43357 http://hdl.handle.net/1880/43357 (retrieved 02.05.07)
49. Silva L.V., Laender A.H.F., and Gonçalves M.A. A usability evaluation study of a digital library self-archiving service. Proceedings of the 5th ACM/IEEE-CS joint conference on digital libraries (2005), Denver, CO, USA, ACM Press, New York, NY 176-177
50. Silva L.V., Laender A.H.F., and Gonçalves M.A. Evaluating a digital library self-archiving service: The BDBComp user case study. Information Processing and Management 43 4 (2007) 1103-1120
51. Stelmaszewska, H., & Blandford, A. (2002). Patterns of interactions: User behaviour in response to search results. In A. Blandford & G. Buchanan (Eds.), JCDL '02 Workshop on usability of digital libraries. (retrieved 11.08.07).
52. Sutcliffe G., Ennis M., and Hu J. Evaluating the effectiveness of visual user interfaces for information retrieval. International Journal of Human-Computer Studies 53 5 (2000) 741-763
53. Swan A., and Brown S. Open access self-archiving: An author study (2005), Key Perspectives Limited
54. Theng Y.L., Duncker E., Mohd-Nasir N., Buchanan G., and Thimbleby H. Design guidelines and user-centred digital libraries. Proceedings of the 3rd European conference on Digital Libraries 2001: LNCS. Vol. 1696 (1999), Springer, Berlin 167-183
55. Thong J.Y.L., Hong W., and Tam K. Understanding user acceptance of digital libraries: What are the roles of interface characteristics, organizational context, and individual differences?. International Journal of Human-Computer Studies 57 3 (2002) 215-242
56. Toms E.G. Information interaction: Providing a framework for information architecture. Journal of the American Society for Information Science and Technology 53 10 (2002) 855-862
57. Tsakonas, G., Kapidakis, S., & Papatheodorou, C. (2004). Evaluation of user interaction in digital libraries. In Notes of the DELOS WP7 workshop on the evaluation of Digital Libraries, Padua, Italy. http://dlib.ionio.gr/wp7/workshop2004_program.html (retrieved 24.01.07).
58. Tsakonas G., and Papatheodorou C. Analysing and evaluating usefulness and usability in electronic information services. Journal of Information Science 32 5 (2006) 400-419
59. Vakkari P., and Hakala P. Changes in relevance criteria and problem stages in task performance. Journal of Documentation 56 5 (2000) 540-562
60. Van House N.A., Butler M.H., Ogle V., and Schiff L. User-centered iterative design for digital libraries: The Cypress experience. D-Lib Magazine 2 2 (1996). http://www.dlib.org/dlib/february96/02vanhouse.html http://www.dlib.org/dlib/february96/02vanhouse.html (retrieved 24.01.07)
61. Wilson T.D. Models in information behaviour research. Journal of Documentation 55 3 (1999) 249-270
62. Wolfram D., and Xie H. Traditional IR for web users: A context for general audience digital libraries. Information Processing and Management 38 5 (2002) 627-648
63. Wyles, R., Maxwell, M., & Yamog, J. (2006). Technical evaluation of selected open source repository solutions. https://eduforge.org/docman/view.php/131/1062/RepositoryEvaluationDocument.pdf (retrieved 24.01.07).
64. Xie H. Online IR system evaluation: Online databases versus Web search engines. Online Information Review 28 3 (2004) 211-219
65. Xie H. Evaluation of digital libraries: Criteria and problems from users' perspectives. Library and Information Science Research 28 3 (2006) 433-452
66. Xu Q. Content management and resources integration: a practice in Shanghai Digital Library. Proceedings the 7th international conference on Asian Digital Libraries, ICADL 2004, Digital Libraries: International collaboration and cross-fertilization: LNCS. Vol. 3334 (2004), Springer, Berlin 25-34
67. Yang Z., Cai S., Zhou Z., and Zhou N. Development and validation of an instrument to measure user perceived service quality of information presenting web portals. Information and Management 42 4 (2004) 575-589