From usage to user: Library metrics and expectations for the evaluation of digital libraries

Evaluation of Digital Libraries: An Insight Into Useful Applications and Methods

Volumn , Issue , 2009, Pages 17-39

  Franklin, Brinley ^a   Kyrillidou, Martha ^c   Plum, Terry ^b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b Simmons Graduate School of Library and Information Science   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

BIOMEDICAL ENGINEERING;

DIGITAL LIBRARIES;

EID: 77954641149     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-1-84334-484-1.50002-8     Document Type: Chapter

References (37)

1. Measures for electronic resources (E-Metrics) 2002, Association of Research Libraries, available at:, (accessed 8 August 2008). http://www.arl.org/bm~doc/emetrics.pdf.zip.
2. ARL Statistics 2005-06 2008, Association of Research Libraries, available at:, (accessed 28 July 2008). http://www.arl.org/bm~doc/arlstats06.pdf.
3. Baker G., Read E.J. Vendor-supplied usage data for electronic resources: a survey of academic libraries. Learned Publishing 2008, 21(1):48-57.
4. Bertot J.C., McClure C.M. Outcomes assessment in the networked environment: Research questions, issues, considerations, and moving forward. Library Trends 2003, 51(4):590-613.
5. Bertot J.C., Davis D.M. Planning and Evaluating Library Networked Services and Resources 2005, Libraries Unlimited, Westport, CT.
6. Bollen J., Rodriguez M.A., Van de Sompel H. MESUR: Usage-based metrics of scholarly impact. Proceedings of the 7th ACM/IEEE-CS Joint Conference on Digital Libraries Vancouver, BC 2007, 474-475. ACM Press, New York, June.
7. Conyers A., Dalton P. Electronic resource measurement: Linking research to practice. Library Quarterly 2007, 77(4):463-470.
8. Trustworthy Repositories Audit and Certification (TRAC): Criteria and Checklist 2007, Center for Research Libraries, Center for Research Libraries and OCLC, Chicago, IL.
9. Davis P.M., Connolly M.J.L. Institutional repositories: evaluating the reasons for non-use of Cornell University's installation of DSpace. D-Lib Magazine 2007, 12(3/4). available at:, (accessed 8 August 2008). http://www.dlib.org/dlib/march07/davis/03davis.html.
10. Library Assessment Conference: Building Effective, Sustainable and Practical Assessment 2007, ARL, Washington, DC. F. DeFranco, S. Hiller, L. Janicke Hinchliffe, K. Justh, M. Kyrillidou, J. Self (Eds.).
11. Franklin B., Plum T. Successful web survey methodologies for Measuring the Impact of Networked Electronic Services (MINES for Libraries). IFLA Journal 2006, 32(1):28-40.
12. Franklin B., Plum T. Assessing the value and impact of digital content. Journal of Library Administration 2008, 48(1):1-57.
13. Galvin T., Kent A. Use of a university library collection. Library Journal 1977, 102(20):2317-2320.
14. Hiller S., Kyrillidou M., Self J. When evidence isn't enough: Organizational factors that influence effective, sustainable and practical assessment. Performance Measurement and Metrics 2008, 9(3):223-230.
15. Jamali H.R., Nicholas D., Huntington P. Use and users of scholarly e-journals: a review of log analysis studies. Aslib Proceedings 2005, 57(6):554-571.
16. Digital curation and trusted repositories: seeking success JCDL, available at:, (accessed 8 August 2008). http://sils.unc.edu/events/2006jcdl/digitalcuration/.
17. Kyrillidou M., Olshen T., Franklin B., Plum T. MINES for Libraries™: Measuring the Impact of Networked Electronic Services and the Ontario Council of University Libraries' Scholar Portal, Final report, January 2006, ARL, Washington, DC, 26.
18. Lakos A. 'Evidence-based library management. The leadership challenge', portal: Libraries and the Academy 2007, 7(4):431-450.
19. McDonald J. Usage statistics and information behaviors: understanding user behavior with quantitative indicators. paper presented at NISO 2007: Understanding the Data Around Us: Gathering and Analyzing Usage Data, Dallas 2007, (accessed 8 August 2008). TX, 1-2 November, available at:. http://www.niso.kavi.com/news/events/niso/past/usage07/usage07mcdonald.pdf.
20. Montgomery C.H., King D.W. Comparing library and user related costs of print and electronic journal collections: a first step towards a comprehensive analysis. D-Lib Magazine 2002, 8(10). available at:, (accessed 8 August 2008). http://www.dlib.org/dlib/october02/montgomery/10montgomery.html.
21. Library Assessment Conference Papers 2007, ARL, Thessaloniki, Greece, Washington, DC, 13-15 June 2005. M. Moreleli-Cacouris (Ed.).
22. Nicholas D., Huntington P., Jamali H., Tenopir C. What deep log analysis tells us about the impact of big deals: case study OhioLINK. Journal of Documentation 2005, 62(4):482-508.
23. Evaluation criteria OARiNZ, available at:, (accessed 8 August 2008). http://www.oarinz.ac.nz/oarinzwiki/index.php?n=OARiNZ.EvaluationCriteria.
24. Obst O. Patterns and cost of printed and online journal usage. Health Information and Libraries Journal 2003, 20(1):22-32.
25. Proudman V. The population of repositories. A DRIVER's Guide to European Repositories 2007, 49-101. AUP, Amsterdam. K. Weenink, L. Waaijers, K. van Godtsenhoven (Eds.).
26. Reeves T., Apedoe X., Woo Y. Evaluating digital libraries: A user-friendly guide (revised version) available at:, (accessed 28 November 2008). http://www.dpc.ucar.edu/projects/evalbook/index.html.
27. Rowlands I. Electronic journals and user behavior: A review of recent research. Library and Information Science Research 2007, 29(3):369-396.
28. Samson S., Derry S., Eggleston H. Networked resources, assessment and collection development. The Journal of Academic Librarianship 2004, 30(6):476-481.
29. Schonfeld R.C., King D.W., Okerson A., Gifford Fenton E. The Nonsubscription Side of Periodicals: Changes in Library Operations and Costs between Print and Electronic Formats 2004, CLIR, Washington, DC.
30. Snead J.T., Bertot J.C., Jaeger P.T., McClure C.R. Developing multi-method, iterative, and user-centered evaluation strategies for digital libraries: functionality, usability, and accessibility. paper presented at the Annual Meeting of the American Society for Information Science and Technology 2005, Charlotte, NC, 28 October to 2 November, available at:, (accessed 8 August 2008). http://www.eprints.rclis.org/archive/00005268/.
31. Stemper J.A., Jaguszewski J.M. Usage statistics for electronic journals: an analysis of local and vendor counts. Collection Management 2003, 28(4):3-22.
32. Tenopir C. Use and Users of Electronic Library Resources: An Overview and Analysis of Recent Research Studies 2003, CLIR, Washington, DC.
33. Thompson B., Kyrillidou M., Cook C. 'On-premises library use versus. Google-like information gateway usage patterns: a LibQUAL+® study', portal: Libraries and the Academy 2008, 7(4):463-480.
34. Westell M. Institutional repositories in Canada - institutional repositories: proposed indicators of success'. Library Hi Tech 2006, 24(2):211-226.
35. White A., Kamal E.D. E-Metrics for Library and Information Professionals: How to Use Data for Managing and Evaluating Electronic Resources Collections 2006, Neal- Shuman, New York.
36. Wright S., White L.S. Library Assessment: ARL Spec Kit 303 2007, ARL, Washington, DC.
37. Zucca J. Building frameworks of organizational intelligence. paper presented at the Library Assessment Forum, University of Pennsylvania 2008, (accessed 8 August 2008). Philadelphia, PA, 11 January, available at:. http://www.libqual.org/documents/admin/zuccaarl08.ppt.