The evolution of measurement and evaluation of libraries: A perspective from the association of research libraries

Library Trends

Volumn 56, Issue 4, 2008, Pages 888-909

  Kyrillidou, Martha ^a   Cook, Colleen ^b,c  

^a ASSOCIATION OF RESEARCH LIBRARIES   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c IFLA Statistics and Evaluation Section Committee

Author keywords

[No Author keywords available]

Indexed keywords

EID: 52649107465     PISSN: 00242594     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (84)

1. Baker, S. L., & Lancaster, F. W. (1991). Measurement and evaluation of library services (2nd ed.). Arlington, VA.: Information Resources Press.
2. Baker, S. L., & Wallace, K. L. (2002). The responsive public library: How to develop and market a winning collection. Englewood, CO: Libraries Unlimited.
3. Baughman, M. S., Love, J., Lowry, C., & Saponaro, M. (2007). From organizational assessment to organizational change: The University of Maryland Library experience. In Francine DeFranco et al. (Eds.), Proceedings of the Library Assessment Conference: Building effective, sustainable, practical assessment, September 25-27, 2006, Charlottesville, VA. (pp. 319-329). Washington, DC: Association of Research Libraries.
4. Bertot, J. C., & Jaeger, P. T. (2008). Survey research and libraries: Not necessarily like in the textbooks. Library Quarterly, 78(1), 99-106.
5. Bleiler, R., & Plum, T. (1999). SPEC Kit 253: Networked information resources. Washington, DC: Association of Research Libraries. Retrieved March 03, 2008, from http://www.arl.org/bm~doc/spec253web.pdf.
6. Blixrud, J. C. (2003, October/December). Mainstreaming new measures. ARL Bimonthly Report 230/231, 1-8. Retrieved March 3, 2008, from http://www.arl.org/newsltr/230/mainstreaming.html.
7. Booz, A., & Hamilton, Inc. (1973). Organization and staffing of the libraries of Columbia University: A case study. Westport, CT: Redgrave Information Resources.
8. Cook, C. (2001). A mixed-methods approach to the identification and measurement of academic library service quality constructs: LibQUAL+™ (PhD diss., Texas A&M University, 2001). Dissertation Abstracts International, 62: 2295A. (University of Microfilms No. AAT3020024 62).
9. Cook, C. (2006). The importance of the LibQUAL+® survey for the Association of Research Libraries and Texas A&M University. In Mersini Moreleli-Cacouris (Ed.), Library assessment conference-Thessaloniki 13-15 June 2005 (pp. 55-74). Washington, DC: Association of Research Libraries. Retrieved March 3, 2008, from http://www.arl.org/bm~doc/lac-greece-2005.pdf.
10. Cook, C., & Heath, F. (2001). Users' perceptions of library service quality: A LibQUAL+™ qualitative study. Library Trends, 49(4), 548-584.
11. Cook, C., Heath, F., Kyrillidou, M., Lincoln, Y., Thompson, B., & Webster, D. (2003, October) . Developing a National Science Digital Library (NSDL) LibQUAL+™ protocol: An e-service for assessing the library of the 21st century. A report submitted for the NSDL Evaluation Workshop. Retrieved March 3, 2008, from http://www.libqual.org/documents/admin/NSDL_workshop_web1. pdf.
12. Cook, C., Heath, F., Kyrillidou, M., & Webster, D. (2002). The forging of consensus: A methodological approach to service quality assessment. In Joan Stein, Martha Kyrillidou and Denise Davis (Eds.), Proceedings of the 4th Norhumbria International Conference on Performance Measurement in Libraries and Information Services "Meaningful measures for emerging realities". Washington DC: Association of Research Libraries, 93-98.
13. Cook, C., Heath, F., & Thompson, B. (2001). Users' hierarchical perspectives on library service quality: A "LibQUAL+" study. College and Research Libraries, 62, 147-153.
14. Cook, C., Heath, F., & Thompson, B. (2002). Score norms for improving library service quality: A LibQUAL+™ study, portal: Libraries and the Academy, 2(1), 13-26.
15. Cook, C., Heath, F., & Thompson, B. (2003). "Zones of tolerance" in perceptions of library service quality: A LibQUAL+™ study, portal: Libraries and the Academy, 3(1), 113-123.
16. Cook, C., Heath, F., Thompson, B., & Thompson, R. L. (2001). LibQUAL+™: Service quality assessment in research libraries. IFLA Journal 4, 264-268.
17. Cook, C., & Thompson, B. (2001). Psychometric properties of scores from the Web-based LibQUAL+ study of perceptions of library service quality. Library Trends, 49(4), 585-604.
18. Franklin, B. (2006). Measuring the Impact of Networked Electronic Service (MINES): The North American experience. In Mersini Moreleli-Cacouris (Ed.), Library Assessment Conference - Thessaloniki 13-15 June 2005 (pp. 75-94). Washington, DC: Association of Research Libraries. Retrieved March 3, 2008, from http://www.arl.org/bm~doc/lacgreece-2005.pdf.
19. Franklin, B. (2007a). The privatization of public university research libraries. portal: Libraries and the Academy, 7, 407-414.
20. Franklin, B. (2007b). Return on investment. In Francine DeFranco et al. (Eds.), Proceedings of the Library Assessment Conference: Building effective, sustainable, practical assessment, September 25-27, 2006, Charlottesville, VA. (pp. 127-130). Washington, DC: Association of Research Libraries.
21. Franklin, B., & Plum, T. (2002). Patterns of patron use of networked electronic services at four academic health sciences libraries. Performance Measurement and Metrics, 3(3), 123-133. Retrieved March 3, 2008, from http://www.emeraldinsight.com/1467-8047.htm.
22. Franklin, B., & Plum, T. (2003). Documenting usage patterns of networked electronic services. ARL: Bimonthly Report. 230/231 (October/December) : 20-21. Retrieved March 3, 2008, from http://www.arl.org/ newsltr/230/usage.html.
23. Franklin, B., & Plum, T. (2004). Library usage patterns in the electronic information environment. Information Research: An International Electronic Journal, 9(4), paper 187. Retrieved March 3, 2008, from http://informationr.net/ir/about.html.
24. Franklin, B. & Plum, T. (2006). Successful Web survey methodologies for Measuring the Impact of Networked Electronic Services (MINES for libraries). IFLA Journal 32(1), 28-40. Retrieved March 3, 2008, from http://www.ifla.org/V/iflaj/IFLA-Journal-1-2006.pdf.
25. Hanges, P. J., Aiken, J., & Chen, X. (2007). Diversity, organizational climate, and organizational culture: The role they play in influencing organizational effectiveness. In Francine DeFranco et al. (Eds.), Proceedings of the Library Assessment Conference: Building effective, Sustainable, Practical Assessment, September 25-27, 2006, Charlottesville, VA. (pp. 359-368). Washington, DC: Association of Research Libraries.
26. Heath, F., Cook, C., Kyrillidou, M., & Thompson, B. (2002). ARL Index and other validity correlates of LibQUAL+™ scores. portal: Libraries and the Academy, 2, 27-42.
27. Hiller, S., Kyrillidou, M., & Self, J. (2006) Assessment in North American research libraries: A preliminary report card. Performance Measurement and Metrics: The International Journal for Library and Information Services, 7(2), 100-106.
28. Hiller, S., Kyrillidou, M., & Self, J. (2007a). When the evidence isn't enough: Organizational factors that influence effective and successful library assessment. Presented at the Evidence Based Library and Information Science Conference. Retrieved March 3, 2008, from http://www.libqual.org/ documents/admin/HIller2.pdf.
29. Hiller, S., Kyrillidou, M., & Self, J. (2007b). Keys to effective, sustainable and practical library assessment. In Francine DeFranco et al. (Eds.), Proceedings of the Library Assessment Conference: Building effective, sustainable, practical assessment, September 25-27, 2006, Charlottesville, VA. (pp. 171-176). Washington, DC: Association of Research Libraries.
30. Hiller, S., & Self, J. (2004). From measurement to management: Using data wisely for planning and decision-making. Library Trends, 53(1), 129-155.
31. Hoseth, A. E. (2007). We did LibQUAL+®-Now what? Practical suggestions for maximizing your survey results. College and Undergraduate Libraries, 4(3), 75-84.
32. Kyrillidou, M. ( 1990). User survey of the library of the English Department, Aristotle University, Thessaloniki, Greece. (Master's thesis, Kent State University, 1990).
33. Kyrillidou, M. (2000). Research library trends: ARL Statistics. Journal of Academic Librarianship, 26(6), 427-436.
34. Kyrillidou, M. (2002). From input and output measures to quality and outcome measures, or, From the user in the life of the library to the library in the life of the user. Journal of Academic Librarianship, 28(1), 42-46.
35. Kyrillidou, M. (2005). [Translated citation - original in Greek] The globalization of library assessment and the role of LibQUAL+ (tm). From library science to information science: Studies in honor of G. Kakouri (Thessaloniki). Retrieved March 3, 2008, from http://www.libqual.org/documents/ admin/libqual_greek2004.pdf.
36. Kyrillidou, M. (2005/2006). Library assessment as a collaborative enterprise. Resource Sharing & Information Networks, 18(1/2), 73-87.
37. Kyrillidou, M. (2006b). Service quality: A perceived outcome for libraries. In P. Hernon, R. E. Dungan, and C. Schartz (Eds.), Revisiting outcomes assessment in higher education. Westport, Connecticut: Libraries Unlimited, pp. 351-366.
38. Kyrillidou, M. (2006a). Library assessment: Why today and not tomorrow? In Mersini MoreleliCacouris (Ed.), Library Assessment Conference-Thessaloniki 13-15 June 2005 (pp. 9-27). Washington, DC: Association of Research Libraries. Retrieved March 3, 2008, from http://www.arl.org/bm-doc/lac-greece- 2005.pdf.
39. Kyrillidou, M. (2008, February). Reshaping ARL statistics to capture the new environment. ARL Bimonthly Report, 256, 9-11.
40. Kyrillidou, M., & Crowe, W. (1998). In search of new measures. ARL: A Bimonthly Report, no. 197, 8-10.
41. Kyrillidou, M., & Heath, F. (Eds.). (2001). The new culture of assessment in academic libraries: Measuring library service quality. Library Trends, 49(4).
42. Kyrillidou, M., & Heath, F. (2004). The starving research library user: Relationships between library institutional characteristics and spring 2002 LibQUAL+™ scores. Journal of Library Administration, 40(3/4), 1-11.
43. Kyrillidou, M., Olshen, T., Franklin, B., & Plum, T. (2005). The story behind the numbers: Measuring the Impact of Networked Electronic Services (MINES) and the assessment of the Ontario Council of University Libraries' Scholars Portal. 6th Northumbria International Conference on Performance Measurement in Libraries and Information Services, Durham, England, Aug. 23. Retrieved March 3, 2008, from http://www.libqual.org/documents/admin/ Northumbria_2005MINES_sept20.doc.
44. Kyrillidou, M., Olshen, T., Franklin, B., & Plum, T. (2006). MINES for Libraries™: Measuring the Impact of Networked Electronic Services and the Ontario Council of University Libraries' Scholar Portal, final report, January 26, 2006. Washington, DC: Association of Research Libraries. Retrieved March 3, 2008, from http://www.libqual.org/documents/admin/ FINAL%20REPORT_Jan26mk.pdf.
45. Kyrillidou, M., Olshen, T., Heath, F., Bonnelly, C., amp; Côte, J. (2005) La mise en œuvre interculturelle de LibQUAL+MC Le cas du français. BBF 2005 Paris, t.50, n o 05, 48-55.
46. Kyrillidou, M., & Persson, A. C. (2006). The new library user in Sweden: A LibQUAL+™ study at Lund University. Performance Measurement and Metrics: The International Journal for Library and Information Services, 7(2), 45-53.
47. Kyrillidou, M., & Young, M. (2008). ARL Statistics 2005-06. Washington, DC: Association of Research Libraries.
48. Lakos, A. (2007). Evidence-based library management: The leadership challenge. portal: Libraries and the Academy, 7(4), 431-450.
49. Lancaster F. W. (1988). If you want to evaluate your library. . . . Champaign, IL: University of Illinois Graduate School of Library and Information Science.
50. Lancaster F. W. (1993). If you want to evaluate your library. . . . (2nd ed.). Champaign, IL: University of Illinois Graduate School of Library and Information Science.
51. Lancaster, F. W., with the assistance of M. J. Jon̈cich (1977). The Measurement and Evaluation of Library Services. Arlington, VA: Information Resources Press.
52. Lincoln, Y., Cook, C., & Kyrillidou, M. (2004) Evaluating the NSF National Science Digital Library Collections. Paper presented at the Multiple Educational Resources for Learning and Online Technologies (MERLOT) Conference, Costa Mesa, California, August 3-6, 2004. Retrieved March 3, 2008, from http://www.libqual.org/documents/admin/MERLOT%20Paper2_final.pdf.
53. Lincoln, Y., Cook, C., & Kyrillidou, M. (2005). User perspectives into designs for both physical and digital libraries: New insights on commonalities/similarities and differences from the NDSL digital libraries and LibQUAL+™ databases. Presented at the 7th ISKO Conference, Barcelona, Spain, 2005.
54. Lowry, C. B. (2005). Continuous organizational development - Teamwork, learning, leadership, and measurement. portal: Libraries and the Academy, 5(1), 1-6.
55. Lowry, C. B., & Hanges, P. J. (2008). What is the healthy organization? Organizational climate and diversity assessment: A research partnership. portal: Libraries and the Academy, 8(1), 1-5.
56. Molyneux, R. E. (1986). The Gerould Statistics 1907/08 - 1961/62. Washington, DC: Association of Research Libraries. Retrieved March 03, 2008, from http://fisher.lib.virginia.edu/gerould.
57. Nisonger, T. E. (1992). Collection evaluation in academic libraries: A literature guide and annotated bibliography. Englewood, CO: Libraries Unlimited.
58. Nitecki, D., & Franklin, B. (1999). New measures for research libraries. Journal of Academic Librarianship, 25(6), 484-487.
59. Parasuraman, A. (2002). Foreword. Performance Measurement and Metrics: The International Journal for Library and Information Services, 3(2), 37-39.
60. Plum, T. (2006). Evaluating the usage of library networked electronic resources. In Mersini Moreleli-Cacouris (Ed.), Library Assessment Conference - Thessaloniki 13-15 June 2005 (pp. 95-116). Washington, DC: Association of Research Libraries. Retrieved March 03, 2008, from http://www.arl.org/bm~doc/ lac-greece-2005.pdf.
61. Plum, T., & Bleiler, R. (2001). SPEC Kit 267: User authentication. Washington, DC: Association of Research Libraries. Retrieved March 03, 2008, from http://www.arl.org/bm~doc/spec267web.pdf.
62. Stubbs, K. (1980). The ARL Library Index and quantitative relationships in the ARL. Report prepared for the Committee on ARL Statistics, November, 1980.
63. Stubbs, K. (1981). University libraries: Standards and statistics. College and Research Libraries 42(6), 527-38.
64. Stubbs, K. (1986a). On the ARL Library Index. In Research Libraries: Measurement, Management, Marketing. Minutes of the 108th Meeting of the Association of Research Libraries, May 1-2, 1986, Minneapolis, Minnesota. Washington, DC: Association of Research Libraries, 18-20.
65. Stubbs, K. (1986b). Lies, damned lies . . . and ARL Statistics? In Research libraries: measurement, management, marketing. Minutes of the 108th Meeting of the Association of Research Libraries, May 1-2, 1986, Minneapolis, Minnesota. Washington, DC: Association of Research Libraries, 79-85.
66. Stubbs, K. (1988). Apples and oranges and ARL Statistics. Journal of Academic Librarianship, 14, 231-35.
67. Stubbs, K. (1993). Access and ARL membership criteria. In Proceedings of the 125th Meeting of the Association of Research Libraries, 117-122.
68. Stubbs, K. L., & Molyneux, R. E. (1990). Research library statistics 1907-08 through 1987-88. Washington, DC: Association of Research Libraries.
69. Thompson, B. (2006). Research and practice: Key elements of success for LibQUAL+®. In Mersini Moreleli-Cacouris (Ed.), Library Assessment Conference - Thessaloniki 13-15 June 2005 (pp. 41-54). Washington, DC: Association of Research Libraries. http://www.arl.org/bm~doc/lac-greece-2005. pdf.
70. Thompson, B. (2007). Some alternative quantitative library activity descriptions/statistics that supplement the ARL Logarithmic Index. A report submitted to the Association of Research Libraries. Retrieved March 03, 2008, from http://www.arl.org/bm~doc/bruce_3mk.pdf.
71. Thompson, B., & Cook, C. (2002). Stability of the reliability of LibQUAL+™ scores: A "Reliability Generalization" meta-analysis study. Educational and Psychological Measurement, 62, 735-743.
72. Thompson, B., Cook, C., & Heath, F. (2003a). Two short forms of the LibQUAL+™ survey assessing users' perceptions of library service quality. Library Quarterly, 73(4), 453-465.
73. Thompson, B., Cook, C., & Heath, F. (2003b). Structure of perceptions of service quality in libraries: A LibQUAL+™ study. Structural Equation Modeling 10, 456-464.
74. Thompson, B., Cook, C., & Kyrillidou, M. (2005). Concurrent validity of LibQUAL+™ scores: What do LibQUAL+™ scores measure? Journal of Academic Librarianship, 31(6), 517-522.
75. Thompson, B., Cook, C., & Kyrillidou, M. (2006). Using localized survey items to augment standardized benchmarking measures: A LibQUAL+™ study. portal: Libraries and the Academy, 6(2), 219-230.
76. Thompson, B., Cook, C., & Thompson, R. L. (2002). Reliability and structure of LibQUAL+™ scores: Measuring perceived library service quality. portal: Libraries and the Academy, 2(1), 3-12.
77. Thompson, B., Kyrillidou, M., & Cook, C. (2007a). User library service expectations in health science versus other settings: A LibQUAL+® study. Health Information and Libraries Journal, 24 (Supplement 1), 38-45.
78. Thompson, B., Kyrillidou, M., & Cook, C. (2007b). On-premises library versus Google™-like information gateway usage patterns: A LibQUAL+® study. portal: Libraries and the Academy, 7(4), 463-480.
79. Thompson, B., Kyrillidou, M., & Cook, C. (2008). Library users' service desires: A LibQUAL+® study. Library Quarterly, 78(1), 1-18.
80. Town, S. (2006). Academic library performance, quality and evaluation in the UK and Europe. In Mersini Moreleli-Cacouris (Ed.), Library Assessment Conference - Thessaloniki 13-15 June 2005 (pp. 29-39). Washington, DC: Association of Research Libraries. http://www.arl.org/bm~doc/lac-greece-2005. pdf.
81. Webster. D. (2007). Library assessment: Demonstrating value-added in a time of constrained resources and unique opportunities. In Francine DeFranco et al. (Eds.), Proceedings of the Library Assessment Conference: Building effective, sustainable, practical assessment, September 25-27, 2006, Charlottesville, VA. (pp. 1-4). Washington, DC: Association of Research Libraries.
82. Weiner, S. (2005). Library quality and impact: Is there a relationship between new measures and traditional measures? Journal of Academic Librarianship, 31(5), 432-437.
83. Williams, J. (2004). How to know if it's real: Assessing diversity and organizational climate. Paper presented at the 2004 National Diversity in Libraries Conference: Diversity in Libraries: Making It Real.
84. Wright, S., & White, L. S. (2007). SPEC kit 303 library assessment. Washington, DC: Association of Research Libraries.