Rubrics to assess information literacy: An examination of methodology and interrater reliability

Journal of the American Society for Information Science and Technology

Volumn 60, Issue 5, 2009, Pages 969-983

  Oakleaf, Megan ^a  

^a 326 Hinds Hall ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION LITERACY; INTERRATER RELIABILITY; RIGOROUS APPROACH; TRAINING SESSIONS;

LIBRARIES; RELIABILITY;

INFORMATION USE;

EID: 65649105422     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.21030     Document Type: Article

References (40)

1. Andrade, H.G. (2000). Using rubrics to promote thinking and learning. Educational Leadership, 57(5), 13-18.
2. Arter, J., & McTighe, J. (2000). Scoring rubrics in the classroom: Using performance criteria for assessing and improving student performance. Thousand Oaks, CA: Corwin Press.
3. Association of College and Research Libraries. (2000). Information literacy competency standards for higher education. Retrieved January 1, 2009, from http://www.ala.org/ala/mgrps/div/acr/standards/informationliteracy competency.cfm
4. Bernier, R. (2004). Making yourself indispensible by helping teachers create rubrics. CSLA Journal, 27(2), 24-25.
5. Bresciani, M.J., Zelna, C.L., & Anderson, J.A. (2004). Assessing student learning and development: A handbook for practitioners. National Association of Student Personnel Administrators.
6. Buchanan, L.E. (2003). Assessing liberal arts classes. In E.F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic libraries (pp. 68-73). Chicago: Association of College and Research Libraries.
7. Callison, D. (2000). Rubrics. School Library Media Activities Monthly, 17(2), 34-36, 42.
8. Choinski, E., Mark, A.E., & Murphey, M. (2003). Assessment with rubrics: An efficient and objective means of assessing student outcomes in an information resources class. Portal: Libraries and the Academy, 3(4), 563-575.
9. Colton, D.A. (1997). Reliability issues with performance assessments: A collection of papers. Iowa City, IA: ACT.
10. D'Angelo, B.J. (2001). Integrating and assessing information competencies in a gateway course. Reference Services Review, 29(4), 282-293.
11. Emmons, M., & Martin, W. (2002). Engaging conversation: Evaluating the contribution of library instruction to the quality of student research. College and Research Libraries, 63(6), 545-560.
12. Franks, D. (2003). Using rubrics to assess information literacy attainment in a community college education class. In E.F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic libraries (pp. 132-147). Chicago: Association of College and Research Libraries.
13. Gauss, N., & Kinkema, K. (2003). Webliography assignment for a lifetime wellness class. In E.F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic libraries (pp. 161-171) Chicago: Association of College and Research Libraries.
14. Hafner, J.C. (2003). Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer-group rating. International Journal of Science Education, 25(12), 1509-1528. (Pubitemid 37519479)
15. Hutchins, E.O. (2003). Assessing student learning outcomes in political science classes. In E.F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic libraries (pp. 172-184) Chicago: Association of College and Research Libraries.
16. Kivel, A. (2003). Institutionalizing a graduation requirement. In E.F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic libraries (pp. 192-200). Chicago: Association of College and Research Libraries.
17. Knight, L.A. (2006). Using rubrics to assess information literacy. Reference Services Review, 34(1), 43-55.
18. Kobritz, B. (2003). Information literacy in community college communications courses. In E.F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic libraries (pp. 207-215) Chicago: Association of College and Research Libraries.
19. Landis, J.R., & Koch, G.G. (1977). The measure of observer agreement for categorical data. Biometrics, 33, 159-174. (Pubitemid 8054849)
20. Maki, P.L. (2004). Assessing for learning: Building a sustainable commitment across the institution. Sterling, VA: Stylus.
21. Mertler, C.A. (2001). Designing scoring rubrics for your classroom. Practical Assessment Research and Evaluation, 7(25). Retrieved January 1, 2009, from http://pareonline.net/getvn.asp?v=7&n=25
22. Merz, L.H., & Mark, B.L. (2002). Clip note #32: Assessment in college library instruction programs. Chicago: Association of College and Research Libraries.
23. Moskal, B.M. (2000). Scoring rubrics: What, when, and how? Practical Assessment Research and Evaluation, 7(3). Retrieved January 1, 2009, from http:// pareonline.net/getvn.asp?v=7&n=3
24. Moskal, B.M., & Leydens, J.A. (2000). Scoring rubric development: Validity and reliability. Practical Assessment Research and Evaluation, 7(10) Retrieved January 1, 2009, http://pareonline.net/getvn.asp?v= 7&n=10
25. Nitko, A.J. (2004). Educational assessment of students. Upper Saddle River, NJ: Pearson Education.
26. Oakleaf, M.J. (2006). Assessing information literacy instruction: A rubric approach (Doctoral dissertation, University of North Carolina at Chapel Hill, 2006). Dissertation Abstracts International, Proquest No 1095444541.
27. Oakleaf, M.J. (2007). Using rubrics to collect evidence for decisionmaking: What do librarians need to know? Evidence Based Library and Information Practice, 2(3), 27-42.
28. Oakleaf, M.J. (2008). Dangers and opportunities: A conceptual map of information literacy assessment approaches. Portal: Libraries and theAcademy, 8(3), 233-253.
29. Oakleaf, M.J. (2009). The information literacy instruction assessment cycle: A conceptual framework. Journal of Documentation, 65(4).
30. Pausch, L.M., & Popp, M.P. (1997, April). Assessment of information literacy: Lessons from the higher education assessment movement. Paper presented at the meeting of the Association of College and Research Libraries, Nashville, TN.
31. Popham, W.J. (2003). Test better, teach better: The instructional role of assessment. Alexandria,VA: Association for Supervision and Curriculum Development.
32. Prus, J., & Johnson, R. (1994). A critical review of student assessment options. New Directions for Community Colleges, 88, 69-83.
33. Rockman, I.F. (2002). Rubrics for assessing information competence in the California State University. Retrieved April 10, 2005, from http://www.calstate.edu/LS/1-rubric.doc
34. SAS. (2006). Compute estimates and tests of agreement among multipleraters.
35. Smalley, T.N. (2003). Bay Area Community Colleges information competency assessment project. Retrieved November 17, 2003, from http:// www.topsy.org/ICAP/ICAProject.html
36. Stemler, S.E. (2004).A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Practical Assessment, Research, and Evaluation, 9(4). Retrieved January 1, 2009, from http://pareonline. net/getvn.asp?v=9&n=4
37. Stevens, D.D., & Levi, A. (2005). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and promote student learning. Sterling, VA: Stylus.
38. Tierney, R., & Simon, M. (2004). What's still wrong with rubrics: Focusing on the consistency of performance criteria across scales levels. Practical Assessment Research and Evaluation, 9(2). Retrieved January 1, 2009, from http://pareonline.net/getvn.asp?v=9&n=2
39. Warmkessel, M.M. (2003). Assessing abilities of freshmen to reconcile new knowledge with prior knowledge. In E.F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic libraries (pp. 249-256). Chicago: Association of College and Research Libraries.
40. Wiggins, G. (1996). Creating tests worth taking. In R.E. Blum & J.A. Arter (Eds.), A handbook for student performance in an era of restructuring (pp. V-6:1-V-6:9). Alexandria, VA: Association for Supervision and Curriculum Development.