Assessing assessment quality: Criteria for quality assurance in design of (peer) assessment for learning - A review of research studies

Studies in Educational Evaluation

Volumn 37, Issue 1, 2011, Pages 25-34

  Tillema, Harm ^a   Leenknecht, Martijn ^a   Segers, Mien ^b  

^a LEIDEN UNIVERSITY   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Assessment cycle; Assessment for learning; Peer assessment; Quality criteria; Student involvement

Indexed keywords

EID: 79955973716     PISSN: 0191491X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.stueduc.2011.03.004     Document Type: Article

References (89)

1. Assessment Reform Group Assessment for learning: Beyond the black box 1999, University of Cambridge, School of Education, Cambridge.
2. Baartman, L. K. J. (2008). Assessing the assessment': Development and use of quality criteria for Competence Assessment Programmes. Utrecht University. Retrieved from http://dspace.learningnetworks.org/bitstream/1820/1555/1/Liesbeth%20Baartman.pdf.
3. Baartman L.K.J., Prins F.J., Kirschner P.A., van der Vleuten C.P.M. Determining the quality of competence assessment programs: A self-evaluation procedure. Studies in Educational Evaluation 2007, 33(3-4):258-281.
4. Bastick T. Reliable and valid measurement of individual's contributions to group work. Paper presented at the annual meeting of the western psychological association 1999.
5. Biggs J. What the student does: Teaching for enhanced learning. Higher Education & Development 1999, 18(1):57-75.
6. Birenbaum M. Assessment 2000: Towards a pluralistic approach to assessment. Alternatives in assessment of achievements, learning processes and prior knowledge 1996, 3-29. Kluwer Academic Publishers, Boston. M. Birenbaum, F.J.R.C. Dochy (Eds.).
7. Birenbaum M. Evaluating the assessment: Sources of evidence for quality assurance. Studies in Educational Evaluation 2007, 33(1):29-49.
8. Black P., Wiliam D. Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice 1998, 5(1). 7.15.
9. Bloxham S., West A. Learning to write in higher education: Students' perceptions of an intervention in developing understanding of assessment criteria. Teaching in Higher Education 2007, 12:77-89.
10. Boud D. Assessment and learning: Contradictory or complementary?. Assessment for learning in higher education 1995, 35-48. Kogan Page Limited, London. P. Knight (Ed.).
11. Boud D. Sustainable assessment: Rethinking assessment for the learning society. Studies in Continuing Education 2000, 22(2):151-167.
12. Boud D., Falchikov N. Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education 2006, 31(4):399-413.
13. Brennan R.L. Educational measurement 2006, ACE Praeger, New York.
14. Brookhart S.M. Teachers' grading: Practice and theory. Applied Measurement in Education 1994, 7(4):279-301.
15. Brown G.T.L. Teachers' conceptions of assessment. Assessment in Education 2004, 11(3):310-318.
16. Brualdi A. Implementing performance assessment in the classroom. Practical Assessment, Research & Evaluation 1998, 6(2). Retrieved from. http://pareonline.net/getvn.asp?v=6&n=2.
17. Carless D. Differing perceptions in the feedback process. Studies in Higher Education 2006, 31:219-233.
18. Carver R.P. Two dimensions of tests: Psychometric and edumetric. American Psychologist 1974, 29(7):512-518.
19. CCSSO. (2009, September). Report of the Council of Chief State Scool Officers. Vision for developing assessment systems that support high quality learning. Washington, DC.
20. Chan K., Elliott R.G. Relational analysis of personal epistemology and conceptions about teaching and learning. Teaching and Teacher Education 2004, 20(8):817-831.
21. Cheng W., Warren M. Having second thoughts: Student perceptions before and after a peer assessment exercise. Studies in Higher Education 1997, 22:233-240.
22. Cho K., Schunn C.D., Wilson R.W. Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology 2006, 98:891-901.
23. Dancer W.T., Dancer J. Peer rating in higher education. Journal of Education for Business 1992, 67(5):306-310.
24. Dannefer E.F., Henson L.C., Biere S.B., Grady-Weliky T.A., Meldrum S., Nofziger A.C., et al. Peer assessment of professional competence. Medical Education 2005, 39:713-722.
25. Davies P. Don't write, just mark; the validity of assessing student ability via their computerized peer-marking of an essay rather than their creation of an essay. Research in Learning Technology 2004, 12(3):261-277.
26. Dierick S., Dochy F. New lines in edumetrics: New forms of assessment lead to new assessment criteria. Studies in Educational Evaluation 2001, 27:307-329.
27. Dochy F. A new assessment era: Different needs, new challenges. Learning and Instruction 2001, 10(Suppl. 1):11-20.
28. Dochy F., McDowell L. Assessment as a tool for learning. Studies in Educational Evaluation 1997, 23(4):279-298.
29. Dochy F., Segers M.S.R., Sluijsmans D. The use of self-, peer and co-assessment in higher education: A literature review. Studies in Higher Education 1999, 24(3):331-350.
30. Falchikov N. Peer feedback marking: Developing peer assessment. Innovations in Education and Training International 1995, 32:175-187.
31. Falchikov N. Involving students in assessment. Psychology Learning and Teaching 2004, 3:102-108.
32. Falchikov N. Improving assessment through student involvement. Practical solutions for aiding learning in higher and further education 2005, Routledge Falmer, London and New York.
33. Falchikov N., Goldfinch J. Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research 2000, 70:287-323.
34. Frederiksen J.R., Collins A. A system approach to educational testing. Educational Researcher 1989, 18(9):27-32.
35. Freeman R., Lewis R. Planning and implementing assessment 1998, Kogan Page, London.
36. Gielen S., Dochy F., Dierick S. Evaluating the consequential validity of new modes of assessment: The influence of assessment on learning, including pre-, post-, and true assessment effects. Optimising new modes of assessment: In search of qualities and standards 2003, 37-54. Kluwer Academic Publishers, Dordrecht/Boston. M.S.R. Segers, F. Dochy, E. Cascallar (Eds.).
37. Gielen, S. (2007). Peer assessment as a tool for learning. Doctoral dissertation. Catholic University Leuven.
38. Gulikers J., Bastiaens T., Kirschner P. A five-dimensional framework for authentic assessment. Educational Technology Research and Development 2004, 52(3):67-86.
39. Haertel E.H. Performance tests, simulations and other methods. The new handbook of teacher evaluation 1991, 278-294. Sage, Newbury Park. J. Millman, L. Darling Hammonds (Eds.).
40. James M., McCormick R., Black P., Carmichael P., Drummond M., Fox A., et al. Improving learning how to learn 2007, Routledge, London.
41. Kerka, S. (1995). Techniques for authentic assessment: Practice application brief (ERIC Clearinghouse on Adult, Career, and Vocational Education, No. ED381688). Retrieved from http://www.eric.ed.gov/contentdelivery/servlet/ERICErvlet?accno=ED381688.
42. Langan A.M., Wheater C.P., Shwa E.M., Haines B.J., Cullen W.R., Boyle J.C., et al. Peer assessment of oral presentations: Effects of student gender, university affiliation and participation in the development of assessment criteria. Assessment and Evaluation in Higher Education 2005, 30:21-34.
43. Linn R.L., Baker E.L., Dunbar S.B. Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher 1991, 20(8):15.
44. Liu N.-F., Carless D. Peer feedback: The learning element of peer assessment. Teaching in Higher Education 2006, 11:279-290.
45. Lizzio A., Wilson K. Feedback on assessment: Students' perceptions of quality and effectiveness. Assessment & Evaluation in Higher Education 2008, 33:263-275.
46. MacLelland E. How convincing is alternative assessment for use in higher education?. Assessment and Evaluation in Higher Education 2004, 29:311-321.
47. Magzoub M.M.A., Schmidt H.G., Dolmans D.H.J.M., Abdelhameed A.A. Assessing students in community settings: The role of peer evaluation. Advances in Health Sciences Education 1998, 3:3-13.
48. Martin S. Two models of educational assessment: A response from initial teacher education: If the cap fits. Assessment & Evaluation in Higher Education 1997, 22:337-343.
49. McDowell L. The impact of innovative assessment on student learning. Education and Training International 1995, 32:302-313.
50. McInerney D.M., Brown G.T., Liem L.G.D. Student perspectives on assessment: What students can tell us about assessment for learning 2009, IAP, Charlotte, NC.
51. McMillan J.H. Formative classroom assessment: Research, theory and practice 2007, Teachers College Press, New York.
52. McMillan J.H., Myran S., Workman D. Elementary teachers' classroom assessment and grading practices. Journal of Educational Research 2002, 95(4):203-213.
53. Messick S. Test validity and the ethics of assessment. American Psychologist 1980, 35:1012-1027.
54. Messick S. The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher 1994, 23:13-23.
55. Moskal B.M. Recommendations for developing classroom performance assessments and scoring rubrics. Practical Assessment, Research & Evaluation 2003, 8(14). Retrieved from. http://pareonline.net/getvn.asp?v=8&n=14.
56. Natriello G. The impact of evaluation processes on students. Educational Psychologist 1987, 22(2):1-5.
57. O'Donovan B., Price M., Rust C. Know what I mean? Enhancing student understanding of assessment standards and criteria. Teaching in Higher Education 2004, 9:325-335.
58. O'Donovan B., Price M., Rust C. Developing student understanding of assessment standards: A nested hierarchy of approaches. Teaching in Higher Education 2008, 13:205-217.
59. Orsmond P., Merry S., Reiling K. The importance of marking criteria in the use of peer assessment. Assessment and Evaluation in Higher Education 1996, 21:239-250.
60. Papinczak T., Young L., Groves M. Peer assessment in problem-based learning: A qualitative study. Advances in Health Sciences Education 2007, 12:169-186.
61. Ploegh K., Tillema H.H., Segers M.S.R. In search of quality criteria in peer assessment practices. Studies in Educational Evaluation 2009, 35(2-3):102-109.
62. Popham W.J. Curriculum, instruction, and assessment: Amiable allies or phony friends?. Teachers College Record 2004, 106(3):417-428.
63. Poulos A., Mahony M.J. Effectiveness of feedback: The students' perspective. Assessment & Evaluation in Higher Education 2008, 33:143-154.
64. Rust C., Price M., O'Donovan B. Improving students' learning by developing their understanding of assessment criteria and processes. Assessment & Evaluation in Higher Education 2003, 28:147-164.
65. Ryan G.J., Marshall L.L., Porter K., Jia H. Peer, professor and self-evaluation of class participation. Active Learning in Higher Education 2007, 8:49-61.
66. Sadler D.R. Formative assessment and the design of instructional systems. Instructional Science 1989, 18(2):119-144.
67. Sadler D.R. Beyond feedback, developing student capability in complex appraisal. Assessment & Evaluation in Higher Education 2010, 35:535-550.
68. Optimising new modes of assessment: In search of qualities and standards 2004, 37-54. Kluwer Academic Publishers, Dordrecht/Boston. M.S.R. Segers, F. Dochy, E. Cascallar (Eds.).
69. Shepard L.A. The role of assessment in a learning culture. Educational Researcher 2000, 29(7):4-14.
70. Sivan A. The implementation of peer assessment: An action research approach. Assessment in Education 2000, 7:193-213.
71. Sluijsmans, D. M. A. (2002, June). Student involvement in assessment: The training of peer assessment skills. Unpublished doctoral dissertation. Open University, Heerlen, TheNetherlands.
72. Sluijsmans D.M.A., Dochy F., Moerkerke G. Creating a learning environment by using self-, peer-, and co-assessment. Learning Environments Research 1999, 1:293-319.
73. Sluijsmans D.M.A., Moerkerke G., van Merriënboer J.J.G., Dochy F.J.R. Peer assessment in problem based learning. Studies in Educational Evaluation 2001, 27(2):153-173.
74. Stiggins R.J. Assessment crisis: The absence of assessment for learning. Phi Delta Kappan 2002, 83(10):758-765.
75. Stobart, G. (2010). Assessment fit for learning. Key note address to the Northumbria/EARLI sig assessment conference, Slaley Hall, Northumberland, 1-3 September.
76. Struyven K., Dochy F., Janssens S. Students' perceptions about evaluation and assessment in higher education: A review. Assessment & Evaluation in Higher Education 2005, 30:325-341.
77. Symtech Mindmapper plus, 2008 software program 2008, Symtech Systems Inc., Lewisville, TX, USA.
78. Tillema H. Formative assessment in teacher preparation and teacher professional development. Encyclopaedia of Education 2010, Reed Elsevier, London.
79. Topping K. Peer assessment between students in colleges and universities. Review of Educational Research 1998, 68(3):249-276.
80. Topping K.J. Peer Assessment. Theory Into Practice 2009, 48(1):20-27.
81. Topping K.J., Smith E.F., Swanson I., Elliot A. Formative peer assessment of academic writing between postgraduate students. Assessment & Evaluation in Higher Education 2000, 25(2):149-169.
82. Torrance H., Pryor J. Developing formative assessment in the classroom: Using action research to explore and modify theory. British Educational Research Journal 2001, 615-631.
83. Van Gennip N.A.E., Segers M.S.R., Tillema H.H. Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features. Educational Research Review 2009, 4(1):41-54.
84. Vu T.T., Dall'Alba G. Students' experience of peer assessment in a professional course. Assessment & Evaluation in Higher Education 2007, 32:541-556.
85. Wiggins G. Assessment: Authenticity, context, and validity. Phi Delta Kappan 1993, 11(November):200-214.
86. Willingham W.W. A systemic view of test fairness. Assessment in higher education: Issues of access, quality, student development and policy 1999, 213-243. Lawrence Erlbaum Associates, Mahwah, NJ. S.J. Messick (Ed.).
87. Xiao Y., Lucking R. The impact of two types of peer assessment on students' performance and satisfaction within a Wiki environment. Internet and Higher Education 2008, 11:186-193.
88. Yorke M. Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. Higher Education 2003, 45(4):477-501.
89. Zhang B., Johnston L., Kilic G.B. Assessing the reliability of self- and peer rating in student group work. Assessment & Evaluation in Higher Education 2008, 33:329-340.