Estimating the quality of performance assessments: The case of an 'interactive examination' for teacher competencies

Learning Environments Research

Volumn 12, Issue 3, 2009, Pages 225-241

  Jonsson, Anders ^a   Baartman, Liesbeth K J ^b   Lennung, Sven A ^a  

^a MALMÖ UNIVERSITY   (Sweden)

^b UTRECHT UNIVERSITY   (Netherlands)

Author keywords

Higher education; Performance assessment; Quality estimation; Reliability; Validity

Indexed keywords

EID: 76349119698     PISSN: 13871579     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10984-009-9061-z     Document Type: Article

References (33)

1. Anderson, L., & Krathwohl, D. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. New York: Longman.
2. Baartman, L. K. J., Bastiaens, Th. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2006). The wheel of competency assessment: Presenting quality criteria for competency assessment programmes. Studies in Educational Evaluation, 32, 153-177.
3. Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2007a). Teachers' opinions on quality criteria for competency assessment programmes. Teaching and Teacher Education, 23, 857-867.
4. Baartman, L. K. J., Prins, F. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2007b). Determining the quality of competence assessment programs: A self-evaluation procedure. Studies in Educational Evaluation, 33, 258-281.
5. Birenbaum, M. (1996). Assessment 2000: Towards a pluralistic approach to assessment. In M. Birenbaum & F. J. R. C. Dochy (Eds.), Alternatives in assessment of achievements, learning processes and prior knowledge (pp. 3-29). Dordrecht, The Netherlands: Kluwer.
6. Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80, 139-148.
7. Boud, D., & Falchikov, N. (1989). Quantitative studies of self-assessment in higher education: A critical analysis of findings. Higher Education, 18, 529-549.
8. Dochy, F., Segers, M., & Sluijsmans, D. (1999). The use of self-, peer and co-assessment in higher education: A review. Studies in Higher Education, 24, 331-350.
9. Dunbar, S. B., Koretz, D. M., & Hoover, H. D. (1991). Quality control in the development and use of performance assessments. Applied Measurement in Education, 4, 289-303.
10. Entwistle, N. J., & Ramsden, P. (1983). Understanding student learning. London: Croom Helm.
11. Fransson, A. (1977). On qualitative differences in learning. IV-Effects of motivation and test anxiety on process and outcome. British Journal of Educational Psychology, 47, 244-257.
12. Frederiksen, J. R., & Collins, A. (1989). A systems approach to educational testing. Educational Researcher, 18, 27-32.
13. Hambleton, R. K. (1996). Advances in assessment models, methods, and practices. In D. C. Berliner & R. C. Calfee (Eds.), Handbook of educational psychology (pp. 899-925). New York: Macmillan.
14. Jönsson, A. (2008). Educational assessment for/of teacher competency. Doctoral dissertation, Malmö University, Sweden.
15. Jonsson, A., Mattheos, N., Svingby, G., & Attström, R. (2007). Dynamic assessment and the "interactive examination". Educational Technology & Society, 10, 17-27.
16. Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2, 130-144.
17. Kane, M. T. (2004). Certification testing as an illustration of argument-based validation. Measurement: Interdisciplinary Research and Perspectives, 2, 135-170.
18. Kane, M., Crooks, T., & Cohen, A. (1999). Validating measures of performance. Educational Measurement: Issues and Practice, 18, 5-17.
19. Lane, S., Stone, C. L., Ankenmann, R. D., & Liu, M. (1994). Reliability and validity of a mathematics performance assessment. International Journal of Educational Research, 21, 247-266.
20. Linn, R. L., Baker, J., & Dunbar, S. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20, 15-21.
21. Mattheos, N., Nattestad, A., Falk Nilsson, E., & Attström, R. (2004). The interactive examination: Assessing students' self-assessment ability. Medical Education, 38, 378-389.
22. McLellan, E. (2004). How convincing is alternative assessment for use in higher education? Assessment & Evaluation in Higher Education, 29, 311-321.
23. Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23, 13-23.
24. Messick, S. (1996). Validity of performance assessments. In G. Phillips (Ed.), Technical issues in large-scale performance assessment (pp. 1-18). Washington, DC: National Center for Education Statistics.
25. Miller, M. D., & Linn, R. L. (2000). Validation of performance based assessments. Applied Psychological Measurement, 24, 367-378.
26. Orsmond, P., & Merry, S. (1996). The importance of marking criteria in the use of peer assessment. Assessment & Evaluation in Higher Education, 21, 239-250.
27. Shavelson, R. J., Baxter, G. P., & Pine, J. (1991). Performance assessment in science. Applied Measurement in Education, 4, 347-362.
28. Shavelson, R. J., Gao, X., & Baxter, G. (1996). On the content validity of performance assessments: Centrality of domain-specifications. In M. Birenbaum & F. Dochy (Eds.), Alternatives in assessment of achievements, learning processes and prior knowledge (pp. 131-141). Boston: Kluwer.
29. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
30. Struyven, K., Dochy, F., & Janssens, S. (2005). Students' perceptions about new modes of assessment in higher education: A review. Assessment & Evaluation in Higher Education, 30, 325-341.
31. Taconis, R., van der Plas, P., & van der Sanden, J. (2004). The development of professional competencies by educational assistants in school-based teacher education. European Journal of Teacher Education, 27, 215-240.
32. Topping, K. (2003). Self and peer assessment in school and university: Reliability, validity and utility. In M. Segers, F. Dochy, & E. Cascallar (Eds.), Optimizing new modes of assessment: In search of qualities and standards (pp. 55-87). Dordrecht, The Netherlands: Kluwer.
33. Wiggins, G. (1998). Educative assessment. San Francisco: Jossey-Bass.