Programmatic assessment and Kane's validity perspective

Medical Education

Volumn 46, Issue 1, 2012, Pages 38-48

  Schuwirth, Lambert W T ^a,b   van der Vleuten, Cees P M ^b  

^a FLINDERS UNIVERSITY   (Australia)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; EDUCATION; HUMAN; MEDICAL EDUCATION; METHODOLOGY; PSYCHOMETRY; REPRODUCIBILITY; STANDARD;

CLINICAL COMPETENCE; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; HUMANS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 83455206782     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2011.04098.x     Document Type: Article

References (40)

1. Newble DI, Baxter A, Elmslie RG. A comparison of multiple-choice tests and free-response tests in examinations of clinical competence. Med Educ 1979;13:263-8.
2. Norman G, Swanson D, Case S. Conceptual and methodological issues in studies comparing assessment formats, issues in comparing item formats. Teach Learn Med 1996;8:208-16.
3. Norman G, Tugwell P, Feightner J, Muzzin L, Jacoby L. Knowledge and clinical problem-solving. Med Educ 1985;19:344-56.
4. Schuwirth LWT, van der Vleuten CPM, Donkers HHLM. Open-ended questions versus multiple-choice questions. In: Harden R, Hart IR, Mulholland H, eds. Approaches to the Assessment of Clinical Competence. Proceedings of the Fifth Ottawa Conference. Norwich: Page Brothers 1992;486-91.
5. Maatsch J, Huang R. An evaluation of the construct validity of four alternative theories of clinical competence. In: Proceedings of the 25th Annual Research in Medical Education Conference. Chicago, IL: Association of American Medical Colleges 1986;69-74.
6. van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1996;1:41-67.
7. Messick S. The interplay of evidence and consequences in the validation of performance assessments. Educ Res 1994;23:13-23.
8. van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ 2005;39:309-17.
9. Van der Vleuten CPM, Schuwirth LWT, Scheele F, Driessen EW, Hodges B. The assessment of professional competence: building blocks for theory development. Best Pract Res Clin Obstet Gynaecol 2010;24:703-19.
10. Accreditation Council for Graduate Medical Education. Common Program Requirements Document. [Accessed 15 August 2011].
11. Royal College of Physicians and Surgeons of Canada. CanMeds 2005 framework. [Accessed 15 August 2011].
12. Schuwirth LWT, van der Vleuten CPM. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach 2011;33:478-85.
13. Kane MT. Current concerns in validity theory. J Educ Measure 2001;38:319-42.
14. Kane MT. Validation. In: Brennan RL, ed. Educational Measurement. Westport, CT: ACE/Praeger 2006;7-64.
15. Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull 1955;52:281-302.
16. Polsen P, Jeffries R. Expertise in problem solving. In: Sternberg RJ, ed. Advances in the Psychology of Human Intelligence. Hillsdale, NJ: Lawrence Erlbaum Associates 1982;367-411.
17. Chi MTH, Glaser R, Rees E. Expertise in problem solving. In: Sternberg RJ, ed. Advances in the Psychology of Human Intelligence. Hillsdale, NJ: Lawrence Erlbaum Associates 1982;7-76.
18. Schmidt HG, Boshuizen HP. On acquiring expertise in medicine. Educ Psychol Rev 1993;5:205-21.
19. Swanson DB, Norcini JJ, Grosso LJ. Assessment of clinical competence: written and computer-based simulations. Assess Eval High Educ 1987;12:220-46.
20. Schmidt HG, Boshuizen HP. On the origin of intermediate effects in clinical case recall. Mem Cognit 1993;21:338-51.
21. Schmidt HG, Boshuizen HPA, Hobus PPM. Transitory stages in the development of medical expertise: the 'intermediate effect' in clinical case representation studies. In: Proceedings of the 10th Annual Conference of the Cognitive Science Society. Montreal, QC: Lawrence Erlbaum Associates 1988;139-45.
22. Schuwirth LWT, Gorter SL, van der Heijde D, Rethans JJ, Brauer J, Houben H, Van der Linden SJ, Van der Vleuten CPM, Scherpbier AJJA. The role of a computerised case-based testing procedure in practice performance assessment. Adv Health Sci Educ Theory Pract 2005;10:145-55.
23. Elstein AS, Shulmann LS, Sprafka SA. Medical Problem-Solving: An Analysis of Clinical Reasoning. Cambridge, MA: Harvard University Press 1978.
24. Eva K. On the generality of specificity. Med Educ 2003;37:587-8.
25. Page G, Bordage G. The Medical Council of Canada's key features project: a more valid written examination of clinical decision-making skills. Acad Med 1995;70:104-10.
26. Bordage G. An alternative approach to PMPs: the 'key-features' concept. In: Hart IR, Harden R, eds. Further Developments in Assessing Clinical Competence. Proceedings of the Second Ottawa Conference. Montreal, QC: Can-Heal Publications 1987;59-75.
27. Case SM, Swanson DB. Extended-matching items: a practical alternative to free response questions. Teach Learn Med 1993;5:107-15.
28. Schuwirth LWT, Blackmore DB, Mom E, van de Wildenberg F, Stoffers H, van der Vleuten CPM. How to write short cases for assessing problem-solving skills. Med Teach 1999;21:144-50.
29. Schuwirth LWT, Verheggen MM, van der Vleuten CPM, Boshuizen HPA, Dinant GJ. Do short cases elicit different thinking processes than factual knowledge questions do? Med Educ 2001;35:348-56.
30. Page G, Bordage G, Allen T. Developing key-feature problems and examinations to assess clinical decision-making skills. Acad Med 1995;70:194-201.
31. Clauser BE, Margolis MJ, Swanson DB. Issues of validity and reliability for assessments in medical education. In: Holboe ES, Hawkins RE, eds. Evaluation of Clinical Competence. Philadelphia, PA: Mosby Elsevier 2008;10-23.
32. Nederlands Huisartsen Genootschap. Richtlijn cardiovasculair management. [Accessed 15 August 2011].
33. Downing SM, Haladyna TM. Test item development: validity evidence from quality assurance procedures. Appl Meas Educ 1997;10:61-82.
34. Case SM, Swanson DB. Item Writing Manual. [Accessed 15 August 2011].
35. Muijtjens AMM, van Mameren H, Hoogenboom RJI, Evers JLH, van der Vleuten C. The effect of a 'don't know' option on test scores: number-right and formula scoring compared. Med Educ 1999;33:267-75.
36. Schuwirth LWT, van der Vleuten CPM. A plea for new psychometrical models in educational assessment. Med Educ 2006;40:296-300.
37. Rickets C. A plea for the proper use of criterion-referenced tests in medical assessment. Med Educ 2009;53:1141-6.
38. Govaerts MJB, Schuwirth LWT, van der Vleuten CPM, Muijtjens AMM. Workplace-based assessment: effects of rater expertise. Adv Health Sci Educ 2011;16 (2):151-65.
39. Govaerts MJB, van der Vleuten CPM, Schuwirth LWT, Muijtjens AMM. Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract 2007;12:239-60.
40. World Health Organization. Preamble to the Constitution of the World Health Organization as Adopted by the International Health Conference. Geneva: Official Records of the WHO 1946.