Structured Assessments of Clinical Competence

Understanding Medical Education: Evidence, Theory and Practice

Volumn , Issue , 2010, Pages 246-258

  Boursicot, Katharine A M ^a   Roberts, Trudie E ^b   Burdick, William P ^c,d,e  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b UNIVERSITY OF LEEDS   (United Kingdom)

^c FOUNDATION FOR ADVANCEMENT OF INTERNATIONAL MEDICAL EDUCATION AND RESEARCH   (United States)

^d FAIMER Institute   (India)

^e DREXEL UNIVERSITY COLLEGE OF MEDICINE   (United States)

Author keywords

Borderline group method; Clinical competence assessment decisions made about ability of clinicians and doctors in training; Educational Commission for Foreign Medical Graduates (ECFMG); Hofstee method compromise between relative and absolute standard setting methods; Objective Structure Clinical Examination (OSCE) and Objective Structured Long Case Examination Record (OSLER); Objective Structure Clinical Examinations (OCSEs) widespread in clinical competence assessment; OSLER, 10 key features and OSCE inherent unreliability of classical long and short cases; Simulated patient training; Structured assessments of clinical competence; System based blueprint

Indexed keywords

EID: 84871441176     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781444320282.ch17     Document Type: Chapter

References (58)

1. Miller G (1990) The assessment of clinical skills/competence/performance. Academic Medicine. 65 (s9): S63-7.
2. General Medical Council (2003) Tomorrow's Doctors. London, GMC.
3. General Medical Council (2001) Good Medical Practice. London, GMC.
4. Frank JR, Jabbour M and Tugwell P (1996) Skills for the new millennium: report of the Societal Needs Working Group, CanMEDS 2000 Project. Annals of the Royal College of Physicians and Surgeons of Canada. 29: 206-16.
5. Rethans JJ, Norcini JJ, Baron-Maldonado M et al. (2002) The relationship between competence and performance: implications for assessing practice performance. Medical Education. 36: 901-9.
6. Norcini JJ (2001) The validity of long cases. Medical Education. 35: 720-1.
7. Swanson DB, Norman GR and Linn RL (1995) Performance based assessment: lessons learned from health professions. Education Research. 24 (5): 5-11.
8. Norcini JJ (2002) The death of the long case? British Medical Journal. 324: 408-9.
9. Norcini JJ (2001) Does observation add to the validity of the long case? [letter]. Medical Education. 35: 1131-3.
10. Hampton JR, Harrison MJG, Mitchell JRA et al. (1975) Relative contributions of history taking, physical examination and laboratory investigations to diagnosis and management of medical outpatients. British Medical Journal. 2: 486-9.
11. Gleeson FA (1997) Assessment of clinical competence using the objective structured long examination record (OSLER). Medical Teacher. 19: 7-14.
12. Gleeson FA (1994) The effects of immediate feedback on clinical skills using the OSLER. Proceedings of the Sixth Ottawa Conference in Medical Education, pp. 412-15.
13. van Thiel J, Kraan HF and van der Vleuten CPM (1991) Reliability and feasibility of measuring medical interviewing skills. The revised Maastricht history and advice checklist. Medical Education. 25: 224-9.
14. Wass V, Jones R and van der Vleuten CPM (2001) Standardized or real patients to test clinical competence? The long case revisited. Medical Education. 35: 321-5.
15. Reznick RK, Blackmore D, Cohen R et al. (1993) An objective structured clinical examination for the licentiate of the Medical Council of Canada: from research to reality. Academic Medicine. 68 (s10): S4-6.
16. Sloan DA, Donnelly MB, Schwartz RW and Strodel WE (1995) The Objective Structured Clinical Examination. The new gold standard for evaluating postgraduate clinical performance. Annals of Surgery. 222: 735-42.
17. Cohen R, Reznick RK, Taylor BR et al. (1990) Reliability and validity of the objective structured clinical examination in assessing surgical residents. American Journal of Surgery. 160: 302-5.
18. Davis MH (2003) OSCE: the Dundee experience. Medical Teacher. 25: 255-61.
19. Newble D (2004) Techniques for measuring clinical competence: objective structured clinical examinations. Medical Education. 38: 199-203.
20. Harden RM and Gleeson FA (1979) Assessment of clinical competence using an Objective Structured Clinical Examination (OSCE). Medical Education. 13: 41-54.
21. van der Vleuten CPM (1996) The assessment of professional competence: developments, research and practical implications. Advances in Health Science Education. 1: 41-67.
22. Swanson DB (1987) A measurement framework for performance-based tests. In: Harvey I and Harden RM (eds) Further Developments in Assessing Clinical Competence, pp. 13-45. Can-Heal, Montreal.
23. van der Vleuten CPM and Swanson DB (1990) Assessment of clinical skills with standardized patients: state of the art. Teaching and Learning in Medicine. 2: 58-76.
24. Messick S (1994) The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher. 23 (2): 13-23.
25. Downing SM and Haladyna TM (2004) Validity threats: overcoming interference with proposed interpretations of assessment data. Medical Education. 38: 327-33.
26. Downing SM (2003) Validity: on the meaningful interpretation of assessment data. Medical Education. 37: 830-7.
27. Biggs J (1999) Teaching for Quality Learning at University. Open University Press and Society for Research into Higher Education, Buckingham.
28. Petrusa E (2002) Clinical performance assessments. In: Norman GR, van der Vleuten CPM and Newble DI (eds) International Handbook of Research in Medical Education, pp. 673-709. Kluwer, Dordrecht, Boston and London.
29. Kaufman DM (2003) ABC of learning and teaching in medicine: applying educational theory in practice. British Medical Journal. 326: 213-16.
30. Newble DI and Jaeger K (1983) The effect of assessments and examinations on the learning of medical students. Medical Education. 17: 165-71.
31. Vargas AL, Boulet JR, Errichetti AM, van Zanten M and Lopez MJ (2007) Developing performance-based medical school assessment programs in resource-limited environments. Medical Teacher. 29 (2-3): 192-8.
32. Adamo G (2003) Simulated and standardized patients in OSCEs: achievements and challenges 1992-2003. Medical Teacher. 25: 262-70.
33. Newble DI (2004) Techniques for measuring clinical competence: objective structured clinical examinations. Medical Education. 38: 199-203.
34. Townsend AH, Mcllvenny S, Miller CJ and Dunn EV (2001) The use of an Objective Structured Clinical Examination (OSCE) for formative and summative assessment in a general practice clinical attachment and its relationship to final medical school examination performance. Medical Education. 35: 841-6.
35. Hodges B (2003) Validity and the OSCE. Medical Teacher. 25: 250-4.
36. Hodges B, Turnbull J, Cohen R et al. (1996) Evaluating communication skills in the OSCE format: reliability and generalizability. Medical Education. 30: 38-43.
37. Mavis BE and Henry RC (2002) Between a rock and a hard place: finding a place for the OSCE in medical education. Medical Education. 36: 408-9.
38. Reznick RK, Blackmore D, Dauphinee WD et al. (1996) Large-scale high-stakes testing with an OSCE: report from the Medical Council of Canada. Academic Medicine. 71 (s1): S19-S21.
39. Rymer AT (2001) The new MRCOG Objective Structured Clinical Examination-the examiners'evaluation. Journal of Obstetrics and Gynaecology. 21: 103-6.
40. Eva KW, Rosenfeld J, Reiter HI and Norman GR (2004) An admissions OSCE: the multiple mini-interview. Medical Education. 38: 314-26.
41. Lane P (2005) Recruitment into training for general practice-the winds of change or a breath of fresh air? British Medical Journal Career Focus. 331: 153.
42. Whelan GP, Boulet JR, McKinley DW et al. (2005) Scoring standardized patient examinations: lessons learned from the development and administration of the ECFMG Clinical Skills Assessment (CSA). Medical Teacher. 27: 200-6.
43. Boulet JR, Ben David MF, Ziv A et al. (1998) High-stakes examinations: what do we know about measurement?: using standardized patients to assess the interpersonal skills of physicians. Academic Medicine. 73 (10): S94-6.
44. Whelan GP, McKinley DW, Boulet JR et al. (2001) Validation of the doctor-patient communication component of the Educational Commission for Foreign Medical Graduates Clinical Skills Assessment. Medical Education. 35: 757-61.
45. Boulet JR, McKinley DW, Norcini JJ and Whelan GP (2002) Assessing the comparability of standardized patient and physician evaluations of clinical skills. Advances in Health Sciences Education, Theory and Practice. 7: 85-97.
46. Noel GL, Herbers JE Jr, Caplow MP et al. (1992) How well do internal medicine faculty members evaluate the clinical skills of residents? Annals of Internal Medicine. 117: 757-65.
47. Boulet JR, van Zanten M, McKinley DW and Gary NE (2001) Evaluating the spoken English proficiency of graduates of foreign medical schools. Medical Education. 35: 767-73.
48. Norcini JJ (2003) Setting standards on educational tests. Medical Education. 37: 464-9.
49. Norcini JJ and Shea JA (1997) The credibility and comparability of standards. Applied Measurement in Education. 10: 39-59.
50. Livingstone SA and Zeiky MJ (1982) Passing Scores: a manual for setting standards of performance on educational and occupational tests. Educational Testing Service, Princeton, NJ.
51. Zeiky MJ (2001) So much has changed. How the setting of cutscores has evolved since the 1980s. In: Cizek GJ (ed.) Setting Performance Standards: concepts, methods, and perspectives, pp. 19-52. Lawrence Erlbaum Associates, Mahwah, NJ.
52. Cizek GJ (2001) Setting Performance Standards: concepts, methods, and perspectives. Lawrence Erlbaum Associates, Mahwah, NJ.
53. Angoff WH (1971) Scales, norms and equivalent scores. In: Thorndike RL (ed.) Educational Measurement, pp. 508-600. American Council on Education, Washington, DC.
54. Cohen R, Rothman AI, Poldre P and Ross J (1991) Validity and generalizability of global ratings in an objective structured clinical examination. Academic Medicine. 66: 545-8.
55. Dauphinee WD, Blackmore DE, Smee SM et al. (1997) Using the judgements of physician examiners in setting standards for a national multicentre high stakes OSCE. Advances in Health Science Education. 2: 201-11.
56. Hodges B (2003) Analytic global OSCE ratings are sensitive to level of training. Medical Education. 37: 1012-16.
57. Smee SM and Blackmore DE (2001 Setting standards for an objective structured clinical examination: the borderline group method gains ground on Angoff. Medical Education. 35: 1009-10.
58. Boursicot K and Roberts T (2005) How to set up an OSCE. The Clinical Teacher. 2: 16-20.