The role of assessment in competency-based medical education

Medical Teacher

Volumn 32, Issue 8, 2010, Pages 676-682

  Holmboe, Eric S ^a   Sherbino, Jonathan ^b   Long, Donlin M ^c   Swing, Susan R ^d   Frank, Jason R ^e  

^a AMERICAN BOARD OF INTERNAL MEDICINE   (United States)

^b MCMASTER UNIVERSITY   (Canada)

^c JOHNS HOPKINS UNIVERSITY   (United States)

^d Accreditation Council for Graduate Medical Education   (United States)

^e UNIVERSITY OF OTTAWA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; CURRICULUM; HUMAN; MEDICAL EDUCATION; ORGANIZATION AND MANAGEMENT; PERSONNEL MANAGEMENT; STANDARD;

CLINICAL COMPETENCE; COMPETENCY-BASED EDUCATION; EDUCATION, MEDICAL, UNDERGRADUATE; EMPLOYEE PERFORMANCE APPRAISAL; HUMANS;

EID: 77955067708     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.3109/0142159X.2010.500704     Document Type: Article

References (55)

1. Barsuk JH, McGaghie WC, Cohen ER, Balachandran JS, Wayne DB. 2009. Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit. J Hosp Med 4(7):397-403.
2. Battistone MJ, Pendleton B, Milne C, Battistone ML, Sande MA, Hemmer PA, Shomaker TS. 2001. Global descriptive evaluations are more responsive than global numeric ratings in detecting students' progress during the inpatient portion of an internal medicine clerkship. Acad Med 76(10):S105-S107.
3. Bing-You RG, Trowbridge RL. 2009. Why medical educators may be failing at feedback. JAMA 302(12):1330-1331.
4. Bowen JL, Salerno SM, Chamberlain JK, Eckstrom E, Chen HL, Brandenburg S. 2005. Changing habits of practice. Transforming internal medicine residency education in ambulatory settings. J Gen Intern Med 20(12):1181-1187.
5. Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmouth AL. 2007. Designing and evaluating complex interventions to improve health care. BMJ 334(7591):455-459.
6. Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: From Flexner to competencies. Acad Med 77(5):361-367.
7. Chantler C, Ashton R. 2009. The purpose and limits to professional selfregulation. JAMA 302(18):2032-2033.
8. Choudhry NK, Fletcher RH, Soumerai SB. 2005. Systematic review: The relationship between clinical experience and quality of health care. Ann Intern Med 142(4):260-273.
9. Cleland JA, Abe K, Rethans JJ. 2009. AMEE Guide No. 42: The use of simulated patients in medical education. Med Teach 31(6):477-486.
10. Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. 2009. Effect of rater training on reliability and accuracy of mini-CEX scores: A randomized, controlled trial. J Gen Intern Med 24(1):74-79.
11. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. 2006. Accuracy of physician self-assessment compared with observed measures of competence: A systematic review. JAMA 296(9):1094-1102.
12. Driessen E, van der Vleuten C, Schuwirth L, van Tartwijk C, Vermunt J. 2005. The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: A case study. Med Educ 39(2):214-220.
13. Duffy FD, Lynn LA, Didura H, Hess B, Caverzagie K, Grosso L, Lipner RA, Holmboe ES. 2008. Self assessment of practice performance: Development of the ABIM Practice Improvement Module (PIM). J Contin Ed Health Prof 28(1):38-46.
14. Ericsson KA. 2006. The influence of expertise and deliberate practice on the development of superior expert performance. In: Ericsson KA, Charness N, Hoffman RR, Feltovich PJ, editors. Cambridge Handbook of Expertise and Expert Performance. Cambridge, UK: Cambridge University Press. pp 683-704.
15. Ericsson KA. 2007. An expert-performance perspective of research on medical expertise: The study of clinical performance. Med Educ 41(12):1124-1130.
16. Eva KW, Regehr G. 2008. ''I'll never play professional football" and other fallacies of self-assessment. J Contin Educ Health Prof 28(1):14-19.
17. Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL. 2003. The implications of regional variations in Medicare spending. Part 1: The content, quality, and accessibility of care. Ann Intern Med 138(4):273-287.
18. Goroll AH, Sirio C, Duffy FD, Le Blond RF, Alguire P, Blackwell TA, Rodak WE, Nasca T, Residency Review Committee for Internal Medicine. 2004. A new model for accreditation of residency programs in internal medicine. Ann Intern Med 140(11):902-909.
19. Govaerts MJ, van der Vleuten CP, Schuwirth LW, Muijtjens AM. 2007. Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Adv Health Sc Educ Theory Pract 12(2):239-260.
20. Green ML, Aagaard EM, Caverzagie KJ, Chick DA, Holmboe E, Kane G, Smith CD, Iobst W. 2009. Charting the road to competence: Developmental milestones for internal medicine residency training. J Grad Med Educ 1:5-20.
21. Hawkins RE, Holmboe ES. 2008. Constructing an evaluation system for an educational program. In: Holmboe ES, Hawkins RE, editors. Practical Guide to the Evaluation of Clinical Competence. Philadelphia, PA: Mosby/Elsevier. pp 216-238.
22. Hafferty FW, Levinson D. 2008. Moving beyond nostalgia and motives: Towards a complexity science view of medical professionalism. Perspect Biol Med 51(4):599-615.
23. Hattie J, Timperley H. 2007. The power of feedback. Rev Educ Res 77(1):81-112.
24. Herbers JE Jr, Noel GL, Cooper GS, Harvey J, Pangaro LN, Weaver MJ. 1989. How accurate are faculty evaluations of clinical competence? J Gen Intern Med 4(3):202-208.
25. Hemmer PA, Hawkins R, Jackson JL, Pangaro LN. 2000. Assessing how well three evaluation methods detect deficiencies in medical students' professionalism in two settings of an internal medicine clerkship. Acad Med 75(2):167-173.
26. Hodge S. 2007. The origins of competency-based training. Aust J Adult Learn 47(2):179-209.
27. Holmboe ES. 2004. Faculty and the observation of trainees' clinical skills: Problems and opportunities. Acad Med 79(1):16-22.
28. Holmboe ES. 2008. Assessment of the practicing physician: Challenges and opportunities. J Contin Educ Health Prof 28(Suppl 1):S4-S10.
29. Holmboe ES, Hawkins RE, Huot SJ. 2004. Effects of training in direct observation of medical residents' clinical competence: A randomized trial. Ann Intern Med 140(11):874-881.
30. Holmboe ES, Rodak W, Mills G, McFarlane MJ, Schultz HJ. 2006. Outcomesbased evaluation in resident education: Creating systems and structured portfolios. Am J Med 119(8):708-714.
31. Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. 2005. Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Med Teach 27(1):10-28.
32. Kalet A, Earp JA, Kowlowitz V. 1992. How well do faculty evaluate the interviewing skills of medical students? J Gen Intern Med 7(5):499-505.
33. Kennedy TJ, Lingard L, Baker GR, Kitchen L, Regehr G. 2007. Clinical oversight: Conceptualizing the relationship between supervision and safety. J Gen Intern Med 22(8):1080-1085.
34. Kogan JR, Holmboe ES, Hauer KE. 2009. Tools for direct observation and assessment of clinical skills of medical trainees: A systematic review. JAMA 302(12):1316-1326.
35. Landy FJ, Farr JL. 1980. Performance rating. Psychol Bull 87(1):72-107.
36. Leung WC. 2002. Competency based medical training: Review. BMJ 325(7366):693-696.
37. McCowan RJ. 1998. Origins of competency-based training. Buffalo (NY): Center for Development of Human Services. http://www.bsc-cdhs.org
38. McDaniel RR, Driebe DJ. 2001. Complexity science and healthcare management. In: Blair JD, Fottler MD, Savage GT, editors. Advances in Health Care Management., Vol.2. Stamford, CN: JAI Press. pp 11-36.
39. Medicare Payment Advisory Commission (MedPAC). 2009. Medical Education in the United States: Upporting long-term delivery system reforms. In: Report to the Congress: Improving Incentives in the Medicare Program. June, 2009; pp 3-38. Washington (DC): MedPAC. http://www.med pac.gov/documents/Jun09-EntireReport. pdf
40. Murphy KR, Cleveland JN. 1995. Understanding performance appraisal: Social, organizational, and goal based perspectives. Thousand Oaks, CA: Sage Publications.
41. Nasca TJ. 2008. Where will the ''milestones'' take us? The next accreditation system. ACGME [Accreditation Council for Graduate Medical Education] Bulletin (September): 3-5. http://www.acgme.org/acWebsite/bulletin/ ACG11-BulletinSep08-F.PDF
42. Nelson EC, Batalden PB, Godfrey MM. (Eds.) 2007. Quality by design: A clinical microsystems approach. San Francisco (CA): Jossey-Bass.
43. Noel GL, Herbers JE Jr, Caplow MP, Cooper GS, Pangaro LN, Harvey J. 1992. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med. 117:757-765.
44. Norcini JJ. 2003. Work-based assessment. BMJ 326(7392):753-755.
45. Norcini JJ, Holmboe ES, Hawkins RE. 2008. Evaluation challenges in the era of outcomes-based education. In: Holmboe ES, Hawkins RE, editors. Practical Guide to the Evaluation of Clinical Competence. Philadelphia, PA: Mosby/Elsevier. pp 1-9.
46. Pawson R, Tilley N. 1997. Realistic evaluation. London, UK: Sage Publications.
47. Reddy SG, Babbott SF, Beasley BW, Nadkarni M, Gertner E, Holmboe ES. In press. Prevalance and functionality of electronic health records in Internal Medicine continuity clinics. Acad Med.
48. Rethans JJ, Norcini JJ, Barón-Maldonado M, Blackmore D, Jolly BC, LaDuca T, Lew S, Page GG, Southgate LH. 2002. The relationship between competence and performance: Implications for assessing practice performance. Med Educ 36(10):901-909. (Pubitemid 35286311)
49. Shaw K, Cassel CK, Black C, Levinson W. 2009. Shared medical regulation in a time of increasing calls for accountability and transparency: Comparison of recertification in the United States, Canada, and the United Kingdom. JAMA 302(18):2008-2014.
50. Suchman AL. 2006. A new theoretical foundation for relationship-centered care. Complex responsive processes of relating. J Gen Intern Med 21(Suppl 1):S40-S44.
51. Swing SR, Clyman SG, Holmboe E, Williams RG. 2010. Advancing resident assessment in graduate medical education. J Grad Med Educ. In press.
52. Talbot M. 2004. Monkey see, monkey do: A critique of the competency model in graduate medical education. Med Educ 38(6):587-592.
53. van de Ridder JM, Stokking KM, McGaghie WC, ten Cate OT. 2008. What is feedback in clinical education? Med Educ 42(2):189-197.
54. van der Vleuten CPM. 1996. The assessment of professional competence: Developments, research and practical implications. Adv Health Sci Educ 1(1):41-67.
55. Williams RG, Klamen DA, McGaghie WC. 2003. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 15(4):270-292.