Faculty development in assessment: The missing link in competency-based medical education

Academic Medicine

Volumn 86, Issue 4, 2011, Pages 460-467

  Holmboe, Eric S ^a   Ward, Denham S ^b   Reznick, Richard K ^c   Katsufrakis, Peter J ^d   Leslie, Karen M ^e   Patel, Vimla L ^f   Ray, Donna D ^g   Nelson, Elizabeth A ^h  

^a AMERICAN BOARD OF INTERNAL MEDICINE   (United States)

^b UNIVERSITY OF ROCHESTER MEDICAL CENTER   (United States)

^c UNIVERSITY OF TORONTO   (Canada)

^d NATIONAL BOARD OF MEDICAL EXAMINERS   (United States)

^e UNIVERSITY OF TORONTO   (Canada)

^f UNIVERSITY OF TEXAS MEDICAL SCHOOL   (United States)

^g UNIVERSITY OF SOUTH CAROLINA SCHOOL OF MEDICINE   (United States)

^h BAYLOR COLLEGE OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79955104983     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/ACM.0b013e31820cb2a7     Document Type: Article

References (76)

1. Flexner A. Medical Education in the United States and Canada. A Report to the Carnegie Foundation for the Advancement of Teaching. Bulletin No. 4. Boston, Mass: Updyke; 1910.
2. Hoover EL. A century after Flexner: The need for reform in medical education from college and medical school through residency training. J Natl Med Assoc. 2005;97:1232-1239. (Pubitemid 41254429)
3. Whitcomb ME. Commentary: Flexner redux 2010: Graduate medical education in the United States. Acad Med. 2009;84:1476-1478. http://journals.lww.com/ academicmedicine/Fulltext/2009/11000/Commentary-Flexner-Redux-2010-Graduate- Medical.10.aspx. Accessed December 13, 2010.
4. Holmboe ES, Bowen JL, Green ML, et al. Reforming internal medicine residency training. J Gen Intern Med. 2005;20:1165-1172.
5. Schroeder SA, Sox HC. Internal medicine training: Putt or get off the green. Ann Intern Med. 2006;144:938-939. (Pubitemid 46768136)
6. Institute of Medicine. Resident Duty Hours: Enhancing Sleep, Supervision, and Safety. Washington, DC: National Academy Press; 2009.
7. Leipzig RM, Granville L, Simpson D, Anderson MB, Sauvigné K, Soriano RP. Keeping granny safe on July 1: A consensus on minimum geriatrics competencies for graduating medical students. Acad Med. 2009;84:604-610. http://journals.lww.com/academicmedicine/Fulltext/2009/05000/ Keeping-Granny-Safe-on-July-1-A-Consensus-on.17.aspx. Accessed December 13, 2010.
8. Royal College of Physicians of Canada. Directions for Residency Education, 2009: The Final Report of the Core Competency Project. http://rcpsc.medical.org/residency/competency/index.php. Accessed December 17, 2010.
9. Simpson JG, Furnace J, Crosby J, et al. The Scottish doctor-Learning outcomes for the medical undergraduate in Scotland: A foundation for competent and reflective practitioners. Med Teach. 2002;24:136-143. (Pubitemid 34308712)
10. Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: From Flexner to competencies. Acad Med. 2002;77:361-367. http://journals.lww.com/academicmedicine/Fulltext/2002/05000/ Shifting-Paradigms-From-Flexner-to-Competencies.3.aspx. Accessed December 13, 2010. (Pubitemid 34526146)
11. Smith SR, Dollase R. AMEE Guide No. 14: Outcomes-based education: Part 2-Planning, implementing and evaluating a competency-based curriculum. Med Teach. 1999;21:15-22. (Pubitemid 29092475)
12. Hodge S. The origins of competency-based training. Aust J Adult Learn. 2007;47:179-209.
13. Frank JR, Mungroo R, Ahmad Y, Wang M, De Rossi S, Horsley T. Toward a definition of competency-based education in medicine: A systematic review of published definitions. Med Teach. 2010;32:631-637.
14. Frank JR, Danoff D. The CanMEDS initiative: Implementing an outcomes-based framework of physician competencies. Med Teach. 2007; 29:642-647. (Pubitemid 351200661)
15. Batalden P, Leach D, Swing S, Dreyfus H, Dreyfus S. General competencies and accreditation in graduate medical education. Health Aff (Millwood). 2002;21:103-111.
16. Association of American Medical Colleges. Scientific Foundations for Future Physicians: Report of the AAMC-HHMI Committee. https://www.aamc.org/ download/64442/data/08209execsummary.pdf. December 13, 2010.
17. McMahon GT, Tallia AF. Perspective: Anticipating the challenges of reforming the United States Medical Licensing Examination. Acad Med. 2010;85:453-456. http://journals.lww.com/academicmedicine/Abstract/2010/03000/ Perspective-Anticipating-the-Challenges-of.18.aspx. Accessed December 13, 2010.
18. Harden RM. International medical education and future directions: A global perspective. Acad Med. 2006;81(12 suppl):S22-S29. http://journals.lww. com/academicmedicine/Fulltext/2006/12001/International-Medical-Education-and- Future.5.aspx. Accessed December 13, 2010. (Pubitemid 44691243)
19. Huddle TS, Heudebert GR. Viewpoint: Taking apart the art: The risk of anatomizing clinical competence. Acad Med. 2007;82:536-541. http://journals.lww. com/academicmedicine/Fulltext/2007/06000/Viewpoint-Taking-Apart-the-Art-The- Risk-of.3.aspx. Accessed December 13, 2010. (Pubitemid 46828200)
20. Lurie SJ, Mooney CJ, Lyness JM. Measurement of the general competencies of the Accreditation Council for Graduate Medical Education: A systematic review. Acad Med. 2009;84:301-309. http://journals.lww. com/academicmedicine/ Fulltext/2009/03000/Measurement-of-the-General-Competencies-of-the.11.aspx. Accessed December 13, 2010.
21. Sharp LK, Bashook PG, Lipsky MS, Horowitz SD, Miller SH. Specialty board certification and clinical outcomes: The missing link. Acad Med. 2002;77:534-542. http://journals.lww. com/academicmedicine/Fulltext/2002/06000/ Specialty-Board-Certification-and-Clinical. 11.aspx. Accessed December 13, 2010. (Pubitemid 34655279)
22. Hawkins RE, Boulet JR. Direct observation: Standardized patients. In: Holmboe ES, Hawkins RE, eds. Practical Guide to the Evaluation of Clinical Competence. Philadelphia, Pa: Mosby-Elsevier; 2008:102-118.
23. Cleland JA, Abe K, Rethans JJ. The use of simulated patients in medical education: AMEE Guide No. 42. Med Teach. 2009;31: 477-486.
24. Holmboe ES. The importance of faculty observation of trainees' clinical skills. Acad Med. 2004;79:16-22. http://journals.lww. com/academicmedicine/ Fulltext/2004/01000/Faculty-and-the-Observation-of-Trainees-Clinical.6.aspx. Accessed December 13, 2010. (Pubitemid 38031534)
25. Eva KW, Neville AJ, Norman GR. Exploring the etiology of content specificity: Factors influencing analogic transfer and problem solving. Acad Med. 1998;73(10 suppl):S1-S5. http://journals.lww.com/academicmedicine/Citation/ 1998/10000/Exploring-the-Etiology-of-Content-Specificity-.28.aspx. Accessed December 13, 2010. (Pubitemid 28476044)
26. Ericsson KA. An expert-performance perspective of research on medical expertise: The study of clinical performance. Med Educ. 2007;41:1124-1130. (Pubitemid 350197082)
27. Ericsson KA. The influence of expertise and deliberate practice on the development of superior expert performance. In: Ericsson KA, Charness N, Feltovich P, Hoffman RR, eds. Cambridge Handbook of Expertise and Expert Performance. Cambridge, UK: Cambridge University Press; 2006:685-706.
28. Eva KW, Regehr G. "I'll never play professional football" and other fallacies of self-assessment. J Contin Educ Health Prof. 2008;28:14-19.
29. Nelson EC, Batalden PB, Godfrey MM. Quality by Design: A Clinical Microsystems Approach. San Francisco, Calif: Jossey-Bass; 2007.
30. Lynn LA, Hess BJ, Conforti LN, Lipner RS, Holmboe ES. The effect of residency clinic systems on the quality of care for older adults in internal and family medicine residency programs. Acad Med. 2009;84:1732-1740. http://journals.lww.com/academicmedicine/Fulltext/2009/12000/ Clinic-Systems-and-the-Quality-of-Care-for-Older.24.aspx. Accessed December 13, 2010.
31. Reddy SG, Babbott SF, Beasley BW, Nadkarni M, Gertner E, Holmboe ES. Prevalance and functionality of electronic health records in internal medicine continuity clinics. Acad Med. 2010;85:1369-1377. http://journals.lww.com/ academicmedicine/Abstract/2010/08000/Prevalence-and-Functionality-of-Electronic- Health.25.aspx. Accessed February 8, 2011.
32. Holmboe E, Ginsburg S, Bernabeo E. The rotational approach to medical education: Time to confront our assumptions? Med Educ. 2011;45:69-80.
33. Sterkenburg A, Barach P, Kalkman C, Gielen M, ten Cate O. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med. 2010;85:1408-1417. http://journals.lww.com/academicmedicine/Abstract/2010/ 09000/When-Do-Supervising-Physicians-Decide-to-Entrust.11.aspx. Accessed December 13, 2010.
34. Hirsh DA, Ogur B, Thibault GE, Cox M. "Continuity" as an organizing principle for clinical educational reform. N Engl J Med. 2007;356:858-866. (Pubitemid 46294621)
35. Kilminster S, Cottrell D, Grant J, Jolly B. AMEE Guide No. 27: Effective educational and clinical supervision. Med Teach. 2007;29: 2-19. (Pubitemid 46887833)
36. Cox SM. "Forward feeding" about students' progress: Information on struggling medical students should not be shared among clerkship directors or with students' current teachers. Acad Med. 2008;83:801. http://journals.lww. com/academicmedicine/Fulltext/2008/09000/-Forward-Feeding-About-Students- Progress-.3.aspx. Accessed December 13, 2010.
37. Pangaro L. "Forward feeding" about students' progress: More information will enable better policy. Acad Med. 2008;83:802-803. http://journals.lww.com/academicmedicine/Fulltext/2008/09000/ -Forward-Feeding-About-Students-Progress-The.2.aspx. Accessed December 13, 2010.
38. Babbott S. Watching closely at a distance: Key tensions in supervising resident physicians. Acad Med. 2010;85:1399-1340. http://journals.lww.com/ academicmedicine/Fulltext/2010/09000/Commentary-Watching-Closely-at-a-Distance- Key.7.aspx. Accessed December 13, 2010.
39. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005;165:1493-1499. (Pubitemid 41058029)
40. Hafferty FW, Levinson D. Moving beyond nostalgia and motives: Towards a complexity science view of medical professionalism. Perspect Biol Med. 2008;51:599-615.
41. Hafferty FW. Beyond curriculum reform: Confronting medicine's hidden curriculum. Acad Med. 1998;73:403-407. http://journals.lww.com/academicmedicine/ Abstract/1998/04000/Beyond-curriculum-reform-confronting-medicine-s.13.aspx. Accessed December 13, 2010. (Pubitemid 28215048)
42. MacDonald C. Nurse autonomy as relational. Nurs Ethics. 2002;9:194-201.
43. Sherwin S. A relational approach to autonomy in health care. In: Sherwin S, ed. The Politics of Women's Health: Exploring Agency and Autonomy. Philadelphia, Pa: Temple University Press; 1998:19-47.
44. Bowen JL, Salerno SM, Chamberlain JK, Eckstrom E, Chen HL, Brandenburg S. Changing habits of practice. Transforming internal medicine residency education in ambulatory settings. J Gen Intern Med. 2005; 20:1181-1187. (Pubitemid 43110272)
45. Holmboe ES, Prince L, Green ML. Teaching and improving quality of care in a residency clinic. Acad Med. 2005;80:571-577. http://journals.lww.com/ academicmedicine/Fulltext/2005/06000/Teaching-and-Improving-Quality-of-Care-in- a.12.aspx. Accessed December 13, 2010.
46. Bowen JL. Educational strategies to promote clinical diagnostic reasoning. N Engl J Med. 2006;355:2217-2224.
47. Gruppen LD, Frohna AZ. Clinical reasoning. In: Norman GR, van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education. Dordrecht, Netherlands: Kluwer Academic; 2002:205-230.
48. Aagaard E, Teherani A, Irby DM. Effectiveness of the one-minute preceptor model for diagnosing the patient and the learner: Proof of concept. Acad Med. 2004;79:42-49. http://journals.lww.com/academicmedicine/Fulltext/2004/01000/ Effectiveness-of-the-One-Minute-Preceptor-Model.10.aspx. Accessed December 13, 2010. (Pubitemid 38031538)
49. Herbers JE, Noel GL, Cooper GS. How accurate are faculty evaluations of clinical competence? J Gen Intern Med. 1989;4:202-208. (Pubitemid 19133706)
50. Kalet A, Ear JA, Kilowatts V. How well do faculty evaluate the interviewing skills of medical students? J Gen Intern Med. 1992;97: 179-184.
51. Noel GL, Herbers JE Jr, Caplow MP, Cooper GS, Pangaro LN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med. 1992;117:757-765.
52. Holmboe ES, Hawkins RE, Huot SJ. Direct observation of competence training: A randomized controlled trial. Ann Intern Med. 2004;140:874-881.
53. Landy FJ, Farr JL. Performance rating. Psychol Bull. 1980;87:72-107.
54. Holmboe ES. Direct observation by faculty. In: Holmboe ES, Hawkins RE, eds. Practical Guide to the Evaluation of Clinical Competence. Philadelphia, Pa: Mosby-Elsevier; 2008:110-129.
55. Kogan JR, Holmboe ES, Hauer KE. Tools for direct observation and assessment of clinical skills of medical trainees: A systematic review. JAMA. 2009;302:1316-1326.
56. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance settings. Teach Learn Med. 2003;15:270-292. (Pubitemid 37414480)
57. Govaerts MJ, van der Vleuten CP, Schuwirth LW, Muijtjens AM. Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract. 2007;12:239-260.
58. Driessen E, van der Vleuten C, Schuwirth L, van Tartwijk J, Vermunt J. The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: A case study. Med Educ. 2005;39: 214-220. (Pubitemid 40278548)
59. National Board for Professional Teaching Standards. What is national board certification? http://www.nbpts.org/become-a-candidate/what-is-national- board-c. Accessed December 13, 2010.
60. Albanese M, Mejicano G, Xakellis G, Kokotailo P. Physician practice change I: A critical review of an integrated systems model. Acad Med. 2009;84:1043-1055. http://journals.lww.com/academicmedicine/Fulltext/2009/08000/ Physician-Practice-Change-I-A-Critical-Review-and.18.aspx. Accessed December 13, 2010.
61. Albanese M, Mejicano G, Xakellis G, Kokotailo P. Physician practice change II: Implications of the integrated systems model (ISM) for the future of continuing medical education. Acad Med. 2009;84:1056-1065. http://journals.lww. com/academicmedicine/Fulltext/2009/08000/Physician-Practice-Change-II- Implications-of-the.19.aspx. Accessed December 13, 2010.
62. Green ML, Aagaard EM, Caverzagie KJ, et al. Charting the road to competence: Developmental milestones for internal medicine residency training. J Grad Med Educ. 2009;1:5-20.
63. Swing SR, Clyman SG, Holmboe E, Williams RG. Advancing resident assessment in graduate medical education. J Grad Med Educ. 2009;1:278-286.
64. Goodstone MS, Lopez FE. The frame of reference approach as a solution to an assessment center dilemma. Consult Psychol J Pract Res. 2001;53:96-107. (Pubitemid 33293421)
65. Hauenstein NMA. Training raters to increase accuracy of appraisals and the usefulness of feedback. In: Smither JW, ed. Performance Appraisal. San Francisco, Calif: Jossey-Bass; 1998:404-442.
66. Hemmer PA, Pangaro L. Using formal evaluation sessions for case-based faculty development during clinical clerkships. Acad Med. 2000;75:1216-1221. http://journals.lww. com/academicmedicine/Fulltext/2000/12000/Using-Formal- Evaluation-Sessions-for-Case-based.21.aspx. Accessed December 13, 2010. (Pubitemid 32038198)
67. Hemmer PA, Papp KK, Mechaber AJ, Durning SJ. Evaluation, grading, and use of the RIME vocabulary on internal medicine clerkships: Results of a national survey and comparison to other clinical clerkships. Teach Learn Med. 2008;20:118-126.
68. Vukanovic-Criley JM, Criley S, Warde CM, et al. Competency in cardiac examination skills in medical students, trainees, physicians and faculty: a multicenter trial. Arch Intern Med. 2006;166:610-616.
69. Braddock CH 3rd, Edwards KA, Hasenberg NM, Laidley TL, Levinson W. Informed decision making in outpatient practice: Time to get back to basics. JAMA. 1999;282:2313-2320. (Pubitemid 30013062)
70. Internal Medicine Residency Review Committee. ACGME Program Requirements for Graduate Medical Education in Internal Medicine. http://www.acgme.org/ acWebsite/downloads/RRC-progReq/140-internal-medicine-07012009.pdf. Accessed December 13, 2010.
71. Holmboe ES, Davis MH, Carraccio C. Portfolios. In: Holmboe ES, Hawkins RE, eds. Practical Guide to the Evaluation of Clinical Competence. Philadelphia, Pa: Mosby-Elsevier; 2008:86-101.
72. Nasca TJ. Where will the "milestones" take us? The next accreditation system. ACGME Bull. September 2008:3-5. http://www.acgme. org/acWebsite/bulletin/ACG11-BulletinSep08-F.PDF. Accessed December 13, 2010.
73. Medicare Payment Advisory Commission. Medical education in the United States: Supporting long-term delivery system reforms. In: Report to the Congress: Improving Incentives in the Medicare Program. Washingon, DC: Medicare Payment Advisory Commission; June 2009: 3-39. http://www.medpac.gov/documents/ Jun09-EntireReport.pdf. Accessed December 13, 2010.
74. Iglehart JK. Medicare, graduate medical education and new policy directions. N Engl J Med. 2008;359:643-650.
75. Steinert Y, Mann K, Centeno A, Dolmans D, Spencer J, Gelula M, Prideux D. A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach. 2006;28:497-526. (Pubitemid 44660478)
76. O'Sullivan PS, Irby DM. Reframing research on faculty development. Acad Med. 2011;86: 421-428.