Outcomes-based Evaluation in Resident Education: Creating Systems and Structured Portfolios

American Journal of Medicine

Volumn 119, Issue 8, 2006, Pages 708-714

  Holmboe, Eric S ^b   Rodak, William ^c   Mills, Glenn ^d   McFarlane, Michael J ^e   Schultz, Henry J ^a,f  

^a Accreditation Council for Graduate Medical Education and American Bd of Medical Specialties Quadrad   (United States)

^b AMERICAN BOARD OF INTERNAL MEDICINE   (United States)

^c ACCREDITATION COUNCIL FOR GRADUATE MEDICAL EDUCATION   (United States)

^d LOUISIANA STATE UNIVERSITY HEALTH SCIENCES CENTER   (United States)

^e CASE WESTERN RESERVE UNIVERSITY   (United States)

^f MAYO CLINIC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCREDITATION; ARTICLE; COMPETENCE; HUMAN; LEADERSHIP; MEDICAL EDUCATION; MEDICAL PRACTICE; MEDICAL STAFF; OUTCOME ASSESSMENT; PRIORITY JOURNAL; QUALITY CONTROL; RESIDENCY EDUCATION; SKILL;

EID: 33746439325     PISSN: 00029343     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.amjmed.2006.05.031     Document Type: Note

References (45)

1. Accreditation Council for Graduate Medical Education. The Outcome Project. Available at: http://www.acgme.org/Outcome/. Accessed September 30, 2005.
2. Holmboe E.S., and Hawkins R.E. Evaluating the clinical competence of residents. a review. Ann Intern Med 129 (1998) 42-48
3. Nelson E.C., Batalden P.B., Huber T.P., et al. Microsystems in health care: Part 1. Learning from high-performing front-line clinical units. Jt Comm J Qual Improv 28 (2002) 472-493
4. Donabedian A. Explorations in Quality Assessment and Monitoring. The Definition of Quality and Approaches to its Assessment Vol. 1 (1980), Health Administration Press, Ann Arbor, MI
5. Swing S.R. Assessing the ACGME General Competencies. general considerations and assessment methods. Acad Emerg Med 9 (2002) 1278-1288
6. Gray J.D. Global rating scales in residency education. Acad Med 71 (1996) S55-S63
7. Schon D.A. The Reflective Practitioner. How Professionals Think In Action (1983), Basic Books, New York, NY
8. Holmboe E.S., Bowen J.D., Green M., et al. Reforming internal medicine residency training. a report from the Society of General Internal Medicine's task force for residency reform. J Gen Intern Med 20 (2005) 1165-1172
9. Ende J. Feedback in clinical medical education. JAMA 250 (1983) 777-781
10. Holmboe E.S., Williams F., Yepes M., and Huot S. Feedback and the mini clinical evaluation exercise. J Gen Intern Med 19 (2004) 558-561
11. Hemmer P.A., Hawkins R., Jackson J.L., and Pangaro L.N. Assessing how well three evaluation methods detect deficiencies in medical students' professionalism in two settings of an internal medicine clerkship. Acad Med 75 (2000) 167-173
12. Hiss R.G., MacDonald R., and David W.R. Identification of physician educational influentials in small community hospitals. Res Med Educ 17 (1978) 283-288
13. Holmboe E.S., Bradley E.S., Mattera J.A., et al. Characteristics of physician leaders working to improve the quality of care in acute myocardial infarction. a qualitative study. Jt Comm J Qual Saf 29 (2003) 289-296
14. Brennan T.A. Physicians responsibility to improve the quality of care. Acad Med 77 (2002) 973-980
15. Gruen R.L., Pearson S.D., and Brennan T.A. Physician-citizens-public roles and professional obligations. JAMA 291 (2004) 94-98
16. Friedman Ben David M., Davis M.H., Harden R.M., et al. AAME Educational Guide 24. portfolios as a method of student assessment. Med Teach 23 (2001) 535-551
17. Challis M. AMEE Medical Education Guide No.11. portfolio-based learning and assessment in medical education. (revised). Med Teach 21 (1999) 370-386
18. Carraccio C., and Englander R. Evaluating competence using a portfolio. a literature review and web-based application to the ACGME competencies. Teach Learn Med 16 (2004) 381-387
19. Campbell C.M., Parboosingh J.T., Gondocz S.T., et al. Study of physicians' use of a software program to create a portfolio of their self-directed learning. Acad Med 71 (1996) S49-S51
20. Wilkinson T.J., Challis M., Hobma S.O., et al. The use of portfolios for assessment of the competence and performance of doctors in practice. Med Educ 36 (2002) 918-924
21. Turnbull J., Gray J., and MacFayden J. Improving in-training evaluation programs. J Gen Intern Med 13 (1998) 317-323
22. Silber C.G., Nasca T.J., Paskin D.L., et al. Do global rating forms enable program directors to assess the ACGME competencies?. Acad Med 79 (2004) 549-556
23. Schwind C.J., Williams R.G., Boehler M.L., and Dunnington G.L. Do individual attendings' post-rotation performance ratings detect residents' clinical performance deficiencies?. Acad Med 79 (2004) 453-457
24. Holmboe E.S., Fiebach N.H., Galaty L.A., and Huot S. Effectiveness of a focused educational intervention on resident evaluations from faculty. a randomized control trial. J Gen Intern Med 16 (2001) 427-434
25. Pangaro L. A new vocabulary and other innovations for improving descriptive in-training evaluations. Acad Med 74 (1999) 1203-1207
26. Holmboe E.S. Faculty and the observation of trainees' clinical skills. problems and opportunities. Acad Med 79 (2004) 16-22
27. Garibaldi R.A., Subhiyah R., Moore M.E., and Waxman H. The in-training examination in internal medicine. an analysis of resident performance over time. Ann Intern Med 137 (2002) 505-510
28. Hawkins R.E., Sumption K.F., Gaglione M.M., and Holmboe E.S. The in-training examination in internal medicine. resident perceptions and correlation between resident scores and faculty predictions of resident performance. Am J Med 106 (1999) 206-210
29. Norcini J.J., Blank L.L., Duffy F.D., and Fortna G.S. The mini-CEX. a method for assessing clinical skills. Ann Intern Med 138 (2003) 476-481
30. Holmboe E.S., Huot S., and Hawkins R.E. Construct validity of the mini clinical evaluation exercise. Acad Med 78 (2003) 826-830
31. Holmboe E.S., Hawkins R.E., and Huot S.J. Direct observation of competence training. a randomized controlled trial. Ann Intern Med 140 (2004) 874-881
32. Matthews D.A., and Feinstein A.R. A new instrument for patients' ratings of physician performance in the hospital setting. J Gen Intern Med 4 (1989) 14-22
33. Butterfield P.S., and Mazzaferri E.L. A new rating form for use by nurses in assessing residents' humanistic behavior. J Gen Intern Med 6 (1991) 155-161
34. Lipner R.S., Blank L.L., Leas B.F., and Fortna G.S. The value of patient and peer ratings in recertification. Acad Med 77 (2002) S64-S66
35. Violato C., Lockyer J., and Fidler H. Multisource feedback. a method of assessing surgical practice. BMJ 326 (2003) 546-548
36. Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof 23 (2003) 4-12
37. Norcini J.J. Peer assessment of competence. Med Educ 37 (2003) 539-543
38. Jamtvedt G., Young J.M., Kristoffersen J.T., Thomson O.M.A., and Oxman A.D. Audit and feedback. effects on professional practice and health care outcomes. Cochrane Database Syst Rev 3 (2003) CD000259
39. Holmboe E.S., Prince L., and Green M.L. Teaching and improving quality of care in a residency clinic. Acad Med 80 (2005) 571-577
40. Ogrinc G., Headrick L.A., Mutha S., et al. A framework for teaching medical students and residents about practice-based learning and improvement, synthesized from a literature review. Acad Med 78 (2003) 748-756
41. Djuricich A.M., Ciccarelli M., and Swigonski N.L. A continuous quality improvement curriculum for residents. addressing core competencies, improving systems. Acad Med 79 (2004) S65-S67
42. Ogrinc G., Headrick L.A., Morrison L.J., and Foster T. Teaching and assessing resident competence in practice-based learning and improvement. J Gen Intern Med 19 (2004) 496-500
43. Wong J., Holmboe E.S., and Huot S. Teaching and learning in an 80-hour work week. a novel day-float rotation for medical residents. J Gen Intern Med 19 (2004) 519-523
44. American Board of Internal Medicine. Practice improvement modules. Available at: https://www.abim.org/online/pim/DEFAULT.ASPX. Accessed September 30, 2005.
45. E*value Residency Evaluation System. Available at: http://www.advancedinformatics.com/?id=3. Accessed March 15, 2006.