Evaluation of a novel assessment form for observing medical residents: A randomised, controlled trial

Medical Education

Volumn 42, Issue 12, 2008, Pages 1234-1242

  Donato, Anthony A ^a   Pangaro, Louis ^b   Smith, Cynthia ^c   Rencic, Joseph ^d   Diaz, Yvonne ^e   Mensinger, Janell ^a   Holmboe, Eric ^b,f,g  

^a READING HOSPITAL AND MEDICAL CENTER   (United States)

^b UNIFORMED SERVICES UNIVERSITY OF THE HEALTH SCIENCES   (United States)

^c LANKENAU HOSPITAL   (United States)

^d TUFTS MEDICAL CENTER   (United States)

^e UNIVERSITY OF MIAMI MILLER SCHOOL OF MEDICINE   (United States)

^f YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^g AMERICAN BOARD OF INTERNAL MEDICINE   (United States)

Author keywords

*Internship and residency; Clinical competence *standards; Feedback; Internal medicine *education; Randomised controlled trial publication type

Indexed keywords

ARTICLE; EXERCISE; HUMAN; INTERNAL MEDICINE; INTERRATER RELIABILITY; NORMAL HUMAN; OBSERVATIONAL STUDY; RESIDENCY EDUCATION; SCORING SYSTEM; STAFF; STUDENT; TRAINING; UNIVERSITY; VIDEOTAPE;

ANALYSIS OF VARIANCE; CLINICAL COMPETENCE; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; HUMANS; INTERNAL MEDICINE; INTERNSHIP AND RESIDENCY; LOGISTIC MODELS; UNITED STATES;

EID: 56649124432     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2008.03230.x     Document Type: Article

References (30)

1. Pfeiffer C, Madray H, Ardolino A, Willms J. The rise and fall of students' skill in obtaining a medical history. Med Educ 1998 32 (3 283 8.
2. Mangione S, Nieman LZ. Cardiac auscultatory skills of internal medicine and family practice trainees. A comparison of diagnostic proficiency. JAMA 1997 278 (9 717 22.
3. Braddock CH III., Edwards KA, Hasenberg NM, Laidley TL, Levinson W. Informed decision making in outpatient practice: time to get back to basics. JAMA 1999 282 (24 2313 20.
4. Duffy FD, Gordon GH, Whelan G, Cole-Kelly K, Frankel R, Buffone N, Lofton S, Wallace M, Goode L, Langdon L. Assessing competence in communication and interpersonal skills: the Kalamazoo II report. Acad Med 2004 79 (6 495 507.
5. Pulito AR, Donnelly MB, Plymale M, Mentzer RM Jr. What do faculty observe of medical students' clinical performance? Teach Learn Med 2006 18 (2 99 104.
6. Leach DC. A model for GME: shifting from process to outcomes. A progress report from the Accreditation Council for Graduate Medical Education. Med Educ 2004 38 (1 12 4.
7. Kroboth FJ, Hanusa BH, Parker S, Coulehan JL, Kapoor WN, Brown FH, Karpf M, Levey GS. The inter-rater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med 1992 7 (2 174 9.
8. Noel GL, Herbers JE Jr., Caplow MP, Cooper GS, Pangaro LN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med 1992 117 (9 757 65.
9. Norcini JJ, Blank LL, Arnold GK, Kimball HR. The mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med 1995 123 (10 795 9.
10. American Board of Internal Medicine. Evaluating Competence in Internal Medicine. Philadelphia, PA : ABIM 2003 6. http://www.abim.org/pdf/paper-tools/ Resident.pdf. [Accessed 8 June 2008.]
11. Durning SJ, Cation LJ, Markert RJ, Pangaro LN. Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Acad Med 2002 77 (9 900 4.
12. Holmboe ES, Huot S, Chung J, Norcini J, Hawkins RE. Construct validity of the miniclinical evaluation exercise (miniCEX). Acad Med 2003 78 (8 826 30.
13. Margolis MJ, Clauser BE, Cuddy MM, Ciccone A, Mee J, Harik P, Hawkins RE. Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: a validity study. Acad Med 2006 10 (Suppl S56 60.
14. Norcini JJ, Blank LL, Duffy FD, Fortna GS. The mini-CEX: a method for assessing clinical skills. Ann Intern Med 2003 138 (6 476 81.
15. Holmboe ES, Hawkins RE. Methods for evaluating the clinical competence of residents in internal medicine: a review. Ann Intern Med 1998 129 (1 42 8.
16. Hatala R, Ainslie M, Kassen BO, Mackie I, Roberts JM. Assessing the mini-clinical evaluation exercise in comparison to a national specialty examination. Med Educ 2006 40 (10 950 6.
17. Holmboe ES, Yepes M, Williams F, Huot SJ. Feedback and the mini-clinical evaluation exercise. J Gen Intern Med 2004 19 (5 Part 2 558 61.
18. Lichstein PR. Chapter 3: The medical interview. In : Walker HK, Hall WD, Hurst JW, eds. Clinical Methods: the history, physical, and laboratory examinations, 3rd edn Vol. 1. Stoneham : Butterworth Publishers 1990 : 29 39.
19. Barker L, Bartlett E, Golden AS. Chapter 3: The doctor-patient relationship: communication and patient education. In : Barker LR, Burton BJ, Zieve PD, Fiebach NH, Kern DE, Thomas PA, Ziegelstein RC, eds Principles of Ambulatory Medicine, 6th edn Vol. 1. Philadelphia : Lippincott Williams & Wilkins 2003 : 33 6.
20. Landy F, Farr J. Performance rating. Psychol Bull 1980 1 (11 72 107.
21. Battistone MJ, Pendleton B, Milne C, Battistone ML, Sande MA, Hemmer PA, Shomaker TS. Global descriptive evaluations are more responsive than global numeric ratings in detecting students' progress during the inpatient portion of an internal medicine clerkship. Acad Med 2001 10 (Suppl S105 7.
22. Holmboe ES, Hawkins RE, Huot SJ. Effects of training in direct observation of medical residents' clinical competence: a randomized trial. Ann Intern Med 2004 140 (11 874 81.
23. Jamieson THP, Pangaro L. Legal Aspects of Failing Grades, Guidebook For Clerkship Directors, Alliance for Clinical Education Guidebook for Clerkship Directors, 3rd edn. 2005 : 226 9. Omaha, NE : Alliance for Clinical Education, Nebraska Medical Center.
24. Salerno SM, O'Malley PG, Pangaro LN, Wheeler GA, Moores LK, Jackson JL. Faculty development seminars based on the one-minute preceptor improved feedback in the ambulatory setting. J Gen Intern Med 2002 17 (10 779 87.
25. Salerno SM, Jackson JL, O'Malley PG. Interactive faculty development seminars improve the quality of written feedback in ambulatory teaching. J Gen Intern Med 2003 18 (10 831 4.
26. Schirmer JM, Mauksch L, Lang F, Marvel MK, Zoppi K, Epstein RM, Brock D, Pryzbylski M. Assessing communication competence: a review of current tools. Fam Med 2005 37 (3 184 92.
27. Gosman GG, Simhan HN, Guido RS, Lee TT, Mansuria SM, Sanfilippo JS. Focused assessment of surgical performance: difficulty with faculty compliance. Am J Obstet Gynecol 2005 193 (5 1811 6.
28. Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P. Framework for design and evaluation of complex interventions to improve health. BMJ 2000 321 (7262 694 6.
29. van der Vleuten CP. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996 1 (4 41 67.
30. Pangaro L. A new vocabulary and other innovations for improving descriptive in-training evaluations. Acad Med 1999 74 (11 1203 7.