Twelve tips for implementing tools for direct observation of medical trainees' clinical skills during patient encounters

Medical Teacher

Volumn 33, Issue 1, 2011, Pages 27-33

  Hauer, Karen E ^a   Holmboe, Eric S ^b   Kogan, Jennifer R ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b AMERICAN BOARD OF INTERNAL MEDICINE   (United States)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; DOCTOR PATIENT RELATION; HUMAN; MEDICAL EDUCATION; MEDICAL STUDENT; METHODOLOGY; OBSERVATION; PRACTICE GUIDELINE;

CLINICAL COMPETENCE; EDUCATION, MEDICAL; GUIDELINES AS TOPIC; HUMANS; OBSERVATION; PHYSICIAN-PATIENT RELATIONS; STUDENTS, MEDICAL;

EID: 78650787154     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.3109/0142159X.2010.507710     Document Type: Article

References (47)

1. Bing-You RG, Trowbridge RL. 2009. Why medical educators may be failing at feedback. JAMA 302:1330-1331.
2. Braddock III CH, Edwards KA, Hasenberg NM, Laidley TL, Levinson W. 1999. Informed decision making in outpatient practice: Time to get back to basics. JAMA 282:2313-2320.
3. Burdick WP, Schoffstall J. 1995. Observation of emergency medicine residents at the bedside: How often does it happen? Acad Emerg Med 2:909-913.
4. Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. 2009. Effect of rater training on reliability and accuracy of mini-CEX scores: A randomized, controlled trial. J Gen Intern Med 24:74-79.
5. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. 2006. Accuracy of physician self-assessment compared with observed measures of competence: A systematic review. JAMA 296:1094-1102.
6. de Haes JC, Oort F, Oosterveld P, Ten Cate O. 2001. Assessment of medical students' communicative behaviour and attitudes: Estimating the reliability of the use of the Amsterdam attitudes and communication scale through generalisability coefficients. Patient Educ Couns 45:35-42.
7. Downing SM. 2003. Validity: On meaningful interpretation of assessment data. Med Educ 37:830-837.
8. Duffy FD, Gordon GH, Whelan G, Cole-Kelly K, Frankel R, Buffone N, Lofton S, Wallace M, Goode L, Langdon L. 2004. Assessing competence in communication and interpersonal skills: The Kalamazoo II report. Acad Med 79:495-507.
9. Ende J. 1983. Feedback in clinical medical education. JAMA 250:777-781.
10. Ericsson K, Krampe RT, Tesch-Römer C. 1993. The role of deliberate practice in the acquisition of expert performance. Psychol Rev 100:363-406.
11. Eva KW, Regehr G. 2008. "I'll never play professional football" and other fallacies of self-assessment. J Contin Educ Health Prof 28:14-19.
12. Govaerts MJ, van der Vleuten CP, Schuwirth LW, Muijtjens AM. 2005. The use of observational diaries in in-training evaluation: Student perceptions. Adv Health Sci Educ Theory Pract 10:171-188.
13. Graber ML. 2008. Taking steps towards a safer future: Measures to promote timely and accurate medical diagnosis. Am J Med 121:S43-S46.
14. Graber M, Franklin N, Gordon R, Power D, Shanafelt T. 2005. Diagnostic error in internal medicine. Arch Intern Med 165:1493-1499.
15. Han PK, Keranen LB, Lescisin DA, Arnold RM. 2005. The palliative care clinical evaluation exercise (CEX): An experience-based intervention for teaching end-of-life communication skills. Acad Med 80:669-676.
16. Hasnain M, Bordage G, Connell K, Sinacore J. 2001. History-taking behaviors associated with diagnostic competence of clerks: An exploratory study. Acad Med 76:S14-S17.
17. Hattie JA, Timperly H, Rogers HJ. 2007. The power of feedback. Rev Res Educ 77:81-112.
18. Hemmer PA, Pangaro L. 2000. Using formal evaluation sessions for case-based faculty development during clinical clerkships. Acad Med 75:1216-1221.
19. Holmboe ES, Hawkins RE, Huot SJ. 2004a. Effects of training in direct observation of medical residents' clinical competence: A randomized trial. Ann Intern Med 140:874-881.
20. Holmboe ES, Yepes M, Williams F, Huot SJ. 2004b. Feedback and the mini clinical evaluation exercise. J Gen Intern Med 19:558-561.
21. Howley LD, Wilson WG. 2004. Direct observation of students during clerkship rotations: A multiyear descriptive study. Acad Med 79:276-280.
22. Kilminster S, Jolly B, van der Vleuten CP. 2002. A framework for effective training for supervisors. Med Teach 24:385-389.
23. Kogan JR, Holmboe ES, Hauer KE. 2009. Tools for direct observation and assessment of clinical skills of medical trainees: A systematic review. JAMA 302:1316-1326.
24. Kotter J. 1995. Leading change: Why transformation efforts fail. Harv Bus Rev 73:59-67.
25. Kuo AK, Irby DI, Loeser H. 2005. Does direct observation improve medical students' clerkship experiences? Med Educ 39:518.
26. Lane JL, Gottlieb RP. 2000. Structured clinical observations: A method to teach clinical skills with limited time and financial resources. Pediatrics 105:973-977.
27. Malhotra S, Hatala R, Courneya CA. 2008. Internal medicine residents' perceptions of the Mini-Clinical Evaluation Exercise. Med Teach 30:414-419.
28. Mangione S, Burdick WP, Peitzman SJ. 1995. Physical diagnosis skills of physicians in training: A focused assessment. Acad Emerg Med 2:622-629.
29. Mckinley RK, Fraser RC, van der Vleuten C, Hastings AM. 2000. Formative assessment of the consultation performance of medical students in the setting of general practice using a modified version of the leicester assessment package. Med Educ 34:573-579.
30. Messick S. 1995. Standards of validity and the validity of standards in performance assessment. Educ Meas 14:5-8.
31. Mitka M. 2008. Many physician practices fall short on accurate blood pressure measurement. JAMA 299:2842-2844.
32. Murphy KR, Cleveland JN, Skattebo AL, Kinney TB. 2004. Raters who pursue different goals give different ratings. J Appl Psychol 89:158-164.
33. Noel GL, Herbers Jr JE, Caplow MP, Cooper GS, Pangaro LN, Harvey J. 1992. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med 117:757-765.
34. Norcini JJ, Blank LL, Duffy FD, Fortna GS. 2003. The mini-CEX: A method for assessing clinical skills. Ann Intern Med 138:476-481.
35. PMETB [Internet]. 2008. Postgraduate Medical Education Training Board. Standards for curriculum and assessment systems. United Kingdom. [Published 2009 November 20]. Available from: http://www.pmetb.org. uk/fileadmin/user/ Standards-Requirements/PMETB-Scas-July2008- Final.pdf
36. Ross R. 2002. A clinical-performance biopsy instrument. Acad Med 77:268.
37. Shumway JM, Harden RM. 2003. AMEE Guide No. 25: The assessment of learning outcomes for the competent and reflective physician. Med Teach 25:569-584.
38. Simpson M, Buckman R, Stewart M, Maguire P, Lipkin M, Novack D, Till J. 1991. Doctor-patient communication: The Toronto consensus statement. BMJ 303:1385-1387.
39. Steinert Y, Cruess RL, Cruess SR, Boudreau JD, Fuks A. 2007. Faculty development as an instrument of change: A case study on teaching professionalism. Acad Med 82:1057-1064.
40. Stewart MA. 1995. Effective physician-patient communication and health outcomes: A review. CMAJ 152:1423-1433.
41. Torre DM, Sebastian JL, Simpson DE. 2005. A PDA-based instructional tool to monitor students' cardiac auscultation during a medicine clerkship. Med Teach 27:559-561.
42. Torre DM, Simpson DE, Elnicki DM, Sebastian JL, Holmboe ES. 2007. Feasibility, reliability and user satisfaction with a PDA-based mini-CEX to evaluate the clinical skills of third-year medical students. Teach Learn Med 19(3):271-277.
43. Van De Ridder JM, Stokking KM, Mcgaghie WC, Ten Cate OT. 2008. What is feedback in clinical education? Med Educ 42:189-197.
44. Van Der Vleuten CP, Schuwirth LW. 2005. Assessing professional competence: From methods to programmes. Med Educ 39:309-317.
45. Vukanovic-Criley JM, Criley S, Warde CM, Boker JR, Guevara-Matheus L, Churchill WH, Nelson WP, Criley JM. 2006. Competency in cardiac examination skills in medical students, trainees, physicians, and faculty: A multicenter study. Arch Intern Med 166:610-616.
46. Westberg J. 2001. Helping learners become reflective practitioners. Educ Health (Abingdon) 14:313-321.
47. Williams RG, Klamen DA, McGaghie WC. 2003. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 15:270-292.