Toward meaningful evaluation of clinical competence: The role of direct observation in clerkship ratings

Academic Medicine

Volumn 79, Issue 10 SUPPL., 2004, Pages

  Hasnain, Memoona ^a   Connell, Karen J ^b   Downing, Steven M ^b   Olthoff, Allan ^b   Yudkowsky, Rachel ^b  

^a UNIVERSITY OF ILLINOIS   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ACADEMIC ACHIEVEMENT; CLINICAL EDUCATION; CLINICAL EXAMINATION; COMPETENCE; CONFERENCE PAPER; EVALUATION; FAMILY MEDICINE; OBSERVATION; PRIORITY JOURNAL; RELIABILITY; RESEARCH; SCORING SYSTEM; VALIDATION PROCESS;

EID: 4644344888     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/00001888-200410001-00007     Document Type: Conference Paper

References (23)

1. Landon BE, Normand SL, Blumenthal D, Daley J. Physician clinical performance assessment: prospects and barriers. JAMA. 2003;290:1183-9.
2. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med. 2003;15:270-92.
3. Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ. 2003;37:830-7.
4. Feinstein AR. Clinical Judgment. Baltimore: Williams & Wilkins, 1967:1-71, 291-349.
5. Engel GL. The deficiencies of the case presentation as a method of clinical teaching: another approach. N Engl J Med. 1971;284:20-4.
6. Wakefiled J. Direct observation. In: Neufeld VR, Norman GR (eds). Assessing Clinical Competence. New York: Springer Publishing Company, 1985;51-70.
7. Holmboe ES. Faculty and the observation of trainees' clinical skills: problems and opportunities. Acad Med. 2004;79:16-22.
8. Stillman P, Swanson D, Regan MB, et al. Assessment of clinical skills of residents utilizing standardized patients: a follow-up study and recommendations for application. Ann Intern Med. 1991;114:393-401.
9. Kassebaum DG, Eaglen RH. Shortsomings in the evaluation of students' clinical skills and behaviors in medical schools. Acad Med. 1999;74:842-9.
10. Steege/Thompson Communications. Clinical skills exam: frequently asked questions 〈www.usmle.org〉. Accessed 5 February 2003.
11. Holmboe ES, Williams FK, Yepes M, Norcini JJ, Blank LL, Huot S. The mini clinical evaluation exercise and interactive feedback: preliminary results. J Gen Intern Med. 2001;16(suppl 1):100.
12. Links PS, Colton T, Norman GR. Evaluating a direct observation exercise in a psychiatric clerkship. Med Educ. 1984;18:46-51.
13. Muchinsky PM. The correction for attenuation. Educ Psychol Meas. 1996;56:63-75.
14. Herbers JE Jr, Noel GL, Cooper GS, Harvey J, Pangaro LN, Weaver MJ. How accurate are faculty evaluations of clinical competence? J Gen Intern Med. 1989;4:202-8.
15. Metheny WP. Limitations of physician ratings in the assessment of student clinical performance in an obstetrics and gynecology clerkship. Obstet Gynecol. 1991;78: 136-41.
16. Kreiter CD, Ferguson K, Lee WC, Brennan RL, Densen P. A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performances. Acad Med. 1998;73:1294-8.
17. Noel GL, Herbers JE Jr, Caplow MP, Cooper GS, Pangaro LN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med. 1992;117:757-65.
18. Hasnain M, Onishi H, Elstein AS. Inter-rater reliability in judging errors in diagnostic reasoning. Med Educ. 2004;38:609-16.
19. Carline JD, Paauw DS, Thiede KW, Ramsey PG. Factors affecting the reliability of ratings of students' clinical skills in a medicine clerkship. J Gen Intern Med. 1992;7:506-10.
20. Levinson W, Branch WT Jr, Kroenke K. Clinician Educators in academic medical centers: a two-part challenge. Ann Intern Med. 1998;129:59-64.
21. Levinson W, Rubenstein A. Integrating clinician-educators into academic medical centers: challenges and potential solutions. Acad Med. 2000;75:906-12.
22. Chang RW, Bordage G, Connell KJ. The importance of early problem representation during case presentations. Acad Med. 1998;73(suppl 10):S109-11.
23. Hasnain M, Bordage G, Connell KJ, Sinacore JM. History-taking behaviors associated with diagnostic competence of clerks: an exploratory study. Acad Med. 2001;76(suppl 10):S14-7.