Interobserver variability among faculty in evaluations of residents' clinical skills

Academic Emergency Medicine

Volumn 6, Issue 1, 1999, Pages 38-44

  LaMantia, Joseph ^a   Rennie, William ^b   Risucci, Donald A ^a   Cydulka, Rita ^c   Spillane, Linda ^d   Graff, Louis ^e   Becher, John ^f   Kleinschmidt, Kurt ^g  

^a NORTH SHORE UNIVERSITY HOSPITAL   (United States)

^b LONG ISLAND JEWISH MEDICAL CENTER   (United States)

^c METROHEALTH MEDICAL CENTER   (United States)

^d UNIVERSITY OF ROCHESTER   (United States)

^e UNIVERSITY OF CONNECTICUT   (United States)

^f ALBERT EINSTEIN MEDICAL CENTER   (United States)

^g UNIVERSITY OF TEXAS SOUTHWESTERN MEDICAL CENTER   (United States)

Author keywords

Clinical skills; Emergency medicine; Faculty; Interobserver variability; Performance assessment; Rating scales; Residents; Standardized patients

Indexed keywords

ANAMNESIS; ARTICLE; CLINICAL PRACTICE; COMPETENCE; EMERGENCY MEDICINE; HUMAN; OBSERVER VARIATION; PRIORITY JOURNAL; RESIDENT; SKILL;

EID: 0032893282     PISSN: 10696563     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1553-2712.1999.tb00092.x     Document Type: Article

References (14)

1. Stillman PL, Swanson DB, Smee S, et al. Assessing clinical skills of residents with standardized patients. Ann Intern Med. 1986; 105:762-71.
2. Burdick WP, Schoffstall J. Observation of emergency medicine residents at the bedside: how often does it happen? Acad Emerg Med. 1995; 2:909-13.
3. Van der Vleuten CPM, Norman GR, DeGraaff E. Pitfalls in the pursuit of objectivity: issues of reliability. Med Educ. 1991; 25:110-8.
4. Noel GL, Herbers JE Jr, Caplow MP, Cooper GS, Pangaro LN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med. 1992; 117:757-65.
5. Herbers JE Jr, Noel GL, Cooper GS, Harvey J, Pangaro LN, Weaver MJ. How accurate are faculty evaluations of clinical competence? J Gen Intern Med. 1989; 4:202-8.
6. Ryan JG, Mandel FS, Sama A, Ward MF. Reliability of faculty clinical evaluations of non-emergency medicine residents during emergency department rotations. Acad Emerg Med. 1996; 3:1124-30.
7. Harden RM, Gleeson FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ. 1979; 13:41-54.
8. Barrows HS. An overview of the uses of standardized patients for teaching and evaluating clinical skills. Acad Med. 1993; 68:443-53.
9. Kroboth FJ, Hanusa BH, Parker S, et al. The inter-rater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med. 1992; 7:174-9.
10. McCormick DP, Rasson GM, Stroup-Benham CA, et al. Use of videotaping to evaluate pediatric resident performance of health supervision examinations of infants. Pediatrics. 1993; 92:116-20.
11. Gray JD. Global rating scales in residency education. Acad Med. 1996; 71(Jan suppl 1):S55-S63.
12. Borman WC. Evaluating performance effectiveness on the job: how can we generate more accurate ratings? In: Lloyd JS (ed). Evaluation of Non-cognitive Skills and Clinical Performance. Chicago: American Board of Medical Specialties, 1982, pp 179-93.
13. Norman GR, Van der Vleuten CPM, DeGraaff E. Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability. Med Educ. 1991; 25:119-26.
14. Page GG. Assessing reasoning and judgment. In: Mancall EL, Bashook GO (eds). Assessing Clinical Reasoning: The Oral Examination and Alternative Methods. Evanston, IL: American Board of Medical Specialties, 1995, pp 11-27.