Real-time inter-rater reliability of the council of emergency medicine residency directors standardized direct observation assessment tool

Academic Emergency Medicine

Volumn 16, Issue SUPPL. 2, 2009, Pages

  LaMantia, Joseph ^a   Kane, Bryan ^b   Yarris, Lalena ^c   Tadros, Anthony ^a   Ward, Mary Frances ^a   Lesser, Martin ^d   Shayne, Philip ^e   Brunett, Patrick ^c   Kyriakedes, Chris ^f   Rinnert, Stephen ^g   Schimdt, Joseph ^h   Wald, David ⁱ   Akerman, Meredith ^d   Livote, Elayne ^d   Soohoo, David ^a   Gong, Jonathan ^a  

^a NORTH SHORE UNIVERSITY HOSPITAL   (United States)

^b LEHIGH VALLEY HOSPITAL   (United States)

^c OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^d FEINSTEIN INSTITUTE FOR MEDICAL RESEARCH   (United States)

^e EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

^f AKRON GENERAL MEDICAL CENTER   (United States)

^g Downstate Health Sciences University   (United States)

^h BAYSTATE HEALTH   (United States)

ⁱ TEMPLE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Evaluation; Inter rater variation; Reliability; Training

Indexed keywords

ARTICLE; BEHAVIOR; CLINICAL ASSESSMENT; CLINICAL ASSESSMENT TOOL; CLINICAL COMPETENCE; CURRICULUM; EMERGENCY MEDICINE; EVALUATION; HUMAN; INTERRATER RELIABILITY; MEDICAL EDUCATION; OBSERVATIONAL METHOD; PRIORITY JOURNAL; RELIABILITY; RESIDENCY EDUCATION; SCORING SYSTEM; SIMULATION; SKILL; STANDARDIZATION;

CLINICAL COMPETENCE; HUMANS; INTERNSHIP AND RESIDENCY; PROSPECTIVE STUDIES; REPRODUCIBILITY OF RESULTS;

EID: 73349137942     PISSN: 10696563     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1553-2712.2009.00593.x     Document Type: Article

References (9)

1. Swing SR. Assessing the ACGME general competencies: general considerations and assessment methods. Acad Emerg Med. 2002; 9:1278-88.
2. Joyce B. Developing an assessment system: facilitator's guide. Academic Council for Graduate Medical Education, 2006. Available at: http:??www.acgme. org?outcome?e-learn?FacManual-module3.pdf. Accessed June 28, 2009.
3. LaMantia J, Panacek E. Core competencies conference: executive summary. Acad Emerg Med. 2002; 9:1213-5.
4. Shayne P, Gallahue F, Rinnert S, et al., CORD SDOT Study Group. Reliability of a core competency checklist assessment in the emergency department: the standardized direct observation assessment tool. Acad Emerg Med. 2006; 13:727-32.
5. Mendenhall W, Ott L, Scheaffer RL. Elementary Survey Sampling. Belmont, CA: Duxbury Press, 1971.
6. Feinstein AR, Cicchetti DV. High agreement but low Kappa: I. The problem of two paradoxes. J Clin Epidemiol. 1990; 43(6):543-9.
7. Cicchetti DV, Feinstein AR. High agreement but low Kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990; 43(6):551-8.
8. LaMantia J, Rennie W, Risucci , et al. Interobserver variability among faculty in evaluation of residents' clinical skills. Acad Emerg Med. 1999; 6:38-44.
9. Bianchi L, Gallagher EJ, Korte R, Ham HP. Interexaminer agreement on the American Board Of Emergency Medicine oral certification examination. Ann Emerg Med. 2003; 41:859-64.