Evaluating the evaluators: Interrater reliability on EMT licensing examinations

Prehospital Emergency Care

Volumn 2, Issue 1, 1998, Pages 37-46

  Snyder, Wayne ^a   Smit, Steve ^b  

^a ST JOSEPH MERCY HOSPITAL   (United States)

^b SWM Systems   (United States)

Author keywords

EMT; evaluator; examination; licensing; rater; reliability

Indexed keywords

ARTICLE; EDUCATION; HUMAN; LICENSING; OBSERVER VARIATION; REPRODUCIBILITY; RESCUE PERSONNEL; STANDARD; UNITED STATES;

EDUCATIONAL MEASUREMENT; EMERGENCY MEDICAL TECHNICIANS; HUMANS; LICENSURE; MICHIGAN; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; UNITED STATES;

EID: 0031610083     PISSN: 10903127     EISSN: 15450066     Source Type: Journal    
DOI: 10.1080/10903129808958838     Document Type: Article

References (10)

1. Hauswald M. Medical direction of the EMT training program. In: Roush W, Aranosian R, Blair T, Handal K, Kellow R, Stewart R (eds). Principles of EMS Systems. Dallas, TX: American College of Emergency Physicians, 1989, pp. 175-80.
2. Orchard C. Factors that interfere with clinical judgements of students' performance. J Nurs Educ. 1992;31:309-13.
3. Swanson R, Swanson S, Spooner J, Haight K, Ramsden V, Tan L. Inter-rater variability in an Advanced Cardiac Life Support course: a case study. Med Teacher. 1987;9:447-9.
4. Loustau A, Lentz M, Lee K, et al. Evaluating students' clinical performance: using a videotape to establish rater reliability. J Nurs Educ. 1980;19:10-7.
5. Castorr A, Thompson K, Ryan J, Phillips C, Prescott P, Soeken K. The process of rater training for observational instruments: implications for interrater reliability. Res Nurs Health. 1990;13:311-8.
6. Burril L, Butman A, Jordan L, Politis J, Smith M. EMT-Basic Practical Examination Users Guide. National Registry of Emergency Medical Technicians, Columbus, OH, 1994.
7. Ryan J, Phillips C, Prescott P. Interrater reliability: the underdeveloped role of rater training. Appl Nurs Res. 1988;1:148-50.
8. Smit S. Regional Coordinator, Southwest Michigan Systems, telephone interview, February 18,1997.
9. Hubinger J. Section Chief, EMS Division, Michigan Department of Consumer and Industry Services, telephone interview, February 18,1997.
10. Bourn S, Smith M. Reliability of EMS instructors as evaluators of practical skills stations. In: Prehopsital Care Research Forum. J Emerg Med Serv. 1995;20(3):113.