A Consideration of the Measurement and Reporting of Interrater Reliability. Answers to the July 2009 Journal Club Questions

Annals of Emergency Medicine

Volumn 54, Issue 6, 2009, Pages 843-853

  Day, Frank C ^a   Schriger, David L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CORRELATION FUNCTION; EMERGENCY PATIENT; EMERGENCY PHYSICIAN; INTERRATER RELIABILITY; MEASUREMENT; PRIORITY JOURNAL; RESIDENCY EDUCATION; SENSITIVITY AND SPECIFICITY; VALIDATION STUDY; ACUTE CORONARY SYNDROME; ANAMNESIS; EMERGENCY HEALTH SERVICE; EMERGENCY MEDICINE; HUMAN; INFORMATION PROCESSING; METHODOLOGY; NOTE; OBSERVER VARIATION; PERSONNEL; PHYSICIAN; REPRODUCIBILITY; STATISTICS;

ACUTE CORONARY SYNDROME; DATA COLLECTION; EMERGENCY MEDICINE; EMERGENCY SERVICE, HOSPITAL; HUMANS; MEDICAL HISTORY TAKING; OBSERVER VARIATION; PHYSICIANS; REPRODUCIBILITY OF RESULTS; RESEARCH PERSONNEL;

EID: 70449727219     PISSN: 01960644     EISSN: 10976760     Source Type: Journal    
DOI: 10.1016/j.annemergmed.2009.07.013     Document Type: Article

References (14)

1. Cruz C.O., Meshberg E.G., Shofer F.S., et al. Interrater reliability and accuracy of clinicians and trained research assistants performing prospective data collection in emergency department patients with potential acute coronary syndrome. Ann Emerg Med 54 (2009) 1-7
2. Landis J.R., and Koch G.C. The measurement of observer agreement for categorical data. Biometrics 33 (1977) 159-174
3. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measure 20 (1960) 37-46
4. Uebersax J. Statistical methods for rater agreement. http://ourworld.compuserve.com/homepages/jsuebersax/agree.htm Accessed May 31, 2009
5. Wuensch K.L. Inter-rater agreement. http://core.ecu.edu/psyc/wuenschk/docs30/InterRater.doc Accessed May 18, 2009
6. Kendall M. A new measure of rank correlation. Biometrika 30 (1938) 81-89
7. Spearman C. The proof and measurement of association between two things. Am J Psychol 15 (1904) 72-101
8. Noether G.E. Why Kendall tau?. http://rsscse.org.uk/ts/bts/noether/text.html Accessed May 18, 2009
9. Shrout P.E., and Fleiss J.L. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86 (1979) 420-428
10. Bland J.M., and Altman D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1 (1986) 307-310
11. Dewitte K., Fierens C., Stockl D., et al. Application of the Bland-Altman plot for interpretation of method-comparison studies: a critical investigation of its practice. Clin Chem 48 (2002) 799-801
12. Fleiss J.L. Statistical Methods for Rates and Proportions. 2nd ed. (1981), John Wiley & Sons, New York, NY
13. Feinstein A.R., and Cicchetti D.V. High agreement but low kappa, I: the problems of two paradoxes. J Clin Epidemiol 43 (1990) 543-549
14. Cicchetti D.V., and Feinstein A.R. High agreement but low kappa, II: resolving the paradoxes. J Clin Epidemiol 43 (1990) 551-558