Coefficients of agreement for fixed observers

Statistical Methods in Medical Research

Volumn 15, Issue 3, 2006, Pages 255-271

  Haber, Michael J ^a   Barnhart, Huiman X ^b  

^a EMORY UNIVERSITY   (United States)

^b DUKE CLINICAL RESEARCH INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ANALYSIS OF VARIANCE; ARTICLE; CAROTID ARTERIOGRAPHY; CAROTID ARTERY OBSTRUCTION; CONTROLLED STUDY; CORRELATION COEFFICIENT; HUMAN; IMAGE ANALYSIS; INDEPENDENCE; INTERMETHOD COMPARISON; INTERRATER RELIABILITY; MAGNETIC RESONANCE ANGIOGRAPHY; MEASUREMENT ERROR; OBSERVER VARIATION; PROBABILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; VARIANCE;

ANALYSIS OF VARIANCE; BIOMEDICAL RESEARCH; CAROTID STENOSIS; CLINICAL TRIALS; COMPUTER SIMULATION; HUMANS; MAGNETIC RESONANCE ANGIOGRAPHY; MODELS, STATISTICAL; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS;

EID: 33744826790     PISSN: 09622802     EISSN: None     Source Type: Journal    
DOI: 10.1191/0962280206sm441oa     Document Type: Article

References (22)

1. Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol. Rep. 1966; 19: 3-11.
2. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol. Bull. 1979; 86: 420-28.
3. Muller R, Buttner P. A critical discussion of intraclass correlation coefficients. Stat. Med. 1994; 13: 2465-76.
4. McGraw KO, Wong SP. Forming inferences on intraclass correlation coefficients. Psychol. Methods 1996; 1: 30-46.
5. Bartko JJ. Corrective note to: the intraclass correlation coefficient as a measure of reliability. Psychol. Rep. 1974; 34: 418.
6. Lin L. A concordance correlation coefficient to evaluate reproducibility. Biometrics 1989; 45: 255-68.
7. Krippendorff K. Bivariate agreement coefficients for reliability of data. Sociol. Method. 1970; 2: 139-50.
8. Zegers FE. A family of chance-corrected association coefficients for metric scales. Psychometrika 1986; 51: 559-62.
9. Barnhart HX, Haber M, Song J. Overall concordance correlation coefficient for evaluating agreement among multiple observers. Biometrics 2002; 58: 1020-27.
10. Song J. Assessing agreement/association for continuous measurement scales. PhD thesis, Emory University, 2003.
11. Stine WW. Interobserver relational agreement. Psychol. Bull. 1989; 106: 341-47.
12. Fagot RF. A generalized family of coefficients of relational agreement for numerical scales. Psychometrika 1993; 58: 357-70.
13. Fagot RF. An ordinal coefficient of relational agreement for multiple judges. Psychometrika 1994; 59: 241-51.
14. Zegers FE, ten Berge JMF. A family of association coefficients for metric scales. Psychometrika 1985; 50: 17-24.
15. Zegers FE. Coefficients for interrater agreement. Appl. Psychol. Meas. 1991; 15: 321-33.
16. Haber M, Barnhart HX, Song J, Gruden J. Observer variability: a new approach in evaluating interobserver agreement. J. Data Sci. 2005; 3: 69-83.
17. Barnhart HX, Song J, Haber M. Assessing agreement in studies designed with replicated measurements. Stat. Med. 2005; 24: 1371-84.
18. Schall R, Luus HG. On population and individual bioequivalence. Stat. Med. 1993; 12: 1109-24.
19. Kelderman H. Measurement exchangeability and normal one-factor models. Biometrika 2004; 91: 738-42.
20. Atkinson G, Nevill A. Comment on the use of concordance correlation to assess the agreement between variables. Biometrics 1997; 53: 775-78.
21. Dunn G. Statistical evaluation of measurement errors, second edition. London: Arnold, 2004.
22. Shoukri MM. Measures of interobserver agreement. Boca Raton: Chapman & Hall/CRC, 2004.