Assessment of observer agreement for matched repeated binary measurements

Computational Statistics and Data Analysis

Volumn 56, Issue 5, 2012, Pages 1052-1060

  Gao, Jingjing ^a   Pan, Yi ^a   Haber, Michael ^a  

^a EMORY UNIVERSITY   (United States)

Author keywords

Binary data; Coefficient of individual agreement; Generalized linear mixed model; Observer agreement; Repeated measurements

Indexed keywords

BINARY DATA; COEFFICIENT OF INDIVIDUAL AGREEMENT; GENERALIZED LINEAR MIXED MODELS; OBSERVER AGREEMENT; REPEATED MEASUREMENTS;

COMPUTATIONAL METHODS; DATA HANDLING;

RATING;

EID: 84857640539     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2011.11.005     Document Type: Article

References (36)

1. H.X. Barnhart, M. Haber, and A.S. Kosinski Assessing individual agreement Journal of Biopharmaceutical Statistics 17 2007 697 719 (Pubitemid 47027016)
2. H.X. Barnhart, M. Haber, and L.I. Lin An overview on assessing agreement with continuous measurements Journal of Biopharmaceutical Statistics 17 2007 529 569 (Pubitemid 47027007)
3. H.X. Barnhart, M. Haber, Y. Lokhnygina, and A.S. Kosinski Comparison of concordance correlation coefficient and coefficient of individual agreement in assessing agreement Journal of Biopharmaceutical Statistics 17 2007 721 738 (Pubitemid 47027015)
4. H.X. Barnhart, M. Haber, and J. Song Overall concordance correlation coefficient for evaluating agreement among multiple observers Biometrics 58 2002 1020 1027 (Pubitemid 36133782)
5. H.X. Barnhart, J. Song, and M. Haber Assessing intra, inter, and total agreement with replicated measurements Statistics in Medicine 24 2005 1371 1384 (Pubitemid 40585174)
6. J.J. Bartko The intraclass correlation coefficient as a measure of reliability Psychological Reports 19 1966 3 11
7. J.J. Bartko Corrective note to the intraclass correlation coefficient as a measure of reliability Psychological Reports 34 1974 418
8. J.L. Carrasco A generalized concordance correlation coefficient based on the variance components generalized linear mixed models for overdispersed count data Biometrics 66 2010 897 904
9. J. Cohen A coefficient of agreement for nominal scales Educational and Psychological Measurement 20 1960 37 46
10. J. Cohen Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit Psychological Bulletin 70 1968 213 220
11. M. Eliasziw, S.L. Young, M.G. Woodbury, and K. Fryday-Field Statistical methodology for the concurrent assessment of interrater and intrarater reliability: using goniometric measurements as an example Physical Therapy 74 1994 777 788 (Pubitemid 24245119)
12. J.G. Elmore, C.K. Wells, C.H. Lee, D.H. Howard, and A. Feinstein Variability in radiologists' interpretation of mammograms New England Journal of Medicine 331 1994 1493 1499
13. A.R. Feinstein, and D.V. Cicchetti High agreement but low kappa Journal of Clinical Epidemiology 43 1990 543 558
14. M. Haber, and H.X. Barnhart A general approach to evaluating agreement between two observers or methods of measurement Statistical Methods in Medical Research 17 2008 151 169
15. M. Haber, H.X. Barnhart, J. Song, and J. Gruden Observer variability: a new approach in evaluating interobserver agreement Journal of Data Science 3 2005 69 83
16. M. Haber, J. Gao, and H.X. Barnhart Assessing observer agreement in studies involving replicated binary observations Journal of Biopharmaceutical Statistics 17 2007 757 766 (Pubitemid 47027014)
17. M. Haber, J. Gao, and H.X. Barnhart Evaluation of agreement between measurement methods from data with matched repeated measurements via the coefficient of individual agreement Journal of Data Science 8 2010 457 469
18. T.S. King, and V.M. Chinchilli A generalized concordance correlation coefficient for continuous and categorical data Statistics in Medicine 20 2001 2131 2174
19. T.S. King, and V.M. Chinchilli Robust estimators of the concordance correlation coefficients Journal of Biopharmaceutical Statistics 11 2001 83 105 (Pubitemid 33062682)
20. T.S. King, V.M. Chinchilli, J.L. Carrasco, and K. Wang A class of repeated measures concordance correlation coefficients Journal of Biopharmaceutical Statistics 17 2007 653 672 (Pubitemid 47027017)
21. D.B. Kopans The accuracy of mammographic interpretation New England Journal of Medicine 331 1994 1521 1522 (Pubitemid 24356316)
22. H.C. Kraemer Ramifications of a population model for kappa as a coefficient of reliability Psychometrika 44 1979 461 472
23. J.R. Landis, and G.G. Koch The measurement of observer agreement for categorical data Biometrics 33 1977 159 174 (Pubitemid 8054849)
24. L.I. Lin A concordance correlation coefficient to evaluate reproducibility Biometrics 45 1989 255 268
25. L.I. Lin Assay validation using the concordance correlation coefficient Biometrics 48 1992 599 604
26. L.I. Lin A note on the concordance correlation coefficients Biometrics 56 2000 324 325
27. L.I. Lin Total deviation index for measuring individual agreement with applications in laboratory performance and bioequivalence Statistics in Medicine 19 2000 255 270 (Pubitemid 30051246)
28. L.I. Lin, A.S. Hedayat, B. Sinha, and M. Yang Statistical methods in assessing agreement: models, issues and tools Journal of American Statistical Association 97 2002 257 270
29. L.I. Lin, A.S. Hedayat, and W. Wenting A unified approach for assessing agreement for continuous and categorical data Journal of Biopharmaceutical Statistics 17 2007 629 652 (Pubitemid 47027011)
30. K.O. McGraw, and S.P. Wong Forming inferences about some intraclass correlation coefficients Psychological Methods 1 1996 30 46 (Pubitemid 126421252)
31. R. Muller, and P. Buttner A critical discussion of intraclass correlation coefficients Statistics in Medicine 13 1994 2465 2476
32. Y. Pan, J. Gao, M. Haber, and H.X. Barnhart Estimation of coefficients of individual agreement (CIAs) for quantitative and binary data using SAS and R Computer Methods and Programs in Biomedicine 98 2010 214 219
33. Y. Pan, M. Haber, and H.X. Barnhart A new permutation-based method for assessing agreement between two observers making replicated binary readings Statistics in Medicine 30 2011 839 853
34. J.C. Pinheiro, and D.M. Bates Approximations to the loglikelihood function in the nonlinear mixed effects model Journal of Computational and Graphical Statistics 4 1995 12 35
35. J.C. Pinheiro, and E.C. Chao Efficient Laplacian and adaptive gaussian quadrature algorithms for multilevel generalized linear mixed models Journal of Computational and Graphical Statistics 15 2006 58 81 (Pubitemid 43514411)
36. P.E. Shrout, and J.L. Fleiss Intraclass correlations: uses in assessing rater reliability Psychological Bulletin 86 1979 420 428