Bayesian random effects for interrater and test-retest reliability with nested clinical observations

Journal of Clinical Epidemiology

Volumn 64, Issue 7, 2011, Pages 808-814

  Hsiao, Chuhsing K ^a   Chen, Pei Chun ^a,b   Kao, Wen Hsin ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b PROVIDENCE UNIVERSITY   (Taiwan)

Author keywords

Agreement; Common correlation model; GLMM; Kappa; Reliability; Reproducibility

Indexed keywords

ADULT; ARTICLE; BAYES THEOREM; CORRELATION ANALYSIS; HEALTH CARE QUALITY; HUMAN; INTERRATER RELIABILITY; INTRARATER RELIABILITY; LINEAR SYSTEM; PRIORITY JOURNAL; RANDOMIZATION; STATISTICAL MODEL; TEST RETEST RELIABILITY; TOOTH RADIOGRAPHY; TOOTH ROOT CANAL;

BAYES THEOREM; EFFECT MODIFIERS (EPIDEMIOLOGY); ENDODONTICS; FEASIBILITY STUDIES; HUMANS; LINEAR MODELS; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; ROOT CANAL THERAPY;

EID: 79956207256     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2010.10.015     Document Type: Article

References (29)

1. J. Cohen A coefficient of agreement for nominal scales Educ Psychol Meas 20 1960 37 46
2. J.L. Fleiss, J. Cohen, and B.S. Everitt Large sample standard errors of kappa and weighted kappa Psychol Bull 72 1969 323 327
3. J.L. Fleiss Measuring nominal scale agreement among many raters Psychol Bull 76 1971 378 382
4. A.J. Conger Integration and generalization of kappas for multiple raters Psychol Bull 88 1980 322 328
5. A.M. Liebetrau Measures of association 1983 Sage Thousand Oaks, CA
6. A. Donner A review of inference procedures for the intraclass correlation coefficients in the one-way random effect model Int Stat Rev 54 1986 67 82
7. M.M. Shoukri Measures of interobserver agreement 2004 Chapman & Hall/CRC Boca Raton, FL
8. L.D. Broemeling Bayesian methods for measures of agreement 2009 Chapman & Hall/CRC Boca Raton, FL
9. S. Basu, M. Banerjee, and A. Sen Bayesian inference for kappa from single and multiple studies Biometrics 56 2000 577 582 (Pubitemid 30422651)
10. B.J. Gajewski, S. Hart, S. Bergquist-Beringer, and N. Dunton Inter-rater reliability of pressure ulcer staging: ordinal probit Bayesian hierarchical model that allows for uncertain rater response Stat Med 26 2007 4605 4618
11. W. Barlow Measurement of interrater agreement with adjustment for covariates Biometrics 52 1996 695 702 (Pubitemid 26187073)
12. M.M. Shoukri, and I.U.H. Mian Maximum likelihood estimation of the kappa coefficient from bivariate logistic regression Stat Med 15 1996 1409 1419 (Pubitemid 26242550)
13. S. Ren, S. Yang, and S. Lai Intraclass correlation coefficients and bootstrap methods of hierarchical binary outcomes Stat Med 25 2006 3576 3588 (Pubitemid 44575171)
14. J.L. Fleiss Measuring agreement between two judges on the presence or absence of a trait Biometrics 31 1975 651 659
15. D.A. Bloch, and H.C. Kraemer 2×2 Kappa coefficients: measures of agreement or association Biometrics 45 1989 269 287 (Pubitemid 19109173)
16. H.C. Kraemer Ramifications of a population model for κ as a coefficient of reliability Psychometrika 44 1979 461 472
17. R.R. Bahadur A representation of the joint distribution of responses to n dichotomous items H. Solomon, Studies in Item Analysis and Prediction 1961 Stanford University Press Stanford, CA pp. 158-68
18. H.C.W. De Vet Observer reliability and agreement ArmitageP T. Colton, Encyclopedia Biostatistics Vol 4 1998 John Wiley & Sons, Ltd Chichester, UK 3123 3128
19. H.C.W. De Vet, C.B. Terwee, D.L. Knol, and L.M. Bouter When to use agreement versus reliability measures J Clin Epidemiol 59 2006 1033 1039 (Pubitemid 44376776)
20. Y. Boucher, L. Matossian, F. Rilliard, and P. Machtou Radiographic evaluation of the prevalence and technical quality of root canal treatment in a French subpopulation Int Endod J 35 2002 229 238
21. L.H. Chueh, S.C. Chen, C.M. Lee, Y.Y. Hsu, S.F. Pai, and M.L. Kuo Technical quality of root canal treatment in Taiwan Int Endod J 36 2003 416 422
22. D.V. Cicchetti, F. Volkmar, A. Klin, and D. Showalter Diagnosing autism using ICD-10 criteria: a comparison of neural networks and standard multivariate procedures Child Neuropsychol 1 1995 26 37
23. D.V. Cicchetti, and S.A. Sparrow Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior Am J Ment Defic 86 1981 127 137 (Pubitemid 11006962)
24. J.L. Fleiss Statistical methods for rates and proportions 2nd ed. 1981 Wiley New York, NY
25. J.L. Fleiss, B. Levin, and M.C. Paik Statistical methods for rates and propostions 3rd ed. 2003 Wiley New York, NY
26. J.R. Landis, and G.G. Koch The measurement of observer agreement for categorical data Biometrics 33 1977 159 174 (Pubitemid 8054849)
27. D.J. Lunn, A. Thomas, N. Best, and D. Spiegelhalter WinBUGS - a Bayesian modeling framework: concepts, structure, and extensibility Stat Comput 10 2000 325 337
28. D.J. Spiegelhalter, A. Thomas, N. Best, and D. Lunn WinBUGS Version 1.4 user manual 2003 MRC Biostatistics Unit Cambridge, UK
29. A.R. Feinstein, and D.V. Cicchetti High agreement but low kappa: I. The problems of two paradoxes J Clin Epidemiol 43 1990 543 549 (Pubitemid 20178543)