Assessing interrater agreement from dependent data

Biometrics

Volumn 53, Issue 2, 1997, Pages 707-714

  Williamson, John M ^a   Manatunga, Amita K ^b  

^a CENTERS FOR DISEASE CONTROL AND PREVENTION   (United States)

^b EMORY UNIVERSITY   (United States)

Author keywords

Correlated random effects; Interrater agreement; Intraclass correlation coefficient; Ordered categorical data

Indexed keywords

CORRELATED RANDOM EFFECT; INTER-RATER AGREEMENTS; INTRACLASS CORRELATION COEFFICIENTS; LATENT MODELS; ORDERED CATEGORICAL DATA; RANDOM EFFECTS; VARIANCE COMPONENTS; VISUAL ASSESSMENTS;

RANDOM PROCESSES;

ACCURACY; ARTICLE; DATA ANALYSIS; MATHEMATICAL MODEL; MEASUREMENT;

EID: 0030948879     PISSN: 0006341X     EISSN: None     Source Type: Journal    
DOI: 10.2307/2533970     Document Type: Article

References (20)

1. Alsawalmeh, Y. M. and Feldt, L. S. (1992). Test of the hypothesis that the intraclass reliability coefficient is the same for two measurement procedures. Applied Psychological Measurement 16, 195-205.
2. Bartko, J. J. (1966). The intraclass correlation coefficient as a measure of reliability. Psychological Reports 19, 3-11.
3. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20, 37-46.
4. Davies, M. and Fleiss, J. L. (1982). Measuring agreement for multinomial data. Biometrics 38, 1047-1051.
5. Donner, A. (1986). A review of inference procedures for the intraclass correlation coefficient in the one-way random effects model. International Statistical Review 54, 67-82.
6. Donner, A. and Bull, S. (1983). Inferences concerning a common intraclass correlation coefficient. Biometrics 39, 771-775.
7. Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin 76(5), 378-382.
8. Fleiss, J. L., Nee, J. C. M., and Landis, J. R. (1979). Large sample variance of kappa in the case of different sets of raters. Psychological Bulletin 86(5), 974-977.
9. Kim, K. (1995). A bivariate cumulative probit regression model for ordered categorical data. Statistics in Medicine 14, 1341-1352.
10. Kraemer, H. C. (1980). Extension of the kappa coefficient. Biometrics 36, 207-216.
11. Landis, R. J. and Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159-174.
12. Liang, K. Y. and Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika 73, 13-22.
13. Lipsitz, S. R., Laird, N. M., and Brennan, T. A. (1994). Simple moment estimates of the κ-coefficient and its variance. Applied Statistics 43, 309-323.
14. Moss, G. B., Clemetson, D., D' Costa, L., and Plummer, F. A. (1991). Association of cervical ectopy with heterosexual transmission of HIV: Results of a study of couples in Nairobi, Kenya. Journal of Infectious Disease 164, 588-591.
15. Posner, K. L., Sampson, P. D., Caplan, R. A., Ward, R. J., and Cheney, F. W. (1990). Measuring interrater reliability among multiple raters: An example of methods for nominal data. Statistics in Medicine 9, 1103-1115.
16. Prentice, R. L. (1988). Correlated binary regression with covariates specific to each binary observation. Biometrics 44, 1033-1048.
17. Qu, Y., Piedmonte, M. R., and Medendorp, S. V. (1995). Latent variable models for clustered ordinal data. Biometrics 51, 268-275.
18. Qu, Y., Williams, G. W., Beck, G. J., and Medendorp, S. V. (1992). Latent variable models for clustered dichotomous data with multiple subclusters. Biometrics 48, 1095-1102.
19. Tanner, M. A. and Young, M. A. (1985). Modeling agreement among raters. Journal of the American Statistical Association 80, 175-180.
20. Zeger, S. L. and Liang, K. Y. (1986). Longitudinal data analysis for discrete and continuous outcomes. Biometrics 42, 121-130.