Testing the homogeneity of kappa statistics

Biometrics

Volumn 52, Issue 1, 1996, Pages 176-183

  Donner, Allan ^a   Eliasziw, Michael ^b   Klar, Neil ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b ROBARTS RESEARCH INSTITUTE   (Canada)

Author keywords

Agreement; Binary data; Goodness of fit; Reliability

Indexed keywords

INTELLIGENT SYSTEMS;

BINARY DATA; DICHOTOMOUS OUTCOME; GOODNESS OF FIT; GOODNESS OF FIT APPROACHES; INTEROBSERVER AGREEMENT; KAPPA STATISTIC; MONTE CARLO'S SIMULATION; PROPERTY; SAMPLE VARIANCE;

MONTE CARLO METHODS;

ARTICLE; BIOSTATISTICS; MATHEMATICAL ANALYSIS; STATISTICAL ANALYSIS; STATISTICAL MODEL; SYSTEM ANALYSIS; VARIANCE;

EID: 0030003468     PISSN: 0006341X     EISSN: None     Source Type: Journal    
DOI: 10.2307/2533154     Document Type: Article

References (22)

1. Barlow, W., Lai, M. Y., and Azen, S. (1991). A comparison of methods for calculating a stratified kappa. Statistics in Medicine 10, 1465-1472.
2. Bloch, D. A. and Kraemer, H. C. (1989). 2 x 2 kappa coefficients: Measures of agreement or association. Biometrics 45, 269-287.
3. Donner, A. and Eliasziw, M. (1992). A goodness-of-fit approach to inference procedures for the kappa statistic: Confidence interval construction, significance-testing and sample size estimation. Statistics in Medicine 11, 1511-1519.
4. Dunn, G. (1989). Design and Analysis of Reliability Studies. New York: Oxford University Press.
5. Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin 76, 378-382.
6. Fleiss, J. L. (1981). Statistical Methods for Rates and Proportions, 2nd edition. New York: Wiley.
7. Fleiss, J. L. and Cicchetti, D. V. (1978). Inference about weighted kappa in the non-null case. Applied Psychological Measurement 2, 113-117.
8. Fleiss, J. L. and Davies, M. (1982). Jackknifing functions of multinomial frequencies, with an application to a measure of concordance. American Journal of Epidemiology 115, 841-845.
9. Hale, C. A. and Fleiss J. L. (1993). Interval estimation under two study designs for kappa with binary classifications. Biometrics 49, 523-534.
10. Hamdan, M. A. and Martinson, E. O. (1971) Maximum likelihood estimation in the bivariate binomial CO, 1) distribution: Application to 2 x 2 tables. Australian Journal of Statistics 13(3), 154-158.
11. Hannah, M. C., Hopper, J. L., and Mathews, J. D. (1983). Twin concordance for a binary trait. I. Statistical models Illustrated with data on drinking status. Acta Geneticae Medicae et Gemellologlae 32, 127-137.
12. Korten, A. E., Jorm, A. F., Henderson, A. S., McCusker, E., and Creasy, H. (1992). Control-informant agreement on exposure history in case-control studies of Alzheimer's disease. International Journal of Epidemiology 21(6), 1121-1131.
13. Kraemer, H. C. (1992a). How many raters? Toward the most reliable diagnostic consensus. Statistics in Medicine 11, 317-332.
14. Kraemer, H. C. (1992b) Measurement of reliability for categorical data in medical research. Statistical Methods in Medical Research 1, 183-200.
15. Landis, J. R. and Koch, G. G. (1977). A one-way components of variance model for categorical data. Biometrics 33, 671-679.
16. Lee, J. J. and Tu, Z. N. (1994). A better confidence interval for kappa (κ) on measuring agreement between two raters with binary outcomes. Journal of Computational and Graphical Statistics 3(3), 301-321.
17. Lipsitz, S. R., Laird, N. M., and Breman, T. A. (1994). Simple moment estimates of the k-coefficient and its variance. Applied Statistics 43(2), 309-323.
18. Mak, T. K. (1988). Analysing intraclass correlation for dichotomous variables. Applied Statistics 37, 344-352.
19. Scott, W. A. (1955). Reliability of content analysis; the case of nominal scale coding. Public Opinion Quarterly 19, 321-325.
20. Shoukri, M. M., Martin, S. W., and Mian, I. U. H. (1995). Maximum likelihood estimation of the kappa coefficient from models of matched binary responses. Statistics in Medicine 14, 83-99.
21. Thompson, W. D. and Walter, S. D. (1988). A reappraisal of the kappa coefficient. Journal of Clinical Epidemiology 41, 949-958.
22. Zwick, R. (1988). Another look at interrater agreement. Pychological Bulletin 103, 374-378.