Testing the equality of two dependent kappa statistics

Statistics in Medicine

Volumn 19, Issue 3, 2000, Pages 373-387

  Donner, Allan ^a   Shoukri, Mohamed M ^b   Klar, Neil ^c   Bartfay, Emma ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b UNIVERSITY OF GUELPH   (Canada)

^c DANA FARBER CANCER INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; QUALITY CONTROL; SIMULATION; STATISTICAL ANALYSIS; STATISTICAL MODEL; SYSTEM ANALYSIS; VARIANCE;

ANALYSIS OF VARIANCE; BIOMETRY; HUMANS; MODELS, STATISTICAL; OBSERVER VARIATION;

EID: 0034651972     PISSN: 02776715     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1097-0258(20000215)19:3<373::AID-SIM337>3.0.CO;2-Y     Document Type: Article

References (34)

1. Alsawalmeh, Y. M. and Feldt, L. S. 'Testing the equality of two related intraclass reliability coefficients', Applied Psychological Measurement, 18, 183-190 (1994).
2. Korten, A. E. Jorm, A. F., Henderson, A. S., McCusker, E. and Creasey, H. 'Control-informant agreement on exposure history in case-control studies of Alzheimer's disease', International Journal of Epidemiology, 21, 1121-1131 (1992).
3. Browman, G. P., Markman, S., Thompson, G., Minuk, T., Chirawatkul, A. and Roberts, R. S. 'Assessment of observer variation in measuring the radiographic vertebral index in patients with multiple myelomad', Journal of Clinical Epidemiology, 43, 833-840 (1990).
4. Baker, S. G., Freedman, L. S. and Parmar, M. K. B. 'Using replicate observations in observer agreement studies with binary assessments', Biometrics, 47, 1327-1338 (1991).
5. Kraemer, H. C. and Komer, A. F. 'Statistical alternatives in assessing reliability, consistency and individual differences for quantitative measures: applications to behavioural measures of neonates', Psychological Bulletin, 83, 914-921 (1976).
6. Shrout, P. E. and Fleiss, J. L. 'Intraclass correlation: Uses in assessing rater reliability', Psychological Bulletin, 86, 420-428 ( 1979).
7. Kraemer, H. C. 'Extension of Feldt's approach to testing homogeneity of coefficients of reliability', Psychometrika 45, 41-45 (1981).
8. Feldt, D. S. 'A test of the hypothesis that Cronbach's alpha reliability coefficient is the same for two tests administered to the same sample', Psychometrika, 45, 99-105 (1980).
9. Kraemer, H. C. 'On estimation and hypothesis testing problems for correlation coefficients', Psychometrika, 40, 473-485 (1975).
10. Bloch, D. A. and Kraemer, H. C. '2×2 kappa coefficients: measures of agreement or association', Biometrics, 45, 269-287 (1989).
11. Cohen, J. 'A coefficient of agreement for nominal scales', Educational and Psychological Measurement, 20, 37-46 (1960).
12. Hale, C. A. and Fleiss, J. L. 'Interval estimation under two study designs for kappa with binary classifications', Biometrics, 49, 523-534 (1993).
13. Dunn, G. Design and Analysis of Reliability Studies, Oxford University Press, Oxford, New York, 1989.
14. Landis, J. R. and Koch, G. G. 'A one-way components of variance model for categorical data', Biometrics, 33, 671-679 (1977).
15. Scott, W. A. 'Reliability of content analysis; the case of nominal scale codin', Public Opinion Quarterly, 19, 321-325 (1955).
16. Zwick, R. 'Another look at interrater agreement', Psychological Bulletin, 103, 374-378 (1988).
17. Donner, A., Eliasziw, M. and Klar, N. 'Testing the homogeneity of kappa statistics', Biometrics, 52, 176-183 (1996).
18. Donner A. and Eliasziw, M. 'A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation', Statistics in Medicine, 11, 1511-1519 (1992).
19. Donner, A. 'Sample size requirements for the comparison of two or more coefficients of interobserver agreement', Statistics in Medicine, 17, 1157-1168 (1998).
20. Workum, P., BelBoro, E. A., Halford, S. K. and Murphy, R. L. H. 'Observer agreement, chest ausculation, and crackles in asbestos-exposed workers', Chest, 89, 27-29 (1986).
21. Hill, C., Keks, S., Roberts, S., Opeskin, K., Dean, B., MacKinnon, A. and Capolov, D. 'Problem of diagnosis in postmortem brain studies of schizophrenia', American Journal of Psychiatry, 153, 533-537 (1996).
22. McKenzie, D. P., MacKinnon, A. J., Péladeau, N., Onghena, P., Bruce, P. C., Clarke, D. M., Harrigan, S. and McGorry, P. D. 'Comparing correlated kappas by resampling: Is one level of agreement significantly different from another', Journal of Psychiatry Research, 30, 483-492 (1996).
23. Williamson, J. M. and Manatunga, A. K. 'The Consultant's Forum: Assessing interrater agreement from dependent data', Biometrics, 53, 707-714 (1997).
24. Rosner, B. 'Multivariate methods for clustered binary data with more than one level of nesting', Journal of the American Statistical Association, 84, 373-380 (1989).
25. Rosner, B. 'Multivariate methods for clustered binary data with multiple subclasses, with application to binary longitudinal data', Biometrics, 48, 721-731 (1992).
26. Fleiss, J. L. 'Measuring nominal scale agreement among many raters', Psychological Bulletin, 76, 378-382 (1971).
27. Oden, N. 'Estimating kappa from binocular data', Statistics in Medicine, 10, 1303-1311 (1991).
28. Rosner, B. 'Statistical methods in ophthalmology: An adjustment for the intraclass correlation between eyes', Biometrics, 38, 105-114 (1982).
29. Schouten, H. J. A. 'Estimating kappa from binocular data and comparing marginal probabilities', Statistics in Medicine, 12, 2207-2217 (1993).
30. Donner, A., Koval, J. J. and Bull, S. 'Testing the effect of sex differences on sib-sib correlations', Biometrics, 40, 349-356 (1984).
31. Coren, S. and Hakstian, R. 'Methodological implications of interaural correlation: Count heads not ears', Perception and Psychophysics, 48, 291-294 (1990).
32. Thompson, W. D. and Walter, S. D. 'A reappraisal of the kappa statistic', Journal of Clinical Epidemiology, 41, 949-958 (1988).
33. Stuart, A. and Ord, K. Advanced Theory of Statistics, Volume 1, 1987, pp. 324.
34. Stuart, A. 'Test for the homogeneity the marginal distributions in a two-way classification', Biometrika, 42, 412-416 (1995).