The statistical analysis of kappa statistics in multiple samples

Journal of Clinical Epidemiology

Volumn 49, Issue 9, 1996, Pages 1053-1058

  Donner, Allan ^a   Klar, Neil ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Interobserver agreement; Kappa; Meta analysis

Indexed keywords

ARTICLE; BONE SCINTISCANNING; META ANALYSIS; OSTEOMYELITIS; PRIORITY JOURNAL; SAMPLE; SMOKING; STATISTICAL ANALYSIS; VITREORETINOPATHY;

EID: 0030246854     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/0895-4356(96)00057-1     Document Type: Article

References (27)

1. 1. Fleiss JL. Measuring agreement between two judges on the presence or absence of a trait. Biometrics 1975; 31: 651-659.
2. 2. Kraemer HC. Ramifications of a population model for κ as a coefficient of reliability, Psychometrika 1979; 44: 461-472.
3. 3. Mak TK. Analysing intraclass correlation for dichotomous variables. Appl Stat 1988; 37: 344-352.
4. 4. Fleiss JL. Statistical Methods for Rates and Proportions, 2nd Ed. John Wiley & Sons, New York, 1981.
5. 5. Bloch DA, Kraemer HC. 2 × 2 kappa coefficients: Measures of agreement or association. Biometrics 1989; 45: 269-287.
6. 6. Kraemer HC. How many raters? Toward the most reliable diagnostic consensus. Stat Med 1992; 11: 317-332.
7. 7. Kraemer HC. Measurement of reliability for categorical data in medical research. Stat Methods Med Res 1992; 1: 183-200.
8. 8. Donner A, Eliasziw M. A goodness-of-fit approach to inference procedures for the kappa statistic: Confidence interval construction, significance-testing and sample size estimation. Stat Med 1992; 11: 1511-1519.
9. 9. Hale CA, Fleiss JL. Interval estimation under two study designs for kappa with binary classifications. Biometrics 1993; 49: 523-534.
10. 10. Bodian CA. Intraclass correlation for two-by-two tables under three sampling designs. Biometrics 1994; 50: 183-193.
11. 11. Graham P. Modelling covariate effects in observer agreement studies: The case of nominal scale agreement. Stat Med 1995; 14: 299-310.
12. 12. Shoukri MM, Mian IUH. Maximum likelihood estimation of the kappa coefficient from bivariate logistic regression. Stat Med 1996 (in press).
13. 13. Barlow W, Lai MY, Azen S. A comparison of methods for calculating a stratified kappa. Stat Med 1991; 10: 1465-1472.
14. 14. Hannah MC, Hopper JL, Mathews JD. Twin concordance for a binary trait. II. Nested analysis of ever-smoking and ex-smoking traits and unnested analysis of a "Committed-Smoking" trait. Am J Hum Genet 1985; 37: 153-165.
15. 15. Thompson WD, Walter SD, A reappraisal of the kappa coefficient. J Clin Epidemiol 1988; 41: 949-958.
16. 16. Donner A, Eliasziw M, Klar N. Testing the homogeneity of kappa statistics. Biometrics 1996; 52: 176-183.
17. 17. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174.
18. 18. Littenberg B, Mushlin AI, and the Diagnostic Technology Assessment Consortium. Technetium bone scanning in the diagnosis of osteomyelitis: A meta-analysis of test performance. J Gen Intern Med 1992; 7: 158-163.
19. 19. Irwig L, Macaskill P, Glasziou P, Fahey M. Meta-analysis methods for diagnostic test accuracy. J Clin Epidemiol 1995; 48(1): 119-130.
20. 20. Fahey MT, Irwig L, Macaskill P. Meta-analysis of Pap test accuracy. Am J Epidemiol 1995; 141(7): 680-689.
21. 21. Hasselblad V, McCrory DC. Meta-analytic tools for medical decision making: A practical guide. Med Decis Making 1995; 15: 81-96.
22. 22. Koran LM. The reliability of clinical methods, data and judgements. N Engl J Med 1975;. 293(13): 642-646.
23. 23. Nelson LM, Longstreth WT Jr, Koepsell TD, van Belle G. Proxy respondents in epidemiologic research. Epidemiol Rev 1990; 12: 71-86.
24. 24. Fleiss JL, Davies M. Jackknifing functions of multinomial frequencies, with an application to a measure of concordance. Am J Epidemiol 1982; 115: 841-845.
25. 25. Cicchetti DV, Feinstein AR. High agreement but low kappa. II. Resolving the paradoxes. J Clin Epidemiol 1990; 43: 551-558.
26. 2 in certain discrete distributions. Biometrika 1949; 36: 117-129.
27. 27. Armitage P, Berry G. Statistical Methods in Medical Research, 3rd Ed. Blackwell Scientific Publications, London, 1994.