Estimators of kappa-exact small sample properties

Journal of Statistical Computation and Simulation

Volumn 55, Issue 4, 1996, Pages 315-336

  Koval, John J ^b   Blackman, Nicole J M ^a,b  

^a GLAXOSMITHKLINE   (Canada)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

2 tables; 2 ; Interrater agreement; Jackknife; Kappa statistic

Indexed keywords

EID: 0030374549     PISSN: 00949655     EISSN: None     Source Type: Journal    
DOI: 10.1080/00949659608811773     Document Type: Article

References (20)

1. Bartko J. J. (1966) "The Intraclass Correlation Coefficient as a Measure of Reliability," Psychological Reports, 19, 3-11.
2. Blackman, N. J.-M. and Koval, J. J. (1993) "Estimating Rater Agreement in 2 × 2 Tables: Correction for Chance and Intraclass Correlation, " Applied Psychological Measurement, 17, 211-233.
3. Bloch, D. A. and Kraemer, H. C. (1989) "2 × 2 Kappa Coefficients: Measures of Agreement or Association, "Biometrics, 45, 269-287.
4. Cohen, J. (1960) "A Coefficient of Agreement for Nominal Scales," Education and Psychological Measurement, 20, 37-46.
5. Donner, A. and Eliasziw, M. (1992) " A Goodness-of-fit Approach to Inference Procedures for the Kappa Statistic: Confidence Interval Construction, Significance-testing and Sample Size Estimation, " Statistics in Medicine, 11, 1511-1519.
6. Feinstein, A. R. (1985) " A Bibliography of Publications on Observer Variability," Journal of Chronic Diseases, 38, 619-632.
7. Fisher R. A. (1970) Statistical Methods for Research Workers, 14th edition. New York: Hafner.
8. Fleiss J. L. (1975) "Measuring Agreement between Two Judges on the Presence or Absence of a Trait, " Biometrics, 31, 651-659.
9. Fleiss, J. L., Cohen, J. and Everitt, B. S. (1969) "Large Sample Standard Errors of Kappa and Weighted Kappa, " Psychological Bulletin, 5, 323-327.
10. Kraemer, H. C. (1979) "Ramifications of a Population Model for as Coefficient of Reliability," Psychometrika, 44, 461-472.
11. Kraemer, H. C. (1980) "Extension of the Kappa Coefficient," Biometrics, 36, 207-216.
12. Landis, R. J. and Koch, G. G. (1975) "A Review of Statistical Methods in the Analysis of Data Arising form Observer Reliability Studies (Parts I and II), "Statistica Neerlandica, 3, 101-161.
13. Mak, Tak K. (1988) "Analyzing Intraclass Correlation for Dichotomous Variables, " Applied Statistics, 37, 344-352.
14. Maxwell A. E. and Pilliner, A. E. G. (1968) "Deriving Coeffcients of Reliability and Agreement for Ratings, " The British Journal of Mathematical and Statistical Psychology, 21, 105-116.
15. Miller, R. G. (1964) "A Trustworthy Jackknife," Annals of Mathematical Statistics, 35, 1594-1605.
16. Quenouille, M. H. (1956) "Notes on Bias in Estimation," Biometrika, 43, 353-360.
17. Rao, C. R. (1965) Linear Statistical Inference and its Applications, Wiley: New York.
18. Scott, W. A. (1955). "Reliability or Content Analysis: the Case of Nominal Scale Coding," Public Opinion Quarterly, 19, 321-325.
19. Tukey, J. W. (1958) "Bias and Confidence Intervals in Not-quite Large Samples," Annals of Mathematical Statistics, 29, 614-616.
20. Zwich R. (1988) "Another Look at Interrater Agreement," Psychological Bulletin, 3, 374-378.