A FORTRAN program for computing the exact variance of weighted kappa

Perceptual and Motor Skills

Volumn 101, Issue 2, 2005, Pages 468-472

  Mielke Jr , Paul W ^a   Berry, Kenneth J ^a   Johnston, Janis E ^a  

^a Department of Ecosystem Science and Sustainability   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 31344439498     PISSN: 00315125     EISSN: None     Source Type: Journal    
DOI: 10.2466/pms.101.2.468-472     Document Type: Article

References (23)

1. AGRESTI, A. (2002) Categorical data analysis. (2nd ed.) New York: Wiley.
2. BANERJEE, M., CAPOZZOLI, M., MCSWEENEY, L., & SINHA, D. (1999) Beyond kappa: a review of interrater agreement measures. The Canadian Journal of Statistics, 27, 3-23.
3. BERRY, K. I., JOHNSTON, J. E., & MIELKE, P. W., JR. (2005) Exact and resampling probability values for weighted kappa. Psychological Reports, 96, 243-252.
4. CICCHETTI, D. V. (1981) Testing the normal approximation and minimal sample size requirements of weighted kappa when the number of categories is large. Applied Psychological Measurement, 5, 101-104.
5. CICCHETTI, D. V., & ALLISON, T. (1971) A new procedure for assessing reliability of scoring EEC sleep recordings. The American Journal of EEC Technology, 11, 101-109.
6. CICCHETTI, D. V., & FLEISS, J. L. (1977) Comparison of the null distribution of weighted kappa and the C ordinal statistic. Applied Psychological Measurement, 1, 195-201.
7. COHEN, J. (1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
8. COHEN, J. (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213-220.
9. EVERITT, B. S. (1968) Moments of the statistics kappa and weighted kappa. British Journal of Mathematical and Statistical Psychology, 21, 97-103.
10. FLEISS, J. L. (1981) Statistical methods for rates and proportions. (2nd ed.) New York: Wiley.
11. FLEISS, J. L., & CICCHETTI, D. V. (1978) Inference about weighted kappa in the non-null case. Applied Psychological Measurement, 2, 113-117.
12. FLEISS, J. L., & COHEN, J. (1973) The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613-619.
13. FLEISS, J. L., COHEN, J., & EVERITT, B. S. (1969) Large sample standard errors of kappa and weighted kappa. Psychological Bulletin, 72, 323-327.
14. FLEISS, J. L., LEVIN, B., & PAIK, M. C. (2003) Statistical methods for rates and proportions. (5th ed.) Hoboken, NJ: Wiley.
15. KINGMAN, A. (2002) Beyond weighted kappa when evaluating examiner agreement for ordinal responses. Journal of Dental Research, 81, A219.
16. KRAMER, M. S., & FEINSTEIN, A. R. (1981) Clinical biostatistics: LIV. The biostatistics of concordance. Clinical Pharmacology and Therapeutics, 29, 111-123.
17. KUNDEL, H. L., & POLANSKY, M. (2003) Measurement of observer agreement. Radiology, 228, 303-308.
18. LUDBROOK, J. (2002) Statistical techniques for comparing measures and methods of measurement: a critical review. Clinical and Experimental Pharmacology and Physiology, 29, 527-536.
19. MACLURE, M., &WILLETT, W. C. (1987) Misinterpretation and misuse of the kappa statistic. American Journal of Epidemiology, 126, 161-169.
20. MIELKE, P. W., JR., & BERRY, K. J. (2001) Permutation methods: a distance function approach. New York: Springer-Verlag.
21. PERKINS, S. M., & BECKER, M. P. (2002) Assessing rater agreement using marginal association models. Statistics in Medicine, 21, 1743-1760.
22. SCHUSTER, C. (2004) A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales. Educational and Psychological Measurement, 64, 243-253.
23. SPITZER, R. L., COHEN, J., FLEISS, J. L., & ENDICOTT, J. (1967) Quantification of agreement in psychiatrie diagnosis. Archives of General Psychiatry, 17, 83-87.