Modelling patterns of agreement for nominal scales

Statistics in Medicine

Volumn 27, Issue 6, 2008, Pages 810-830

  Roberts, Chris ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Heterogeneity; Homogeneity; Kappa; Nominal scale agreement; Twin studies

Indexed keywords

ARTICLE; CALCULATION; CHI SQUARE TEST; CONFIDENCE INTERVAL; CONTROLLED STUDY; DIZYGOTIC TWINS; GENETIC ANALYSIS; INTERMETHOD COMPARISON; KAPPA STATISTICS; MATHEMATICAL COMPUTING; MONOZYGOTIC TWINS; PREVALENCE; RELIABILITY; SAMPLE SIZE; SIMULATION; STATISTICAL MODEL;

FEMALE; HUMANS; HYPERSENSITIVITY, IMMEDIATE; INFANT, NEWBORN; LIKELIHOOD FUNCTIONS; LINEAR MODELS; NEURODERMATITIS; OBSERVER VARIATION; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; SMOKING; TWIN STUDIES AS TOPIC;

EID: 40449108560     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.2945     Document Type: Article

References (37)

1. Cohen JA. Coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 10:37-46.
2. Fleiss JL. Measuring nominal scale agreement among many raters. Psychological Bulletin 1971; 76:378-383.
3. Bloch DA, Kraemer HC. 2 × 2 kappa coefficients measures of agreement and association. Biometrics 1989; 45:269-288.
4. Kraemer HC. Ramification of a population model of K as a coefficient of reliability. Psychometrika 1979; 44:461-472.
5. Garner JB. The standard error of Cohen's kappa. Statistics in Medicine 1991; 10:767-775.
6. Hale CA, Fleiss JL. Interval estimation under two study designs for kappa with binary classifications. Biometrics 1993; 49:523-524.
7. Donner A, Eliasziw M. A goodness-of-fit approach to inference procedures for kappa statistics: confidence interval construction, significance - testing and sample size estimation. Statistics in Medicine 1992; 11:1511-1519.
8. Basu S, Basu A. Comparison of several goodness-of-fit tests for the kappa statistic based on exact power and coverage probability. Statistics in Medicine 1995; 14:347-356.
9. Nam J. Interval estimation of the kappa coefficient with binary classification and an equal marginal probability model. Biometrics 2000; 56:583-585.
10. Blackman NJM, Koval JJ. Interval estimation for Cohen's kappa as a measure of agreement. Statistics in Medicine 2000; 19:723-741.
11. Nam J. Testing the intraclass version of kappa coefficient of agreement with binary scale and sample size determination. Biometrical Journal 2002; 44:558-570.
12. Mekibib A, Donner A, Klar N. Inference procedures for assessing interobserver agreement among multiple raters. Biometrics 2001; 57:584-588.
13. Donner A, Klar N. The statistical analysis of kappa statistics in multiple samples. Journal of Clinical Epidemiology 1996; 49:1053-1058.
14. Donner A, Eliasziw M, Klar N. Testing the homogeneity of kappa statistics. Biometrics 1996; 52:176-183.
15. Nam J. Homogeneity score test for the intraclass version of the kappa statistic and sample-size determination in multiple or stratified studies. Biometrics 2003; 59:1027-1035.
16. Roberts C, McNamee R. Assessing the reliability of ordered categorical scales using kappa-type statistics. Statistical Methods in Medical Research 2005; 14:493-514.
17. Bartfay E, Donner A. Statistical inferences for interobserver agreement studies with nominal data. The Statistician 2001; 50:135-146.
18. Bartfay B, Donner A. Statistical inferences for a twin correlation with multinominal outcomes. Statistics in Medicine 2001; 20:249-262.
19. Bartfay E, Donner A. The effect of collapsing multinomial data when assessing agreement. International Journal of Epidemiology 2000; 29:1070-1075.
20. Bartfay E, Donner A, Klar N. Testing equality of twin correlations in multinomial outcomes. Annals of Human Genetics 1999; 63:341-349.
21. Landis JR, Koch GG. A one-way components of variance model for categorical data. Biometrics 1977; 33:671-679.
22. Roberts C, McNamee R. A matrix of kappa-type coefficients to assess the reliability of nominal scales. Statistics in Medicine 1998; 17:471-488.
23. Agresti A. A model for agreement between ratings on an ordinal scale. Biometrics 1988; 44:539-548.
24. Becker MP, Agresti A. Log-linear modelling of pairwise interobserver agreement on a categorical scale. Statistics in Medicine 1992; 11:101-114.
25. Agresti A. Modelling patterns of agreement and disagreement. Statistical Methods in Medical Research 1992; 1:201-218.
26. Guggenmoos-Holzmann I, Vonk R. Kappa-like indices of observer agreement viewed from a latent class perspective. Statistics in Medicine 1998; 17:797-812.
27. Gould W, Pitblado J, Sribney W. Maximum Likelihood Estimation with Stata (2nd edn). Stata Press: TX, 2003.
28. StataCorp. Stata Statistical Software Release 9.2. Stata Corporation: College Station, TX, 2005.
29. Microsoft® Office Excel, part of Micro-soft Office Professional 2003, ©1985-2003 Microsoft Corporation, U.S.A.
30. Thompson WD, Walter SD. A reappraisal of the kappa statistic. Journal of Clinical Epidemiology 1988; 41: 949-958.
31. Agresti A. Categorical Data Analysis (2nd edn). Wiley: New York, 2002; 396.
32. James IR. Analysis of nonagreement amongst multiple raters. Biometrics 1983; 39:651-657.
33. Hannah MC, Hopper JH, Mathews JD. Twin concordance for a binary trait II nested analysis of ever smoking and ex-smoking traits and unnested analysis of a 'committed-smoking' traits. Acta Geneticae Gemellology 1985; 37: 153-154.
34. Kraemer HC. What is the right statistical measure of twin concordance (or diagnostic reliability and validity)? Archives of General Psychiatry 1997; 54:1121-1124.
35. Christian JC, Williams CJ. Comparison of analysis of variance and likelihood models of twin data analysis. In Advances in Twin and Sib-pair Studies, Spector TD, Sniedor H, MacGregor AJ (eds). Oxford University Press: London, 2000.
36. Spitznagel EL, Helzer JEA. Proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry 1985; 42:725-728.
37. Gjorup T. The kappa coefficient and the prevalence of diagnosis. Methods of Information in Medicine 1988; 27:184-186.