Chance-corrected measures of reliability and validity in K x K tables

Statistical Methods in Medical Research

Volumn 14, Issue 5, 2005, Pages 473-492

  Martin Andres A ^a   Femia Marzo, P ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTIC METHOD; CONTROLLED STUDY; HEART INFARCTION; HUMAN; MAJOR CLINICAL STUDY; NEUROSIS; PSYCHOSIS; RELIABILITY; REVIEW; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; STATISTICAL PARAMETERS; VALIDATION PROCESS;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; OBSERVER VARIATION; PSYCHOLOGY; REPRODUCIBILITY OF RESULTS; SPAIN;

EID: 27144485399     PISSN: 09622802     EISSN: None     Source Type: Journal    
DOI: 10.1191/0962280205sm412oa     Document Type: Review

References (15)

1. Fleiss JL. Statistical methods for rates and proportions, Second edition. New York: John Wiley, 1981.
2. Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. Journal of Clinical Epidemiology 1990; 43: 551-8.
3. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20: 37-46.
4. Holle R, Windeler J. Is there a gain from 'chance-corrected' measures of diagnostic validity? Journal of Clinical Epidemiology 1997; 1: 117-20.
5. Blackman NJ-M, Koval JJ. Interval estimation for Cohen's Kappa as a measure of agreement. Statistics in Medicine 2000; 19: 723-41.
6. Brenann RL, Prediger DJ. Coefficient kappa: some uses, misuses, and alternatives. Educational and Psychological Measurement 1981; 41: 687-99.
7. Agresti A, Ghosh A, Bini M. Raking kappa: describing potencial impact of marginal distributions on measures of agreement. Biometrical Journal 1995; 37: 811-20.
8. Guggenmoos-Holzmann I, Vonk R. Kappa-like indices of observer agreement viewed from a latent class perspective. Statisttics in Medicine 1998; 17: 797-812.
9. Nelson JC, Pepe MS. Statistical description of interrrater variability in ordinal rating. Statistical Methods in Medical Research 2000; 9: 475-96.
10. Guggenmoos-Holzmann I. The meaning of kappa: probabilistic concepts of reliability and validity revisited. Journal of Clinical Epidemiology 1996; 49: 775-82.
11. Martín Andrés A, Femia Matzo P. Delta: a new measure of agreement between two raters. British Journal of Mathematical and Statistical Psychology 2004; 57: 1-19.
12. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-74.
13. Spitznagel EL, Helzer MD. A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry 1985; 42: 725-28.
14. Yule GU. On the methods of measuring association between two attributes. Journal of the Royal Statistical Society 1912; 75: 581-642.
15. Kraemer HC. Ramifications of a population model for κ as a coefficient of reliability. Psychometrika 1979; 44: 461-72.