Log-linear non-uniform association models for agreement between two ratings on an ordinal scale

Statistics in Medicine

Volumn 26, Issue 3, 2007, Pages 647-662

  Valet, Fabien ^a   Guinot, Christiane ^b   Mary, Jean Yves ^a  

^a INSERM   (France)

^b CERIES   (France)

Author keywords

Category distinguishability; Log linear model; Non uniform association; Ordered contingency table; Ordinal agreement

Indexed keywords

AGING; ARTICLE; CALCULATION; CUTANEOUS PARAMETERS; DERMATOLOGY; DISEASE SEVERITY; FACE; FEMALE; HUMAN; LINEAR SYSTEM; MAJOR CLINICAL STUDY; MEDICAL PHOTOGRAPHY; QUANTITATIVE ANALYSIS; RATING SCALE; REPRODUCIBILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; WRINKLE;

ADULT; AGED; AGED, 80 AND OVER; AGING; FEMALE; HUMANS; MIDDLE AGED; MODELS, STATISTICAL; OBSERVER VARIATION; SKIN;

EID: 33846450315     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.2551     Document Type: Article

References (39)

1. Bowling A. Measuring Health. A Review of Quality of Life Measurement Scales. Open University Press, Inc.: Philadelphia, PA, 1991.
2. Mc Dowell I, Newell C. Measuring Health. A Guide to Rating Scales and Questionnaires. Oxford University Press, Inc.: New York, 1996.
3. Lansing RW, Moosavi SH, Banzeett RB. Measurement of dyspnea: World labeled visual analog scale vs. verbal ordinal scale. Respiratory Physiology and Neurobiology 2003; 134:77-83.
4. De Luca L, Zagari RM, Pozzato P, Fiorini T, Ricciardiello L, Martuzzi C, Roda E, Bazzoli F, Veldhuyzen van Zanten SJO. Measuring dyspepsia: a new severity index validated in Bologna. Digestive and Liver Disease 2004; 36:806-810.
5. Franchignomi F, Orlandini D, Ferriero G, Moscato TA. Reliability, validity, and responsiveness of the locomotor capabilities index in adults with lowerlimb amputation undergoing prosthetic training. Archives of Physical Medicine and Rehabilitation 2004; 85:743-748.
6. Gill MR, Reiley DG, Green SM. Interrater reliability of Glasgow coma scale scores in the emergency department. Annals of Emergency Medicine 2004; 43:215-223.
7. Agresti A. Testing marginal homogeneity for ordinal categorical variables. Biometrics 1983; 39:505-510.
8. Kim D, Agresti A. Nearly exact tests of conditional independence and marginal homogeneity for sparse contingency tables. Computational Statistics and Data Analysis 1997; 2,4:89-104.
9. Park T. Is the exact test better than the asymptotic test for testing marginal homogeneity in 2 × 2 tables. Biometrical Journal 2002; 5:571-583.
10. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin 1968; 70:213-220.
11. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20:37-46.
12. Spitznagel E, Helzer JE. A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry 1985; 42:725-728.
13. Feinstein AR, Cicchetti DV. High agreement but low kappa: the problems of two paradoxes. Journal of Clinical Epidemiology 1990; 43(6):543-549.
14. Agresti A. Categorical Data Analysis. Wiley Series in Probability and Mathematical Statistics. Wiley: New York, 2002.
15. Agresti A. Modelling ordered categorical data: recent advances and future challenges. Statistics in Medicine 1999; 18:2191-2207.
16. Goodman LA. Simple models for the analysis of association in cross-classifications having ordered categories. Journal of the American Statistical Association 1979; 74:537-552.
17. Darroch JN, McCloud PI. Category distinguishability and observer agreement. Australian Journal of Statistics 1986; 28:371-388.
18. Morizot F, Lopez S, Guinot C, Binder M, Tschachler E. Photographic scales documenting features of skin aging based on digital images. Annales de Dermatologie et Vénérologie 2002; 129:1s402.
19. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174.
20. Becker MP. Using association models to analyse agreement data: two examples. Statistics in Medicine 1989; 8:1199-1207.
21. Tanner MA, Young MA. Modeling agreement among raters. Journal of the American Statistical Association 1985; 80:175-181.
22. Agresti A. A model for agreement between ratings on an ordinal scale. Biometrics 1988; 44:539-548.
23. Rogel A, Boëlle PY, Mary JY. Global and partial agreement among several observers. Statistics in Medicine 1998; 17:489-501.
24. Schuster C. Models for ordinal agreement data. Biometrical Journal 2001; 43(7):795-808.
25. Haberman SJ. Log-linear models and frequency tables with small expected cell counts. The Annals of Statistics 1997; 5:1148-1169.
26. Agresti A, Yang M. An empirical investigation of some effects of sparseness in contingency tables. Computational Statistics and Data Analysis 1986; 5:9-21.
27. Agresti A. Modelling patterns of agreement and disagreement. Statistical Methods in Medical Research 1992; 1:201-218.
28. Becker MP, Analysis of sets of two-way contingency tables using association models. Journal of the American Statistical Association 1989; 84(405):142-151.
29. Becker MP. Quasisymmetric models for the analysis of square contingency tables. Journal of the Royal Statistical Society, Series B 1990; 52(2):369-378.
30. Schuster C. A mixture model approach to indexing rater agreement. British Journal of Mathematical and Statistical Psychology 2002; 55:289-303.
31. Forster JJ, McDonald JW, Smith PWF. Monte Carlo exact conditional tests for log-linear and logistic models. Journal of the Royal Statistical Society, Series B 1996; 58(2):445-453.
32. Smith PWF, McDonald JW, Forster JJ. Monte Carlo exact methods used for analysing interethnic unions in Great Britain. Applied Statistics 1996; 45(2): 191-202.
33. Smith PWF, Forster JJ, McDonald JW. Monte Carlo exact tests for square contingency tables. Journal of the Royal Statistical Society, Series A 1996; 159(2):309-321.
34. Agresti A. Exact inference for categorical data: recent advances and continuing controversies. Statistics in Medicine 2001; 20:2709-2722.
35. Caffo BS, Booth JG. Monte Carlo conditional inference for log-linear and logistic models: a survey of current methodology. Statistical Methods in Medical Research 2003; 12:109-123.
36. Rindskopf D, Rindskopf W. The value of latent class analysis in medical diagnosis. Statistics in Medicine 1986; 5:21-27.
37. Agresti A, Lang JB. Quasi-symmetric latent class models, with applications to rater agreement. Biometrics 1993; 49:131-139.
38. Uebersax JS, Grove WM. A latent trait finite mixture model for the analysis of rating agreement. Biometrics 19963; 49:823-835.
39. Perkins SM, Becker MP. Assessing rater agreement using marginal association models. Statistics in Medicine 2002; 21:1743-1760.