Quality assessment of ordinal scale reproducibility: log-linear models provided useful information on scale structure

Journal of Clinical Epidemiology

Volumn 61, Issue 10, 2008, Pages 983-990

  Valet, Fabien ^a,b   Guinot, Christiane ^b,c   Ezzedine, Khaled ^a,d   Mary, Jean Yves ^a  

^a INSERM   (France)

^b CERIES   (France)

^c UNIVERSITÉ DE TOURS   (France)

^d ERASME HOSPITAL   (Belgium)

Author keywords

Agreement; Distinguishability; Kappa; Log linear models; Rating scales; Reproducibility

Indexed keywords

ARTICLE; CROW FEET SCALE; DERMATOLOGY; DYSPLASIA SCALE; GASTROENTEROLOGY; INTERMETHOD COMPARISON; INTERRATER RELIABILITY; INTRARATER RELIABILITY; KAPPA STATISTICS; LOGLINEAR MODEL; ONCOLOGY; PRIORITY JOURNAL; RATING SCALE; REPRODUCIBILITY; SYDNEY SCALE;

EID: 50549097241     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2007.11.004     Document Type: Article

References (30)

1. Bowling A. Measuring health. A review of Quality of Life Measurement Scales (1991), Open University Press, Philadelphia, PA
2. Mc Dowell I., and Newell C. Measuring health. A guide to Rating Scales and Questionnaires (1996), Oxford University Press, New York
3. Au D.H., Blough D.K., Kirchdoerfer L., Weiss K.B., Udris E.M., and Sullivan S.D. Development of a quantifiable symptom assessment tool for patients with chronic bronchitis: the Chronic Bronchitis Symptoms Assessment Scale. COPD 2 (2005) 209-216
4. Dorian P., Cvitkovic S.S., Kerr C.R., Crystal E., Gillis A.M., Guerra P.G., et al. A novel, simple scale for assessing the symptom severity of atrial fibrillation at the bedside: the CCS-SAF scale. Can J Cardiol 22 (2006) 383-386
5. Garrido M.C., and Hubscher S.G. Accuracy of staging in primary biliary cirrhosis. J Clin Pathol 49 (1996) 556-559
6. Oudenhoven L.F., Dhondt E., Kahn S., Nieborg A., Kroon H.M., Hogendoorn P.C., et al. Accuracy of radiography in grading and tissue-specific diagnosis-a study of 200 consecutive bone tumors of the hand. Skeletal Radiol 35 (2006) 78-87
7. Auer S.R., and Reisberg B. Reliability of the Modified Ordinal Scales of Psychological Development: a cognitive assessment battery for severe dementia. Int Psychogeriatr 8 (1996) 225-231
8. Friedman W.H., and Katsantonis G.P. Staging systems for chronic sinus disease. Ear Nose Throat J 73 (1994) 480-484
9. Ching S., Thoma A., McCabe R.E., and Antony M.M. Measuring outcomes in aesthetic surgery: a comprehensive review of the literature. Plast Reconstr Surg 111 (2003) 469-480 discussion 481-482
10. Fedorcik G.G., Sachs R., and Goldfarb M.A. Oncologic and aesthetic results following breast-conserving therapy with 0.5 cm margins in 100 consecutive patients. Breast J 12 (2006) 208-211
11. Denvir M.A., Lee A.J., Rysdale J., Walker A., Eteiba H., Starkey I.R., et al. Influence of socioeconomic status on clinical outcomes and quality of life after percutaneous coronary intervention. J Epidemiol Community Health 60 (2006) 1085-1088
12. Gil Z., Abergel A., Spektor S., Khafif A., and Fliss D.M. Patient, caregiver, and surgeon perceptions of quality of life following anterior skull base surgery. Arch Otolaryngol Head Neck Surg 130 (2004) 1276-1281
13. de Vet H.C., Terwee C.B., and Bouter L.M. Current challenges in clinimetrics. J Clin Epidemiol 56 (2003) 1137-1141
14. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70 (1968) 213-220
15. Agresti A. A model for agreement between ratings on an ordinal scale. Biometrics 44 (1988) 539-548
16. Agresti A. Categorical data analysis. Wiley Series in Probability and Mathematical Statistics (2002), Wiley, New York
17. Goodman L. Simple models for the analysis of association in cross-classifications having ordered categories. J Am Stat Ass 74 (1979) 537-552
18. Tanner M.A., and Young M.A. Modeling agreement among raters. J Am Stat Ass 80 (1985) 175-181
19. Valet F., Guinot C., and Mary J.Y. Log-linear non-uniform association models for agreement between two ratings on an ordinal scale. Stat Med 26 (2007) 647-662
20. Fleiss J.L., and Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas 33 (1973) 613-619
21. Landis J.R., and Koch G.G. The measurement of observer agreement for categorical data. Biometrics 33 (1977) 159-174
22. Darroch J.N., and McCloud P.I. Category distinguishability and observer agreement. Aust J Stat 28 (1986) 371-388
23. Morizot F., Lopez S., Guinot C., Binder M., and Tschachler E. Development of photographic scales documenting features of skin ageing based on digital images. XXème Congrès Mondial de Dermatologie, Paris, 1-5 juillet 2002. Ann Dermatol Venereol 129 (2002) 1s402
24. Terry M.B., Neugut A.I., Bostick R.M., Potter J.D., Haile R.W., and Fenoglio-Preiser C.M. Reliability in the classification of advanced colorectal adenomas. Cancer Epidemiol Biomarkers Prev 11 (2002) 660-663
25. Chen X.Y., van der Hulst R.W., Bruno M.J., van der Ende A., Xiao S.D., Tytgat G.N., et al. Interobserver variation in the histological scoring of Helicobacter pylori related gastritis. J Clin Pathol 52 (1999) 612-615
26. Dixon M.F., Genta R.M., Yardley J.H., and Correa P. Classification and grading of gastritis. The updated Sydney System. International Workshop on the Histopathology of Gastritis, Houston 1994. Am J Surg Pathol 20 (1996) 1161-1181
27. Cicchetti D.V., and Feinstein A.R. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol 43 (1990) 551-558
28. Feinstein A.R., and Cicchetti D.V. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43 (1990) 543-549
29. Graham P., and Jackson R. The analysis of ordinal agreement data: beyond weighted kappa. J Clin Epidemiol 46 (1993) 1055-1062
30. Sim J., and Wright C.C. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther 85 (2005) 257-268