Assessing reproducibility for interval data in health-related quality of life questionnaires: Which coefficient should be used?

Quality of Life Research

Volumn 13, Issue 3, 2004, Pages 571-585

  Schuck, Peter ^a  

^a UNIVERSITY OF WÜRZBURG   (Germany)

Author keywords

Concordance correlation coefficient (CCC); Intraclass correlation coefficients (ICCs); Pearson correlation; Reproducibility; Test retest reliability

Indexed keywords

ANALYSIS OF VARIANCE; CALCULATION; CORRELATION COEFFICIENT; HEALTH CARE; HUMAN; MEASUREMENT; MEDICAL ASSESSMENT; PRIORITY JOURNAL; QUALITY OF LIFE; QUESTIONNAIRE; RELIABILITY; REPRODUCIBILITY; REVIEW; STATISTICAL ANALYSIS;

EID: 1942454308     PISSN: 09629343     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:QURE.0000021318.92272.2a     Document Type: Review

References (40)

1. Guyatt GH, Deyo RA, Charlson M, et al. Responsiveness and validity in health status measurement: A clarification. J Clin Epidemiol 1989; 42: 403-408.
2. Wright JG, Feinstein AR. A comparative contrast of clinimetric and psychometric methods for constructing indexes and rating scales. J Clin Epidemiol 1992; 45: 1201-1218.
3. Cronbach LJ. Test 'reliability': Its meaning and determination. Psychometrika 1947; 12: 1-16.
4. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients [published erratum appears in Psychol Methods 1996; 1: 390]. Psychol Methods 1996; 1: 30-46.
5. Haggard EA. Intraclass Correlation and the Analysis of Variance. New York: Dryden Press, 1958.
6. Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep 1966; 19: 3-11.
7. Bartko JJ. On various intraclass correlation reliability coefficients. Psychol Bull 1976; 83: 762-765.
8. Bartko JJ. Reply to Algina. Psychol Bull 1978; 85: 139-140.
9. Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychol Bull 1979; 86: 420-428.
10. Algina J. Comment on Bartko's 'on various intraclass correlation reliability coefficients.' Psychol Bull 1978; 85: 135-138.
11. Dunn G. Design and analysis of reliability studies. In: The Statistical Evoluation of Measurement Errors. New York: Oxford University Press, 1989.
12. Fleiss JL. The Design and Analysis of Clinical Experiments. New York: Wiley, 1986.
13. Dunn G. Design and analysis of reliability studies. Stat Methods Med Res 1992; 1: 123-157.
14. Deyo RA, Diehr P, Patrick DL. Reproducibility and responsiveness of health status measures. Controlled Clin Trials 1991; 12: 142S-158S.
15. Tammemagi MC, Frank JW, Leblanc M, et al. Methodological issues in assessing reproducibility - a comparative study of various indices of reproducibility applied to repeat ELISA serologic tests for Lyme disease. J Clin Epidemiol 1995; 48: 1123-1132.
16. Bland JM, Altman DG. Measurement error and correlation coefficients (corrected data for Table 1: http:// www.bmj.com/cgi/content/full/313/7048/41/ DC1). Br Med J 1996; 313: 41-42.
17. Beaton DE, Hogg-Johnson S, Bombardier C. Evaluating changes in health status: Reliability and responsiveness of five generic health status measures in workers with musculoskeletal disorders. J Clin Epidemiol 1997; 50: 79-93.
18. Lin LIK. A concordance correlation coefficient to evaluate reproducibility. Biometrics 1989; 45: 255-268.
19. Winer BJ. Statistical Principles in Experimental Design. New York: McGraw-Hill, 1971.
20. Lord FM, Novick MR. Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley, 1968.
21. Nichols DP. Choosing an intraclass correlation coefficient (SPSS keywords, number 67), 1998. http://www.spss. com/tech/stat/articles/whichicc.htm (Accessed 22 January 2003).
22. Bartko JJ, Carpenter WT, Jr. On the methods and theory of reliability. J Nerv Ment Dis 1976; 163: 307-317.
23. Hedges LV, Vevea JL. Fixed-and random-effects models in meta-analysis. Psychol Meth 1998; 3: 486-504.
24. Jackson SE, Brashers DE. Random Factors in ANOVA. Thousand Oaks, CA: Sage Publications, 1994.
25. Fagot RF. A generalized family of coefficients of relational agreement for numerical scales. Psychometrica 1993; 58: 357-370.
26. Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to their Development and Use. 2nd ed. New York: Oxford University Press, 1995.
27. Shrout PE. Measurement reliability and agreement in psychiatry. Stat Methods Med Res 1998; 7: 301-317.
28. Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 1990; 43: 543-549.
29. Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol 1990; 43: 551-558.
30. Shoukri MM, Pause CA. Statistical Methods for Health Sciences. 2nd ed. Boca Raton, London, New York, Washington, DC: CRC Press, 1999.
31. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951; 16: 297-334.
32. Cronbach LJ, Gleser GC, Nanda H, et al. The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. New York: John Wiley, 1972.
33. Nichols DP. My coefficient α is negative! (SPSS keywords, number 68), 1999. http://www.spss.com/tech/stat/articles/ negalpha.htm (Accessed 22 January 2003).
34. Robinson WS. The statistical measurement of agreement. Am Sociol Rev 1957; 22: 17-25.
35. Bartko JJ. Measurement and reliability: Statistical thinking considerations. Schizophr Bull 1991; 17: 483-489.
36. Norman GR. Issues in the use of change scores in randomized trials. J Clin Epidemiol 1989; 42: 1097-1105.
37. Schuck P. Is the formula for the intraclass correlation coefficient correct? (1 September 2000). http://www.bmj.com/ cgi/eletters/313/7048/41#9509 (Accessed 22 January 2003).
38. McStephen MD. Precedence rules in formula (2 May 2002). (bmj.com/cgi/eletters/313/7048/41#21838 (Accessed 22 January 2003).
39. Hays WL. Statistics for the Social Sciences. 2nd ed. London, New York, Sydney, Toronto: Holt, Rinehart and Winston, 1973.
40. O'Brien RG, Kaiser MK. MANOVA method for analyzing repeated measures design: An extensive primer. Psychol Bull 1985; 97: 316-333.