Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM

Journal of Strength and Conditioning Research

Volumn 19, Issue 1, 2005, Pages 231-240

  Weir, Joseph P ^a  

^a DES MOINES UNIVERSITY   (United States)

Author keywords

Consistency; Error; Intraclass correlation coefficient; Precision; Reproducibility; SEM

Indexed keywords

CALCULATION; CONFIDENCE INTERVAL; CORRELATION COEFFICIENT; ERROR; FATIGUE; LEARNING; RELIABILITY; SCORING SYSTEM; SHORT SURVEY;

HUMANS; REPRODUCIBILITY OF RESULTS; STATISTICS;

EID: 15744385505     PISSN: 10648011     EISSN: None     Source Type: Journal    
DOI: 10.1519/15184.1     Document Type: Short Survey

References (52)

1. ALEXANDER, H.W. The estimation of reliability when several trials are available. Psychometrika 12:79-99. 1947.
2. ATKINSON, D.B., AND A.M. NEVILL. Statistical methods for assessing measurement error (reliability) in variables relevant to Sports Medicine. Sports Med. 26:217-238. 1998.
3. BARTKO, J.J. The intraclass reliability coefficient as a measure of reliability. Psychol. Rep. 19:3-11. 1966.
4. BARTKO, J.J. On various intraclass correlation coefficients. Psychol. Bull. 83:762-765. 1976.
5. BAUMGARTNER, T.A. Estimating reliability when all test trials are administered on the same day. Res. Q. 40:222-225. 1969.
6. BAUMGARTNER, T.A. Norm-referenced measurement: reliability. In: Measurement Concepts in Physical Education and Exercise Science. M.J. Safrit and T.M. Woods, eds. Champaign, IL: Human Kinetics, 1989. pp. 45-72.
7. BAUMGARTNER, T.A. Estimating the stability reliability of a score. Meas. Phys. Educ. Exerc. Sci. 4:175-178. 2000.
8. BECKERMAN, H., T.W. VOGELAAR, G.L. LANKHORST, AND A.L.M. VERBEEK. A criterion for stability of the motor function of the lower extremity in stroke patients using the Fugl-Meyer assessment scale. Scand. J. Rehabil. Med. 28:3-7. 1996.
9. BEDARD, M., N.J. MARTIN, P. KRUEGER, AND K. BRAZIL. Assessing reproducibility of data obtained with instruments based on continuous measurements. Exp. Aging Res. 26:353-365. 2000.
10. BLAND, J.M., AND D.G. ALTMAN. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1:307-310. 1986.
11. BROZEK, J., AND H. ALEXANDER. Components of variance and the consistency of repeated measurements. Res. Q. 18:152-166. 1947.
12. BRUTON, A., J.H. CONWAY, AND S.T. HOLGATE. Reliability: What is it and how is it measured. Physiotherapy 86:94-99. 2000.
13. CHARTER, R.A. Revisiting the standard error of measurement, estimate, and prediction and their application to test scores. Percept. Mot. Skills 82:1139-1144. 1996.
14. CHARTER, R.A. Effect of measurement error on tests of statistical significance. J. Clin. Exp. Neuropsychol. 19:458-462. 1997.
15. CHARTER, R.A., AND L.S. FELDT. Meaning of reliability in terms of correct and incorrect clinical decisions: The art of decision making is still alive. J. Clin. Exp. Neuropsychol. 23:530-537. 2001.
16. CHARTER, R.A., AND L.S. FELDT. The importance of reliability as it relates to true score CIs. Meas. Eval. Counseling Dev. 35:104-112. 2002.
17. CHINN, S. Repeatability and method comparison. Thorax 46:454-456. 1991.
18. CHINN, S., AND P.G. BURNEY. On measuring repeatability of data from self-administered questionnaires. Int. J. Epidemiol. 16:121-127. 1987.
19. DUDEK, F.J. The continuing misinterpretation of the standard error of measurement. Psychol. Bull. 86:335-337. 1979.
20. ELIASZIW, M., S.L. YOUNG, M.G. WOODBURY, AND K. FRYDAY-FIELD. Statistical methodology for the concurrent assessment of interrater and intrarater reliability: Using goniometric measurements as an example. Phys. Ther. 74:777-788. 1994.
21. FELDT, L.S., AND M.E. MCKEE. Estimation of the reliability of skill tests. Res. Q. 29:279-293. 1958.
22. FLEISS, J.L. The Design and Analysis of Clinical Experiments. New York: John Wiley and Sons, 1986.
23. GUYATT, G., S. WALTER, AND G. NORMAN. Measuring change over time: assessing the usefulness of evaluative instruments. J. Chronic Dis. 40:171-178. 1987.
24. HARVILL, L.M. Standard error of measurement. Educ. Meas. Issues Pract. 10:33-41. 1991.
25. HEBERT, R., D.J. SPIEGELHALTER, AND C. BRAYNE. Setting the minimal metrically detectable change on disability rating scales. Arch. Phys. Med. Rehabil. 78:1305-1308. 1997.
26. HOPKINS, W.G. Measures of reliability in sports medicine and science. Sports Med. 30:375-381. 2000.
27. KEATING, J., AND T. MATYAS. Unreliable inferences from reliable measurements. Aust. Physiother. 44:5-10. 1998.
28. KEPPEL, G. Design and Analysis: A Researcher's Handbook (3rd ed.). Englewood Cliffs, NJ: Prentice Hall, 1991.
29. KROLL, W. A note on the coefficient of intraclass correlation as an estimate of reliability. Res. Q. 33:313-316. 1962.
30. LAHEY, M.A., R.G. DOWNEY, AND F.E. SAAL. Intraclass correlations: there's more than meets the eye. Psychol. Bull. 93:586-595. 1983.
31. LIBA, M. A trend test as a preliminary to reliability estimation. Res. Q. 38:245-248. 1962.
32. LOONEY, M.A. When is the intraclass correlation coefficient misleading? Meas. Phys. Educ. Exerc. Sci. 4:73-78. 2000.
33. LUDBROOK, J. Statistical techniques for comparing measures and methods of measurement: A critical review. Clin. Exp. Pharmacol. Physiol. 29:527-536. 2002.
34. MCGRAW, KO., AND S.P. WONG. Forming inferences about some intraclass correlation coefficients. Psychol. Methods 1:30-46. 1996.
35. MORROW, J.R., AND A.W. JACKSON. How "significant" is your reliability? Res. Q. Exerc. Sport 64:352-355. 1993.
36. NICHOLS, C.P. Choosing an intraclass correlation coefficient. Available at: www.spss.com/tech/stat/articles/whichicc.htm. Accessed 1998.
37. NITSCHKE, J.E., J.M. MCMEEKEN, H.C. BURRY, AND T.A. MATYAS. When is a change a genuine change? A clinically meaningful interpretation of grip strength measurements in healthy and disabled women. J. Hand Ther. 12:25-30. 1999.
38. NUNNALLY, J.C., AND I.H. BERNSTEIN. Psychometric Theory (3rd ed.). New York: McGraw-Hill, 1994.
39. OLDS, T. Five errors about error. J. Sci. Med. Sport 5:336-340. 2002.
40. PERKINS, D.O., R.J. WYATT, AND J.J. BARTKO. Penny-wise and pound-foolish: The impact of measurement error on sample size requirements in clinical trials. Biol. Psychiatry. 47:762-766. 2000.
41. PORTNEY, L.G., AND M.P. WATKINS. Foundations of Clinical Research (2nd ed.). Upper Saddle River, NJ: Prentice Hall, 2000.
42. ROEBROECK, M.E., J. HARLAAR, AND G.J. LANKHORST. The application of generalizability theory to reliability assessment: An illustration using isometric force measurements. Phys. Ther. 73:386-401. 1993.
43. ROUSSON, V., T. GASSER, AND B. SEIFERT. Assessing intrarater, interrater, and test-retest reliability of continuous measurements. Stat. Med. 21:3431-3446. 2002.
44. SAFRIT, M.J.E. Reliability Theory. Washington, DC: American Alliance for Health, Physical Education, and Recreation, 1976.
45. SHROUT, P.E. Measurement reliability and agreement in psychiatry. Stat. Methods Med. Res. 7:301-317. 1998.
46. SHROUT, P.E., AND J.L. FLEISS. Intraclass correlations: uses in assessing rater reliability. Psychol. Bull. 36:420-428. 1979.
47. STRATFORD, P. Reliability: consistency or differentiating between subjects? [Letter]. Phys. Ther. 69:299-300. 1989.
48. STRATFORD, P.W., AND C.H. GOLDSMITH. Use of standard error as a reliability index of interest: An applied example using elbow flexor strength data. Phys. Ther. 77:745-750. 1997.
49. STREINER, D.L., AND G.R. NORMAN. Measurement Scales: A Practical Guide to Their Development and Use (2nd ed.). Oxford: Oxford University Press, 1995. pp. 104-127.
50. THOMAS, J.R., AND J.K. NELSON. Research Methods in Physical Activity (2nd ed.). Champaign, IL: Human Kinetics, 1990. pp. 352.
51. TRAUB, R.E., AND G.L. ROWLEY. Understanding reliability. Educ. Meas. Issues Pract. 10:37-45. 1991.
52. WALTER, S.D., M. ELIASZIW, AND A. DONNER. Sample size and optimal designs for reliability studies. Stat. Med. 17:101-110. 1998.