Using classical test theory, item response theory, and rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples

Value in Health

Volumn 18, Issue 1, 2015, Pages 25-34

  Petrillo, Jennifer ^a   Cano, Stefan J ^b   McLeod, Lori D ^c   Coon, Cheryl D ^c  

^a NOVARTIS PHARMA AG   (Switzerland)

^b PLYMOUTH UNIVERSITY PENINSULA SCHOOLS OF MEDICINE AND DENTISTRY   (United Kingdom)

^c RTI HEALTH SOLUTIONS   (United States)

Author keywords

classical test theory; item response theory; patient reported outcome; psychometrics; Rasch measurement theory

Indexed keywords

ADULT; ARTICLE; DIABETIC MACULAR EDEMA; EYE PAIN; FEMALE; HUMAN; INTERNAL VALIDITY; MAJOR CLINICAL STUDY; MALE; MENTAL HEALTH; NATIONAL EYE INSTITUTE VISUAL FUNCTION QUESTIONNAIRE; OUTCOME ASSESSMENT; PERIPHERAL VISION; PRIORITY JOURNAL; QUESTIONNAIRE; RASCH ANALYSIS; RELIABILITY; VALIDITY; VISUAL IMPAIRMENT; CLINICAL TRIAL; CONTROLLED STUDY; DIABETIC RETINOPATHY; MACULAR EDEMA; MULTICENTER STUDY; PHASE 3 CLINICAL TRIAL; PROCEDURES; PSYCHOMETRY; RANDOMIZED CONTROLLED TRIAL; SELF REPORT; STANDARDS;

DIABETIC RETINOPATHY; HUMANS; MACULAR EDEMA; PATIENT OUTCOME ASSESSMENT; PSYCHOMETRICS; QUESTIONNAIRES; SELF REPORT;

EID: 84920771484     PISSN: 10983015     EISSN: 15244733     Source Type: Journal    
DOI: 10.1016/j.jval.2014.10.005     Document Type: Article

References (45)

1. Patient-Centered Outcomes Research Institute. Patient-centered outcomes research. 2012. Available from: http://www.pcori.org/patient-centered-outcomes-research/. [Accessed March 23, 2012].
2. I. Wilson, and P. Cleary Linking clinical variables with health-related quality of life: a conceptual model of patient outcomes JAMA 273 1995 59 65
3. A. Gnanasakthy, M. Mordin, and M. Clark A review of patient-reported outcome labels in the United States: 2006 to 2010 Value Health 15 2012 437 442
4. US Department of Health and Human Services. Guidance for industry. Patient-reported outcome measures: use in medical product development to support labeling claims. December 2009. Available from: http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM193282.pdf. [Accessed June 13, 2014].
5. M.R. Novick The axioms and principal results of classical test theory J Math Psychol 3 1966 1 18
6. F.M. Lord, and M.R. Novick Statistical Theories of Mental Test Scores 1968 Addison-Welsley Publishing Company Reading, MA
7. G. Rasch Probabilistic Models for Some Intelligence and Attainment Tests 1980 University of Chicago Press Chicago
8. C. Spearman "General intelligence," objectively determined and measured Am J Psychol 15 1904 201 292
9. F.M. Lord Applications of Item Response Theory to Practical Testing Problems 1980 Erlbaum Mahwah, NJ
10. D. Thissen, and H. Wainer Test Scoring 2001 Erlbaum Mahwah, NJ
11. J.C. Nunnally, and I.H. Bernstein Psychometric Theory 3rd ed. 1994 McGraw-Hill New York NY
12. R. Traub Classical test theory in historical perspective Educ Meas Issues Pract 16 1997 8 14
13. J.C. Cappelleri, J. Lundy, and R.D. Hays Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures Clin Ther 36 2014 648 662
14. B. Wright A history of social science and measurement Educ Meas Issues Pract 16 1997 33 52
15. D. Andrich Controversy and the Rasch model: a characteristic of incompatible paradigms? Med Care 42 2004 I7 16
16. J. Hobart, and S. Cano Improving the evaluation of therapeutic intervention in MS: the role of new psychometric methods Health Technology Assess 13 2009 iii, ix-x, 1-177
17. D. Andrich Rating scales and Rasch measurement Expert Rev Pharmacoeconomics Outcomes Res 11 2011 571 585
18. S. Cano, and J. Hobart The problem with health measurement Patient Prefer Adherence 5 2011 279 290
19. D. Andrich The legacies of R. A. Fisher and K. Pearson in the application of the polytomous Rasch model for assessing the empirical ordering of categories Educ Psychol Meas 73 2013 553 580
20. A. Birnbaum Some latent trait models and their use in inferring an examinee's ability F.M. Lord, M.R. Novick, Statistical Theories of Mental Test Scores 1968 Addison-Wesley Reading, MA
21. R.D. Bock A brief history of item response theory Educ Meas Issues Pract 16 1997 21 33
22. C.H. Chang, and B.B. Reeve Item response theory and its applications to patient-reported outcomes measurement Eval Health Prof 28 2005 264 282
23. D. Thissen, and L. Steinberg Item response theory R. Millsap, A. Maydeu-Olivares, The Sage Handbook of Quantitative Methods in Psychology 2009 Sage London
24. T.H. Nguyen, H.-R. Han, M.T. Kim, and K.S. Chan An introduction to item response theory for patient-reported outcome measurement Patient 7 2014 23 35
25. The World Health Organization Quality of Life Assessment (WHOQOL): development and general psychometric properties Soc Sci Med 46 1998 1569 1585
26. N. Aaronson, J. Alonso, and A. Burnam Assessing health status and quality of life instruments: attributes and review criteria Qual Life Res 11 2002 193 205
27. L. Mokkink, C. Terwee, and D. Patrick The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study Qual Life Res 19 2010 539 549
28. B. Wright, and G. Masters Rating Scale Analysis: Rasch Measurement Chicago: MESA Press 1982
29. R.W. Massof Understanding Rasch and item response theory models: applications to the estimation and validation of interval latent trait measures from responses to rating scale questionnaires Ophthalmic Epidemiol 18 2011 1 19
30. L. Cronbach Coefficient alpha and the internal structure of tests Psychometrika 16 1951 294 334
31. C.M. Mangione, P.P. Lee, and P.R. Gutierrez Development of the 25-item National Eye Institute Visual Function Questionnaire Arch Ophthalmol 119 2001 1050 1058
32. P. Mitchell, F. Bandello, and U. Schmidt-Erfurth The RESTORE study: ranibizumab monotherapy or combined with laser versus laser monotherapy for diabetic macular edema Ophthalmology 118 2011 615 625
33. P. Mitchell, N. Bressler, and K. Tolley Patient-reported visual function outcomes improve after ranibizumab treatment in patients with vision impairment due to diabetic macular edema: randomized clinical trial JAMA Ophthalmol 131 2013 1339 1347
34. P. Orr, A.M. Rentz, and M.K. Margolis Validation of the National Eye Institute Visual Function Questionnaire-25 (NEI VFQ-25) in age-related macular degeneration Invest Ophthalmol Vis Sci 52 2011 3354 3359
35. J. Khadka, C. McAlinden, and K. Pesudovs Validation of the National Eye Institute Visual Function Questionnaire-25 (NEI VFQ-25) in age-related macular degeneration Invest Ophthalmol Vis Sci 53 2012 1276
36. M. Marella, K. Pesudovs, and J.E. Keeffe The psychometric validity of the NEI VFQ-25 for use in a low-vision population Invest Ophthalmol Vis Sci 51 2010 2878 2884
37. M.G. Bulmer Principles of Statistics 1979 Dover Publications Mineola, NY
38. L. Cai, S.H.C. Du Toit, and D. Thissen IRTPRO: Flexible, Multidimensional, Multiple Categorical IRT Modeling [Computer software] 2012 Scientific Software International Chicago
39. F. Samejima Estimation of latent ability using a response pattern of graded scores Psychom Monogr 17 1969 19 36
40. M. Orlando, and D. Thissen Likelihood-based item-fit indices for dichotomous item response theory models Appl Psychol Measure 24 2000 50 64
41. M. Orlando, and D. Thissen Further examination of the performance of S-X2, an item fit index for dichotomous item response theory models Appl Psychol Measure 27 2003 289 298
42. W.H. Chen, and D. Thissen Local dependence indices for item pairs using item response theory J Educ Behav Stat 22 1997 265 289
43. J.C. Nunnally Psychometric Theory 2nd ed 1978 McGraw-Hill New York
44. D. Andrich An index of person separation in latent trait theory, the traditional KR20 index, and the Guttman scale response pattern Educ Psychol Res 9 1982 95 104
45. Coon CD, Williams VSL, Nelson LM, Price MA. Determining missing data rules for patient-reported outcomes: alpha-if-item-deleted. Poster presented at the 15th Annual Meeting of the International Society for Pharmacoeconomics and Outcomes Research, May 17, 2010, Atlanta, GA.