In Pursuit of Empirically Supported Assessment for Use in Medical Settings

Clinical Psychology: Science and Practice

Volumn 23, Issue 4, 2016, Pages 382-402

  Butt, Zeeshan ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

assessment; health care; measurement; patient reported outcomes; performance

Indexed keywords

CLINICAL RESEARCH; HUMAN; HUMAN EXPERIMENT; PATIENT EDUCATION; PATIENT-REPORTED OUTCOME; PSYCHOLOGIC ASSESSMENT; PSYCHOLOGIST;

EID: 85005959291     PISSN: 09695893     EISSN: 14682850     Source Type: Journal    
DOI: 10.1111/cpsp.12176     Document Type: Article

References (153)

1. Aaronson, N. K., & Snyder, C. (2008). Using patient-reported outcomes in clinical practice: Proceedings of an International Society of Quality of Life Research conference. Quality of Life Research, 17, 1295. doi:10.1007/s11136-008-9422-6
2. Abernethy, A. P., Herndon, J. E., Wheeler, J. L., Patwardhan, M., Shaw, H., Lyerly, H. K., & Weinfurt, K. (2008). Improving health care efficiency and quality using tablet personal computers to collect research-quality, patient-reported data. Health Services Research, 43, 1975–1991. doi:10.1111/j.1475-6773.2008.00887.x
3. Abernethy, A. P., Zafar, S. Y., Wheeler, J. L., Lyerly, H. K., Ahmad, A., & Reese, J. B. (2010). Electronic patient-reported data capture as a foundation of rapid learning cancer care. Medical Care, 48(6 Suppl.), S32–S38. doi:10.1097/MLR.0b013e3181db53a4
4. Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall.
5. Atherton, P. J., & Sloan, J. A. (2006). Rising importance of patient-reported outcomes. Lancet Oncology, 7, 883–884. doi:10.1016/S1470-2045(06)70914-7
6. Au, D. H., McDonell, M. B., Martin, D. C., & Fihn, S. D. (2001). Regional variations in health status. Medical Care, 39, 879–888. doi:10.1097/00005650-200108000-00013
7. Basch, E. (2010). The missing voice of patients in drug-safety reporting. New England Journal of Medicine, 362, 865–869. doi:10.1056/NEJMp0911494
8. Basch, E. (2012). Beyond the FDA PRO guidance: Steps toward integrating meaningful patient-reported outcomes into regulatory trials and U.S. drug labels. Value Health, 15, 401–403. doi:10.1016/j.jval.2012.03.1385
9. Basch, E., Geoghegan, C., Coons, S. J., Gnanasakthy, A., Slagle, A. F., Papadopoulos, E. J., & Kluetz, P. G. (2015). Patient-reported outcomes in cancer drug development and U.S. regulatory review: Perspectives from industry, the Food and Drug Administration, and the patient. Journal of the American Medical Association Oncology, 1, 375–379. doi:10.1001/jamaoncol.2015.0530
10. Basch, E., Iasonos, A., McDonough, T., Barz, A., Culkin, A., Kris, M. G., … Schrag, D. (2006). Patient versus clinician symptom reporting using the National Cancer Institute Common Terminology Criteria for Adverse Events: Results of a questionnaire-based study. Lancet Oncology, 7, 903–909. doi:10.1016/S1470-2045(06)70910-X
11. Basch, E., Jia, X., Heller, G., Barz, A., Sit, L., Fruscione, M., … Schrag, D. (2009). Adverse symptom event reporting by patients vs. clinicians: Relationships with clinical outcomes. Journal of the National Cancer Institute, 101, 1624–1632. doi:10.1093/jnci/djp386
12. Basch, E. M., Reeve, B. B., Mitchell, S. A., Clauser, S. B., Minasian, L., Sit, L., … Bruner, D. (2011). Electronic toxicity monitoring and patient-reported outcomes. Cancer Journal, 17, 231–234. doi:10.1097/PPO.0b013e31822c28b3
13. Beckmann, J. T., Hung, M., Bounsanga, J., Wylie, J. D., Granger, E. K., & Tashjian, R. Z. (2015). Psychometric evaluation of the PROMIS physical function computerized adaptive test in comparison to the American Shoulder and Elbow Surgeons score and Simple Shoulder Test in patients with rotator cuff disease. Journal of Shoulder and Elbow Surgery, 24, 1961–1967. doi:10.1016/j.jse.2015.06.025
14. Berenson, R. A., & Kaye, D. R. (2013). Grading a physician's value—The misapplication of performance measurement. New England Journal of Medicine, 369, 2079–2081. doi:10.1056/NEJMp1312287
15. Berger, A. M., Mooney, K., Alvarez-Perez, A., Breitbart, W. S., Carpenter, K. M., Cella, D., … Smith, C. (2015). Cancer-related fatigue, version 2.2015. Journal of the National Comprehensive Cancer Network, 13, 1012–1039.
16. Bilimoria, K. Y., Cella, D., & Butt, Z. (2014). Current challenges in using patient-reported outcomes for surgical care and performance measurement: Everybody wants to hear from the patient, but are we ready to listen? Journal of the American Medical Association Surgery, 149, 505–506. doi:10.1001/jamasurg.2013.5285
17. Birrell, F., Johnell, O., & Silman, A. (1999). Projecting the need for hip replacement over the next three decades: Influence of changing demography and threshold for surgery. Annals of the Rheumatic Diseases, 58, 569–572. doi:10.1136/ard.58.9.569
18. Burstin, H. (2013). The journey to electronic performance measurement. Annals of Internal Medicine, 158, 131–132. doi:10.7326/0003-4819-158-2-201301150-00009
19. Butt, Z., Parikh, N. D., Beaumont, J. L., Rosenbloom, S. K., Syrjala, K. L., Abernethy, A. P., … Cella, D. (2012). Development and validation of a symptom index for advanced hepatobiliary and pancreatic cancers: The National Comprehensive Cancer Network Functional Assessment of Cancer Therapy (NCCN-FACT) Hepatobiliary-Pancreatic Symptom Index (NFHSI). Cancer, 118, 5997–6004. doi:10.1002/cncr.27588
20. Butt, Z., Peipert, J., Webster, K., Chen, C., & Cella, D. (2013). General population norms for the Functional Assessment of Cancer Therapy-Kidney Symptom Index (FKSI). Cancer, 119, 429–437. doi:10.1002/cncr.27688
21. Butt, Z., Wagner, L. I., Beaumont, J. L., Paice, J. A., Peterman, A. H., Shevrin, D., … Cella, D. (2007). Use of a single item screening tool to detect clinically significant fatigue, pain, distress, and anorexia in ambulatory cancer practice. Journal of Pain and Symptom Management, 35, 20–30. doi:10.1016/j.jpainsymman.2007.02.040
22. Butt, Z., Yount, S. E., Caicedo, J. C., Abecassis, M. M., & Cella, D. (2008). Quality of life assessment in renal transplant: Review and future directions. Clinical Transplantation, 35, 20–30. doi:10.1111/j.1399-0012.2007.00784.x
23. Cella, D., & Chang, C. H. (2000). A discussion of item response theory and its applications in health status assessment. Medical Care, 38, 1166–1172.
24. Cella, D., & Nowinski, C. J. (2002). Measuring quality of life in chronic illness: The functional assessment of chronic illness therapy measurement system. Archives of Physical Medicine and Rehabilitation, 83(12 Suppl. 2), S10–S17. doi:10.1053/apmr.2002.36959
25. Cella, D., & Stone, A. A. (2015). Health-related quality of life measurement in oncology: Advances and opportunities. American Psychologist, 70, 175–185. doi:10.1037/a0037821
26. Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., … Rose, M. (2007). The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH Roadmap cooperative group during its first two years. Medical Care, 45(5 Suppl. 1), S3–S11. doi:10.1097/01.mlr.0000258615.42478.55
27. Chang, C. H., Cella, D., Masters, G. A., Laliberte, N., O'Brien, P., Peterman, A., & Shevrin, D. (2002). Real-time clinical application of quality-of-life assessment in advanced lung cancer. Clinical Lung Cancer, 4(2), 104–109. doi:10.3816/CLC.2002.n.020
28. Cleeland, C. S. (2000). Cancer-related symptoms. Seminars in Radiation Oncology, 10, 175–190. doi:10.1016/j.jpainsymman.2009.05.025
29. Cromwell, J., Healy, D., Seeley, E., Trebino, D., & Cromwell, G. (2013). The nation's health care bill: Who bears the burden? Research Triangle Park, NC: RTI Press. doi:10.3768/rtipress.2013.bk.0010.1307
30. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. doi:10.1007/BF02310555
31. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. doi:10.1037/h0040957
32. Davis, K., & Cella, D. (2002). Assessing quality of life in oncology clinical practice: A review of barriers and critical success factors. Journal of Clinical Outcomes Management, 9, 327–332.
33. Detmar, S. B., Muller, M. J., Schornagel, J. H., Wever, L. D., & Aaronson, N. K. (2002). Health-related quality-of-life assessments and patient-physician communication: A randomized controlled trial. Journal of the American Medical Association, 288, 3027–3034.
34. Deyo, R. A., & Patrick, D. L. (1989). Barriers to the use of health status measures in clinical investigation, patient care, and policy research. Medical Care, 27(3 Suppl.), S254–S268. doi:10.1097/00005650-198903001-00020
35. Donaldson, M. S. (2008). Taking PROs and patient-centered care seriously: Incremental and disruptive ideas for incorporating PROs in oncology practice. Quality of Life Research, 17, 1323–1330. doi:10.1007/s11136-008-9414-6
36. Donnelly, S., Walsh, D., & Rybicki, L. (1995). The symptoms of advanced cancer: Identification of clinical and research priorities by assessment of prevalence and severity. Journal of Palliative Care, 11(1), 27–32.
37. Dowling, N. M., Bolt, D. M., Deng, S., & Li, C. (2016). Measurement and control of bias in patient reported outcomes using multidimensional item response theory. BMC Medical Research Methodology, 16(1), 63. doi:10.1186/s12874-016-0161-z
38. Dudgeon, D., King, S., Howell, D., Green, E., Gilbert, J., Hughes, E., … Sawka, C. (2012). Cancer Care Ontario's experience with implementation of routine physical and psychological symptom distress screening. Psycho-Oncology, 21, 357–364. doi:10.1002/pon.1918
39. Embretson, S. E. (2006). The continued search for nonarbitrary metrics in psychology. American Psychologist, 61, 50–55. doi:10.1037/0003-066X.61.1.50
40. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
41. Ethgen, O., Bruyère, O., Richy, F., Dardennes, C., & Reginster, J. Y. (2004). Health-related quality of life in total hip and total knee arthroplasty: A qualitative and systematic review of the literature. Journal of Bone and Joint Surgery. American Volume, 86-A(5), 86. doi:10.1016/j.jval.2010.08.005
42. Eton, D. T., Cella, D., Yost, K. J., Yount, S. E., Peterman, A. H., Neuberg, D. S., … Wood, W. C. (2004). A combination of distribution- and anchor-based approaches determined minimally important differences (MIDs) for four endpoints in a breast cancer scale. Journal of Clinical Epidemiology, 57, 898–910. doi:10.1016/j.jclinepi.2004.01.012
43. Farmer, S. A., Black, B., & Bonow, R. O. (2013). Tension between quality measurement, public quality reporting, and pay for performance. Journal of the American Medical Association, 309, 349–350. doi:10.1001/jama.2012.191276
44. Feldman-Stewart, D., & Brundage, M. D. (2009). A conceptual framework for patient–provider communication: A tool in the PRO research tool box. Quality of Life Research, 18, 109–114. doi:10.1007/s11136-008-9417-3
45. Fihn, S. D., Bucher, J. B., & McDonell, M. (2011). Collaborative care intervention for stable ischemic heart disease. Archives of Internal Medicine, 171, 1471–1479. doi:10.1001/archinternmed.2011.372
46. Fihn, S. D., McDonell, M. B., Diehr, P., Anderson, S. M., Bradley, K. A., Au, D. H., … Sauvigne, A. (2004). Effects of sustained audit/feedback on self-reported health status of primary care patients. American Journal of Medicine, 116, 241–248. doi:10.1016/j.amjmed.2003.10.026
47. Fischer, H. F., Klug, C., Roeper, K., Blozik, E., Edelmann, F., Eisele, M., … Herrmann-Lingen, C. (2014). Screening for mental disorders in heart failure patients using computer-adaptive tests. Quality of Life Research, 23, 1609–1618. doi:10.1007/s11136-013-0599-y
48. Forero, C. G., Vilagut, G., Adroher, N. D., Alonso, J., & ESEMeD/MHEDEA Investigators (2013). Multidimensional item response theory models yielded good fit and reliable scores for the Short Form-12 questionnaire. Journal of Clinical Epidemiology, 66, 790–801. doi:10.1016/j.jclinepi.2013.02.007
49. Frost, M. H., Reeve, B. B., Liepa, A. M., Stauffer, J. W., & Hays, R. D. (2007). What is sufficient evidence for the reliability and validity of patient-reported outcome measures? Value Health, 10(Suppl 2), S94–S105. doi:10.1111/j.1524-4733.2007.00272.x
50. Gilbert, J. E., Howell, D., King, S., Sawka, C., Hughes, E., Angus, H., & Dudgeon, D. (2012). Quality improvement in cancer symptom assessment and control: The Provincial Palliative Care Integration Project (PPCIP). Journal of Pain and Symptom Management, 43, 663–678. doi:10.1016/j.jpainsymman.2011.04.028
51. Greenhalgh, J. (2009). The applications of PROs in clinical practice: What are they, do they work, and why? Quality of Life Research, 18, 115–123. doi:10.1007/s11136-008-9430-6
52. Greenhalgh, S., Long, A. F., & Flynn, R. (2005). The use of patient reported outcome measures in routine clinical practice: Lack of impact or lack of theory? Social Science and Medicine, 60, 833–843. doi:10.1016/j.socscimed.2004.06.022
53. Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993). Measuring health-related quality of life. Annals of Internal Medicine, 118, 622–629. doi:10.7326/0003-4819-118-8-199304150-00009
54. Guyatt, G., & Schunemann, H. (2007). How can quality of life researchers make their work more useful to health workers and their patients? Quality of Life Research, 16, 1097–1105. doi:10.1007/s11136-007-9223-3
55. Hahn, E. A., Cella, D., Chassany, O., Fairclough, D. L., Wong, G. Y., Hays, R. D., & Clinical Significance Consensus Meeting G. (2007). Precision of health-related quality-of-life data compared with other clinical measures. Mayo Clinic Proceedings, 82, 1244–1254. doi:10.4065/82.10.1244
56. Hahn, E. A., Cella, D., Dobrez, D., Shiomoto, G., Marcus, E., Taylor, S. G., … Webster, K. (2004). The Talking Touchscreen: A new approach to outcomes assessment in low literacy. Psycho-Oncology, 13(2), 86–95. doi:10.1002/pon.719
57. Hahn, E. A., Cella, D., Dobrez, D. G., Shiomoto, G., Taylor, S. G., Galvez, A. G., … Du, H. (2003). Quality of life assessment for low literacy Latinos: A new multimedia program for self-administration. Journal of Oncology Management, 12(5), 9–12.
58. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
59. Harris, W. H., & Sledge, C. B. (1990a). Total hip and total knee replacement (1). New England Journal of Medicine, 323, 725–731. doi:10.1056/NEJM199009133231106
60. Harris, W. H., & Sledge, C. B. (1990b). Total hip and total knee replacement (2). New England Journal of Medicine, 323, 801–807. doi:10.1056/NEJM199009133231106
61. Hays, R. D., Farivar, S. S., & Liu, H. (2005). Approaches and recommendations for estimating minimally important differences for health-related quality of life measures. Journal of Chronic Obstructive Pulmonary Disease, 2(1), 63–67. doi:10.1081/COPD-200050663
62. Hays, R. D., & Hadorn, D. (1992). Responsiveness to change: An aspect of validity, not a separate dimension. Quality of Life Research, 1, 73–75. doi:10.1007/bf00435438
63. Hays, R. D., Morales, L. S., & Reise, S. P. (2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38(9 Suppl.), 1128–1142. doi: 10.1097/00005650-200009002-00007
64. Hlubocky, F. J., Webster, K., Beaumont, J., Cashy, J., Paul, D., Abernethy, A., … Cella, D. (2013). A preliminary study of a health related quality of life assessment of priority symptoms in advanced lymphoma: The National Comprehensive Cancer Network-Functional Assessment of Cancer Therapy—Lymphoma Symptom Index. Leukemia and Lymphoma, 54, 1942–1946. doi:10.3109/10428194.2012.762977
65. Hoffman, A., & Emanuel, E. J. (2013). Reengineering U.S. health care. Journal of the American Medical Association, 309, 661–662. doi:10.1001/jama.2012.21457
66. Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51. doi:10.1146/annurev.clinpsy.3.022806.091419
67. Ibrahim, N., Teo, S. S., Che Din, N., Abdul Gafor, A. H., & Ismail, R. (2015). The role of personality and social support in health-related quality of life in chronic kidney disease patients. PLoS ONE, 10(7), e0129015. doi:10.1371/journal.pone.0129015
68. Jaeschke, R., Singer, J., & Guyatt, G. H. (1989). Measurement of health status: Ascertaining the minimal clinically important difference. Controlled Clinical Trials, 10, 407–415. doi:10.1016/0197-2456(89)90005-6
69. Jay, C. L., Butt, Z., Ladner, D. P., Skaro, A. I., & Abecassis, M. M. (2009). A review of quality of life instruments used in liver transplantation. Journal of Hepatology, 51, 949–959. doi:10.1016/j.jhep.2009.07.010
70. Jensen, S. E., Beaumont, J. L., Jacobsen, P. B., Abernethy, A., Syrjala, K. L., & Cella, D. (2013). Measuring priority symptoms in advanced bladder cancer: Development and initial validation of a brief symptom index. Journal of Community and Supportive Oncology, 11(2), 86–93. doi:10.1016/j.suponc.2012.07.002
71. Jensen, S. E., Butt, Z., Bill, A., Baker, T., Abecassis, M. M., Heinemann, A. W., … Dumanian, G. A. (2012). Quality of life considerations in upper limb transplantation: Review and future directions. Journal of Hand Surgery, 37, 2126–2135. doi:10.1016/j.jhsa.2012.06.010
72. Jha, A. K. (2013). Time to get serious about pay for performance. Journal of the American Medical Association, 309, 347–348. doi:10.1001/jama.2012.196646
73. Jordan, J. E., Osborne, R. H., & Buchbinder, R. (2011). Critical appraisal of health literacy indices revealed variable underlying constructs, narrow content and psychometric weaknesses. Journal of Clinical Epidemiology, 64, 366–379. doi:10.1016/j.jclinepi.2010.04.005
74. Justice, A. C., Rabeneck, L., Hays, R. D., Wu, A. W., Bozzette, S. A., & Outcomes Committee of the AIDS Clinical Trials Group. (1999). Sensitivity, specificity, reliability, and clinical validity of provider-reported symptoms: A comparison with self-reported symptoms. Journal of Acquired Immune Deficiency Syndromes, 21(2), 126–133.
75. Kreis, S., Molto, A., Bailly, F., Dadoun, S., Fabre, S., Rein, C., … Gossec, L. (2015). Relationship between optimism and quality of life in patients with two chronic rheumatic diseases: Axial spondyloarthritis and chronic low back pain: A cross sectional study of 288 patients. Health and Quality of Life Outcomes, 13, 78. doi:10.1186/s12955-015-0268-7
76. Kumnig, M., Jowsey, S. G., Rumpold, G., Weissenbacher, A., Hautz, T., Engelhardt, T. O., … Schneeberger, S. (2012). The psychological assessment of candidates for reconstructive hand transplantation. Transplant International, 25, 573–585. doi:10.1111/j.1432-2277.2012.01463.x
77. Kuntz, K., Weinland, S. R., & Butt, Z. (2015). Psychosocial challenges in solid organ transplantation. Journal of Clinical Psychology in Medical Settings, 22, 122–135. doi:10.1007/s10880-015-9435-6
78. Ladner, D. P., Dew, M. A., Forney, S., Gillespie, B. W., Brown, R. S., Jr., Merion, R. M., … Butt, Z. (2015). Long-term quality of life after liver donation in the Adult to Adult Living Donor Liver Transplantation Cohort Study (A2ALL). Journal of Hepatology, 62, 346–353. doi:10.1016/j.jhep.2014.08.043
79. Lai, J. S., Cella, D., Choi, S., Junghaenel, D. U., Christodoulou, C., Gershon, R., & Stone, A. (2011). How item banks and their application can influence measurement practice in rehabilitation medicine: A PROMIS fatigue item bank example. Archives of Physical Medicine and Rehabilitation, 92(10 Suppl.), S20–S27. doi:10.1016/j.apmr.2010.08.033
80. Lamvu, G., Williams, R., Zolnoun, D., Wechter, M. E., Shortliffe, A., Fulton, G., & Steege, J. F. (2006). Long-term outcomes after surgical and nonsurgical management of chronic pelvic pain: One year after evaluation in a pelvic pain specialty clinic. American Journal of Obstetrics & Gynecology, 195, 591–598; discussion 598–600. doi:10.1016/j.ajog.2006.03.081
81. Lee, T. H. (2012). Care redesign—A path forward for providers. New England Journal of Medicine, 367, 466–472. doi:10.1056/NEJMhpr1204386
82. Leidy, N. K., Beusterien, K., Sullivan, E., Richner, R., & Muni, N. I. (2006). Integrating the patient's perspective into device evaluation trials. Value Health, 9, 394–401. doi:10.1111/j.1524-4733.2006.00132.x
83. Lent, L., Hahn, E., Eremenco, S., Webster, K., & Cella, D. (1999). Using cross-cultural input to adapt the Functional Assessment of Chronic Illness Therapy (FACIT) scales. Acta Oncologica, 38, 695–702. doi:10.1080/028418699432842
84. Liang, M. H. (2000). Longitudinal construct validity: Establishment of clinical meaning in patient evaluative instruments. Medical Care, 38(9 Suppl.), 1184–1190.
85. Lipscomb, J., Donaldson, M. S., Arora, N. K., Brown, M. L., Clauser, S. B., Potosky, A. L., & Taplin, S. H. (2004). Cancer outcomes research. Journal of the National Cancer Institute Monographs, 33, 178–197.
86. Lohr, K., & Zebrack, B. (2009). Using patient-reported outcomes in clinical practice: Challenges and opportunities. Quality of Life Research, 18(1), 99–107. doi:10.1007/s11136-008-9413-7
87. Lord, F. M. (1980). Application of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
88. Marek, R. J., Ben-Porath, Y. S., Windover, A., Tarescavage, A. M., Merrell, J., Ashton, K., … Heinberg, L. J. (2013). Assessing psychosocial functioning of bariatric surgery candidates with the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF). Obesity Surgery, 23, 1864–1873. doi:10.1007/s11695-013-1024-x
89. Marek, R. J., Tarescavage, A. M., Ben-Porath, Y. S., Ashton, K., Merrell Rish, J., & Heinberg, L. J. (2015). Using presurgical psychological testing to predict 1-year appointment adherence and weight loss in bariatric surgery patients: Predictive validity and methodological considerations. Surgery for Obesity and Related Diseases, 11, 1171–1181. doi:10.1016/j.soard.2015.03.020
90. Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient-reported outcome measures on routine practice: A structured review. Journal of Evaluation in Clinical Practice, 12, 559–568. doi:10.1111/j.1365-2753.2006.00650.x
91. Mayo, N. E., Moriello, C., Asano, M., van der Spuy, S., & Finch, L. (2011). The extent to which common health-related quality of life indices capture constructs beyond symptoms and function. Quality of Life Research, 20, 621–627. doi:10.1007/s11136-010-9801-7
92. Meyers, C. A., Seabrooke, L. F., Albitar, M., & Estey, E. H. (2002). Association of cancer-related symptoms with physiological parameters. Journal of Pain and Symptom Management, 24, 359–361. doi:10.1007/s11136-010-9606-8
93. Mokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., … de Vet, H. C. (2006). Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments. BMC Medical Research Methodology, 6, 2. doi:10.1186/1471-2288-6-2
94. Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., … de Vet, H. C. (2010a). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63, 737–745. doi:10.1016/j.jclinepi.2010.02.006
95. Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., … de Vet, H. C. W. (2010b). The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Quality of Life Research, 19, 539–549. doi:10.1007/s11136-010-9606-8
96. Morgan, J. H., Kallen, M. A., Okike, K., Lee, O. C., & Vrahas, M. S. (2015). PROMIS physical function computer adaptive test compared with other upper extremity outcome measures in the evaluation of proximal humerus fractures in patients older than 60 years. Journal of Orthopedic Trauma, 29, 257–263. doi:10.1097/BOT.0000000000000280
97. Mullen, K. H., Berry, D. L., & Zierler, B. K. (2004). Computerized symptom and quality-of-life assessment for patients with cancer part II: Acceptability and usability. Oncology Nursing Forum, 31(5), E84–E89. doi:10.1188/04.ONF.E84-E89
98. National Quality Forum. (2009). National voluntary consensus standards for patient outcomes, Retrieved from http://www.qualityforum.org/Publications/2011/07/National_Voluntary_Consensus_Standards_for_Patient_Outcomes_2009.aspx.
99. Naughton, M., & Homsi, J. (2002). Symptom assessment in cancer patients. Current Oncology Reports, 4, 256–263. doi:10.1007/s11912-002-0024-0
100. Nikolaus, S., Bode, C., Taal, E., Oostveen, J. C., Glas, C. A., & van de Laar, M. A. (2013). Items and dimensions for the construction of a multidimensional computerized adaptive test to measure fatigue in patients with rheumatoid arthritis. Journal of Clinical Epidemiology, 66, 1175–1183. doi:10.1016/j.jclinepi.2013.05.010
101. Olbrisch, M. E., Benedict, S. M., Ashe, K., & Levenson, J. L. (2002). Psychological assessment and care of organ transplant patients. Journal of Consulting and Clinical Psychology, 70, 771–783. doi:10.1037/0022-006x.70.3.771
102. Parikh, N. D., Skaro, A. I., Ladner, D. P., Lyuksemburg, V., Cahan, J. G., Daud, A., & Butt, Z. (2015). Clinical outcomes and quality of life in recipients of livers donated after cardiac death. Gastroenterology Research and Practice, 2015, 680316. doi:10.1155/2015/680316
103. Patrick, D. L., & Deyo, R. A. (1989). Generic and disease-specific measures in assessing health status and quality of life. Medical Care, 27(3 Suppl.), S217–S232.
104. Porter, M. E. (2010). What is value in health care? New England Journal of Medicine, 363, 2477–2481. doi:10.1056/NEJMp1011024
105. Ramey, N. A., Butt, Z., Burkat, C. N., Rose, J. G., & Lucarelli, M. J. (2014). Patient-reported outcomes: Comprehensive analysis for the oculofacial clinician. Ophthalmic Plastic and Reconstructive Surgery, 30, 279–289. doi:10.1097/IOP.0000000000000070
106. Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, C. F., … Butt, Z. (2013). ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Quality of Life Research, 22, 1889–1905. doi:10.1007/s11136-012-0344-y
107. Reise, S. P., Ainsworth, A. T., & Haviland, M. G. (2005). Item response theory: Fundamentals, applications, and promise in psychological research. Current Directions in Psychological Science, 14, 95–101. doi:10.1111/j.0963-7214.2005.00342.x
108. Reise, S. P., & Haviland, M. G. (2005). Item response theory and the measurement of clinical change. Journal of Personality Assessment, 84, 228–238. doi:10.1207/s15327752jpa8403_02
109. Revicki, D. A. (2007). FDA draft guidance and health-outcomes research. Lancet, 369, 540–542. doi:10.1016/S0140-6736(07)60250-5
110. Revicki, D. A., Gnanasakthy, A., & Weinfurt, K. (2007). Documenting the rationale and psychometric characteristics of patient reported outcomes for labeling and promotional claims: The PRO Evidence Dossier. Quality of Life Research, 16, 717–723. doi:10.1007/s11136-006-9153-5
111. Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008). Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of Clinical Epidemiology, 61(2), 102–109.
112. Revicki, D. A., Osoba, D., Fairclough, D., Barofsky, I., Berzon, R., Leidy, N. K., & Rothman, M. (2000). Recommendations on health-related quality of life research to support labeling and promotional claims in the United States. Quality of Life Research, 9, 887–900. doi:10.1007/s11136-006-9153-5
113. Richardson, M. W. (1936). The relationship between difficulty and the differential validity of a test. Psychometrika, 1, 33–49. doi:10.1007/bf02288003
114. Riley, W. T., Pilkonis, P., & Cella, D. (2011). Application of the National Institutes of Health Patient-Reported Outcome Measurement Information System (PROMIS) to mental health research. Journal of Mental Health Policy and Economics, 14, 201–208.
115. Rissanen, P., Aro, S., Sintonen, H., Asikainen, K., Slätis, P., & Paavolainen, P. (1997). Costs and cost-effectiveness in hip and knee replacements: A prospective study. International Journal of Technology Assessment in Health Care, 13, 575–588. doi:10.1017/s0266462300010059
116. Rose, M., & Bezjak, A. (2009). Logistics of collecting patient-reported outcomes (PROs) in clinical practice: An overview and practical examples. Quality of Life Research, 18, 125–136. doi:10.1007/s11136-008-9436-0
117. Rosenbloom, S. K., Victorson, D. E., Hahn, E. A., Peterman, A. H., & Cella, D. (2007). Assessment is not enough: A randomized controlled trial of the effects of HRQL assessment on quality of life and satisfaction in oncology clinical practice. Psychooncology, 16, 1069–1079. doi:10.1002/pon.1184
118. Rothrock, N. E., Jensen, S. E., Beaumont, J. L., Abernethy, A. P., Jacobsen, P. B., Syrjala, K., & Cella, D. (2013). Development and initial validation of the NCCN/FACT symptom index for advanced kidney cancer. Value Health, 16, 789–796. doi:10.1016/j.jval.2013.04.015
119. Schunemann, H. J., Akl, E. A., & Guyatt, G. H. (2006). Interpreting the results of patient reported outcome measures in clinical trials: The clinician's perspective. Health and Quality of Life Outcomes, 4, 62. doi:10.1186/1477-7525-4-62
120. Scientific Advisory Committee of the Medical Outcomes Trust. (2002). Assessing health status and quality of life instruments: Attributes and review criteria. Quality of Life Research, 11, 193–205. doi:10.1023/A:1015291021312
121. Selby, J. V., & Lipstein, S. H. (2014). PCORI at 3 years—Progress, lessons, and plans. New England Journal of Medicine, 370, 592–595. doi:10.1056/NEJMp1313061
122. Snyder, C. F., Aaronson, N. K., Choucair, A. K., Elliott, T. E., Greenhalgh, J., Halyard, M. Y., … Santana, M. (2011). Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Quality of Life Research, 21, 1305–1314. doi:10.1007/s11136-011-0054-x
123. Snyder, C. F., Jensen, R., Courtin, S. O., & Wu, A. W. (2009). PatientViewpoint: A website for patient-reported outcomes assessment. Quality of Life Research, 18, 793–800. doi:10.1007/s11136-009-9497-8
124. Soto, C. J. (2015). Is happiness good for your personality? Concurrent and prospective relations of the Big Five with subjective well-being. Journal of Personality, 83, 45–55. doi:10.1111/jopy.12081
125. Staniute, M., Brozaitiene, J., Burkauskas, J., Kazukauskiene, N., Mickuviene, N., & Bunevicius, R. (2015). Type D personality, mental distress, social support and health-related quality of life in coronary artery disease patients with heart failure: A longitudinal observational study. Health and Quality of Life Outcomes, 13, 1. doi:10.1186/s12955-014-0204-2
126. Steinberg, L., & Thissen, D. (1995). Item response theory in personality research. In P. E. Shrout (Ed.), Personality research, methods, and theory: A festschrift honoring Donald W. Fiske (pp. 161–181). Hillsdale, NJ: Erlbaum.
127. Stephens, R. J., Hopwood, P., Girling, D. J., & Machin, D. (1997). Randomized trials with quality of life endpoints: Are doctors’ ratings of patients’ physical symptoms interchangeable with patients’ self-ratings? Quality of Life Research, 6, 225–236. doi:10.1023/A:1026458604826
128. Streiner, D. L., & Norman, G. R. (2003). Health measurement scales: A practical guide to their development and use. New York, NY: Oxford University Press.
129. Suh, S. Y., Leblanc, T. W., Shelby, R. A., Samsa, G. P., & Abernethy, A. P. (2011). Longitudinal patient-reported performance status assessment in the cancer clinic is feasible and prognostic. Journal of Oncology Practice, 7, 374–381. doi:10.1200/JOP.2011.000434
130. Symonds, T., Hackford, C., & Abraham, L. (2014). A review of FDA warning letters and notices of violation issued for patient-reported outcomes promotional claims between 2006 and 2012. Value Health, 17, 433–437. doi:10.1016/j.jval.2014.03.1718
131. Terwee, C. B., Bot, S. D., de Boer, M. R., van der Windt, D. A., Knol, D. L., Dekker, J., … de Vet, H. C. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(1), 34–42. doi:S0895-4356(06)00174-0 [pii]
132. Ujiki, M. B., Gitelis, M. E., Carbray, J., Lapin, B., Linn, J., Haggerty, S., … Denham, W. (2015). Patient-centered outcomes following laparoscopic inguinal hernia repair. Surgical Endoscopy, 29, 2512–2519. doi:10.1007/s00464-014-4011-y
133. U.S. Department of Health and Human Services (DHHS) FDA Center for Drug Evaluation and Research, U.S. DHHS FDA Center for Biologics Evaluation and Research, & U.S. DHHS FDA Center for Devices and Radiological Health. (2006). Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims: Draft guidance. Health & Quality of Life Outcomes, 4, 79. doi:10.1186/1477-7525-4-79
134. U.S. Food and Drug Administration. (2009). Guidance for industry. Patient-reported outcome measures: Use in medical product development to support labeling claims Retrieved from http://www.fda.gov/downloads/Drugs/../Guidances/UCM193282.pdf.
135. Velikova, G., Booth, L., Smith, A. B., Brown, P. M., Lynch, P., Brown, J. M., & Selby, P. J. (2004). Measuring quality of life in routine oncology practice improves communication and patient well-being: A randomized controlled trial. Journal of Clinical Oncology, 22, 714–724. doi:10.1200/jco.2004.06.078
136. Velikova, G., Brown, J. M., Smith, A. B., & Selby, P. J. (2002). Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology. British Journal of Cancer, 86(1), 51–59. doi:10.1038/sj.bjc.6600001
137. Victorson, D. E., Beaumont, J. L., Rosenbloom, S. K., Shevrin, D., & Cella, D. (2011). Efficient assessment of the most important symptoms in advanced prostate cancer: The NCCN/FACT-P Symptom Index. Psychooncology, 20, 977–983. doi:10.1002/pon.1817
138. Von Roenn, J. H., Cleeland, C. S., Gonin, R., Hatfield, A. K., & Pandya, K. J. (1993). Physician attitudes and practice in cancer pain management. A survey from the Eastern Cooperative Oncology Group. Annals of Internal Medicine, 119(2), 121–126. doi:10.7326/0003-4819-119-2-199307150-00005
139. Wagner, L. I., Schink, J., Bass, M., Patel, S., Diaz, M. V., Rothrock, N., … Cella, D. (2015). Bringing PROMIS to practice: Brief and precise symptom screening in ambulatory cancer care. Cancer, 121, 927–934. doi:10.1002/cncr.29104
140. Ware, J. E., Jr. (2003). Conceptualization and measurement of health-related quality of life: Comments on an evolving field. Archives of Physical Medicine & Rehabilitation, 84(4 Suppl. 2), S43–S51. doi:10.1053/apmr.2003.50246
141. Ware, J. E., Jr., Kemp, J. P., Buchner, D. A., Singer, A. E., Nolop, K. B., & Goss, T. F. (1998). The responsiveness of disease-specific and generic health measures to changes in the severity of asthma among adults. Quality of Life Research, 7, 235–244.
142. Webster, K., Cella, D., & Yost, K. (2003). The Functional Assessment of Chronic Illness Therapy (FACIT) Measurement System: Properties, applications, and interpretation. Health and Quality of Life Outcomes, 1(1), 79. doi:10.1186/1477-7525-1-79
143. Weiss, D. J. (2004). Computerized adaptive testing for effective and efficient measurement in counseling and education. Measurement and Evaluation in Counseling and Development, 37, 70–84.
144. Williams, M. H., Newton, J. N., Frankel, S. J., Braddon, F., Barclay, E., & Gray, J. A. M. (1994). Prevalence of total hip replacement: How much demand has been met? Journal of Epidemiology and Community Health, 48, 188–191. doi:10.1136/jech.48.2.188
145. Woodard, L. D., & Petersen, L. A. (2010). Improving the performance of performance measurement. Journal of General Internal Medicine, 25(2), 100–101. doi:10.1007/s11606-009-1198-z
146. World Health Organization. (1946). Constitution of the World Health Organization. Geneva, Switzerland: World Health Organization.
147. Wright, E. P., Selby, P. J., Crawford, M., Gillibrand, A., Johnston, C., Perren, T. J., … Cull, A. (2003). Feasibility and compliance of automated measurement of quality of life in oncology practice. Journal of Clinical Oncology, 21, 374–382. doi:10.1200/jco.2003.11.044
148. Wu, A. W., Fink, N. E., Marsh-Manzi, J. V., Meyer, K. B., Finkelstein, F. O., Chapman, M. M., & Powe, N. R. (2004). Changes in quality of life during hemodialysis and peritoneal dialysis treatment: Generic and disease specific measures. Journal of the American Society of Nephrology, 15, 743–753. doi:10.1097/01.asn.0000113315.81448.ca
149. Wyrwich, K. W. (2004). Minimal important difference thresholds and the standard error of measurement: Is there a connection? Journal of Biopharmaceutical Statistics, 14(1), 97–110. doi:10.1081/BIP-120028508
150. Wyrwich, K. W., Norquist, J. M., Lenderking, W. R., Acaster, S., & Industry Advisory Committee of International Society for Quality of Life Research. (2013). Methods for interpreting change over time in patient-reported outcome measures. Quality of Life Research, 22, 475–483. doi:10.1007/s11136-012-0175-x
151. Yost, K. J., & Eton, D. T. (2005). Combining distribution- and anchor-based approaches to determine minimally important differences: The FACIT experience. Evaluation and the Health Professions, 28, 172–191. doi:10.1177/0163278705275340
152. Youngstrom, E. A. (2013). Future directions in psychological assessment: Combining evidence-based medicine innovations with psychology's historical strengths to enhance utility. Journal of Clinical Child and Adolescent Psychology, 42, 139–159. doi:10.1080/15374416.2012.736358
153. Zikos, E., Coens, C., Quinten, C., Ediebah, D. E., Martinelli, F., Ghislain, I., … Eortc, P. (2016). The added value of analyzing pooled health-related quality of life data: A review of the EORTC PROBE initiative. Journal of the National Cancer Institute, 108(5), djv391. doi:10.1093/jnci/djv391