Stakeholders in outcome measures: Review from a clinical perspective general

Clinical Orthopaedics and Related Research

Volumn 471, Issue 11, 2013, Pages 3426-3436

  Brinker, Mark R ^a   O'Connor, Daniel P ^b  

^a TEXAS ORTHOPEDIC HOSPITAL   (United States)

^b UNIVERSITY OF HOUSTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL RESEARCH; CONFERENCE PAPER; COST BENEFIT ANALYSIS; COST MINIMIZATION ANALYSIS; HEALTH CARE DELIVERY; HEALTH CARE PLANNING; HEALTH CARE POLICY; HUMAN; MEDICAL INFORMATION; MORBIDITY; ORTHOPEDIC SURGERY; OUTCOME ASSESSMENT; PATIENT CARE; PATIENT REPORTED OUTCOMES MEASURE; PHYSICAL ACTIVITY; POSTOPERATIVE COMPLICATION; PRIORITY JOURNAL; QUALITY OF LIFE; SURGICAL MORTALITY; TREATMENT OUTCOME;

EID: 84886931177     PISSN: 0009921X     EISSN: 15281132     Source Type: Journal    
DOI: 10.1007/s11999-013-3265-3     Document Type: Conference Paper

References (107)

1. Agel J, Beskin JL, Brage M, Guyton GP, Kadel NJ, Saltzman CL, Sands AK, Sangeorzan BJ, SooHoo NF, Stroud CC, Thordarson DB. Reliability of the Foot Function Index:: A report of the AOFAS Outcomes Committee. Foot Ankle Int. 2005;26:962-967.
2. Andrawis JP, Chenok KE, Bozic KJ. Health policy implications of outcomes measurement in orthopaedics. Clin Orthop Relat Res. 2013:[in press].
3. Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15:1833-1840.
4. Blackhouse G, Assasi N, Xie F, Marshall J, Irvine EJ, Gaebel K, Campbell K, Hopkins R, O'Reilly D, Tarride JE, Goeree R. Canadian cost-utility analysis of initiation and maintenance treatment with anti-TNF-alpha drugs for refractory Crohn's disease. J Crohns Colitis. 2012;6:77-85.
5. Bozic KJ, Chiu V. Emerging ideas: Shared decision making in patients with osteoarthritis of the hip and knee. Clin Orthop Relat Res. 2011;469:2081-2085.
6. Bozic KJ, Chiu VW, Slover JD, Immerman I, Kahn JG. Health state utility in patients with osteoarthritis of the hip and total hip arthroplasty. J Arthroplasty. 2011;26:129-132 e121-122.
7. Brauer CA, Rosen AB, Greenberg D, Neumann PJ. Trends in the measurement of health utilities in published cost-utility analyses. Value Health. 2006;9:213-218.
8. Brauer CA, Rosen AB, Olchanski NV, Neumann PJ. Cost-utility analyses in orthopaedic surgery. J Bone Joint Surg Am. 2005;87:1253-1259.
9. Brazier J, Jones N, Kind P. Testing the validity of the EuroQol and comparing it with the SF-36 health survey questionnaire. Qual Life Res. 1993;2:169-180.
10. Brazier J, Usherwood T, Harper R, Thomas K. Deriving a preference-based single index from the UK SF-36 Health Survey. J Clin Epidemiol. 1998;51:1115-1128.
11. Brinker MR, O'Connor DP. Outcomes of tibial nonunion in older adults following treatment using the Ilizarov method. J Orthop Trauma. 2007;21:634-642.
12. Brinker MR, O'Connor DP, Crouch CC, Mehlhoff TL, Bennett JB. Ilizarov treatment of infected nonunions of the distal humerus after failure of internal fixation: an outcomes study. J Orthop Trauma. 2007;21:178-184.
13. Bryant D, Fernandes N. Measuring patient outcomes: a primer. Injury. 2011;42:232-235.
14. Budiman-Mak E, Conrad K, Stuck R, Matters M. Theoretical model and Rasch analysis to develop a revised Foot Function Index. Foot Ankle Int. 2006;27:519-527.
15. Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse D, Choi S, Cook K, Devellis R, DeWalt D, Fries JF, Gershon R, Hahn EA, Lai JS, Pilkonis P, Revicki D, Rose M, Weinfurt K, Hays R, Group PC. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63:1179-1194.
16. Daltroy LH, Cats-Baril WL, Katz JN, Fossel AH, Liang MH. The North American Spine Society lumbar spine outcome assessment instrument: reliability and validity tests. Spine (Phila Pa 1976). 1996;21:741-749.
17. Daltroy LH, Liang MH, Fossel AH, Goldberg MJ. The POSNA pediatric musculoskeletal functional health questionnaire: report on reliability, validity, and sensitivity to change. Pediatric Outcomes Instrument Development Group. Pediatric Orthopaedic Society of North America. J Pediatr Orthop. 1998;18:561-571.
18. Daum WJ, Brinker MR, Nash DB. Quality and outcome determination in health care and orthopaedics: evolution and current structure. J Am Acad Orthop Surg. 2000;8:133-139.
19. Dawson J, Doll H, Boller I, Fitzpatrick R, Little C, Rees J, Carr A. Comparative responsiveness and minimal change for the Oxford Elbow Score following surgery. Qual Life Res. 2008;17:1257-1267.
20. Dawson J, Doll H, Boller I, Fitzpatrick R, Little C, Rees J, Jenkinson C, Carr AJ. The development and validation of a patient-reported questionnaire to assess outcomes of elbow surgery. J Bone Joint Surg Br. 2008;90:466-473.
21. Dawson J, Fitzpatrick R, Carr A. Questionnaire on the perceptions of patients about shoulder surgery. J Bone Joint Surg Br. 1996;78:593-600.
22. Dawson J, Fitzpatrick R, Carr A. A self-administered questionnaire for assessment of symptoms and function of the shoulder. J Bone Joint Surg Am. 1998;80:766-767.
23. Dawson J, Fitzpatrick R, Carr A, Murray D. Questionnaire on the perceptions of patients about total hip replacement. J Bone Joint Surg Br. 1996;78:185-190.
24. Dawson J, Fitzpatrick R, Murray D, Carr A. Questionnaire on the perceptions of patients about total knee replacement. J Bone Joint Surg Br. 1998;80:63-69.
25. Derrett S, Stokes EA, James M, Bartlett W, Bentley G. Cost and health status analysis after autologous chondrocyte implantation and mosaicplasty: a retrospective comparison. Int J Technol Assess Health Care. 2005;21:359-367.
26. Domsic RT, Saltzman CL. Ankle osteoarthritis scale. Foot Ankle Int. 1998;19:466-471.
27. Edwards TB, Boulahia A, Kempf JF, Boileau P, Nemoz C, Walch G. The influence of rotator cuff disease on the results of shoulder arthroplasty for primary osteoarthritis: results of a multicenter study. J Bone Joint Surg Am. 2002;84-A:2240-2248.
28. Edwards TB, Kadakia NR, Boulahia A, Kempf JF, Boileau P, Nemoz C, Walch G. A comparison of hemiarthroplasty and total shoulder arthroplasty in the treatment of primary glenohumeral osteoarthritis: results of a multicenter study. J Shoulder Elbow Surg. 2003;12:207-213.
29. EuroQol Group. EuroQol - a new facility for the measurement of health-related quality of life. Health Policy. 1990;16:199-208.
30. Fairbank JC, Couper J, Davies JB, O'Brien JP. The Oswestry low back pain disability questionnaire. Physiotherapy. 1980;66:271-273.
31. Feeny D, Furlong W, Boyle M, Torrance GW. Multi-attribute health status classification systems. Health Utilities Index. Pharmacoeconomics. 1995;7:490-502.
32. Franklin PD, Allison JJ, Ayers DC. Beyond joint implant registries: a patient-centered research consortium for comparative effectiveness in total joint replacement. JAMA. 2012;308:1217-1218.
33. Froberg DG, Kane RL. Methodology for measuring health-state preferences - II: Scaling methods. J Clin Epidemiol. 1989;42:459-471.
34. Furlong WJ, Feeny DH, Torrance GW, Barr RD. The Health Utilities Index (HUI) system for assessing health-related quality of life in clinical studies. Ann Med. 2001;33:375-384.
35. Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, Brazier JE, Bullinger M, Kaasa S, Leplege A, Prieto L, Sullivan M. Cross-validation of item selection and scoring for the SF-12 Health Survey in nine countries: results from the IQOLA Project. International Quality of Life Assessment. J Clin Epidemiol. 1998;51:1171-1178.
36. Gartland JJ. Orthopaedic clinical research. Deficiencies in experimental design and determinations of outcome. J Bone Joint Surg Am. 1988;70:1357-1364.
37. Gartsman GM, Brinker MR, Khan M. Early effectiveness of arthroscopic repair for full-thickness tears of the rotator cuff: an outcome analysis. J Bone Joint Surg Am. 1998;80:33-40.
38. Gartsman GM, Brinker MR, Khan M, Karahan M. Self-assessment of general health status in patients with five common shoulder conditions. J Shoulder Elbow Surg. 1998;7:228-237.
39. Gartsman GM, O'Connor DP. Arthroscopic rotator cuff repair with and without arthroscopic subacromial decompression: a prospective, randomized study of one-year outcomes. J Shoulder Elbow Surg. 2004;13:424-426.
40. Gartsman GM, Roddey TS, Hammerman SM. Arthroscopic treatment of bidirectional glenohumeral instability: two- to five-year follow-up. J Shoulder Elbow Surg. 2001;10:28-36.
41. Gartsman GM, Roddey TS, Hammerman SM. Arthroscopic treatment of multidirectional glenohumeral instability: 2- to 5-year follow-up. Arthroscopy. 2001;17:236-243.
42. Goldstein J. Private practice outcomes: validated outcomes data collection in private practice. Clin Orthop Relat Res. 2010;468:2640-2645.
43. Hansson E, Hansson T. The cost-utility of lumbar disc herniation surgery. Eur Spine J. 2007;16:329-337.
44. Hays RD, Bjorner JB, Revicki DA, Spritzer KL, Cella D. Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res. 2009;18:873-880.
45. Hays RD, Sherbourne CD, Mazel RM. The RAND 36-Item Health Survey 1.0. Health Econ. 1993;2:217-227.
46. Hudak PL, Amadio PC, Bombardier C. Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. The Upper Extremity Collaborative Group (UECG). Am J Ind Med. 1996;29:602-608.
47. Hung M, Clegg DO, Greene T, Weir C, Saltzman CL. A lower extremity physical function computerized adaptive testing instrument for orthopaedic patients. Foot Ankle Int. 2012;33:326-335.
48. Irrgang JJ, Anderson AF, Boland AL, Harner CD, Kurosaka M, Neyret P, Richmond JC, Shelborne KD. Development and validation of the international knee documentation committee subjective knee form. Am J Sports Med. 2001;29:600-613.
49. Irrgang JJ, Anderson AF, Boland AL, Harner CD, Neyret P, Richmond JC, Shelbourne KD, International Knee Documentation C. Responsiveness of the International Knee Documentation Committee Subjective Knee Form. Am J Sports Med. 2006;34:1567-1573.
50. Johanson NA, Liang MH, Daltroy L, Rudicel S, Richmond J. American Academy of Orthopaedic Surgeons lower limb outcomes assessment instruments. Reliability, validity, and sensitivity to change. J Bone Joint Surg Am. 2004;86-A:902-909.
51. Keller RB, Rudicel SA, Liang MH. Outcomes research in orthopaedics. Instr Course Lect. 1994;43:599-611.
52. Kim J, Lonner JH, Nelson CL, Lotke PA. Response bias: effect on outcomes evaluation by mail surveys after total knee arthroplasty. J Bone Joint Surg Am. 2004;86-A:15-21.
53. King GJ, Richards RR, Zuckerman JD, Blasier R, Dillman C, Friedman RJ, Gartsman GM, Iannotti JP, Murnahan JP, Mow VC, Woo SL. A standardized method for assessment of elbow function. Research Committee, American Shoulder and Elbow Surgeons. J Shoulder Elbow Surg. 1999;8:351-354.
54. Kitaoka HB, Alexander IJ, Adelaar RS, Nunley JA, Myerson MS, Sanders M. Clinical rating systems for the ankle-hindfoot, midfoot, hallux, and lesser toes. Foot Ankle Int. 1994;15:349-353.
55. Kocher MS, Smith JT, Iversen MD, Brustowicz K, Ogunwole O, Andersen J, Yoo WJ, McFeely ED, Anderson AF, Zurakowski D. Reliability, validity, and responsiveness of a modified International Knee Documentation Committee Subjective Knee Form (Pedi-IKDC) in children with knee disorders. Am J Sports Med. 2011;39:933-939.
56. Kwon SK, Kang YG, Chang CB, Sung SC, Kim TK. Interpretations of the clinical outcomes of the nonresponders to mail surveys in patients after total knee arthroplasty. J Arthroplasty. 2010;25:133-137.
57. Li N, van Agthoven M, Willemse P, Uyl-de Groot C. A cost-utility analysis comparing second-line chemotherapy schemes in patients with metastatic breast cancer. Anticancer Drugs. 2001;12:533-540.
58. Ljungman D, Lundholm K, Hyltander A. Cost-utility estimation of surgical treatment of pancreatic carcinoma aimed at cure. World J Surg. 2011;35:662-670.
59. Manheim LM, Dunlop D, Song J, Semanik P, Lee J, Chang RW. Relationship between physical activity and health-related utility among knee osteoarthritis patients. Arthritis Care Res (Hoboken). 2012;64:1094-1098.
60. Martin DP, Engelberg R, Agel J, Snapp D, Swiontkowski MF. Development of a musculoskeletal extremity health status instrument: the Musculoskeletal Function Assessment instrument. J Orthop Res. 1996;14:173-181.
61. McEwen LN, Coelho RB, Baumann LM, Bilik D, Nota-Kirby B, Herman WH. The cost, quality of life impact, and cost-utility of bariatric surgery in a managed care population. Obes Surg. 2010;20:919-928.
62. McHorney CA, Ware JE, Jr., Raczek AE. The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247-263.
63. Mehrez A, Gafni A. The healthy-years equivalents: how to measure them using the standard gamble approach. Med Decis Making. 1991;11:140-146.
64. National Committee for Quality Assurance. HEDIS & Performance Measurement. Available at: http://www.ncqa.org/HEDISQualityMeasurement.aspx. Accessed January 2, 2013.
65. National Research Council. The Prevention and Treatment of Missing Data in Clinical Trials. Panel on Handling Missing Data in Clinical Trials. Committee on National Statistics, Division of Behavioral and Social Sciences and Education. Washington, D.C.: The National Academies Press; 2010.
66. Nilsdotter AK, Lohmander LS, Klassbo M, Roos EM. Hip disability and osteoarthritis outcome score (HOOS) - validity and responsiveness in total hip replacement. BMC Musculoskelet Disord. 2003;4:10.
67. Norquist BM, Goldberg BA, Matsen FA, III. Challenges in evaluating patients lost to follow-up in clinical studies of rotator cuff tears. J Bone Joint Surg Am. 2000;82:838-842.
68. O'Connor DP, Brinker MR. Challenges in outcome measurement: clinical research oerspective. Clin Orthop Relat Res. 2013:[this issue].
69. O'Connor DP, Brinker MR, Woods GW. Preoperative health status of patients with four knee conditions treated with arthroscopy. Clin Orthop Relat Res. 2002;395:164-173.
70. Ortqvist M, Roos EM, Brostrom EW, Janarv PM, Iversen MD. Development of the Knee Injury and Osteoarthritis Outcome Score for Children (KOOS-Child). Acta Orthop. 2012;83:666-673.
71. Patient-Centered Outcomes Research Institute. Funding Announcement: "Improving Methods for Conducting Patient-Centered Outcomes Research". Available at: www.pcori.org/assets/PCORI-Improving-Methods-PCOR-PFA-0515131. pdf. Accessed July 2, 2013.
72. Paulsen A, Pedersen AB, Overgaard S, Roos EM. Feasibility of 4 patient-reported outcome measures in a registry setting. Acta Orthop. 2012;83:321-327.
73. Prieto L, Sacristan JA. Problems and solutions in calculating quality-adjusted life years (QALYs). Health Qual Life Outcomes. 2003;1:80.
74. Räsänen P, Paavolainen P, Sintonen H, Koivisto AM, Blom M, Ryynänen OP, Roine RP. Effectiveness of hip or knee replacement surgery in terms of quality-adjusted life years and costs. Acta Orthop. 2007;78:108-115.
75. Read JL, Quinn RJ, Berwick DM, Fineberg HV, Weinstein MC. Preferences for health outcomes. Comparison of assessment methods. Med Decis Making. 1984;4:315-329.
76. Research Data Assistance Center (University of Minnesota), Centers for Medicare & Medicaid Services. Medicare claims data. Available at: http://www.resdac.org/cms-data/file-family/Medicare-Claims. Accessed January 2, 2013.
77. Richards RR, An KN, Bigliani LU, Friedman RJ, Gartsman GM, Gristina AG, Iannotti JP, Mow VC, Sidles JA, Zuckerman JD. A standardized method for the assessment of shoulder function. J Shoulder Elbow Surg. 1994;3:347-352.
78. Riskowski JL, Hagedorn TJ, Hannan MT. Measures of foot function, foot health, and foot pain: American Academy of Orthopedic Surgeons Lower Limb Outcomes Assessment: Foot and Ankle Module (AAOS-FAM), Bristol Foot Score (BFS), Revised Foot Function Index (FFI-R), Foot Health Status Questionnaire (FHSQ), Manchester Foot Pain and Disability Index (MFPDI), Podiatric Health Questionnaire (PHQ), and Rowan Foot Pain Assessment (ROFPAQ). Arthritis Care Res (Hoboken). 2011;63 Suppl 11:S229-239.
79. Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome Score (KOOS) - development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28:88-96.
80. Roos EM, Toksvig-Larsen S. Knee injury and Osteoarthritis Outcome Score (KOOS) - validation and comparison to the WOMAC in total knee replacement. Health Qual Life Outcomes. 2003;1:17.
81. Rowden NJ, Harrison JA, Graves SE, Miller LN, de Steiger RN, Davidson DC. Loss to follow-up after arthroplasty: a new use for registry data. J Bone Joint Surg Br. 2012;94:493-496.
82. Saleh KJ, Bershadsky B, Cheng E, Kane R. Lessons learned from the hip and knee Musculoskeletal Outcomes Data Evaluation and Management System. Clin Orthop Relat Res. 2004:272-278.
83. Sassi F. Calculating QALYs, comparing QALY and DALY calculations. Health Policy Plan. 2006;21:402-408.
84. Saxena S, Carlson D, Billington R, Life WGWHOQO. The WHO quality of life assessment instrument (WHOQOL-Bref): the importance of its items for cross-cultural research. Qual Life Res. 2001;10:711-721.
85. Shah J, Rajgor D, Pradhan S, McCready M, Zaveri A, Pietrobon R. Electronic data capture for registries and clinical trials in orthopaedic surgery: open source versus commercial systems. Clin Orthop Relat Res. 2010;468:2664-2671.
86. SooHoo NF, Samimi DB, Vyas RM, Botzler T. Evaluation of the validity of the Foot Function Index in measuring outcomes in patients with foot and ankle disorders. Foot Ankle Int. 2006;27:38-42.
87. Sox HC, Goodman SN. The methods of comparative effectiveness research. Annu Rev Public Health. 2012;33:425-445.
88. Stewart JI, Moyle S, Criner GJ, Wilson C, Tanner R, Bowler RP, Crapo JD, Zeldin RK, Make BJ, Regan EA, For The Copdgene I. Automated telecommunication to obtain longitudinal follow-up in a multicenter cross-sectional COPD study. COPD. 2012;9:466-472.
89. Suk M, Hanson B, Helfet DL. Evidence-based orthopedic surgery: is it possible? Orthop Clin North Am. 2010;41:139-143.
90. Suk M, Norvell DC, Hanson B, Dettori JR, Helfet D. Evidence-based orthopaedic surgery: what is evidence without the outcomes? J Am Acad Orthop Surg. 2008;16:123-129.
91. Sullivan PW, Ghushchyan V. Preference-Based EQ-5D index scores for chronic conditions in the United States. Med Decis Making. 2006;26:410-420.
92. Swiontkowski MF, Buckwalter JA, Keller RB, Haralson R. The outcomes movement in orthopaedic surgery: where we are and where we should go. J Bone Joint Surg Am. 1999;81:732-740.
93. Swiontkowski MF, Engelberg R, Martin DP, Agel J. Short musculoskeletal function assessment questionnaire: validity, reliability, and responsiveness. J Bone Joint Surg Am. 1999;81:1245-1260.
94. Torrance GW. Preferences for health states: a review of measurement methods. Mead Johnson Symp Perinat Dev Med. 1982:37-45.
95. Torrance GW. Measurement of health state utilities for economic appraisal. J Health Econ. 1986;5:1-30.
96. Torrance GW. Utility approach to measuring health-related quality of life. J Chronic Dis. 1987;40:593-603.
97. Torrance GW, Furlong W, Feeny D, Boyle M. Multi-attribute preference functions. Health Utilities Index. Pharmacoeconomics. 1995;7:503-520.
98. Tosteson AN, Tosteson TD, Lurie JD, Abdu W, Herkowitz H, Andersson G, Albert T, Bridwell K, Zhao W, Grove MR, Weinstein MC, Weinstein JN. Comparative effectiveness evidence from the Spine Patient Outcomes Research Trial: surgical versus nonoperative care for spinal stenosis, degenerative spondylolisthesis, and intervertebral disc herniation. Spine (Phila Pa 1976). 2011;36:2061-2068.
99. Varni JW, Seid M, Kurtin PS. PedsQL 4.0: reliability and validity of the Pediatric Quality of Life Inventory version 4.0 generic core scales in healthy and patient populations. Med Care. 2001;39:800-812.
100. Varni JW, Seid M, Rode CA. The PedsQL: measurement model for the pediatric quality of life inventory. Med Care. 1999;37:126-139.
101. Vavken P, Bianchi T. In Brief: cost-effectiveness analyses in orthopaedics. Clin Orthop Relat Res. 2011;469:2395-2398.
102. Vieira RD, Hueb W, Hlatky M, Favarato D, Rezende PC, Garzillo CL, Lima EG, Soares PR, Hueb AC, Pereira AC, Ramires JA, Kalil Filho R. Cost-effectiveness analysis for surgical, angioplasty, or medical therapeutics for coronary artery disease: 5-year follow-up of medicine, angioplasty, or surgery study (MASS) II trial. Circulation. 2012;126:S145-150.
103. Vitale MA, Vitale MG, Zivin JG, Braman JP, Bigliani LU, Flatow EL. Rotator cuff repair: an analysis of utility scores and cost-effectiveness. J Shoulder Elbow Surg. 2007;16:181-187.
104. Ware J, Jr., Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34:220-233.
105. Ware JE, Jr., Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473-483.
106. Weinstein MC, Torrance G, McGuire A. QALYs: the basics. Value Health. 2009;12 Suppl 1:S5-9.
107. WHOQOL Group. Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med. 1998;28:551-558.