Benefit-of-the-doubt approaches for calculating a composite measure of quality

Health Services and Outcomes Research Methodology

Volumn 9, Issue 4, 2009, Pages 234-251

  Shwartz, Michael ^a,b   Burgess, James F ^a,d   Berlowitz, Dan ^c,d  

^a VA BOSTON HEALTHCARE SYSTEM   (United States)

^b BOSTON UNIVERSITY   (United States)

^c VETERANS AFFAIRS MEDICAL CENTER   (United States)

^d BOSTON UNIVERSITY   (United States)

Author keywords

Benefit of the doubt approaches; Composite measures; Data envelopment analysis; Health care quality; Linear programming; Performance measurement

Indexed keywords

ARTICLE; BENEFIT OF THE DOUBT APPROACH; CALCULATION; HEALTH CARE FACILITY; HEALTH CARE POLICY; HEALTH CARE PRACTICE; HEALTH CARE QUALITY; HEALTH SERVICE; NURSING HOME; PATIENT ASSESSMENT; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; SCORING SYSTEM;

EID: 77955771823     PISSN: 13873741     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10742-010-0056-0     Document Type: Article

References (47)

1. Agency for Healthcare Research and Quality: Prevention quality indicators overview. http://www.qualityindicators.ahrq.gov/pqi-overview.htm (2004). Accessed 4 Nov 2008
2. Agency for Healthcare Research and Quality (AHRQ) Quality Indicators: Patient Safety Indicator Composite Measure Final Technical Report (October 2006)
3. R Allen A Athanassopoulos RG Dyson E Thanassoulis 1997 Weights restrictions and value judgements in data envelopment analysis Ann. Oper. Res. 73 13 34 10.1023/A:1018968909638
4. G Arling SL Karon F Sainfort DR Zimmerman R Ross 1997 Risk adjustment of nursing home quality indicators Gerontologist 37 757 766 1:STN:280: DyaK1c%2FpsVeqsA%3D%3D 9432992
5. G Arling T Lewis RL Kane C Mueller S Flood 2007 Improving quality assessment through multilevel modeling: the case of nursing home compare Health Serv. Res. 42 1177 1199 10.1111/j.1475-6773.2006.00647.x 17489909 (Pubitemid 46699476)
6. Ash, A.S., Shwartz, M., Peköz, E.: Comparing outcomes across providers. In: Iezzoni, L.I. (ed.) Risk Adjustment for Measuring Health Care Outcomes, 3rd edn, pp. 297-333. Health Administration Press, Chicago (2003)
7. DB Berlowitz AS Ash GH Brandeis HK Brand JL Halpern MA Moskowitz 1996 Rating long-term care facilities on pressure ulcer development: importance of case-mix adjustment Ann. Intern. Med. 124 557 563 1:STN:280:DyaK287nsFKmsQ%3D%3D 8597318
8. DR Berlowitz GJ Young EC Hickey D Saliba BS Mittman E Czarnowski, et al. 2003 Quality improvement implementation in the nursing home Health Serv. Res. 38 65 83 10.1111/1475-6773.00105 12650381
9. DB Berlowitz AK Rosen F Wang D Tsilimingras PN Tariot B Engelhardt, et al. 2005 Purchasing or providing nursing home care: can quality of care data provide guidance J. Am. Geriatr. Soc. 53 603 608 10.1111/j.1532-5415.2005.53207. x 15817005 (Pubitemid 41623481)
10. BI Braun 1991 The effect of nursing home quality on patient outcome J. Am. Geriatr. Soc. 39 329 338 1:STN:280:DyaK3M7osFKqsQ%3D%3D 1901326
11. T Caldis 2007 Composite health plan quality scales Health Care Financ. Rev. 28 95 107 17645158
12. MW Carter 2003 Factors associated with ambulatory care-sensitive hospitalizations among nursing home residents J Aging Health 15 295 330 10.1177/0898264303015002001 12795274 (Pubitemid 36438234)
13. A Charnes WW Cooper E Rhodes 1978 Measuring the efficiency of decision making units Eur. J. Oper. Res. 2 429 444 10.1016/0377-2217(78)90138-8 (Pubitemid 9402758)
14. Cherchye, L., Kuosmanen, T.: Benchmarking sustainable development: a synthetic meta-index approach. In: McGillivray, M., Clarke, M. (eds.) Perspectives on human development, chapter 7. United Nations University Press, Tokyo (2004)
15. L Cherchye W Moesen N Rogge T Van Puyenbroeck 2007 An introduction to 'benefit of the doubt' composite indicators Soc. Indic. Res. 82 111 145 10.1007/s11205-006-9029-7 (Pubitemid 46534425)
16. L Cherchye W Moesen N Rogge T Van Puyenbroeck M Saisana A Saltelli R Liska S Tarantola 2008 Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index J. Oper. Res. Soc. 59 239 251 10.1057/palgrave.jors.2602445 (Pubitemid 351177315)
17. Cooper, W.W., Seiford, L.M., Tone, K.: Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEA-Solver Software. Springer Science and Business Media, LLC, New York (2007)
18. DK Despotis 2005 A reassessment of the Human Development Index via data envelopment analysis J. Oper. Res. Soc. 56 969 980 10.1057/palgrave.jors.2601927 (Pubitemid 41028658)
19. JR Edwards RP Bagozzi 2000 On the nature and direction of relationships between constructs and measures Psychol. Methods 5 155 174 10.1037/1082-989X.5. 2.155 1:STN:280:DC%2BD3cvislWlsg%3D%3D 10937327
20. AR Feinstein 1999 Multi-item "instruments" vs Virginia Apgar's principles of clinimetrics Arch. Intern. Med. 159 125 128 10.1001/archinte.159. 2.125 1:STN:280:DyaK1M7isVarsQ%3D%3D 9927093 (Pubitemid 29055098)
21. TK Gandhi EF Cook AL Puopolo HR Burstin JS Haas TA Brennan 2002 Inconsistent report cards: assessing the comparability of various measures of the quality of ambulatory care Med. Care 40 155 165 10.1097/00005650-200202000- 00010 11802088
22. Gormley, W.T., Weimer, D.L.: Organizational Report Cards. Harvard University Press, Cambridge MA (1999)
23. Institute of Medicine: Performance Measurement: Accelerating Improvement. National Academy Press, Washington, DC (2006)
24. R Jacobs M Goddard PC Smith 2005 How robust are hospital ranks based on composite performance measures Med. Care 43 1177 1184 10.1097/01.mlr.0000185692. 72905.4a 16299428 (Pubitemid 43012174)
25. CB Jarvis SB MacKenzie PM Podsakoff 2003 A critical review of construct indicators and measurement model misspecification in marketing and consumer research J. Consum. Res. 30 199 218 10.1086/376806 (Pubitemid 37374305)
26. AK Jha L Zhonghe EJ Orav AM Epstein 2005 Care in U.S. hospitals-The Hospital Quality Alliance Program N. Engl. J. Med. 353 265 274 10.1056/NEJMsa051249 1:CAS:528:DC%2BD2MXmt1KmsL0%3D 16034012 (Pubitemid 41058326)
27. MB Landrum SE Bronskill S-L Normand 2000 Analytic methods for constructing cross-sectional profiles of health care providers Health Serv. Outcomes Res. Methodol. 1 23 47 10.1023/A:1010093701870 (Pubitemid 32798839)
28. Lenard, M.L., Wagner, J.M., Shimshak, D.G., Porell, F.W., Klimberg, R.K.: Evaluating the performance of nursing homes using data envelopment analysis. In: Lawrence, K.D. (ed.) Mathematical Programming, Applications of Management Science, vol. 11, pp. 89-105. Elsevier Ltd, Amsterdam (2004)
29. TR Lied R Malsbary C Eisenberg J Ranck 2002 Combining HEDIS indicators: A new approach to measuring plan performance Health Care Financ. Rev. 23 117 129 12500474
30. PK Lindenauer D Remus S Roman MB Rothberg EM Benjamin A Ma, et al. 2007 Public reporting and pay for performance in hospital quality improvement N. Engl. J. Med. 356 486 496 10.1056/NEJMsa064964 1:CAS:528:DC%2BD2sXht1ersb4%3D 17259444 (Pubitemid 46193076)
31. CAK Lovell 1995 Measuring the macroeconomic performance of the Taiwanese economy Int. J. Prod. Econ. 39 165 178 10.1016/0925-5273(94)00067-K
32. Mahlberg, B., Obersteiner, M.: Remeasuring the HDI by data envelopment analysis. Interim Report IR-01-069. International Institute for Applied Systems Analysis, Laxenburg, Austria (2001)
33. DB Mukamel 1997 Risk-adjusted outcome measures and quality of care in nursing homes Med. Care 35 367 385 10.1097/00005650-199704000-00007 1:STN:280:DyaK2s3mtFamsw%3D%3D 9107205
34. Nardo, M., Saisana, M., Saltelli, A., Tarantola S. Handbook on constructing composite indicators: methodology and user guide. Organization for Economic Co-operation and Development (OECD) Statistics Working Paper, 2005. http://www.olis.oecd.org/olis/2005doc.nsf/LinkTo/std-doc(2005)3. Accessed 9 Sept 2009
35. SM O'Brien DM Shahian ER DeLong S-LT Normand FH Edwards VA Ferraris, et al. 2007 Quality measurement in adult cardiac surgery: part 2-statistical considerations in composite measure scoring and provider rating Ann. Thorac. Surg. 83 S13 S26 10.1016/j.athoracsur.2007.01.055 17383406 (Pubitemid 46440798)
36. Pizer, S.D., Wang, M., Comstock, C.: Preventable hospitalization as a measure of quality of care in nursing homes. Working Paper #2003-01. Health Care Finance and Economics, VA Bedford, MA (2003)
37. F Porell FG Caro A Silva M Monane 1998 A longitudinal analysis of nursing home outcomes Health Serv. Res. 33 835 865 1:STN:280:DyaK1cvltVWjsA%3D%3D 9776939
38. Premier: Hospital Quality Incentive Demonstration Project. Summary of Composite Quality Scoring Methodology. http://www.premierinc.com/quality-safety/ tools-services/p4p/hqi/resources/top-performer-summary.pdf. (2003). Accessed 4 Nov 2008
39. D Reeves SM Campbell J Adams PG Shekelle E Kontopantelis 2007 Combining multiple indicators of clinical quality: an evaluation of different analytic approaches Med. Care 45 489 496 10.1097/MLR.0b013e31803bb479 17515775
40. A Rosen J Wu B Chang DR Berlowitz C Rakovski AS Ash, et al. 2001 Risk adjustment for measuring health outcomes: an application in VA long-term care Am. J. Med. Qual. 16 118 127 10.1177/106286060101600403 1:STN:280: DC%2BD3MvjtVGjsA%3D%3D 11477956
41. AM Ryan JF Burgess CP Tompkins SS Wallack 2009 The relationship between Medicare's process of care quality measures and mortality Inquiry 46 274 291 19938724
42. J Semple 1996 Constrained games for evaluating organizational performance Eur. J. Oper. Res. 96 103 112 10.1016/S0377-2217(96)00068-9
43. M Shwartz J Ren EA Peköz X Wang AB Cohen JD Restuccia 2008 Estimating a composite measure of hospital quality from the Hospital Compare database: differences when using a Bayesian hierarchical latent variable model versus denominator-based weights Med. Care 46 778 785 10.1097/MLR. 0b013e31817893dc 18665057
44. RM Werner ET Bradlow 2006 Relationship between Medicare's hospital compare performance measures and mortality rates JAMA 296 2694 2702 10.1001/jama.296.22.2694 1:CAS:528:DC%2BD28XhtlWrsbnM 17164455 (Pubitemid 44920181)
45. Winston, W., Albright, S.C.: Practical Management Science, 2nd edn. Duxbury, Pacific Grove, CA (2001)
46. AM Zaslavsky JA Shaul LB Zaborski MJ Cioffi PD Cleary 2002 Combining health plan performance indicators into simpler composite measures Health Care Financ. Rev. 23 101 115 12500473
47. DR Zimmerman SL Karon G Arling BR Clark T Collins R Ross, et al. 1995 Development and testing of nursing home quality indicators Health Care Financ. Rev. 16 107 127 1:STN:280:DyaK28%2FlvFOrtg%3D%3D 10151883