Benchmarking trauma centers on mortality alone does not reflect quality of care: Implications for pay-for-performance

Journal of Trauma and Acute Care Surgery

Volumn 76, Issue 5, 2014, Pages 1184-1191

  Hashmi, Zain G ^a   Schneider, Eric B ^a   Castillo, Renan ^d   Haut, Elliott R ^a,b,c   Zafar, Syed Nabeel ^e   Cornwell, Edward E ^e   Mackenzie, Ellen J ^c   Latif, Asad ^a   Haider, Adil H ^a,b,d  

^a JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b Trauma Surgical Critical Care and Acute Care Surgery   (United States)

^c Department of Surgery ^*

^d JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^e HOWARD UNIVERSITY COLLEGE OF MEDICINE   (United States)

Author keywords

benchmarking; morbidity; mortality; pay for performance; Trauma center

Indexed keywords

ACUTE KIDNEY FAILURE; ADOLESCENT; ADULT; ADULT RESPIRATORY DISTRESS SYNDROME; AGED; AREA UNDER THE CURVE; BLUNT TRAUMA; CEREBROVASCULAR ACCIDENT; CONFERENCE PAPER; CORRELATION ANALYSIS; CORRELATION COEFFICIENT; DECUBITUS; EMERGENCY HEALTH SERVICE; FEMALE; HEALTH CARE QUALITY; HEART ARREST; HEART INFARCTION; HUMAN; INJURY SCALE; INJURY SEVERITY; LUNG EMBOLISM; MAJOR CLINICAL STUDY; MALE; MORBIDITY; MORTALITY; MULTICENTER STUDY; OUTCOME ASSESSMENT; PENETRATING TRAUMA; PNEUMONIA; PRIORITY JOURNAL; QUALITY CONTROL; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY ANALYSIS; SEPSIS; SURGICAL INFECTION; VERY ELDERLY;

ADULT; AGED; BENCHMARKING; CAUSE OF DEATH; DATABASES, FACTUAL; FEMALE; HEALTH CARE SURVEYS; HOSPITAL MORTALITY; HUMANS; INJURY SEVERITY SCORE; MALE; MIDDLE AGED; QUALITY OF HEALTH CARE; REIMBURSEMENT, INCENTIVE; RISK ADJUSTMENT; SENSITIVITY AND SPECIFICITY; SURVIVAL ANALYSIS; TRAUMA CENTERS; UNITED STATES; WOUNDS AND INJURIES; WOUNDS, NONPENETRATING; WOUNDS, PENETRATING; YOUNG ADULT;

EID: 84899872434     PISSN: 21630755     EISSN: 21630763     Source Type: Journal    
DOI: 10.1097/TA.0000000000000215     Document Type: Conference Paper

References (37)

1. Centers for Disease Control and Prevention National Center for Injury Prevention and Control. Web-based Injury Statistics Query and Reporting System (WISQARS). Available at: http://www.cdc.gov/injury/wisqars. Accessed August 30, 2013.
2. Corso P, Finkelstein E, Miller T, Fiebelkorn I, Zaloshnja E. Incidence and lifetime costs of injuries in the United States. Inj Prev. 2006; 12(4): 212-218.
3. Velopulos CG, Enwerem NY, Obirieze A, Hui X, Hashmi ZG, Scott VK, et al. National cost of trauma care by payer status. J Surg Res. 2013.
4. Shafi S, Nathens AB, Cryer HG, Hemmila MR, Pasquale MD, Clark DE, et al. The Trauma Quality Improvement Program of the American College of Surgeons Committee on Trauma. J Am Coll Surg. 2009; 209(4): 521-530.e1.
5. Khuri SF, Daley J, Henderson WG. The comparative assessment and improvement of quality of surgical care in the Department of Veterans Affairs. Arch Surg. 2002;137(1):20-27.
6. Nathens AB, Cryer HG, Fildes J. The American College of Surgeons Trauma Quality Improvement Program. Surg Clin North Am. 2012;92(2): 441-454, xxi.
7. Department of Health and Human Services and Centers for Medicare & Medicaid Services. Medicare Program; Hospital Inpatient Value-Based Purchasing Program; Final Rule. 2011. Available at: http://www.gpo. gov/fdsys/pkg/FR-2011- 05-06/pdf/2011-10568.
8. American College of Surgeons. National Trauma Data Bank: NTDB Research Data Set Admission Year 2010, Annual Report. Chicago, IL: American College of Surgeons; 2010.
9. American College of Surgeons. National Trauma Data Standard. Available at: http://www.ntdsdictionary.org/index.html. Accessed August 30, 2013.
10. Kardooni S, Haut ER, Chang DC, Pierce CA, Efron DT, Haider AH, et al. Hazards of benchmarking complications with the National Trauma Data Bank: numerators in search of denominators. J Trauma. 2008;64(2): 273-277; discussion 277-279.
11. American College of Surgeons. Getting startedWith TQIP. Available from: www.facs.org/trauma/ntdb/tqip-gs.html. Accessed September 12, 2013.
12. Haider AH, Hashmi ZG, Zafar SN, Castillo R, Haut ER, Schneider EB, Cornwell EE 3rd, Mackenzie EJ. Developing best practices to study trauma outcomes in large data bases: an evidence based approach to determine the best mortality risk adjustment model. J Trauma Acute Care Surg. 2013.
13. Haider AH, Saleem T, Leow JJ, Villegas C V, Kisat M, Schneider EB, et al. Influence of the National Trauma Data Bank on the study of trauma outcomes: is it time to set research best practices to further enhance its impact? J Am Coll Surg. 2012; 214(5): 756-768.
14. Oyetunji TA, Crompton JG, Ehanire ID, Stevens KA, Efron DT, Haut ER, et al. Multiple imputation in trauma disparity research. J Surg Res. 2011; 165:e37-e41.
15. Glance LG, Osler TM, Mukamel DB, Meredith W, Dick AW. Impact of statistical approaches for handling missing data on trauma center quality. Ann Surg. 2009;249(1):143-148.
16. Hashmi ZG, Dimick JB, Efron DT. Reliability adjustment: a necessity for trauma center ranking and benchmarking. J Trauma Acute Care Surg. 2013;75(1):166-172.
17. Roudsari B, Field C, Caetano R. Clustered and missing data in the US National Trauma Data Bank: implications for analysis. Inj Prev. 2008; 14(2):96-100.
18. Breslow NE, Day NE. Statistical Methods in Cancer Research, Volume II: The Design and Analysis of Cohort Studies. New York, NY: Oxford University Press; 1987.
19. Haider AH, Hashmi ZG, Zafar SN, Hui X, Schneider EB, Efron DT, et al. Minority trauma patients tend to cluster at trauma centers with worse-thanexpected mortality: can this phenomenon help explain racial disparities in trauma outcomes? J Surg Res. 2013;184:444-449.
20. King TS, Chinchilli VM. A generalized concordance correlation coefficient for continuous and categorical data. Stat Med. 2001;20(14):2131-2147.
21. Mehrotra A, Damberg CL, Sorbero MES, Teleki SS. Pay for performance in the hospital setting: what is the state of the evidence? Am J Med Qual. 2009;24(1):19-28.
22. "Hospital compare" gets official rollout by CMS. Qual Lett Healthc Lead. 2005;17(5):11-12, 1.
23. Services C for M and M. Medicare Hospital Compare Quality of Care. 2013. Available at: http://www.medicare.gov/hospitalcompare/. Accessed August 30, 2013.
24. Newgard CD, Fildes JJ, Wu L, Hemmila MR, Burd RS, Neal M, et al. Methodology and analytic rationale for the American College of Surgeons Trauma Quality Improvement Program. J Am Coll Surg. 2013; 216(1): 147-157.
25. Stelfox HT, Bobranska-Artiuch B, Nathens A, Straus SE. Quality indicators for evaluating trauma care: a scoping review. Arch Surg. 2010;145(3):286-295.
26. Shahian DM, Iezzoni LI, Meyer GS, Kirle L, Normand SL. Hospital-wide mortality as a quality metric: conceptual and methodological challenges. Am J Med Qual. 2012;27(2):112-123.
27. Hernandez AF, Fonarow GC, Liang L, Heidenreich PA, Yancy C, Peterson ED. The need for multiple measures of hospital quality: results from the Get with the Guidelines-Heart Failure Registry of the American Heart Association. Circulation. 2011;124(6):712-719.
28. Sharma S, de Mestral C, Hsiao M, Gomez D, Haas B, Rutka J, et al. Benchmarking trauma center performance in traumatic brain injury: the limitations of mortality outcomes. J Trauma Acute Care Surg. 2013;74(3): 890-894.
29. Pitches DW, Mohammed MA, Lilford RJ. What is the empirical evidence that hospitals with higher-risk adjusted mortality rates provide poorer quality care? A systematic review of the literature. BMC Health Serv Res. 2007;7:91.
30. Shahian DM,Wolf RE, Iezzoni LI, Kirle L, Normand SL. Variability in the measurement of hospital-wide mortality rates. N Engl J Med. 2010;363 (26):2530-2539.
31. Shahian DM, Edwards FH, Ferraris VA, Haan CK, Rich JB, Normand SL, et al. Quality measurement in adult cardiac surgery: part 1Vconceptual framework and measure selection. Ann Thorac Surg. 2007;83(Suppl 4):S3-S12.
32. O'Brien SM, Shahian DM, DeLong ER, Normand SL, Edwards FH, Ferraris VA, et al. Quality measurement in adult cardiac surgery: part 2Vstatistical considerations in composite measure scoring and provider rating. Ann Thorac Surg. 2007;83(Suppl 4):S13-S26.
33. Haut ER, Noll K, Efron DT, Berenholz SM, Haider A, Cornwell EE, et al. Can increased incidence of deep vein thrombosis (DVT) be used as a marker of quality of care in the absence of standardized screening? The potential effect of surveillance bias on reported DVT rates after trauma. J Trauma. 2007;63(5):1132-1135; discussion 1135-1137.
34. Pierce CA, Haut ER, Kardooni S, Chang DC, Efron DT, Haider A, et al. Surveillance bias and deep vein thrombosis in the national trauma data bank: the more we look, the more we find. J Trauma. 2008;64(4):932-936; discussion 936-937.
35. Haut ER, Chang DC, Pierce CA, Colantuoni E, Efron DT, Haider AH, et al. Predictors of posttraumatic deep vein thrombosis (DVT): hospital practice versus patient factorsVan analysis of the National Trauma Data Bank (NTDB). J Trauma. 2009;66(4):994-999; discussion 999-1001.
36. Haut ER, Pronovost PJ. Surveillance bias in outcomes reporting. JAMA. 2011;305(23):2462-2463.
37. Haut ER, Schneider EB, Patel A, Streiff MB, Haider AH, Stevens KA, et al. Duplex ultrasound screening for deep vein thrombosis in asymptomatic trauma patients: a survey of individual trauma surgeon opinions and current trauma center practices. J Trauma. 2011;70(1):27-33; discussion 33-34.