Comparison of Outlier Identification Methods in Hospital Surgical Quality Improvement Programs

Journal of Gastrointestinal Surgery

Volumn 14, Issue 10, 2010, Pages 1600-1607

  Bilimoria, Karl Y ^a,b,c   Cohen, Mark E ^a   Merkow, Ryan P ^a   Wang, Xue ^a   Bentrem, David J ^b   Ingraham, Angela M ^a   Richards, Karen ^a   Hall, Bruce L ^d,e,f   Ko, Clifford Y ^g  

^a AMERICAN COLLEGE OF SURGEONS   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c UNIVERSITY OF TEXAS MD ANDERSON CANCER CENTER   (United States)

^d VETERANS AFFAIRS MEDICAL CENTER   (United States)

^e BARNES JEWISH HOSPITAL   (United States)

^f WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^g UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Complications; Deaths; Hospital; Morbidity; Mortality; National surgery quality improvement program; Outlier; Quality; Surgery

Indexed keywords

ARTICLE; COMPARATIVE STUDY; HEALTH CARE QUALITY; HOSPITAL DEPARTMENT; HUMAN; RISK ASSESSMENT; STANDARD; STATISTICS; SURGERY; TOTAL QUALITY MANAGEMENT; UNITED STATES;

HUMANS; QUALITY ASSURANCE, HEALTH CARE; QUALITY IMPROVEMENT; RISK ADJUSTMENT; SURGERY DEPARTMENT, HOSPITAL; SURGICAL PROCEDURES, OPERATIVE; UNITED STATES;

EID: 77957018168     PISSN: 1091255X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11605-010-1316-6     Document Type: Article

References (34)

1. Institute of Medicine (US). Committee on Quality of Health Care in America. Crossing the quality chasm a new health system for the 21st century. Washington, DC: National Academy, 2001.
2. Institute of Medicine (US). Committee on Quality of Health Care in America, Kohn LT, Corrigan J, Donaldson MS. To err is human: building a safer health system. Washington, DC: National Academy, 2000.
3. Institute of Medicine (US). Committee on Redesigning Health Insurance Performance Measures Payment and Performance Improvement Programs. Performance measurement: accelerating improvement. Washington, DC: National Academies, 2006.
4. Fung CH, Lim YW, Mattke S, et al. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med 2008; 148(2): 111-23.
5. Russell EM, Bruce J, Krukowski ZH. Systematic review of the quality of surgical mortality monitoring. Br J Surg 2003; 90(5): 527-32.
6. Faber M, Bosch M, Wollersheim H, et al. Public reporting in health care: how do consumers use quality-of-care information? A systematic review. Med Care 2009; 47(1): 1-8.
7. American College of Surgeons. National Surgical Quality Improvement Program. Available at www. facs. org/acsnsqip. html. Accessed April 15, 2009.
8. Khuri SF, Daley J, Henderson W, et al. The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg 1998; 228(4): 491-507.
9. Daley J, Khuri SF, Henderson W, et al. Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg 1997; 185(4): 328-40.
10. Khuri SF, Henderson WG, Daley J, et al. The patient safety in surgery study: background, study design, and patient populations. J Am Coll Surg 2007; 204(6): 1089-102.
11. Davis CL, Pierce JR, Henderson W, et al. Assessment of the reliability of data collected for the Department of Veterans Affairs national surgical quality improvement program. J Am Coll Surg 2007; 204(4): 550-60.
12. Khuri SF, Henderson WG, Daley J, et al. Successful implementation of the Department of Veterans Affairs' National Surgical Quality Improvement Program in the private sector: the Patient Safety in Surgery study. Ann Surg 2008; 248(2): 329-36.
13. American College of Surgeons. National Surgical Quality Improvement Program: Resources, Program Information. Available at https://acsnsqip. org/main/resources_downloads. asp. Accessed April 15, 2009.
14. Bilimoria K, Cohen M, Ingraham A, et al. Effect of post-discharge morbidity and mortality on comparisons of hospital surgical quality. Ann Surg 2010 (in press).
15. American College of Surgeons. National Surgical Quality Improvement Program: Semiannual Report. Available at https://acsnsqip. org/main/resources_semi_annual_report. pdf. Accessed April 15, 2009.
16. American College of Surgeons. National Surgical Quality Improvement Program. Available at www. facs. org/acsnsqip. html. Accessed April 9, 2010.
17. Surgical Care and Outcomes Assessment Program (SCOAP). Available at http://www. scoap. org/downloads/Q1-2009-Hospital-Report-XX. pdf. Last accessed April 9, 2010.
18. Hamilton BH, Ko CY, Richards K, Hall BL. Missing data in the American College of Surgeons National Surgical Quality Improvement Program are not missing at random: implications and potential impact on quality assessments. J Am Coll Surg; 210(2): 125-139 e2.
19. Sun J, Ono Y, Takebuchi Y. A simple method for calculating the exact confidence interval of the standardized mortality ratio with an [sic] SAS function. Journal of Occupational Health 1996; 38: 196-197.
20. Jones HE, Ohlssen DI, Spiegelhalter DJ. Use of the false discovery rate when comparing multiple health care providers. J Clin Epidemiol 2008; 61(3): 232-240.
21. Austin PC, Naylor CD, Tu JV. A comparison of a Bayesian vs. a frequentist method for profiling hospital performance. J Eval Clin Pract 2001; 7(1): 35-45.
22. Dai J, Li Z, Rocke D. Hierarchical logistic regression modeling with SAS GLIMMIX. Available at: www. lexjansen. com/wuss/2006/Analytics/ANL-Dai. pdf, 2006.
23. Houchens R, Chu B, Steiner C. Hierachical modeling using HCUP data. US Agency for Healthcare and Research Quality 2007.
24. SAS. The GLIMMIX Procedure, June 2006. Available at: http:/support. sas. com/rnd/app/papers/glimmix. pdf, 2006.
25. Cohen ME, Dimick JB, Bilimoria KY, et al. Risk adjustment in the American College of Surgeons national surgical quality improvement program: a comparison of logistic versus hierarchical modeling. J Am Coll Surg 2009; 209(6): 687-93.
26. New York State Department of Health. Adult Cardiac Surgery in New York State. Available at http://www. nyhealth. gov/statistics/diseases/cardiovascular/. Last accessed April 9, 2010.
27. California Office of Statewide Health Planning and Development (OSHPD). Available at http://www. oshpd. ca. gov/HID/DataFlow/HospQuality. html. Last accessed April 9, 2010.
28. The Quality Oncology Practice Initiative (QOPI). Available at http://qopi. asco. org/index. Last accessed April 9, 2010.
29. HealthGrades. Available at http://www. healthgrades. com. Last accessed April 9, 2010.
30. Society of Thoracic Surgeons. http://www. sts. org/sections/stsnationaldatabase/ Accessed April 9. 2010.
31. US Department of Health and Human Resources. Hospital Compare. http://www. hospitalcompare. hhs. gov. Accessed April 15, 2009.
32. Fedeli U, Brocco S, Alba N, et al. The choice between different statistical approaches to risk-adjustment influenced the identification of outliers. J Clin Epidemiol 2007; 60(8): 858-62.
33. Glance LG, Dick A, Osler TM, et al. Impact of changing the statistical methodology on hospital and surgeon ranking: the case of the New York State cardiac surgery report card. Med Care 2006; 44(4): 311-9.
34. Ghaferi AA, Birkmeyer JD, Dimick JB. Variation in hospital mortality associated with inpatient surgery. N Engl J Med 2009; 361(14): 1368-75.