Surgical outcomes research: A progression from performance audits, to assessment of administrative databases, to prospective risk-adjusted analysis - How far have we come?

Current Opinion in Pediatrics

Volumn 20, Issue 3, 2008, Pages 320-325

  Morrato, Elaine H ^a   Dillon, Peter ^b   Ziegler, Moritz ^c  

^a Children's Hospital Colorado   (United States)

^b PENN STATE COLLEGE OF MEDICINE   (United States)

^c UNIVERSITY OF COLORADO SCHOOL OF MEDICINE   (United States)

Author keywords

Administrative data; Quality; Risk adjustment; Surgical outcomes

Indexed keywords

CLINICAL RESEARCH; HOSPITAL CARE; HOSPITAL MANAGEMENT; HUMAN; MEDICAL AUDIT; MEDICAL RECORD; MORBIDITY; MORTALITY; OUTCOME ASSESSMENT; PATIENT SAFETY; PEDIATRICS; PRIORITY JOURNAL; QUALITY CONTROL; REVIEW; TREATMENT OUTCOME;

CHILD; DATABASES, FACTUAL; HUMANS; MEDICAL AUDIT; OUTCOME ASSESSMENT (HEALTH CARE); QUALITY OF HEALTH CARE; RISK ADJUSTMENT; SURGERY;

EID: 43449121255     PISSN: 10408703     EISSN: None     Source Type: Journal    
DOI: 10.1097/MOP.0b013e3283005857     Document Type: Review

References (43)

1. Kohn LT, Corrigan JM, Donaldson MS, editors. To err is human: building a safer health system. Washington DC: National Academies Press; 2000.
2. Institute of Medicine Committee on Quality Healthcare in America. Crossing the quality chasm: a new health system for the 21st century. Washington DC: National Academies Press; 2001.
3. Passaro EJ, Organ CJ, Ernest A. Codman: the improper Bostonian. Bull Am Coll Surg 1999; 84:16-22.
4. Kaska S, Weinstein J. Historical perspective. Ernest Amory Codman, 1869-1940: a pioneer of evidence-based medicine: the end result idea. Spine 1998; 23:629-633.
5. Neuhauser D. Ernest Amory Codman, M.D., and end results of medical care. Int J Technol Assess Healthcare 1990; 6:307-325.
6. Wright J. The history of surgical audit. J Qual Clin Pract 1995; 15:81-88. This paper reviews the historical context of the personal surgical audit from the time of Codman to its more general application in the conventional surgical morbidity and mortality conference.
7. Strauch G. Problem-oriented surgical audit in the community hospital: a concept in evolution. Am J Surg 1975; 129:401-406.
8. Andrus C, Daly J. Evaluation of surgical services in a large university-affiliated VA hospital: use of an in-house-generated quality assurance data base. South Med J 1991; 84:1447-1450.
9. Rageth J, Haner C, Hess P, et al. Systematic scientific quality improvement in surgical specialties: the AQS model. Swiss Surg 1999; 5:62-72.
10. Donati A, Ruzzi M, Andrario E, et al. A new and feasible model for predicting operative risk. Br J Anaesth 2004; 93:393-399.
11. Hadjianastassiou V, Tekkis P, Poloniecki J, et al. Surgical mortality score: risk management tool for auditing surgical performance. World J Surg 2004; 28:193-200.
12. Martin Rn, Brennan M, Jaques D. Quality of complication reporting in the surgical literature. Ann Surg 2002; 235:803-813.
13. Hardwick R, Saltrese-Taylor A, Collins C. Need to measure outcome after discharge in surgical audit. Qual Healthcare 1992; 1:165-167.
14. Strom BL. Overview of automated databases in pharmacoepidemiology. In: Strom BL, Kimmel SE, editors. Textbook of pharmacoepidemiology. West Sussex, UK: John Wiley & Sons, Ltd; 2006. pp. 167-172.
15. Rogers SO. The holy grail of surgical quality improvement: process measures or risk-adjusted outcomes? Am Surg 2006; 72:1046-1050.
16. Best WR, Khuri SF, Phelan M, et al. Identifying patient preoperative risk factors and postoperative adverse events in administrative databases: results from the Department of Veterans Affairs National Surgical Quality Improvement Program. J Am Coll Surg 2002; 194:257-266. This review of VAH NSQIP data demonstrates the limitation of the administrative database as a tool for determining surgical quality. Using administrative data diminished both the sensitivity as well as the positive predictive value of measured surgical outcomes when compared with the standard NSQIP practice of using a nurse data manager.
17. Gordon H, Johnson M, Wray N, et al. Mortality after noncardiac surgery: prediction from administrative versus clinical data. Med Care 2005; 43:159-167.
18. Agency for Healthcare Research and Quality (AHRQ). Overview of HCUP (Healthcare Cost and Utilization Project). http://www.hcup-us.ahrq.gov/overview. jsp. [Accessed 1 February 2008]. This paper describes HCUP, a family of healthcare databases available for longitudinal outcomes assessment of hospitalized patients.
19. Agency for Healthcare Research and Quality (AHRQ). Overview of the Nationwide Inpatient Sample (NIS). http://www.hcup_us.ahrq.gov/nisoverview.jsp. [Accessed 20 February 2008].
20. Lasser MS, Liao JG, Burd RS. National trends in the use of antireflux procedures for children. Pediatrics 2006; 118:1828-1835.
21. Agency for Healthcare Research and Quality (AHRQ). Overview of the Kids' Inpatient Database (KID). http://www.hcup-us.ahrq.gov/kidoverview.jsp. [Accessed 20 February 2008].
22. Bowman SM, Zimmerman FJ, Christakis DA, et al. Hospital characteristics associated with the management of pediatric splenic injuries. JAMA 2005; 294:2611-2617.
23. Agency for Healthcare Research and Quality (AHRQ). Overview of the State Inpatient Databases (SID). http://www.hcup-us.ahrq.gov/sidoverview.jsp. Accessed February 20, 2008.
24. Agency for Healthcare Research and Quality (AHRQ). Overview of the State Ambulatory Surgery Databases (SASD). http://www.hcup-us.ahrq.gov/sasdoverview. jsp. [Accessed 20 February 2008].
25. Russo C, Owens P, Steiner C, Josephsen J. Ambulatory surgery in U.S. hospitals, 2003. HCUP Fact Book No. 9. AHRQ Publication No. 07-0007. Rockville, USA: Agency for Healthcare Research and Quality; 2007.
26. Newman K, Ponsky T, Kittle K, et al. Appendicitis 2000: variability in practice, outcomes, and resource utilization at thirty pediatric hospitals. J Pediatr Surg 2003; 38:372-379.
27. Khuri S, Henderson W, Barbour G, et al. The National Veterans Administration Surgical Risk Study: risk adjustment for the comparative assessment of the quality of surgical care. J Am Coll Surg 1995; 180:519-531.
28. Khuri S, Daley J, Henderson W, et al. Risk adjustment of the postoperative mortality rate for the comparative assessment of the quality of surgical care: results of the national Veterans Affairs Surgical Risk Study. J Am Coll Surg 1997; 185:315-327.
29. Daley J, Khuri SF, Henderson W, et al. Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg 1997; 185:328-340.
30. Khuri S, Daley J, Henderson W, et al. The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Quality Improvement Program. Ann Surg 1998; 228:491-507. This sentinel paper details both the methodology as well as outcomes from the development and application of a NSQIP to VAH. This application allowed the development of a stratification of performance from low to high which in turn allowed hospitals to seek out 'best-in-class' to serve as a model for quality improvement. Presurgical risk factors, in-hospital process-of-care factors, and 30-day postoperative morbidity and mortality were assessed to achieve these improvements in both morbidity and mortality rates.
31. Neumayer L, Mastin M, Vanderhoof L, Hinson D. Using the Veterans Administration National Surgical Quality Improvement Program to improve patient outcomes. J Surg Res 2000; 88:58-61.
32. Khuri S, Daley J, Henderson W. The comparative assessment and improvement of quality of surgical care in the Department of Veterans Affairs. Arch Surg 2002; 137:20-27.
33. Fink A, Campbell DJ, Mentzer RJ, et al. The National Surgical Quality Improvement Program in nonveterans administration hospitals: initial demonstration of feasibility. Ann Surg 2002; 236:344-353.
34. Khuri SF, Daley J, Henderson W, et al. Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program. Ann Surg 1999; 230:414-429.
35. Khuri SF, Henderson WG. The case against volume as a measure of quality of surgical care. World J Surg 2005; 29:1222-1229.
36. Hall BL, Hirbe M, Waterman B, et al. Comparison of mortality risk adjustment using a clinical data algorithm (American College of Surgeons National Surgical Quality Improvement Program) and an administrative data algorithm (Solucient) at the case level within a single institution. J Am Coll Surg 2007; 205:767-777.
37. Miller D, Filson C, Wallner L, et al. Comparing performance of Morbidity and Mortality Conference and National Surgical Quality Improvement Program for detection of complications after urologic surgery. Urology 2006; 68:931-937.
38. Hutter M, Rowell K, Devaney L, et al. Identification of surgical complications and deaths: an assessment of the traditional surgical morbidity and mortality conference compared with the American College of Surgeons - National Surgical Quality Improvement Program. J Am Coll Surg 2006; 203:618-624.
39. Rowell KS, Turrentine FE, Hutter MM, et al. Use of National Surgical Quality Improvement Program data as a catalyst for quality improvement. J Am Coll Surg 2007; 204:1293-1300. This paper using observed-to-expected performance ratios at NSQIP-participating hospitals that allowed institutions to address quality improvement. Specific examples are presented that include dramatic reductions in surgical site infections, wound complications and postoperative urinary infections. In addition, this study validated the usefulness of NSQIP in providing a forum for surgical outcomes research and quality improvement initiatives in these same institutions.
40. Jenkins K, Gauvreau K, Newburger J, et al. Consensus-based method for risk adjustment for surgery for congenital heart disease. J Thorac Cardiovasc Surg 2002; 123:110-118.
41. Lacour-Gayet F, Clarke D. The Aristotle method: a new concept to evaluate quality of care based on complexity. Curr Opin Pediatr 2005; 17:412-417.
42. Tepas JI. The national pediatric trauma registry: a legacy of commitment to control of childhood injury. Semin Pediatr Surg 2004; 13:126-132.
43. Osler T, Vane D, Tepas J, et al. Do pediatric trauma centers have better survival rates than adult trauma centers? An examination of the National Pediatric Trauma Registry. J Trauma 2001; 50:96-101.