How to improve the performance of intraoperative risk models: An example with vital signs using the surgical apgar score

Anesthesia and Analgesia

Volumn 117, Issue 6, 2013, Pages 1338-1346

  Hyder, Joseph A ^a   Kor, Daryl J ^a   Cima, Robert R ^b   Subramanian, Arun ^a  

^a Division of Critical Care Medicine   (United States)

^b MAYO CLINIC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; APGAR SCORE; ARTICLE; DEATH; FEMALE; HEART RATE; HUMAN; MAJOR CLINICAL STUDY; MALE; MEAN ARTERIAL PRESSURE; OPERATIVE BLOOD LOSS; POSTOPERATIVE COMPLICATION; PREDICTIVE VALUE; PRIORITY JOURNAL; SAMPLING; SENSITIVITY AND SPECIFICITY; SKIN INCISION; SURGICAL APGAR SCORE; SURGICAL PATIENT; SURGICAL RISK; VITAL SIGN;

ADULT; AGED; ARTERIAL PRESSURE; BLOOD LOSS, SURGICAL; CHI-SQUARE DISTRIBUTION; FEMALE; HEART RATE; HUMANS; LINEAR MODELS; LOGISTIC MODELS; MALE; MIDDLE AGED; MINNESOTA; MONITORING, INTRAOPERATIVE; MULTIVARIATE ANALYSIS; ODDS RATIO; POSTOPERATIVE COMPLICATIONS; PREDICTIVE VALUE OF TESTS; REGISTRIES; RISK ASSESSMENT; RISK FACTORS; SURGICAL PROCEDURES, OPERATIVE; TIME FACTORS; VITAL SIGNS;

EID: 84889096966     PISSN: 00032999     EISSN: 15267598     Source Type: Journal    
DOI: 10.1213/ANE.0b013e3182a46d6d     Document Type: Article

References (37)

1. Jha AK, Classen DC. Getting moving on patient safety-harnessing electronic data for safer care. N Engl J Med 2011;365:1756-8
2. Kenzaka T, Okayama M, Kuroki S, Fukui M, Yahata S, Hayashi H, Kitao A, Sugiyama D, Kajii E, Hashimoto M. Importance of vital signs to the early diagnosis and severity of sepsis: Association between vital signs and sequential organ failure assessment score in patients with sepsis. Intern Med 2012;51:871-6
3. Herasevich V, Pieper MS, Pulido J, Gajic O. Enrollment into a time sensitive clinical study in the critical care setting: Results from computerized septic shock sniffer implementation. J Am Med Inform Assoc 2011;18:639-44
4. Sobol JB, Wunsch H. Triage of high-risk surgical patients for intensive care. Crit Care 2011;15:217
5. Sternbach G. Claude Beck: Cardiac compression triads. J Emerg Med 1988;6:417-9
6. Bijker JB, van Klei WA, Kappen TH, van Wolfswinkel L, Moons KG, Kalkman CJ. Incidence of intraoperative hypotension as a function of the chosen definition: Literature definitions applied to a retrospective cohort using automated data collection. Anesthesiology 2007;107:213-20
7. Hermeneit S, Müller M, Terzic A, Rodehorst A, Schamberger M, Böttger T. Influenceable surgical and anesthesiological risk factors for the development of cardiac and pulmonary complications in laparoscopic surgery of the colon. Zentralbl Chir 2008;133:156-63
8. Pratt W, Callery MP, Vollmer CM Jr. Optimal surgical performance attenuates physiologic risk in high-Acuity operations. J Am Coll Surg 2008;207:717-30
9. Chau A, Ehrenfeld JM. Using real-Time clinical decision support to improve performance on perioperative quality and process measures. Anesthesiol Clin 2011;29:57-69
10. Moore LE, Sharifpour M, Shanks A, Kheterpal S, Tremper KK, Mashour GA. Cerebral perfusion pressure below 60 mm Hg is common in the intraoperative setting. J Neurosurg Anesthesiol 2012;24:58-62
11. Kheterpal S, O'Reilly M, Englesbe MJ, Rosenberg AL, Shanks AM, Zhang L, Rothman ED, Campbell DA, Tremper KK. Preoperative and intraoperative predictors of cardiac adverse events after general, vascular, and urological surgery. Anesthesiology 2009;110:58-66
12. Sessler DI, Sigl JC, Kelley SD, Chamoun NG, Manberg PJ, Saager L, Kurz A, Greenwald S. Hospital stay and mortality are increased in patients having a "triple low" of low blood pressure, low bispectral index, and low minimum alveolar concentration of volatile anesthesia. Anesthesiology 2012;116:1195-203
13. Regenbogen SE, Bordeianou L, Hutter MM, Gawande AA. The intra-operative Surgical Apgar Score predicts postdischarge complications after colon and rectal resection. Surgery 2010;148:559-66
14. Regenbogen SE, Ehrenfeld JM, Lipsitz SR, Greenberg CC, Hutter MM, Gawande AA. Utility of the surgical apgar score: Validation in 4119 patients. Arch Surg 2009;144:30-6
15. Regenbogen SE, Lancaster RT, Lipsitz SR, Greenberg CC, Hutter MM, Gawande AA. Does the Surgical Apgar Score measure intraoperative performance? Ann Surg 2008;248:320-8
16. Regenbogen SE, Bordeianou L, Hutter MM, Gawande AA. The intraoperative Surgical Apgar Score predicts postdischarge complications after colon and rectal resection. Surgery 2010;148:559-66
17. Gawande AA, Kwaan MR, Regenbogen SE, Lipsitz SA, Zinner MJ. An Apgar score for surgery. J Am Coll Surg 2007;204:201-8
18. Fink AS, Campbell DA Jr, Mentzer RM Jr, Henderson WG, Daley J, Bannister J, Hur K, Khuri SF. The National Surgical Quality Improvement Program in non-veterans administration hospitals: Initial demonstration of feasibility. Ann Surg 2002;236:344-53
19. Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, Chong V, Fabri PJ, Gibbs JO, Grover F, Hammermeister K, Irvin G 3rd, McDonald G, Passaro E Jr, Phillips L, Scamman F, Spencer J, Stremple JF. The Department of Veterans Affairs' NSQIP: The first national, validated, outcome-based, riskadjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg 1998;228: 491-507
20. Dimick JB, Osborne NH, Hall BL, Ko CY, Birkmeyer JD. Risk adjustment for comparing hospital quality with surgery: How many variables are needed? J Am Coll Surg 2010;210:503-8
21. Arvidsson S, Ouchterlony J, Nilsson S, Sjöstedt L, Svärdsudd K. The Gothenburg study of perioperative risk. I. Preoperative findings, postoperative complications. Acta Anaesthesiol Scand 1994;38:679-90
22. Arvidsson S, Ouchterlony J, Sjöstedt L, Svǎrdsudd K. Predicting postoperative adverse events. Clinical efficiency of four general classification systems. The project perioperative risk. Acta Anaesthesiol Scand 1996;40:783-91
23. Khuri SF, Daley J, Henderson W, Barbour G, Lowry P, Irvin G, Gibbs J, Grover F, Hammermeister K, Stremple JF. The National Veterans Administration Surgical Risk Study: Risk adjustment for the comparative assessment of the quality of surgical care. J Am Coll Surg 1995;180:519-31
24. Centers for Medicare and Medicaids Services. Available at: Https://www.cms.gov. Accessed October 21, 2010
25. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models: A framework for traditional and novel measures. Epidemiology 2010;21:128-38
26. Kerr KF, McClelland RL, Brown ER, Lumley T. Evaluating the incremental value of new biomarkers with integrated discrimination improvement. Am J Epidemiol 2011;174:364-74
27. Pencina MJ, Dágostino RB Sr, Demler OV. Novel metrics for evaluating improvement in discrimination: Net reclassification and integrated discrimination improvement for normal variables and nested models. Stat Med 2012;31:101-13
28. Bergstralh EJ. ROCPLUS macro: Available at: Http://mayoresearch. mayo.edu/mayo/research/biostat/sasmacros.cfm. 2009
29. Pepe MS, Janes H. Commentary: Reporting standards are needed for evaluations of risk reclassification. Int J Epidemiol 2011;40:1106-8
30. Hosmer DW, Hosmer T, Le Cessie S, Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med 1997;16:965-80
31. Smith T, Den Hartog D, Moerman T, Patka P, Van Lieshout EM, Schep NW. Accuracy of an expanded early warning score for patients in general and trauma surgery wards. Br J Surg 2012;99:192-7
32. Cannon CM, Braxton CC, Kling-Smith M, Mahnken JD, Carlton E, Moncure M. Utility of the shock index in predicting mortality in traumatically injured patients. J Trauma 2009;67:1426-30
33. Cao H, Eshelman L, Chbat N, Nielsen L, Gross B, Saeed M. Predicting ICU hemodynamic instability using continuous multiparameter trends. Conf Proc IEEE Eng Med Biol Soc 2008;2008:3803-6
34. Chandra A, Mangam S, Marzouk D. A review of risk scoring systems utilised in patients undergoing gastrointestinal surgery. J Gastrointest Surg 2009;13:1529-38
35. Hall BL, Hamilton BH, Richards K, Bilimoria KY, Cohen ME, Ko CY. Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: An evaluation of all participating hospitals. Ann Surg 2009;250:363-76
36. Pepe MS. Problems with risk reclassification methods for evaluating prediction models. Am J Epidemiol 2011;173:1327-35
37. Ioannidis JP, Tzoulaki I. What makes a good predictor?: The evidence applied to coronary artery calcium score. JAMA 2010;303:1646-7