A targeted real-time early warning score (TREWScore) for septic shock

Science Translational Medicine

Volumn 7, Issue 299, 2015, Pages

  Henry, Katharine E ^a   Hager, David N ^b   Pronovost, Peter J ^b,c,d   Saria, Suchi ^a,c,d  

^a Johns Hopkins University   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c JOHNS HOPKINS UNIVERSITY   (United States)

^d JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; AREA UNDER THE CURVE; ARTICLE; CLINICAL ASSESSMENT TOOL; CLINICAL PROTOCOL; CONTROLLED STUDY; ELECTRONIC MEDICAL RECORD; HIGH RISK PATIENT; HUMAN; HYPERLACTATEMIA; HYPOTENSION; INFECTION; INTENSIVE CARE; INTERMETHOD COMPARISON; LABORATORY TEST; LEARNING ALGORITHM; MAJOR CLINICAL STUDY; MODIFIED EARLY WARNING SCORE; MORTALITY; ONSET AGE; ORGAN INJURY; PREDICTION; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; SCORING SYSTEM; SENSITIVITY AND SPECIFICITY; SEPTIC SHOCK; SYSTEMIC INFLAMMATORY RESPONSE SYNDROME; TARGETED REAL-TIME EARLY WARNING SCORE; TRAINING; EARLY INTERVENTION; INTENSIVE CARE UNIT; PROPENSITY SCORE; SECONDARY PREVENTION; SHOCK, SEPTIC; UNITED STATES;

EARLY MEDICAL INTERVENTION; HUMANS; INTENSIVE CARE UNITS; PROPENSITY SCORE; ROC CURVE; SECONDARY PREVENTION; SHOCK, SEPTIC; UNITED STATES;

EID: 84938704873     PISSN: 19466234     EISSN: 19466242     Source Type: Journal    
DOI: 10.1126/scitranslmed.aab3719     Document Type: Article

References (64)

1. D. C. Angus, W. T. Linde-Zwirble, J. Lidicker, G. Clermont, J. Carcillo, M. R. Pinsky, Epidemiology of severe sepsis in the United States: Analysis of incidence, outcome, and associated costs of care. Crit. Care Med. 29, 1303-1310 (2001).
2. HCUP Facts and Figures: Statistics on Hospital-based Care in the United States, 2009 (Agency for Healthcare Research and Quality, Rockville, MD, 2011); www.hcup-us.ahrq.gov/reports.jsp.
3. G. Kumar, N. Kumar, A. Taneja, T. Kaleekal, S. Tarima, E. McGinley, E. Jimenez, A. Mohan, R. A. Khan, J. Whittle, E. Jacobs, R. Nanchal; Milwaukee Initiative in Critical Care Outcomes Research Group of Investigators, Nationwide trends of severe sepsis in the 21st century (2000-2007). Chest 140, 1223-1231 (2011).
4. E. Rivers, B. Nguyen, S. Havstad, J. Ressler, A. Muzzin, B. Knoblich, E. Peterson, M. Tomlanovich; Early Goal-Directed Therapy Collaborative Group, Early goal-directed therapy in the treatment of severe sepsis and septic shock. N. Engl. J. Med. 345, 1368-1377 (2001).
5. H. B. Nguyen, S. W. Corbett, R. Steele, J. Banta, R. T. Clark, S. R. Hayes, J. Edwards, T. W. Cho, W. A. Wittlake, Implementation of a bundle of quality indicators for the early management of severe sepsis and septic shock is associated with decreased mortality. Crit. Care Med. 35, 1105-1112 (2007).
6. F. Sebat, A. A. Musthafa, D. Johnson, A. A. Kramer, D. Shoffner, M. Eliason, K. Henry, B. Spurlock, Effect of a rapid response system for patients in shock on time to treatment and mortality during 5 years. Crit. Care Med. 35, 2568-2575 (2007).
7. A. Kumar, D. Roberts, K. E. Wood, B. Light, J. E. Parrillo, S. Sharma, R. Suppes, D. Feinstein, S. Zanotti, L. Taiberg, D. Gurka, A. Kumar, M. Cheang, Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit. Care Med. 34, 1589-1596 (2006).
8. V. Coba, M. Whitmill, R. Mooney, H. M. Horst, M. M. Brandt, B. Digiovine, M. Mlynarek, B. McLellan, G. Boleski, J. Yang, W. Conway, J. Jordan; The Henry Ford Hospital Sepsis Collaborative Group, Resuscitation Bundle Compliance in severe sepsis and septic shock: Improves survival, is better late than never. J. Intensive Care Med. 26, 304-313 (2011).
9. A. Castellanos-Ortega, B. Suberviola, L. A. Garc?a-Astudillo, M. S. Holanda, F. Ortiz, J. Llorca, M. Delgado-Rodr?guez, Impact of the Surviving Sepsis Campaign protocols on hospital length of stay and mortality in septic shock patients: Results of a three-year follow-up quasi-experimental study. Crit. Care Med. 38, 1036-1043 (2010).
10. ProCESS Investigators; D. M. Yealy, J. A. Kellum, D. T. Huang, A. E. Barnato, L. A. Weissfeld, F. Pike, T. Terndrup, H. E. Wang, P. C. Hou, F. LoVecchio, M. R. Filbin, N. I. Shapiro, D. C. Angus, A randomized trial of protocol-based care for early septic shock. N. Engl. J. Med. 370, 1683-1693 (2014).
11. ARISE Investigators; ANZICS Clinical Trials Group, S. L. Peake, A. Delaney, M. Bailey, R. Bellomo, P. A. Cameron, D. J. Cooper, A. M. Higgins, A. Holdgate, B. D. Howe, S. A. Webb, P.Williams, Goal directed resuscitation for patients with early septic shock. N. Engl. J. Med. 371, 1496-1506 (2014).
12. P. R. Mouncey, T. M. Osborn, G. S. Power, D. A. Harrison, M. Z. Sadique, R. D. Grieve, R. Jahan, S. E. Harvey, D. Bell, J. F. Bion, T. J. Coats, M. Singer, J. D. Young, K. M. Rowan; ProMISe Trial Investigators, Trial of early, goal-directed resuscitation for septic shock. N. Engl. J. Med. 372, 1301-1311 (2015).
13. M. M. Levy, Early goal directed therapy: What do we do now? Crit. Care 18, 705 (2014).
14. N. O. Ghanem-Zoubi, M. Vardi, A. Laor, G. Weber, H. Bitterman, Assessment of diseaseseverity scoring systems for patients with sepsis in general internal medicine departments. Crit. Care 15, R95 (2011).
15. S. L. Barriere, S. F. Lowry, An overview of mortality risk prediction in sepsis. Crit. Care Med. 23, 376-393 (1995).
16. A. E. Jones, S. Trzeciak, J. A. Kline, The Sequential Organ Failure Assessment score for predicting outcome in patients with severe sepsis and evidence of hypoperfusion at the time of emergency department presentation. Crit. Care Med. 37, 1649-1654 (2009).
17. C. Vorwerk, B. Loryman, T. J. Coats, J. A. Stephenson, L. D. Gray, G. Reddy, L. Florence, N. Butler, Prediction of mortality in adult emergency department patients with sepsis. Emerg. Med. J. 26, 254-258 (2009).
18. V. Herasevich, M. S. Pieper, J. Pulido, O. Gajic, Enrollment into a time sensitive clinical study in the critical care setting: Results from computerized septic shock sniffer implementation. J. Am. Med. Inform. Assoc. 18, 639-644 (2011).
19. Acutely Ill Patients in Hospital: Recognition of and Response to Acute Illness in Adults in Hospital (NICE clinical guideline no. 50) (National Institute for Health and Clinical Excellence, London, UK, 2007); www.nice.org.uk/CG050).
20. S. Q. Nguyen, E. Mwakalindile, J. S. Booth, V. Hogan, J. Morgan, C. T. Prickett, J. P. Donnelly, H. E. Wang, Automated electronic medical record sepsis detection in the emergency department. PeerJ 2, e343 (2014).
21. C. A. Umscheid, J. Betesh, C. VanZandbergen, A. Hanish, G. Tait, M. E. Mikkelsen, B. French, B. D. Fuchs, Development, implementation, and impact of an automated early warning and response system for sepsis. J. Hosp. Med. 10, 26-31 (2015).
22. J. Nelson, B. Smith, J. Jared, J. Younger, Prospective trial of real-time electronic surveillance to expedite early care of severe sepsis. Ann. Emerg. Med. 57, 500-504 (2011).
23. R. J. M. Morgan, F. Williams, M. N. Wright, An early warning scoring system for detecting developing critical illness. Clin. Intens. Care Nurs. 8, 100 (1997).
24. D. W. Bates, S. Saria, L. Ohno-Machado, A. Shah, G. Escobar, Big data in health care: Using analytics to identify and manage high-risk and high-cost patients. Health Aff. 33, 1123-1131 (2014).
25. J. Donzé, D. Aujesky, D. Williams, J. L. Schnipper, Potentially avoidable 30-day hospital readmissions in medical patients: Derivation and validation of a prediction model. JAMA Intern. Med. 173, 632-638 (2013).
26. T. M. Osborn, G. Phillips, S. Lemeshow, S. Townsend, C. A. Schorr, M. M. Levy, R. P. Dellinger, Sepsis Severity Score: An internationally derived scoring system from the Surviving Sepsis Campaign database. Crit. Care Med. 42, 1969-1976 (2014).
27. S. Saria, A. Rajani, J. Gould, D. Koller, A. Penn, Integration of early physiological responses predicts later illness severity in preterm infants. Sci. Transl. Med. 2, 48ra65 (2010).
28. J. Wiens, E. Horvitz, and J. V. Guttag, Patient risk stratification for hospital-associated C. diff as a time-series classification task. Adv. in Neural Inf. Process. Syst. 25, 476-484 (2012).
29. O. Gajic, O. Dabbagh, P. K. Park, A. Adesanya, S. Y. Chang, P. Hou, H. Anderson III, J. J. Hoth, M. E. Mikkelsen, N. T. Gentile, M. N. Gong, D. Talmor, E. Bajwa, T. R. Watkins, E. Festic, M. Yilmaz, R. Iscimen, D. A. Kaufman, A. M. Esper, R. Sadikot, I. Douglas, J. Sevransky, M. Malinchoc; U.S. Critical Illness and Injury Trials Group: Lung Injury Prevention Study Investigators (USCIITGLIPS), Early identification of patients at risk of acute lung injury: Evaluation of Lung Injury Prediction Score in a multicenter cohort study. Am. J. Respir. Crit. Care Med. 183, 462-470 (2011).
30. I. Stanculescu, C. K. I. Williams, Y. Freer, Autoregressive hidden Markov models for the early detection of neonatal sepsis. IEEE J. Biomed. Health Inform. 18, 1560-1570 (2014).
31. M. P. Griffin, D. E. Lake, T. M. O?Shea, J. R. Moorman, Heart rate characteristics and clinical signs in neonatal sepsis. Pediatr. Res. 61, 222-227 (2007).
32. E. Gultepe, J. P. Green, H. Nguyen, J. Adams, T. Albertson, I. Tagkopoulos, From vital signs to clinical outcomes for patients with sepsis: A machine learning basis for a clinical decision support system. J. Am. Med. Inform. Assoc. 21, 315-325 (2014).
33. K. K. Giuliano, Physiological monitoring for critically ill patients: Testing a predictive model for the early detection of sepsis. Am. J. Crit. Care 16, 122-130 (2007).
34. S. W. Thiel, J. M. Rosini, W. Shannon, J. A. Doherty, S. T. Micek, M. H. Kollef, Early prediction of septic shock in hospitalized patients. J. Hosp. Med. 5, 19-25 (2010).
35. K. Henry, C. Paxton, K. S. Kim, J. Pham, S. Saria, REWS: Real-time early warning score for septic shock. Crit. Care Med. 42, abstract 63 (2014).
36. D. Shavdia, thesis, Septic shock: Providing early warnings through multivariate logistic regression models, Harvard-MIT Division of Health Sciences and Technology (2007).
37. J. C. Ho, C. H. Lee, J. Ghosh, Septic shock prediction for patients with missing data. ACM Trans. Manag. Inf. Syst. 5, Article No. 1 (2014).
38. C. Paxton, A. Niculescu-Mizil, S. Saria, Developing predictive models using electronic medical records: Challenges and pitfalls. AMIA Annu. Symp. Proc. 2013, 1109-1115 (2013).
39. K. Dyagilev, S. Saria, Learning (predictive) risk scores in the presence of censoring due to interventions. arXiv:1507.07295 (2015).
40. A. L. Goldberger, L. A. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark, J. E. Mietus, G. B. Moody, C. K. Peng, H. E. Stanley, PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals. Circulation 101, e215-e220 (2000).
41. A. Hendrich, J. Byrd, V. Naylor, T. Daniels, R. Weakland, C. Wagner, Leading Edge Advanced Practice Topic (LEAPT): Severe Sepsis and Septic Shock (Health Research & Educational Trust, Chicago, IL, 2014); www.hret-hen.org/index.php?option=com-phocadownload&view=category&id=370&Itemid=369).
42. S. Townsend, T. Clemmer, D. Jacobsen, IHI Expedition: Treating Sepsis in the Emergency Department and Beyond, Session 6 (Institute for Healthcare Improvement, Cambridge, MA, 2013); www.ihi.org/Engage/Memberships/Passport/Pages/Treating-Sepsis.aspx).
43. C. P. Subbe, M. Kruger, P. Rutherford, L. Gemmel, Validation of a modified Early Warning Score in medical admissions. QJM 94, 521-526 (2001).
44. G. B. Smith, D. R. Prytherch, P. E. Schmidt, P. I. Featherstone, Review and performance evaluation of aggregate weighted ?track and trigger? systems. Resuscitation 77, 170-179 (2008).
45. R. P. Dellinger, M. M. Levy, A. Rhodes, D. Annane, H. Gerlach, S. M. Opal, J. E. Sevransky, C. L. Sprung, I. S. Douglas, R. Jaeschke, T. M. Osborn, M. E. Nunnally, S. R. Townsend, K. Reinhart, R. M. Kleinpell, D. C. Angus, C. S. Deutschman, F. R. Machado, G. D. Rubenfeld, S. A. Webb, R. J. Beale, J. L. Vincent, R. Moreno; Surviving Sepsis Campaign Guidelines Committee including the Pediatric Subgroup, Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2012. Crit. Care Med. 41, 580-637 (2013).
46. T. Berger, J. Green, T. Horeczko, Y. Hagar, N. Garg, A. Suarez, E. Panacek, N. Shapiro, Shock index and early recognition of sepsis in the emergency department: Pilot study. West. J. Emerg. Med. 14, 168-174 (2013).
47. H. D. Humes, in Kelley?s Essentials of Internal Medicine (Lippincott Williams & Wilkins, Philadelphia, ed. 2, 2001), chap. 18.
48. J. S. Rachoin, R. Daher, C. Moussallem, B. Milcarek, K. Hunter, C. Schorr, M. Abboud, P. Henry, L. S. Weisberg, The fallacy of the BUN:creatinine ratio in critically ill patients. Nephrol. Dial. Transplant. 27, 2248-2254 (2012).
49. C. Hug, ?Detecting hazardous intensive care patient episodes using real-time mortality models? (MIT Technical Report, 2009).
50. H. van der Sijs, J. Aarts, A. Vulto, M. Berg, Overriding of drug safety alerts in computerized physician order entry. J. Am. Med. Inform. Assoc. 13, 138-147 (2006).
51. W. J. Gu, F. Wang, J. Bakker, L. Tang, J. C. Liu, The effect of goal-directed therapy on mortality in patients with sepsis - earlier is better: A meta-analysis of randomized controlled trials. Crit. Care 18, 570 (2014).
52. J. Campbell, T. Payne, A comparison of four schemes for codification of problem lists. Proc. Annu. Symp. Comput. Appl. Med. Care 201-205 (1994).
53. S. A. Whittaker, M. E. Mikkelsen, D. F. Gaieski, S. Koshy, C. Kean, B. D. Fuchs, Severe sepsis cohorts derived from claims-based strategies appear to be biased toward a more severely ill patient population. Crit. Care Med. 41, 945-953 (2013).
54. S. Saria, G. McElvain, A. K. Rajani, A. A. Penn, D. L. Koller, Combining structured and free-text data for automatic coding of patient outcomes. AMIA Annu. Symp. Proc. 2010, 712-716 (2010).
55. M. M. Levy, R. P. Dellinger, S. R. Townsend, W. T. Linde-Zwirble, J. C. Marshall, J. Bion, C. Schorr, A. Artigas, G. Ramsay, R. Beale, M. M. Parker, H. Gerlach, K. Reinhart, E. Silva, M. Harvey, S. Regan, D. C. Angus; Surviving Sepsis Campaign, The Surviving Sepsis Campaign: Results of an international guideline-based performance improvement program targeting severe sepsis. Crit. Care Med. 38, 367-374 (2010).
56. W. Pan, A multiple imputation approach to Cox regression with interval-censored data. Biometrics 56, 199-203 (2000).
57. Z. Zhang, L. Sun, J. Sun, D. M. Finkelstein, Regression analysis of failure time data with informative interval censoring. Stat. Med. 26, 2533-2546 (2007).
58. R. Little, D. Rubin, Statistical Analysis with Missing Data (Wiley Series in Probability and Mathematical Statistics, Wiley, New York, NY, 2002).
59. T. M. Therneau, T. Lumley, The Survival Package (The Comprehensive R Archive Network, 2014).
60. J. Friedman, T. Hastie, R. Tibshirani, Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33, 1-22 (2010).
61. N. Simon, J. Friedman, T. Hastie, R. Tibshirani, Regularization paths for Cox?s proportional hazards model via coordinate descent. J. Stat. Softw. 39, 1-13 (2011).
62. R. Tibshirani, The lasso method for variable selection in the cox model. Stat. Med. 16, 385-395 (1997).
63. P. J. Heagerty, T. Lumley, M. S. Pepe, Time-dependent ROC curves for censored survival data and a diagnostic marker. Biometrics 56, 337-344 (2000).
64. P. Blanche, J.-F. Dartigues, H. Jacqmin-Gadda, Review and comparison of ROC curve estimators for a time-dependent outcome with marker-dependent censoring. Biom. J. 55, 687-704 (2013).