Multicentre validation of a sepsis prediction algorithm using only vital sign data in the emergency department, general ward and ICU

BMJ Open

Volumn 8, Issue 1, 2018, Pages

  Mao, Qingqing ^a   Jay, Melissa ^a   Hoffman, Jana L ^a   Calvert, Jacob ^a   Barton, Christopher ^b   Shimabukuro, David ^b   Shieh, Lisa ^c   Chettipally, Uli ^b,d   Fletcher, Grant ^e   Kerem, Yaniv ^c,f   Zhou, Yifan ^a,g   Das, Ritankar ^a  

^a DASCENA INC   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d KAISER PERMANENTE   (United States)

^e UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^f KAISER PERMANENTE MEDICAL CENTER   (United States)

^g UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Clinical Decision Support; Electronic Health Records; Machine Learning; Prediction; Sepsis; Septic Shock

Indexed keywords

ADULT; ARTICLE; CALIFORNIA; EMERGENCY WARD; FEMALE; GENERAL WARD; HUMAN; INTENSIVE CARE UNIT; MACHINE LEARNING; MAJOR CLINICAL STUDY; MALE; MULTICENTER STUDY; RETROSPECTIVE STUDY; SEPSIS; SEPTIC SHOCK; VALIDATION STUDY; VITAL SIGN; WARD; ADOLESCENT; AGED; ALGORITHM; AREA UNDER THE CURVE; CLINICAL TRIAL; FACTUAL DATABASE; HEALTH CARE FACILITY; HOSPITAL EMERGENCY SERVICE; HOSPITAL MORTALITY; LENGTH OF STAY; MASSACHUSETTS; MIDDLE AGED; MORTALITY; ORGANIZATION AND MANAGEMENT; PROGNOSIS; RECEIVER OPERATING CHARACTERISTIC; SEVERITY OF ILLNESS INDEX; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; ALGORITHMS; AREA UNDER CURVE; BOSTON; DATABASES, FACTUAL; EMERGENCY SERVICE, HOSPITAL; FEMALE; HOSPITAL MORTALITY; HUMANS; INTENSIVE CARE UNITS; LENGTH OF STAY; MACHINE LEARNING; MALE; MIDDLE AGED; PATIENTS' ROOMS; PROGNOSIS; RETROSPECTIVE STUDIES; ROC CURVE; SAN FRANCISCO; SEPSIS; SEVERITY OF ILLNESS INDEX; SHOCK, SEPTIC; VITAL SIGNS; YOUNG ADULT;

EID: 85051798815     PISSN: None     EISSN: 20446055     Source Type: Journal    
DOI: 10.1136/bmjopen-2017-017833     Document Type: Article

References (32)

1. Murphy SL, Xu J, Kochanek KD. Deaths: final data for 2010. Natl Vital Stat Rep 2013;61:1-17.
2. Angus DC, Linde-Zwirble WT, Lidicker J, et al. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med 2001;29:1303-10.
3. Stevenson EK, Rubenstein AR, Radin GT, et al. Two decades of mortality trends among patients with severe sepsis: a comparative meta-analysis∗. Crit Care Med 2014;42:625.
4. Pfuntner A, Wier LM, Steiner C. Costs for Hospital Stays in the United States, 2010: Statistical Brief #146. In Healthcare Cost and Utilization Project (HCUP) Statistical Briefs:Cost H, Project U, Rockville; MDAgency for Healthcare Research and QualityUSA, 2006. https://www. ncbi. nlm. nih. gov/ books/ NBK121966/.
5. O'Brien J. The Cost of Sepsis. CDC Safe Healthcare Blog 2015 https:// blogs. cdc. gov/ safehealthcare/ the- cost- of- sepsis/# ref.
6. Gaieski DF, Edwards JM, Kallan MJ, et al. Benchmarking the incidence and mortality of severe sepsis in the United States. Crit Care Med 2013;41:1167-74.
7. Rivers E, Nguyen B, Havstad S, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med 2001;345:1368-77.
8. Nguyen HB, Corbett SW, Steele R, et al. Implementation of a bundle of quality indicators for the early management of severe sepsis and septic shock is associated with decreased mortality. Crit Care Med 2007;35:1105-12.
9. Kumar A, Roberts D, Wood KE, et al. Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit Care Med 2006;34:1589-96.
10. Levy MM, et al. sccm/esicm/accp/ats/sis international sepsis definitions conference. Intensive Care Med 2001;2003:530-8.
11. Singer M, Deutschman CS, Seymour CW, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA 2016;315:801-10.
12. Subbe CP, Slater A, Menon D, et al. Validation of physiological scoring systems in the accident and emergency department. Emerg Med J 2006;23:841-5.
13. Rangel-Frausto MS, Pittet D, Costigan M, et al. The natural history of the systemic inflammatory response syndrome (SIRS). A prospective study. JAMA 1995;273:117-23.
14. Vincent JL, Moreno R, Takala J, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/ failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 1996;22:707-10.
15. Johnson AE, Pollard TJ, Shen L, et al. MIMIC-III, a freely accessible critical care database. Sci Data 2016;3:160035.
16. Lowe HJ, Ferris TA, Hernandez PM, et al. STRIDE--An integrated standards-based translational research informatics platform. AMIA Annu Symp Proc 2009;2009:391-5.
17. PostgreSQL Global Development Group. https://www. postgresql. org/ (5 Oct 2017).
18. Van Rossum G. The Python Language Reference Manual: Network Theory Ltd, 2003. https://www. python. org/.
19. Henry KE, Hager DN, Pronovost PJ, et al. A targeted real-time early warning score (TREWScore) for septic shock. Sci Transl Med 2015;7:299ra122.
20. Fullerton JN, Price CL, Silvey NE, et al. Is the Modified Early Warning Score (MEWS) superior to clinician judgement in detecting critical illness in the pre-hospital environment? Resuscitation 2012;83:557-62.
21. Ben-David S, Blitzer J, Crammer K, et al. A theory of learning from different domains. Mach Learn 2010;79:151-75.
22. Calvert JS, Price DA, Chettipally UK, et al. A computational approach to early sepsis detection. Comput Biol Med 2016;74:69-73.
23. Desautels T, Calvert J, Hoffman J, et al. Prediction of Sepsis in the Intensive Care Unit With Minimal Electronic Health Record Data: A Machine Learning Approach. JMIR Med Inform 2016;4:e28.
24. Calvert J, Desautels T, Chettipally U, et al. High-performance detection and early prediction of septic shock for alcohol-use disorder patients. Ann Med Surg 2016;8:50-5.
25. Calvert JS, Price DA, Barton CW, et al. Discharge recommendation based on a novel technique of homeostatic analysis. J Am Med Inform Assoc 2017;24:24-9.
26. Calvert J, Mao Q, Rogers AJ, et al. A computational approach to mortality prediction of alcohol use disorder inpatients. Comput Biol Med 2016;75:74-9.
27. Calvert J, Mao Q, Hoffman JL, et al. Using electronic health record collected clinical variables to predict medical intensive care unit mortality. Ann Med Surg 2016;11:52-7.
28. Iwashyna TJ, Odden A, Rohde J, et al. Identifying patients with severe sepsis using administrative claims: patient-level validation of the angus implementation of the international consensus conference definition of severe sepsis. Med Care 2014;52:e39.
29. Gultepe E, Green JP, Nguyen H, et al. From vital signs to clinical outcomes for patients with sepsis: a machine learning basis for a clinical decision support system. J Am Med Inform Assoc 2014;21:315-25.
30. Brause R, Hamker F, Paetz J. Septic shock diagnosis by neural networks and rule based systems. In: Schmitt M, Teodorescu HN, Jain A, eds. et alComputational intelligence techniques in medical diagnosis and prognosis. New York: Springer, 2002:323-56.
31. Thiel SW, Rosini JM, Shannon W, et al. Early Prediction of Septic Shock. J. Hosp. Med 2010;1:19-25.
32. Horng S, Sontag DA, Halpern Y, et al. Creating an automated trigger for sepsis clinical decision support at emergency department triage using machine learning. PLoS One 2017;12:e0174708.