Development and external validation of an automated computer-aided risk score for predicting sepsis in emergency medical admissions using the patient's first electronically recorded vital signs and blood test results

Critical Care Medicine

Volumn 46, Issue 4, 2018, Pages 612-618

  Faisal, Muhammad ^a   Scally, Andy ^a   Richardson, Donald ^b   Beatson, Kevin ^b   Howes, Robin ^c   Speed, Kevin ^c   Mohammed, Mohammed A ^a  

^a UNIVERSITY OF BRADFORD   (United Kingdom)

^b YORK TEACHING HOSPITAL NHS FOUNDATION TRUST   (United Kingdom)

^c Northern Lincolnshire and Goole Hospitals NHS Foundation Trust   (United Kingdom)

Author keywords

Blood tests; Computer aided risk score; National early warning score; Sepsis; Vital signs

Indexed keywords

ADULT; ALGORITHM; ARTICLE; AUTOMATED COMPUTER AIDED RISK SCORE; BLOOD ANALYSIS; COHORT ANALYSIS; DISEASE SEVERITY; ELECTRONIC MEDICAL RECORD; EXTERNAL VALIDITY; HOSPITAL ADMISSION; HOSPITAL MORTALITY; HUMAN; MEDICAL INFORMATICS; MORTALITY RATE; PREDICTIVE VALUE; PREVALENCE; PRIORITY JOURNAL; RISK ASSESSMENT; SCORING SYSTEM; SENSITIVITY AND SPECIFICITY; SEPSIS; SEPTIC SHOCK; VITAL SIGN; AGE; AGED; BLOOD EXAMINATION; CLINICAL DECISION SUPPORT SYSTEM; CLINICAL TRIAL; CROSS-SECTIONAL STUDY; FEMALE; HOSPITAL EMERGENCY SERVICE; MALE; MIDDLE AGED; MORTALITY; MULTICENTER STUDY; ORGANIZATION AND MANAGEMENT; PROGNOSIS; REPRODUCIBILITY; SEVERITY OF ILLNESS INDEX; SEX FACTOR; STANDARDS; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA; VERY ELDERLY;

AGE FACTORS; AGED; AGED, 80 AND OVER; ALGORITHMS; CROSS-SECTIONAL STUDIES; DECISION SUPPORT SYSTEMS, CLINICAL; EMERGENCY SERVICE, HOSPITAL; FEMALE; HEMATOLOGIC TESTS; HOSPITAL MORTALITY; HUMANS; LOGISTIC MODELS; MALE; MIDDLE AGED; PROGNOSIS; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; SEPSIS; SEVERITY OF ILLNESS INDEX; SEX FACTORS; SHOCK, SEPTIC; VITAL SIGNS;

EID: 85051694854     PISSN: 00903493     EISSN: 15300293     Source Type: Journal    
DOI: 10.1097/CCM.0000000000002967     Document Type: Article

References (43)

1. Singer M, Deutschman CS, Seymour CW, et al: The third international consensus defnitions for sepsis and septic shock (Sepsis-3). JAMA 2016; 315:801-810
2. Global Sepsis Alliance: The World Spesis Declaration. 2012. Available at: https://static1.squarespace.com/static/597f001fb3db2bde61e79d4a/t/59846c78197aea356cd5131a/1501850746119/2017-WSD- Declaration-English.pdf. Accessed January 15, 2018
3. Mellor J: Parliamentary and Health Service Ombudsman. London. 2013. Available at: https://www.ombudsman.org.uk/sites/default/fles/2016-08/FINAL-Sepsis-Report-web.pdf. Accessed January 15, 2018
4. National Confdential Enquiry into Patient Outcome and Death: Just Say Sepsis! A Review Of The Process Of Care Received By Patients With Sepsis. 2015. Available at: http://www.ncepod. org.uk/2015report2/downloads/JustSaySepsis-FullReport.pdf. Accessed January 15, 2018
5. National Institute for Health and Care Excellence: NICE Guideline 51. Sepsis: Recognition, Assessment and Early Management. 2016. Available at: https://www.nice.org.uk/guidance/ng51/resources/sepsis-recognition-diagnosis-and-early-management-pdf-1837508256709. Accessed January 15, 2018
6. Torio CM, Andrews RM: National Inpatient Hospital Costs: The Most Expensive Conditions by Payer, 2011: Statistical Brief #160. Healthcare Cost and Utilization Project, Agency for Healthcare Research and Quality. 2013. Available at: https://www.hcup-us.ahrq.gov/reports/statbriefs/sb160.jsp. Accessed January 15, 2018
7. York Health Economics Consortium: The Cost of Sepsis Care in the UK, 2017. Available at: http://allcatsrgrey.org.uk/wp/down-load/health-economics/YHEC-Sepsis-Report-17.02.17-FINAL.pdf. Accessed January 15, 2018
8. Rivers EP, Coba V, Whitmill M: Early goal-directed therapy in severe sepsis and septic shock: A contemporary review of the literature. Curr Opin Anaesthesiol 2008; 21:128-140
9. NHS Choices: Sepsis. Available at: http://www.nhs.uk/conditions/blood-poisoning/pages/introduction.aspx. Accessed January 15, 2018
10. Slade E, Tamber PS, Vincent JL: The surviving sepsis campaign: Raising awareness to reduce mortality. Crit Care 2003; 7:1-2
11. Smith GB, Prytherch DR, Schmidt P, et al: Hospital-wide physiologi-cal surveillance-a new approach to the early identifcation and man-agement of the sick patient. Resuscitation 2006; 71:19-28
12. Edwards M, McKay H, Van Leuvan C, et al: Modifed Early Warning Scores: Inaccurate summation or inaccurate assignment of score? Crit Care 2010; 14:P257
13. Prytherch DR, Smith GB, Schmidt P, et al: Calculating early warning scores-a classroom comparison of pen and paper and hand-held computer methods. Resuscitation 2006; 70:173-178
14. Mohammed M, Hayton R, Clements G, et al: Improving accuracy and effciency of early warning scores in acute care. Br J Nurs 2009; 18:18-24
15. NHS England: Acute Kidney Injury (AKI) Algorithm. 2014. Available at: https://www.england.nhs.uk/akiprogramme/aki-algorithm/. Accessed January 15, 2018
16. National Confdential Enquiry into Patient Outcome and Death: Acute Kidney Injury: Adding Insult to Injury. National Confdential Enquiry into Patient Outcome and Death, 2009. Available at http://www. ncepod.org.uk/2009report1/Downloads/AKI-report.pdf. Accessed January 15, 2018
17. Levy MM, Fink MP, Marshall JC, et al; International sepsis defni-tions conference: 2001 SCCM/ESICM/ACCP/ATS/SIS international sepsis defnitions conference. Intensive Care Med 2003; 29:530-538
18. Paterson R, MacLeod DC, Thetford D, et al: Prediction of in-hospital mortality and length of stay using an early warning scoring system: Clinical audit. Clin Med (Lond) 2006; 6:281-284
19. Vincent JL, Moreno R, Takala J, et al: The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 1996; 22:707-710
20. Rathour S, Kumar S, Hadda V, et al: PIRO concept: Staging of sep-sis. J Postgrad Med 2015; 61:235-242
21. Levy MM, Dellinger RP, Townsend SR et al. The Surviving Sepsis Campaign: results of an international guideline-based performance improvement program targeting server sepsis. Intensive Care Med 2010;36:222-231
22. Rhodes A, Evans LE, Alhazzani W, et al: Surviving sepsis campaign: International guidelines for management of sepsis and septic shock: 2016.Intensive Care Med 2017; 43:304-377
23. Society of Critical Care Medicine and the European Society of Inten-sive Care Medicine: Surviving Sepsis Campaign. Available at: http://www.survivingsepsis.org. Accessed January 15, 2018
24. Jolley RJ, Quan H, Jetté N, et al: Validation and optimisation of an ICD-10-coded case defnition for sepsis using administrative health data. BMJ Open 2015; 5:e009487
25. Jolley RJ, Sawka KJ, Yergens DW, et al: Validity of administrative data in recording sepsis: A systematic review. Crit Care 2015; 19:139
26. StatCorp: Stata: Release 13. Statistical Software. College Station, TX, StataCorp LP, 2014
27. Venables W, Ripley B: Modern Applied Statistics with S. Fourth Edition. New York, NY, Springer, 2002
28. R Development Core Team: R: A language and environment for statistical computing. R Foundation for Statistical Computing, 2015. Available at: http://www.r-project.org/. Accessed January 15, 2018
29. Steyerberg EW: Clinical Prediction Models. A Practical Approach to Development, Validation And Updating. New York, NY, Springer, 2008
30. Faisal M, Howes R, Steyerberg EW, et al: Using routine blood test results to predict the risk of death for emergency medical admissions to hospital: An external model validation study. QJM 2017; 110:27-31
31. Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143:29-36
32. Robin X, Turck N, Hainard A, et al: pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinfor-matics 2011; 12:77
33. Mohammed MA, Deeks JJ, Girling A, et al: Evidence of methodologi-cal bias in hospital standardised mortality ratios: Retrospective database study of English hospitals. BMJ 2009; 338:b780
34. Harrell FE: rms: Regression Modeling Strategies, 2015. Available at: http://cran.r-project.org/package=rms. Accessed January 15, 2018
35. Harrell FE: Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. New York, NY, Springer, 2001
36. Sing T, Sander O, Beerenwinkel N, et al: ROCR: Visualizing classifer performance in R. Bioinformatics 2005; 21:3940-3941
37. Marwick CA, Guthrie B, Pringle JE, et al: Identifying which septic patients have increased mortality risk using severity scores: A cohort study. BMC Anesthesiol 2014; 14:1
38. Corfeld AR, Lees F, Zealley I, et al; Scottish Trauma Audit Group Sep-sis Steering Group: Utility of a single early warning score in patients with sepsis in the emergency department. Emerg Med J 2014; 31:482-487
39. Churpek MM, Snyder A, Han X, et al: Quick sepsis-related organ fail-ure assessment, systemic infammatory response syndrome, and early warning scores for detecting clinical deterioration in infected patients outside the intensive care unit. Am J Respir Crit Care Med 2017; 195:906-911
40. NHS England: Algorithm for Detecting Acute Kidney Injury (AKI) Based on Serum Creatinine Changes With Time, 2014. Available at: https://www.england.nhs.uk/wp-content/uploads/2014/06/psa-aki-alg.pdf. Accessed January 15, 2018
41. Silcock DJ, Corfeld AR, Gowens PA, et al: Validation of the National Early Warning Score in the prehospital setting. Resuscitation 2015; 89:31-35
42. Escobar GJ, Dellinger RP: Early detection, prevention, and mitigation of critical illness outside intensive care settings. J Hosp Med 2016; 11(Suppl 1):S5-S10
43. Escobar GJ, Turk BJ, Ragins A, et al: Piloting electronic medical record-based early detection of inpatient deterioration in community hospitals. J Hosp Med 2016; 11(Suppl 1):S18-S24