Inclusion of unstructured clinical text improves early prediction of death or prolonged ICU stay

Critical Care Medicine

Volumn 46, Issue 7, 2018, Pages 1125-1132

  Weissman, Gary E ^a,b   Hubbard, Rebecca A ^c   Ungar, Lyle H ^d   Harhay, Michael O ^a,c   Greene, Casey S ^b,c   Himes, Blanca E ^c   Halpern, Scott D ^a,b,c  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

^d UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Critical care; Decision support techniques; Electronic health records; Forecasting; Machine learning; Natural language processing

Indexed keywords

ADULT; ARTICLE; COHORT ANALYSIS; CONTROLLED STUDY; DEATH; DECISION SUPPORT SYSTEM; ELASTIC TISSUE; ELECTRONIC HEALTH RECORD; FEMALE; FORECASTING; HOSPITAL ADMISSION; HOSPITAL PATIENT; HOSPITALIZATION; HUMAN; INTENSIVE CARE; ISRAEL; LENGTH OF STAY; MACHINE LEARNING; MALE; MASSACHUSETTS; MORTALITY; NATURAL LANGUAGE PROCESSING; PREDICTION; PROGNOSIS; RANDOM FOREST; RECEIVER OPERATING CHARACTERISTIC; RETROSPECTIVE STUDY; SAMPLING; AGED; HOSPITAL MORTALITY; INTENSIVE CARE UNIT; MIDDLE AGED; PATIENT CARE PLANNING;

AGED; DECISION SUPPORT TECHNIQUES; FEMALE; HOSPITAL MORTALITY; HUMANS; INTENSIVE CARE UNITS; LENGTH OF STAY; MACHINE LEARNING; MALE; MIDDLE AGED; NATURAL LANGUAGE PROCESSING; PATIENT CARE PLANNING; RETROSPECTIVE STUDIES;

EID: 85061250421     PISSN: 00903493     EISSN: 15300293     Source Type: Journal    
DOI: 10.1097/CCM.0000000000003148     Document Type: Article

References (49)

1. Barrett M, Smith M, Elixhauser A, et al: Utilization of Intensive Care Services, 2011. Technical Report #185. Rockville, Agency for Healthcare Research and Quality, 2014
2. Elliott D, Davidson JE, Harvey MA, et al: Exploring the scope of post-intensive care syndrome therapy and care: Engagement of non-critical care providers and survivors in a second stakeholders meeting. Crit Care Med 2014; 42:2518-2526
3. Gabler NB, Ratcliffe SJ, Wagner J, et al: Mortality among patients admitted to strained intensive care units. Am J Respir Crit Care Med 2013; 188:800-806
4. Wagner J, Gabler NB, Ratcliffe SJ, et al: Outcomes among patients discharged from busy intensive care units. Ann Intern Med 2013; 159:447-455
5. Weissman GE, Gabler NB, Brown SE, et al: Intensive care unit capacity strain and adherence to prophylaxis guidelines. J Crit Care 2015; 30:1303-1309
6. Hart JL, Harhay MO, Gabler NB, et al: Variability among US intensive care units in managing the care of patients admitted with preexisting limits on life-sustaining therapies. JAMA Intern Med 2015; 175:1019-1026
7. Le Guen J, Boumendil A, Guidet B, et al: Are elderly patients' opinions sought before admission to an intensive care unit? Results of the ICE-CUB study. Age Ageing 2016; 45:303-309
8. Teno JM, Fisher E, Hamel MB, et al: Decision-making and outcomes of prolonged ICU stays in seriously ill patients. J Am Geriatr Soc 2000; 48:S70-S74
9. Zimmerman JE, Kramer AA, McNair DS, et al: Acute Physiology and Chronic Health Evaluation (APACHE) IV: Hospital mortality assessment for today's critically ill patients. Crit Care Med 2006; 34:1297-1310
10. Fan E, Dowdy DW, Colantuoni E, et al: Physical complications in acute lung injury survivors: A two-year longitudinal prospective study. Crit Care Med 2014; 42:849-859
11. Jones SS, Thomas A, Evans RS, et al: Forecasting daily patient volumes in the emergency department. Acad Emerg Med 2008; 15:159-170
12. Kerlin MP, Harhay MO, Vranas KC, et al: Objective factors associated with physicians' and nurses' perceptions of intensive care unit capacity strain. Ann Am Thorac Soc 2014; 11:167-172
13. Nassar AP Jr, Caruso P: ICU physicians are unable to accurately predict length of stay at admission: A prospective study. Int J Qual Health Care 2016; 28:99-103
14. Rocker G, Cook D, Sjokvist P, et al; Level of Care Study Investigators; Canadian Critical Care Trials Group: Clinician predictions of intensive care unit mortality. Crit Care Med 2004; 32:1149-1154
15. Meadow W, Pohlman A, Frain L, et al: Power and limitations of daily prognostications of death in the medical intensive care unit. Crit Care Med 2011; 39:474-479
16. Sinuff T, Adhikari NK, Cook DJ, et al: Mortality predictions in the intensive care unit: Comparing physicians with scoring systems. Crit Care Med 2006; 34:878-885
17. Detsky ME, Harhay MO, Bayard DF, et al: Discriminative Accuracy of physician and nurse predictions for survival and functional outcomes 6 months after an ICU admission. JAMA 2017; 317:2187-2195
18. Moreno RP, Metnitz PG, Almeida E, et al; SAPS 3 Investigators: SAPS 3-From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005; 31:1345-1355
19. Higgins TL, Teres D, Copes WS, et al: Assessing contemporary intensive care unit outcome: An updated Mortality Probability Admission Model (MPM0-III). Crit Care Med 2007; 35:827-835
20. Verburg IW, Atashi A, Eslami S, et al: Which models can I use to predict adult ICU length of stay? A systematic review. Crit Care Med 2017; 45:e222-e231
21. Zimmerman JE, Kramer AA, McNair DS, et al: Intensive care unit length of stay: Benchmarking based on Acute Physiology and Chronic Health Evaluation (APACHE) IV. Crit Care Med 2006; 34:2517-2529
22. Kramer AA, Zimmerman JE: A predictive model for the early identification of patients at risk for a prolonged intensive care unit length of stay. BMC Med Inform Decis Mak 2010; 10:27
23. Kramer AA: Are ICU length of stay predictions worthwhile? Crit Care Med 2017; 45:379-380
24. Admon AJ, Seymour CW, Gershengorn HB, et al: Hospital-level variation in ICU admission and critical care procedures for patients hospitalized for pulmonary embolism. Chest 2014; 146:1452-1461
25. Abhyankar S, Demner-Fushman D, Callaghan FM, et al: Combining structured and unstructured data to identify a cohort of ICU patients who received dialysis. J Am Med Inform Assoc 2014; 21:801-807
26. Weissman GE, Harhay MO, Lugo RM, et al: Natural language processing to assess documentation of features of critical illness in discharge documents of acute respiratory distress syndrome survivors. Ann Am Thorac Soc 2016; 13:1538-1545
27. Ford E, Carroll JA, Smith HE, et al: Extracting information from the text of electronic medical records to improve case detection: A systematic review. J Am Med Inform Assoc 2016; 23:1007-1015
28. Navathe AS, Zhong F, Lei VJ, et al: Hospital readmission and social risk factors identified from physician notes. Health Serv Res 2018; 53:1110-1136
29. Pirracchio R, Petersen ML, Carone M, et al: Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): A population-based study. Lancet Respir Med 2015; 3:42-52
30. Le Gall JR, Lemeshow S, Saulnier F: A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multi-center study. JAMA 1993; 270:2957-2963
31. LaFaro RJ, Pothula S, Kubal KP, et al: Neural network prediction of ICU length of stay following cardiac surgery based on pre-incision variables. PLoS One 2015; 10:e0145395
32. Tsai PFJ, Chen PC, Chen YY, et al: Length of hospital stay prediction at the admission stage for cardiology patients using artificial neural network. J Healthc Eng 2016; 2016
33. Goldstein BA, Navar AM, Pencina MJ, et al: Opportunities and challenges in developing risk prediction models with electronic health records data: A systematic review. J Am Med Inform Assoc 2017; 24:198-208
34. Marafino BJ, Boscardin WJ, Dudley RA: Efficient and sparse feature selection for biomedical text classification via the elastic net: Application to ICU risk stratification from nursing notes. J Biomed Inform 2015; 54:114-120
35. Lehman LW, Saeed M, Long W, et al: Risk stratification of ICU patients using topic models inferred from unstructured progress notes. AMIA Annu Symp Proc 2012; 2012:505-511
36. Amarasingham R, Audet AM, Bates DW, et al: Consensus statement on electronic health predictive analytics: A guiding framework to address challenges. EGEMS (Wash DC) 2016; 4:1163
37. Johnson AE, Pollard TJ, Shen L, et al: MIMIC-III, a freely accessible critical care database. Sci Data 2016; 3:160035
38. Churpek MM, Yuen TC, Winslow C, et al: Multicenter comparison of machine learning methods and conventional regression for predicting clinical deterioration on the wards. Crit Care Med 2016; 44:368-374
39. Weissman GE: gweissman/text-pred-icu: Full release, 2017. Available at: https://doi.org/10.5281/zenodo.826438. Accessed November 1, 2017
40. DeLong ER, DeLong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 1988; 44:837-845
41. Paul P, Pennell ML, Lemeshow S: Standardizing the power of the Hosmer-Lemeshow goodness of fit test in large data sets. Stat Med 2013; 32:67-80
42. Kern ML, Park G, Eichstaedt JC, et al: Gaining insights from social media language: Methodologies and challenges. Psychol Methods 2016; 21:507-525
43. Schwartz HA, Eichstaedt JC, Kern ML, et al: Personality, gender, and age in the language of social media: The open-vocabulary approach. PLoS One 2013; 8:e73791
44. Salton G, McGill M: Introduction to Modern Information Retrieval, New York, NY, McGraw-Hill, 1983
45. Harhay MO, Ratcliffe SJ, Halpern SD: Measurement error in intensive care unit length of stay estimates due to patient flow. Am J Epidemiol 2017; 186:1389-1395
46. Elixhauser A, Steiner C, Harris DR, et al: Comorbidity measures for use with administrative data. Med Care 1998; 36:8-27
47. Kuhn M: caret: Variable Importance, 2017. Available at: https://topepo.github.io/caret/variable-importance.html. Accessed November 1, 2017
48. Weissman GE, Hubbard RA, Ungar LH, et al: Inclusion of unstructured text data from clinical notes improves early prediction of death or prolonged ICU stay among hospitalized patients. Poster Presentation. Am J Respir Crit Care Med 2017; 195:A1084
49. Charles D, Gabriel M, Searcy T: Adoption of electronic health record systems among U.S. non - federal acute care hospitals: 2008-2014. ONC Data Brief 2015; 23:1-10