Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): A population-based study

The Lancet Respiratory Medicine

Volumn 3, Issue 1, 2015, Pages 42-52

  Pirracchio, Romain ^a,b,c   Petersen, Maya L ^a   Carone, Marco ^d   Rigon, Matthieu Resche ^b   Chevret, Sylvie ^b   van der Laan, Mark J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b SAINT LOUIS HOSPITAL   (France)

^c Service d'Anesthésie Réanimation HÔpital Européen Georges Pompidou   (France)

^d UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; APACHE; ARTICLE; CONTROLLED STUDY; DATA BASE; DISEASE SEVERITY; EXPLANATORY VARIABLE; EXTERNAL VALIDITY; FEMALE; FRANCE; HOSPITAL ADMISSION; HUMAN; INTENSIVE CARE UNIT; LEARNING ALGORITHM; MACHINE LEARNING; MAJOR CLINICAL STUDY; MALE; MORTALITY; MULTIPARAMETER INTELLIGENT MONITORING IN INTENSIVE CARE II DATABASE; OUTCOME ASSESSMENT; PATIENT SELECTION; PROBABILITY; RANDOMIZATION; RECEIVER OPERATING CHARACTERISTIC; SIMPLIFIED ACUTE PHYSIOLOGY SCORE; SUPER ICU LEARNER ALGORITHM; UNITED STATES; ALGORITHM; HOSPITAL MORTALITY; MASSACHUSETTS; MIDDLE AGED; REPRODUCIBILITY; RISK; SEVERITY OF ILLNESS INDEX; STATISTICS AND NUMERICAL DATA; VERY ELDERLY;

AGED; AGED, 80 AND OVER; ALGORITHMS; BOSTON; FEMALE; HOSPITAL MORTALITY; HUMANS; INTENSIVE CARE UNITS; MACHINE LEARNING; MALE; MIDDLE AGED; REPRODUCIBILITY OF RESULTS; RISK; ROC CURVE; SEVERITY OF ILLNESS INDEX;

EID: 84920273517     PISSN: 22132600     EISSN: 22132619     Source Type: Journal    
DOI: 10.1016/S2213-2600(14)70239-5     Document Type: Article

References (47)

1. Halpern NA, Pastores SM Critical care medicine in the United States 2000-2005: an analysis of bed numbers, occupancy rates, payer mix, and costs. Crit Care Med 2010, 38:65-71.
2. Ridley S, Morris S Cost effectiveness of adult intensive care in the UK. Anaesthesia 2007, 62:547-554.
3. Zimmerman JE, Kramer AA, Knaus WA Changes in hospital mortality for United States intensive care unit admissions from 1988 to 2012. Crit Care 2013, 17:R81.
4. Knaus WA, Zimmerman JE, Wagner DP, Draper EA, Lawrence DE APACHE-acute physiology and chronic health evaluation: a physiologically based classification system. Crit Care Med 1981, 9:591-597.
5. Knaus WA, Draper EA, Wagner DP, Zimmerman JE APACHE II: a severity of disease classification system. Crit Care Med 1985, 13:818-829.
6. Le Gall JR, Loirat P, Alperovitch A, et al. A simplified acute physiology score for ICU patients. Crit Care Med 1984, 12:975-977.
7. Le Gall JR, Lemeshow S, Saulnier F A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 1993, 270:2957-2963.
8. Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA 1993, 270:2478-2486.
9. Knaus WA, Wagner DP, Draper EA, et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991, 100:1619-1636.
10. Le Gall JR, Neumann A, Hemery F, et al. Mortality prediction using SAPS II: an update for French intensive care units. Crit Care 2005, 9:R645-R652.
11. Nassar AP, Mocelin AO, Nunes ALB, et al. Caution when using prognostic models: a prospective comparison of 3 recent prognostic models. J Crit Care 2012, 27:423.e1-423.e7.
12. Poole D, Rossi C, Latronico N, Rossi G, Finazzi S, Bertolini G Comparison between SAPS II and SAPS 3 in predicting hospital mortality in a cohort of 103 Italian ICUs. Is new always better?. Intensive Care Med 2012, 38:1280-1288. the GiViTI.
13. Metnitz B, Schaden E, Moreno R, Le Gall J-R, Bauer P, Metnitz PGH Austrian validation and customization of the SAPS 3 Admission Score. Intensive Care Med 2009, 35:616-622. the ASDI Study Group.
14. Moreno RP, Metnitz PGH, Almeida E, et al. SAPS 3--From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005, 31:1345-1355. the SAPS 3 Investigators.
15. Beck DH, Smith GB, Pappachan JV, Millar B External validation of the SAPS II, APACHE II and APACHE III prognostic models in South England: a multicentre study. Intensive Care Med 2003, 29:249-256.
16. Aegerter P, Boumendil A, Retbi A, Minvielle E, Dervaux B, Guidet B SAPS II revisited. Intensive Care Med 2005, 31:416-423.
17. Ledoux D, Canivet J-L, Preiser J-C, Lefrancq J, Damas P SAPS 3 admission score: an external validation in a general intensive care population. Intensive Care Med 2008, 34:1873-1877.
18. Lee J, Scott DJ, Villarroel M, Clifford GD, Saeed M, Mark RG Open-access MIMIC-II database for intensive care research. Conf Proc IEEE Eng Med Biol Soc 2011, 2011:8315-8318.
19. Saeed M, Villarroel M, Reisner AT, et al. Multiparameter Intelligent Monitoring in Intensive Care II: a public-access intensive care unit database. Crit Care Med 2011, 39:952-960.
20. Goldberger AL, Amaral LA, Glass L, et al. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 2000, 101:E215-E220.
21. Vincent JL, Moreno R, Takala J, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 1996, 22:707-710.
22. Neamatullah I, Douglass MM, Lehman LW, et al. Automated de-identification of free-text medical records. BMC Med Inform Decis Mak 2008, 8:32-48.
23. Dudoit S, Van Der Laan MJ Asymptotics of cross-validated risk estimation in estimator selection and performance assessment. Stat Methodol 2003, 2:131-154.
24. Van Der Laan MJ, Dudoit S Unified cross-validation methodology for selection among estimators and a general cross-validated adaptive epsilon-net estimator: Finite sample oracle inequalities and examples. UC Berkeley Division of Biostatistics Working Paper Series 2003, 1-103. Working Paper.
25. Van der Laan MJ, Polley EC, Hubbard AE Super learner. Stat Appl Genet Mol Biol 2007, 6:25.
26. Cox DR Two further applications of a model for binary regression. Biometrika 1958, 45:562-565.
27. Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 2006, 34:1378-1388.
28. Kramer AA, Zimmerman JE Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited. Crit Care Med 2007, 35:2052-2056.
29. Bertolini G, D'Amico R, Nardi D, Tinazzi A, Apolone G One model, several results: the paradox of the Hosmer-Lemeshow goodness-of-fit test for the logistic regression model. J Epidemiol Biostat 2000, 5:251-253.
30. Miller ME, Hui SL, Tierney WM Validation techniques for logistic regression models. Stat Med 1991, 10:1213-1226.
31. Cook NR Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 2007, 115:928-935.
32. Cook NR Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. Clin Chem 2008, 54:17-23.
33. Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 2008, 27:157-172. discussion 207-12.
34. LeDell E, Petersen M, van der Laan M, LeDell ME Package 'cvAUC' (accessed March 13, 2014). ftp://ftp.sam.math.ethz.ch/sfs/Software/R-CRAN/web/packages/cvAUC/cvAUC.pdf.
35. Polley E, van der Laan M SuperLearner: Super Learner Prediction 2014 (accessed March 13, 2014). http://CRAN.R-project.org/package=SuperLearner.
36. Sing T, Sander O, Beerenwinkel N, Lengauer T ROCR: visualizing classifier performance in R. Bioinformatics 2005, 21:3940-3941.
37. Dybowski R, Weller P, Chang R, Gant V Prediction of outcome in critically ill patients using artificial neural network synthesised by genetic algorithm. Lancet 1996, 347:1146-1150.
38. Clermont G, Angus DC, DiRusso SM, Griffin M, Linde-Zwirble WT Predicting hospital mortality for patients in the intensive care unit: a comparison of artificial neural networks with logistic regression models. Crit Care Med 2001, 29:291-296.
39. Ribas VJ, López JC, Ruiz-Sanmartin A, et al. Severe sepsis mortality prediction with relevance vector machines. Conf Proc IEEE Eng Med Biol Soc 2011, 2011:100-103.
40. Kim S, Kim W, Park RW A Comparison of Intensive Care Unit Mortality Prediction Models through the Use of Data Mining Techniques. Healthc Inform Res 2011, 17:232-243.
41. Johnson A, Dunkley N, Mayaud L, Tsanas A, Kramer A, Clifford G Patient-specific Predictions in the ICU using a Bayesian Ensemble. Comput Cardiol 2012, 2012:249-252.
42. Citi L, Barbieri R PhysioNet 2012 challenge: predicting mortality of ICU patients using a cascaded SVM-GLM paradigm. Comput Cardiol 2012, 39:257-260.
43. Greenland S The need for reorientation toward cost-effective prediction: comments on 'Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond' by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929). Stat Med 2008, 27:199-206.
44. Sakr Y, Krauss C, Amaral ACKB, et al. Comparison of the performance of SAPS II, SAPS 3, APACHE II, and their customized prognostic models in a surgical intensive care unit. Br J Anaesth 2008, 101:798-803.
45. Rosenberg AL Recent innovations in intensive care unit risk-prediction models. Curr Opin Crit Care 2002, 8:321-330.
46. Steyerberg EW, Harrell FE, Borsboom GJJ, Eijkemans MJ, Vergouwe Y, Habbema JDF Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001, 54:774-781.
47. Strobl C, Malley J, Tutz G An introduction to recursive partitioning: rationale, application, and characteristics of classification and regression trees, bagging, and random forests. Psychol Methods 2009, 14:323-348.