A comparison of a machine learning model with EuroSCORE II in predicting mortality after elective cardiac surgery: A decision curve analysis

PLoS ONE

Volumn 12, Issue 1, 2017, Pages

  Allyn, Jérôme ^a,b   Allou, Nicolas ^a,b   Augustin, Pascal ^b   Philip, Ivan ^b,c   Martinet, Olivier ^a   Belghiti, Myriem ^a   Provenchere, Sophie ^b   Montravers, Philippe ^b,d   Ferdynus, Cyril ^e,f  

^a Groupe Hospitalier Felix Guyon   (France)

^b BICHAT HOSPITAL   (France)

^c INSTITUT MUTUALISTE MONTSOURIS   (France)

^d UNIVERSITÉ PARIS DESCARTES   (France)

^e Centre d'Investigations Cliniques   (France)

^f INSERM   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; CARDIOPULMONARY BYPASS; COHORT ANALYSIS; DATA BASE; EUROSCORE; HEART SURGERY; HUMAN; LOGISTIC REGRESSION ANALYSIS; MACHINE LEARNING; MAJOR CLINICAL STUDY; MIDDLE AGED; MORTALITY; PREDICTION; PROBABILITY; RECEIVER OPERATING CHARACTERISTIC; SURGERY; UNIVERSITY HOSPITAL; ADVERSE EFFECTS; AGED; COMORBIDITY; DECISION SUPPORT SYSTEM; FEMALE; HOSPITAL MORTALITY; MALE; PROCEDURES; REPRODUCIBILITY; STATISTICAL MODEL;

AGED; CARDIAC SURGICAL PROCEDURES; CARDIOPULMONARY BYPASS; COMORBIDITY; DECISION SUPPORT TECHNIQUES; FEMALE; HOSPITAL MORTALITY; HUMANS; LOGISTIC MODELS; MACHINE LEARNING; MALE; MIDDLE AGED; MODELS, STATISTICAL; REPRODUCIBILITY OF RESULTS; ROC CURVE;

EID: 85009893949     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0169772     Document Type: Article

References (28)

1. Authors/Task Force members, Windecker S, Kolh P, Alfonso F, Collet J-P, Cremer J, et al. 2014 ESC/EACTS Guidelines on myocardial revascularization: The Task Force on Myocardial Revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS)Developed with the special contribution of the European Association of Percutaneous Cardiovascular Interventions (EAPCI). Eur Heart J. 2014; 35: 2541-2619. doi: 10.1093/eurheartj/ehu278 PMID: 25173339
2. Nashef SAM, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR, et al. EuroSCORE II. Eur J Cardio-Thorac Surg Off J Eur Assoc Cardio-Thorac Surg. 2012; 41: 734-744-745.
3. Shahian DM, O'Brien SM, Filardo G, Ferraris VA, Haan CK, Rich JB, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1-coronary artery bypass grafting surgery. Ann Thorac Surg. 2009; 88: S2-22. doi: 10.1016/j.athoracsur.2009.05.053 PMID: 19559822
4. O'Brien SM, Shahian DM, Filardo G, Ferraris VA, Haan CK, Rich JB, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 2 - isolated valve surgery. Ann Thorac Surg. 2009; 88: S23-42. doi: 10.1016/j.athoracsur.2009.05.056 PMID: 19559823
5. Shahian DM, O'Brien SM, Filardo G, Ferraris VA, Haan CK, Rich JB, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 3 - valve plus coronary artery bypass grafting surgery. Ann Thorac Surg. 2009; 88: S43-62. doi: 10.1016/j.athoracsur.2009.05.055 PMID: 19559824
6. Joint Task Force on the Management of Valvular Heart Disease of the European Society of Cardiology (ESC), European Association for Cardio-Thoracic Surgery (EACTS), Vahanian A, Alfieri O, Andreotti F, Antunes MJ, et al. Guidelines on the management of valvular heart disease (version 2012). Eur Heart J. 2012; 33: 2451-2496. doi: 10.1093/eurheartj/ehs109 PMID: 22922415
7. Chhor V, Merceron S, Ricome S, Baron G, Daoud O, Dilly M-P, et al. Poor performances of EuroSCORE and CARE score for prediction of perioperative mortality in octogenarians undergoing aortic valve replacement for aortic stenosis. Eur J Anaesthesiol. 2010; 27: 702-707. doi: 10.1097/EJA.0b013e32833a45de PMID: 20520558
8. Kuwaki K, Inaba H, Yamamoto T, Dohi S, Matsumura T, Morita T, et al. Performance of the EuroSCORE II and the Society of Thoracic Surgeons Score in patients undergoing aortic valve replacement for aortic stenosis. J Cardiovasc Surg (Torino). 2015; 56: 455-462.
9. Churpek MM, Yuen TC, Winslow C, Meltzer DO, Kattan MW, Edelson DP. Multicenter Comparison of Machine Learning Methods and Conventional Regression for Predicting Clinical Deterioration on the Wards. Crit Care Med. 2016; 44: 368-374. doi: 10.1097/CCM.0000000000001571 PMID: 26771782
10. Kessler RC, van Loo HM, Wardenaar KJ, Bossarte RM, Brenner LA, Cai T, et al. Testing a machine-learning algorithm to predict the persistence and severity of major depressive disorder from baseline self-reports. Mol Psychiatry. 2016
11. Weichenthal S, Ryswyk KV, Goldstein A, Bagg S, Shekkarizfard M, Hatzopoulou M. A land use regression model for ambient ultrafine particles in Montreal, Canada: A comparison of linear regression and a machine learning approach. Environ Res. 2016; 146: 65-72. doi: 10.1016/j.envres.2015.12.016 PMID: 26720396
12. Taylor RA, Pare JR, Venkatesh AK, Mowafi H, Melnick ER, Fleischman W, et al. Prediction of In-hospital Mortality in Emergency Department Patients With Sepsis: A Local Big Data-Driven, Machine Learning Approach. Acad Emerg Med Off J Soc Acad Emerg Med. 2016; 23: 269-278.
13. Liu NT, Holcomb JB, Wade CE, Darrah MI, Salinas J. Utility of vital signs, heart rate variability and complexity, and machine learning for identifying the need for lifesaving interventions in trauma patients. Shock Augusta Ga. 2014; 42: 108-114.
14. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak Int J Soc Med Decis Mak. 2006; 26: 565-574.
15. Shigeta K, Ishii Y, Hasegawa H, Okabayashi K, Kitagawa Y. Evaluation of 5-fluorouracil metabolic enzymes as predictors of response to adjuvant chemotherapy outcomes in patients with stage II/III colorectal cancer: a decision-curve analysis. World J Surg. 2014; 38: 3248-3256. doi: 10.1007/s00268-014-2738-1 PMID: 25167895
16. Zastrow S, Brookman-May S, Cong TAP, Jurk S, von Bar I, Novotny V, et al. Decision curve analysis and external validation of the postoperative Karakiewicz nomogram for renal cell carcinoma based on a large single-center study cohort. World J Urol. 2015; 33: 381-388. doi: 10.1007/s00345-014-1321-6 PMID: 24850226
17. Hernandez JM, Tsalatsanis A, Humphries LA, Miladinovic B, Djulbegovic B, Velanovich V. Defining optimum treatment of patients with pancreatic adenocarcinoma using regret-based decision curve analysis. Ann Surg. 2014; 259: 1208-1214. doi: 10.1097/SLA.0000000000000310 PMID: 24169177
18. Shariat SF, Savage C, Chromecki TF, Sun M, Scherr DS, Lee RK, et al. Assessing the clinical benefit of nuclear matrix protein 22 in the surveillance of patients with nonmuscle-invasive bladder cancer and negative cytology: a decision-curve analysis. Cancer. 2011; 117: 2892-2897. doi: 10.1002/cncr.25903 PMID: 21692050
19. Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardio-Thorac Surg Off J Eur Assoc Cardio-Thorac Surg. 1999; 16: 9-13.
20. Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning [Internet]. New York, NY: Springer New York; 2009. Available: http://link.springer.com/10.1007/978-0-387-84858-7
21. Rennie JD, Shih L, Teevan J, Karger D. Tackling the poor assumptions of naive bayes text classifiers. International Conference on Machine Learning. 2003. p. 616. Available: http://www.aaai.org/Papers/ICML/2003/ICML03-081.pdf
22. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988; 44: 837-845. PMID: 3203132
23. Vickers AJ. Decision analysis for the evaluation of diagnostic tests, prediction models and molecular markers. Am Stat. 2008; 62: 314-320. doi: 10.1198/000313008X370302 PMID: 19132141
24. Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak. 2008; 8: 53. doi: 10.1186/1472-6947-8-53 PMID: 19036144
25. Chen T, He T, Benesty M. xgboost: Extreme Gradient Boosting [Internet]. 2016. Available: https://cran.r-project.org/web/packages/xgboost/index.html
26. Simm J, Abril IM de. extraTrees: Extremely Randomized Trees (ExtraTrees) Method for Classification and Regression [Internet]. 2014. Available: https://cran.r-project.org/web/packages/extraTrees/index.html
27. Meyer D, Dimitriadou E, Hornik K, Weingessel A, Leisch F, C++-code) C-CC (libsvm, et al. e1071: Misc Functions of the Department of Statistics, Probability Theory Group (Formerly: E1071), TU Wien [Internet]. 2015. Available: https://cran.r-project.org/web/packages/e1071/index.html
28. Fitzgerald M, Saville BR, Lewis RJ. Decision curve analysis. JAMA. 2015; 313: 409-410. doi: 10.1001/jama.2015.37 PMID: 25626037