A reinforcement learning approach to weaning of mechanical ventilation in intensive care units

Uncertainty in Artificial Intelligence - Proceedings of the 33rd Conference, UAI 2017

Volumn , Issue , 2017, Pages

  Prasad, Niranjani ^a   Cheng, Li Fang ^a   Chivers, Corey ^b   Draugelis, Michael ^b   Engelhardt, Barbara E ^a  

^a Princeton University   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECISION SUPPORT SYSTEMS; FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; REINFORCEMENT LEARNING; VENTILATION;

DECISION SUPPORT TOOLS; HOSPITAL COSTS; MECHANICAL VENTILATION; PATIENT INFORMATION; PATIENT STATE; RANDOMIZED TREES; REINFORCEMENT LEARNING APPROACH; TREATMENT POLICIES;

INTENSIVE CARE UNITS;

EID: 85031120880     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Nicolino Ambrosino and Luciano Gabbrielli. The difficultto- wean patient. Expert Review of Respiratory Medicine, 4(5): 685-692, 2010.
2. HannahWunsch, JasonWagner, Maximilian Herlim, David Chong, Andrew Kramer, and Scott D Halpern. Icu occupancy and mechanical ventilator use in the united states. Critical care medicine, 41(12), 2013.
3. Shruti B Patel and John P Kress. Sedation and analgesia in the mechanically ventilated patient. American journal of respiratory and critical care medicine, 185(5): 486-497, 2012.
4. Christopher G Hughes, Stuart McGrane, and Pratik P Pandharipande. Sedation in the intensive care setting. Clin Pharmacol, 4: 53-63, 2012.
5. James S Krinsley, Praveen K Reddy, and Abid Iqbal. What is the optimal rate of failed extubation? Critical Care, 16(1): 111, 2012.
6. Giorgio Conti, Jean Mantz, Dan Longrois, and Peter Tonner. Sedation and weaning from mechanical ventilation: Time for 'best practice' to catch up with new realities? Multidisciplinary respiratory medicine, 9(1): 45, 2014.
7. J Goldstone. The pulmonary physician in critical care: Difficult weaning. Thorax, 57(11): 986-991, 2002.
8. Damien Ernst, Guy-Bart Stan, Jorge Goncalves, and Louis Wehenkel. Clinical data based optimal sti strategies for hiv: A reinforcement learning approach. In 2006 45th IEEE Conference on Decision and Control, pages 667- 672. IEEE, 2006.
9. Yufan Zhao, Donglin Zeng, Mark A. Socinski, and Michael R. Kosorok. Reinforcement learning strategies for clinical trials in nonsmall cell lung cancer. Biometrics, 67(4): 1422-1433, 2011.
10. Pablo Escandell-Montero, Milena Chermisi, Jos M. Martnez-Martnez, Juan Gmez-Sanchis, Carlo Barbieri, Emilio Soria-Olivas, Flavio Mari, Joan Vila- Francs, Andrea Stopper, Emanuele Gatti, and Jos D. Martn-Guerrero. Optimization of anemia treatment in hemodialysis patients via reinforcement learning. Artificial Intelligence in Medicine, 62(1): 47 - 60, 2014.
11. Brett L Moore, Eric D Sinzinger, Todd M Quasny, and Larry D Pyeatt. Intelligent control of closed-loop sedation in simulated icu patients. In FLAIRS Conference, pages 109-114, 2004.
12. R. Padmanabhan, N. Meskin, and W. M. Haddad. Closedloop control of anesthesia and mean arterial pressure using reinforcement learning. In 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), pages 1-8, Dec 2014.
13. S. Nemati, M. M. Ghassemi, and G. D. Clifford. Optimal medication dosing from suboptimal clinical examples: A deep reinforcement learning approach. In 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pages 2978- 2981, Aug 2016.
14. Martina Mueller, Jonas S Almeida, Romesh Stanislaus, and Carol L Wagner. Can machine learning methods predict extubation outcome in premature infants as well as clinicians? Journal of neonatal biology, 2, 2013.
15. Hung-Ju Kuo, Hung-Wen Chiu, Chun-Nin Lee, Tzu-Tao Chen, Chih-Cheng Chang, and Mauo-Ying Bien. Improvement in the prediction of ventilator weaning outcomes by an artificial neural network in a medical icu. Respiratory care, 60(11): 1560-1569, 2015.
16. Yuanyuan Gao, Anqi Xu, Paul Jen-Hwa Hu, and Tsang- Hsiang Cheng. Incorporating association rule networks in feature category-weighted naive bayes model to support weaning decision making. Decision Support Systems, 2017.
17. Alistair EW Johnson, Tom J Pollard, Lu Shen, Li-wei H Lehman, Mengling Feng, Mohammad Ghassemi, Benjamin Moody, Peter Szolovits, Leo Anthony Celi, and Roger G Mark. Mimic-iii, a freely accessible critical care database. Scientific data, 3, 2016.
18. Oliver Stegle, Sebastian V. Fallert, David J. C. MacKay, and Søren Brage. Gaussian process robust regression for noisy heart rate data. IEEE Transactions on Biomedical Engineering, 55(9): 2143-2151, 2008.
19. Robert Dürichen, Marco A. F. Pimentel, Lei Clifton, Achim Schweikard, and David A. Clifton. Multitask Gaussian processes for multivariate physiological timeseries analysis. IEEE Transactions on Biomedical Engineering, 62(1): 314-322, 2015.
20. Marzyeh Ghassemi, Marco A. F. Pimentel, Tristan Naumann, Thomas Brennan, David A. Clifton, Peter Szolovits, and Mengling Feng. A multivariate timeseries modeling approach to severity of illness assessment and forecasting in ICU with sparse, heterogeneous clinical data. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pages 446-453, 2015.
21. Li-Fang Cheng, Gregory Darnell, Corey Chivers, Michael Draugelis, Kai Li, and Barbara Engelhardt. Sparse Multi-Output Gaussian Processes for Medical Time Series Prediction. ArXiv e-prints, March 2017.
22. Carl Edward Rasmussen and Christopher K. I. Williams. Gaussian Processes for Machine Learning. The MIT Press, 2006.
23. Dirk Ormoneit and Saunak Sen. Kernel-based reinforcement learning. Machine learning, 49(2-3): 161-178, 2002.
24. Pierre Geurts, Damien Ernst, and Louis Wehenkel. Extremely randomized trees. Machine learning, 63(1): 3-42, 2006.
25. Damien Ernst, Pierre Geurts, and Louis Wehenkel. Treebased batch mode reinforcement learning. Journal of Machine Learning Research, 6(Apr): 503-556, 2005.
26. Martin Riedmiller. Neural fitted q iteration-first experiences with a data efficient neural reinforcement learning method. In European Conference on Machine Learning, pages 317-328. Springer, 2005.
27. Diederik Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv: 1412.6980, 2014.
28. Guy W Soo Hoo. Blood gases, weaning, and extubation. Respiratory Care, 48(11): 1019-1021, 2012.
29. Julie-Ann Collins, Aram Rudenski, John Gibson, Luke Howard, and Ronan ODriscoll. Relating oxygen partial pressure, saturation and content: The haemoglobin- oxygen dissociation curve. Breathe, 11(3): 194, 2015.
30. Andrew Y Ng, Stuart J Russell, et al. Algorithms for inverse reinforcement learning. 2000.
31. Sergey Levine, Zoran Popovic, and Vladlen Koltun. Feature construction for inverse reinforcement learning. In Advances in Neural Information Processing Systems, pages 1342-1350, 2010.