Optimal medication dosing from suboptimal clinical examples: A deep reinforcement learning approach

Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

Volumn 2016-October, Issue , 2016, Pages 2978-2981

  Nemati, Shamim ^a   Ghassemi, Mohammad M ^b   Clifford, Gari D ^a,c  

^a EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b USA   (United States)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HEPARIN;

ALGORITHM; DOSE RESPONSE; FACTUAL DATABASE; HUMAN; LEARNING; LENGTH OF STAY; MARKOV CHAIN; REINFORCEMENT; RETROSPECTIVE STUDY;

ALGORITHMS; DATABASES, FACTUAL; DOSE-RESPONSE RELATIONSHIP, DRUG; HEPARIN; HUMANS; LEARNING; LENGTH OF STAY; MARKOV CHAINS; REINFORCEMENT (PSYCHOLOGY); RETROSPECTIVE STUDIES;

EID: 85009088494     PISSN: 1557170X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/EMBC.2016.7591355     Document Type: Conference Paper

References (18)

1. J. T. James, "A new, evidence-based estimate of patient harms associated with hospital care, " Journal of patient safety, vol. 9, no. 3, pp. 122-128, 2013.
2. S. Alban, "Adverse effects of heparin, " in Heparin-A Century of Progress. Springer, 2012, pp. 211-263.
3. R. A. Raschke, B. Gollihare, and J. C. Peirce, "The effectiveness of implementing the weight-based heparin nomogram as a practice guideline, " Archives of internal medicine, vol. 156, no. 15, p. 1645, 1996.
4. C. S. Landefeld, E. F. Cook, M. Flatley, M. Weisberg, and L. Goldman, "Identification and preliminary validation of predictors of major bleeding in hospitalized patients starting anticoagulant therapy, " The American journal of medicine, vol. 82, no. 4, pp. 703-713, 1987.
5. H. Q. Ontario et al., "Point-of-care international normalized ratio (inr) monitoring devices for patients on long-term oral anticoagulation therapy: an evidence-based analysis, " Ontario health technology assessment series, vol. 9, no. 12, p. 1, 2009.
6. V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski et al., "Human-level control through deep reinforcement learning, " Nature, vol. 518, no. 7540, pp. 529-533, 2015.
7. R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction. MIT press Cambridge, 1998, vol. 1, no. 1.
8. M. M. Ghassemi, S. E. Richter, I. M. Eche, T. W. Chen, J. Danziger, and L. A. Celi, "A data-driven approach to optimized medication dosing: a focus on heparin, " Intensive care medicine, vol. 40, no. 9, pp. 1332-1339, 2014.
9. M. Saeed, M. Villarroel, A. T. Reisner, G. Clifford, L.-W. Lehman, G. Moody, T. Heldt, T. H. Kyaw, B. Moody, and R. G. Mark, "Multiparameter intelligent monitoring in intensive care ii (mimic-ii): A public-access intensive care unit database, " Critical care medicine, vol. 39, no. 5, p. 952, 2011.
10. S. Nemati, R. Adams et al., "Supervised learning in dynamic Bayesian networks, " in NIPS Workshop on Deep Learning and Representation Learning, 2014.
11. C. J. Watkins and P. Dayan, "Q-learning, " Machine learning, vol. 8, no. 3-4, pp. 279-292, 1992.
12. M. Riedmiller, "Neural fitted q iteration-first experiences with a data efficient neural reinforcement learning method, " in Machine Learning: ECML 2005. Springer, 2005, pp. 317-328.
13. M. Schmidt, "minfunc: unconstrained differentiable multivariate optimization in matlab, " 2012.
14. M. Ghassemi, L.-w. Lehman, J. Snoek, and S. Nemati, "Global optimization approaches for parameter tuning in biomedical signal processing: A focus on multi-scale entropy, " in Computing in Cardiology Conference (CinC), 2014. IEEE, 2014, pp. 993-996.
15. B. Chakraborty and S. A. Murphy, "Dynamic treatment regimes, " Annual review of statistics and its application, vol. 1, p. 447, 2014.
16. H. Asoh, M. S. S. Akaho, T. Kamishima, K. Hasida, E. Aramaki, and T. Kohro, "An application of inverse reinforcement learning to medical records of diabetes treatment, " 2013.
17. M. K. Bothe, L. Dickens, K. Reichel, A. Tellmann, B. Ellger, M. Westphal, and A. A. Faisal, "The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas, " Expert review of medical devices, vol. 10, no. 5, pp. 661-673, 2013.
18. B. D. Friedman CP, Wong AK, "Achieving a nationwide learning health system, " Sci Transl Med, vol. 2, no. 57, pp. 1-3, 2010.