Model Predictive Control with Reinforcement Learning for drug delivery in renal anemia management

Annual International Conference of the IEEE Engineering in Medicine and Biology - Proceedings

Volumn , Issue , 2006, Pages 5177-5180

  Gaweda, Adam E ^a,b   Muezzinoglu, Mehmet K ^a,c   Jacobs, Alfred A ^b   Aronoff, George R ^b   Brier, Michael E ^d  

^a IEEE   (United States)

^b University of Louisville School of Medicine   (United States)

^c University of Louisville   (United States)

^d NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANEMIA; KIDNEY FAILURE; PATIENT RESPONSE;

BIOLOGICAL ORGANS; DISEASE CONTROL; MODEL PREDICTIVE CONTROL; PHARMACODYNAMICS; REINFORCEMENT LEARNING;

DRUG DELIVERY;

HEMOGLOBIN;

ALGORITHM; ANEMIA; ARTICLE; BIOMEDICAL ENGINEERING; COMPUTER; COMPUTER PROGRAM; COMPUTER SIMULATION; DOSE RESPONSE; DRUG DELIVERY SYSTEM; EQUIPMENT; HUMAN; KIDNEY FAILURE; METABOLISM; METHODOLOGY; RENAL REPLACEMENT THERAPY; STATISTICAL MODEL; THEORETICAL MODEL; TIME;

ALGORITHMS; ANEMIA; BIOMEDICAL ENGINEERING; COMPUTER SIMULATION; COMPUTERS; DOSE-RESPONSE RELATIONSHIP, DRUG; DRUG DELIVERY SYSTEMS; HEMOGLOBINS; HUMANS; MODELS, STATISTICAL; MODELS, THEORETICAL; RENAL DIALYSIS; RENAL INSUFFICIENCY; SOFTWARE; TIME FACTORS;

EID: 34047110757     PISSN: 05891019     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IEMBS.2006.260685     Document Type: Conference Paper

References (14)

1. S. Vozeh and L. Steimer, "Feedback Control Methods for Drug Dosage Optimization: Concepts, Classification and Clinical Application," Clinical Pharmacokinetics, vol. 10, 1985, pp. 457-476.
2. Z. Trajanoski and P. Wach, "Neural Predictive Controller for Insulin Delivery Using the Subcutaneous Route," IEEE Trans. Biomed. Engineering, Vol. 45, No. 9, September 1998, pp. 1122-1134.
3. J.Y. Conway and M.M. Polycarpou, "Using Adaptive Networks to Model and Control Drug Delivery," IEEE Intelligent Control, April 1996, pp. 31-37.
4. M.M. Polycarpou and J.Y. Conway, "Indirect Adaptive Control of Drug Delivery Systems," IEEE Trans. Automatic Control, Vol. 43, No. 6, June 1998, pp. 849-856.
5. A.E. Gaweda, A.A. Jacobs, G.R. Aronoff, M.E. Brier, "Intelligent control for drug delivery in management of renal anemia," in Proc. 2004 Int. Conf. Machine Learning and Applications, pp. 355-359.
6. A.B. Gaweda, M.K. Muezzinoglu, G.R. Aronoff, A.A. Jacobs, J.M. Zurada, M.E. Brier, "Reinforcement Learning Approach to Chronic Pharmacotherapy," in Proc. 2005 IEEE Int. Joint Conf. Neural Networks, vol. 5, pp. 3290-3295.
7. A.E. Gaweda, M.K. Muezzinoglu, G.R. Aronoff, A.A. Jacobs, J.M. Zurada, M.E. Brier, "Individualization of Pharmacological Anemia Management using Reinforcement Learning," Neural Networks, vol 18, 2005, pp. 826-834.
8. J.W. Eschbach and J.W. Adamson, "Anemia of end-stage renal disease (ESRD)," Kidney Int., 28, 1985, pp. 1-5.
9. "U.S. Renal Data System, USRDS 2001 Annual Data RrHuEPOrt: Atlas of End-Stage Renal Disease in the United States," National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases, Bethesda, MD, 2001.
10. A.E. Gaweda, A.A. Jacobs, M.E. Brier, and J.M. Zurada, "Pharmacodynamic Population Analysis in Chronic Renal Failure Using Artificial Neural Networks - A Comparative Study," Neural Networks, Vol. 16, 5-6, 2003, pp. 841-845.
11. D.W. Clarke, C. Mohtadi, and P.S. Tuffs, "Generalized predictive control-I. The basic algorithm," Automatica, 23, 1987, pp. 137-148.
12. R.S. Sutton and A.G. Barto, Reinforcement Learning: An Introduction, MIT Press: Cambridge, MA, 1998.
13. R.R. Negenborn, B. De Schutter, M.A. Wiering, and H. Hellendoorn, "Learning-based model predictive control for Markov decision processes," Proc. 16th IFAC World Congress, Paper 2106 / We-M16-TO/2.
14. C. Watkins, Learning from Delayed Rewards, Thesis, University of Cambidge, England, 1989.