Drug scheduling of cancer chemotherapy based on natural actor-critic approach

BioSystems

Volumn 106, Issue 2-3, 2011, Pages 121-129

  Ahn, Inkyung ^a   Park, Jooyoung ^a  

^a Korea University   (South Korea)

Author keywords

Actor critic methods; Cancer chemotherapy; Drug scheduling; Reinforcement learning; Tumor growth model

Indexed keywords

ARTIFICIAL INTELLIGENCE; CANCER; CHEMOTHERAPY; DECISION MAKING; DRUG PRESCRIBING; GROWTH MODELING; LEARNING; PERFORMANCE ASSESSMENT; REINFORCEMENT; TUMOR;

ARTICLE; CANCER CHEMOTHERAPY; CELL INTERACTION; IMMUNOCOMPETENT CELL; MATHEMATICAL MODEL; TUMOR CELL; TUMOR GROWTH; TUMOR MODEL;

EID: 80054875922     PISSN: 03032647     EISSN: 18728324     Source Type: Journal    
DOI: 10.1016/j.biosystems.2011.07.005     Document Type: Article

References (42)

1. A Survey of Models for Tumor-immune System Dynamics 1996, Birkhauser. J.A. Adam, N. Bellomo (Eds.).
2. Alamir M., Chareyron S. Positive systems. State-constrained Optimal Control Applied to Cell-cycle-specific Cancer Chemotherapy. Lecture Notes in Computer and Information Sciences 341 2006, 271-278. C. Commault, N. Marchand (Eds.).
3. Amari S. Natural gradient works efficiently in learning. Neural Computation 1998, 10:251-276.
4. Arciero J.C., Jackson T.L., Kirschner D.E. A mathematical model of tumor-immune evasion and siRNA treatment. Discrete and Continuous Dynamical Systems - Series B 2004, 4:39-58.
5. Banerjee S., Sarkarb R.R. Delay-induced model for tumor-immune interaction and control of malignant tumor growth. Biosystems 2008, 91(1):268-288.
6. Bellomo N., Bellouquid A., Delitala M. Mathematical topics on the modelling of multicellular systems in competition between tumor and immune cells. Mathematical Models and Methods in Applied Sciences 2004, 14:1683-1733.
7. Burden T., Ernstberger J., Fister K. Optimal control applied to immunotherapy. Discrete and Continuous Dynamical Systems - Series B 2004, 4:135-146.
8. Chaplain M., Matzavinos A. Mathematical modeling of spatio-temporal phenomena in tumour immunology. Tutorials in Mathematical Biosciences: Cell Cycle, Proliferation, and Cancer 2006, 3:131-183.
9. Chareyron S., Alamir M. Mixed immunotherapy and chemotherapy of tumors: feedback design and model updating schemes. Journal of Theoretical Biology 2009, 258:444-454.
10. DeBoer R.J., Hogeweg P., Dullens H.F.J., DeWeger R.A., DenOtter W. Macrophage T lymphocyte interactions in the anti-tumor immune response: a mathematical model. Journal of Immunology 1985, 134(4):2748-2758.
11. de Pillis L.G., Fister K.R., Gu W., Collins C., Daub M., Gross D., Moore J., Preskill B. Mathematical model creation for cancer chemo-immunotherapy. Computational and Mathematical Methods in Medicine 2009, 10(3):165-184.
12. de Pillis L.G., Gu W., Radunskaya A.E. Mixed immunotherapy and chemotherapy of tumors: modeling, applications and biological interpretations. Journal of Theoretical Biology 2006, 238:841-862.
13. de Pillis L.G., Gu W., Fister K.R., Head T., Maples K., Murugan A., Neal T., Yoshida K. Chemotherapy for tumors: an analysis of the dynamics and a study of quadratic and linear optimal controls. Mathematical Biosciences 2007, 209:292-315.
14. de Pillis L.G., Radunskaya A.E. The Dynamics of an optimally controlled tumor model: a case study. Mathematical and Computer Modelling 2003, 37:1221-1244.
15. de Pillis L.G., Mallet D.G., Radunskaya A.E. Spatial tumor-immune modeling. Computational and Mathematical Methods in Medicine 2006, 7(2-3):159-176.
16. de Pillis L.G., Radunskaya A.E., Wiseman C.L. A validated mathematical model of cell-mediated immune response to tumor growth. Cancer Research 2005, 65:7950-7958.
17. Derbel L. Analysis of a new model for tumor-immune system competition including long time scale effects. Mathematical Models and Methods in Applied Sciences 2004, 14:1657-1681.
18. Eftimie R., Bramson J.L., Earn D.J. Interactions between the immune system and cancer: a brief review of non-spatial mathematical models. Bulletin of Mathematical Biology 2011, 73:2-32.
19. Ghaffari A., Naserifar N. Optimal therapeutic protocols in cancer immunotherapy. Computers in Biology and Medicine 2010, 40:261-270.
20. Hassani A., Naghibi M.B. Reinforcement learning based control of tumor growth with chemotherapy. Proceedings of 2010 IEEE International Conference of System Science and Engineering (ICSSE 2010) 2010.
21. Itik M., Salamci M., Banks S. SDRE optimal control of drug administration in cancer treatment. Turkish Journal of Electrical Engineering & Computer Sciences 2010, 18:715-729.
22. Kim B., Park J., Park S., Kang S. Impedance learning for robotic contact tasks using natural actor-critic algorithm. IEEE Transactions on Systems, Man, and Cybernetics: Part B - Cybernetics 2010, 40(2):433-443.
23. Kirschner D., Panetta J.C. Modeling immunotherapy of the tumor-immune interaction. Journal of Mathematical Biology 1998, 37:235-252.
24. Ko, W., Ahn, I. Diffusive tumor-immune interaction systems under immunotherapy. Nonlinear Analysis: Real World Applications, in press (doi:10.1016/j.nonrwa.2011.05.005).
25. Ko W., Ahn I. Stationary patterns and stability in a tumor-immune interaction model with immunotherapy. Journal of Mathematical Analysis and Applications 2011, 383(2):307-329.
26. Kolev M. Mathematical modelling of the competition between tumors and immune system considering the role of the antibodies. Mathematical and Computer Modelling 2003, 37:1143-1152.
27. Konda V., Tsitsiklis J.N. Actor-critic algorithms. SIAM Journal on Control and Optimization 2003, 42:1143-1166.
28. Kuznetsov V.A., Makalkin I.A., Taylor M.A., Perelson A.S. Nonlinear dynamics if immunogenic tumors: Parameter estimation and global bifurcation analysis. Bulletin of Mathematical Biology 1994, 56(2):295-321.
29. Ledzewicz U., Schattler H. Analysis of a cell-cycle specific model for cancer chemotherapy. Journal of Biological Systems 2002, 10(3):183-206.
30. Martin R. Optimal drug scheduling of cancer chemotherapy. Automatica 1992, 28(6):1113-1123.
31. Martin R., Teo K. Optimal Drug Administration in Cancer Chemotherapy 1994, World Scientific.
32. Moon T.K., Stirling W.C. Mathematical Methods and Algorithm for Signal Processing 2000, Prentice Hall.
33. Nakamura Y., Mori T., Sato M., Ishii S. Reinforcement learning for a biped robot based on a CPG-actor-critic method. Neural Networks 2007, 20(6):723-735.
34. Nani F.K., Freedman H.I. A mathematical model of cancer treatment by immunotherapy. Mathematical Biosciences 2000, 163:159-199.
35. Nani F.K., Oguztoreli M.N. Modeling and simulation of Rosenberg-type adoptive cellular immunotherapy. IMA Journal of Mathematics Applied in Medicine and Biology 1994, 11:107-147.
36. Park J., Kim J., Kang D. An RLS-based natural actor-critic algorithm for locomotion of a two-linked robot arm. Lecture Notes in Artificial Intelligence 2005, 3801:65-72.
37. Peters J., Schaal S. Natural actor-critic. Neurocomputing 2008, 71:1180-1190.
38. Peters J., Vijayakumar S., Schaal S. Reinforcement learning for humanoid robotics. Proceedings of IEEE-RAS International Conference on Humanoid Robots (Humanoids2003) 2003.
39. Sutton R.S., McAllester D., Singh S., Mansour Y. Policy gradient methods for reinforcement learning with function approximation. Advances in Neural Information Processing Systems 2000, 12:1057-1063.
40. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press.
41. Swan G.W. Role of optimal control in cancer chemotherapy. Mathematical Biosciences 1990, 101:237-284.
42. Williams R. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning 1992, 8:229-256.