A robust Markov game controller for nonlinear systems

Applied Soft Computing Journal

Volumn 7, Issue 3, 2007, Pages 818-827

  Sharma, Rajneesh ^a   Gopal, Madan ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

Author keywords

Inverted pendulum; Markov decision process; Markov game controller; Markov games; Matrix games; Neural networks; Reinforcement learning; Two link robot

Indexed keywords

FUNCTION EVALUATION; MARKOV PROCESSES; NONLINEAR CONTROL SYSTEMS; REINFORCEMENT LEARNING; ROBOTS; ROBUST CONTROL;

INVERTED PENDULUM; MARKOV DECISION PROCESS; MARKOV GAME CONTROLLERS; MARKOV GAMES; MATRIX GAMES; TWO LINK ROBOTS;

GAME THEORY;

EID: 34047276480     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2006.02.005     Document Type: Article

References (15)

1. Altman E., and Hordijk A. Zero-sum Markov games and worst-case optimal control of queueing systems, Invited paper, QUESTA. Optim. Queueing Syst. 21 (1995) 415-447 (special issue)
2. Bertsekas D.P., and Tsitsiklis J.N. Neuro-Dynamic Programming (1996), Athena Scientific, Belmont, MA
3. Haykin S. Neural Networks: A Comprehensive Foundation. 2nd ed. (1999), Prentice-Hall, Englewood Cliffs, NJ
4. Lagoudakis M.G., and Parr R. Least-squares policy iteration. J. Mach. Learn. Res. 4 (2003) 1107-1149
5. Lagoudakis M.G., and Parr R. Value function approximation in zero-sum Markov games. Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence (UAI 2002). Edmonton, Alta., Canada, August 1-4 (2002) 283-292
6. Littman M.L. Value-function reinforcement learning in Markov games. J. Cogn. Syst. Res. 2 (2001) 55-66
7. Littman M.L. Markov games as a framework for multi-agent reinforcement learning. Proceedings of the 11th International Conference on Machine Learning. Morgan Kaufmann, San Francisco, CA (1994)
8. Owen G. Game Theory. 2nd ed. (1982), Academic Press, Orlando, FL
9. Strang G. Linear Algebra and its Applications (1980), Academic Press, Orlando, FL
10. C.J.C.H. Watkins, Learning from delayed rewards, Ph.D. Thesis, King's College, Cambridge, UK, 1989.
11. Zhou K., Doyle J.C., and Glower K. Robust and Optimal Control (1996), Prentice-Hall, New Jersey
12. Morimoto J., and Doya K. Robust reinforcement learning. Neural Comput. 17 (2005) 335-359
13. Kim Y.H., and Lewis F.L. Direct-adaptive-reinforcement-learning neural network control for nonlinear systems. Proceedings of the American Control Conference. Albuquerque, NM, June (1997) 1804-1808
14. Altman E. Flow control using the theory of zero-sum Markov games. IEEE Trans. Automat. Control 39 (1994) 814-818
15. Lewis F.L., Jagannathan S., and Yesildirek A. Neural Network Control of Robotic Manipulators and Nonlinear Systems (1999), Taylor & Francis, London