Online solution of nonlinear two-player zero-sum games using synchronous policy iteration

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2010, Pages 3040-3047

  Vamvoudakis, Kyriakos G ^a   Lewis, F L ^a  

^a UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

Approximate dynamic programming; H infinity; Hamilton Jacobi Isaacs equation; Nash equilibrium; Persistence of excitation; Policy iteration; Synchronous zero sum game policy iteration

Indexed keywords

ADAPTIVE ALGORITHMS; ADAPTIVE CONTROL SYSTEMS; CONTINUOUS TIME SYSTEMS; DYNAMIC PROGRAMMING; GAME THEORY; ONLINE SYSTEMS; OPTIMAL SYSTEMS; SYSTEM STABILITY;

APPROXIMATE DYNAMIC PROGRAMMING; H-INFINITY; HAMILTON-JACOBI-ISAACS EQUATIONS; NASH EQUILIBRIA; PERSISTENCE OF EXCITATION; POLICY ITERATION; ZERO-SUM GAME;

ITERATIVE METHODS;

EID: 79953155097     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2010.5717607     Document Type: Conference Paper

References (31)

1. M. Abu-Khalaf, F. L. Lewis, "Nearly Optimal Control Laws for Nonlinear Systems with Saturating Actuators Using a Neural Network HJB Approach", Automatica, vol. 41, no. 5, pp. 779-791, 2005.
2. M. Abu-Khalaf, F. L. Lewis, "Neurodynamic Programming and Zero- Sum Games for Constrained Control Systems," IEEE Transactions on Neural Networks, vol. 19, no. 7, pp. 1243-1252, 2008.
3. ∞ State Feedback Control With Input Saturation" , IEEE Transactions on Automatic Control, vol. 51, no. 12, pp. 1989-1995, 2006.
4. R. Adams, J. Fournier, Sobolev spaces, New York: Academic Press, 2003.
5. ∞ -control," J. Math Syst., Estimat., Control, vol. 6, no.1, pp. 1-22, 1996.
6. M. Bardi and I. Capuzzo-Dolcetta, Optimal Control and Viscosity Solutions of Hamilto-Jacobi-Bellman Equations. Boston, MA: Birkhäuser, 1997.
7. nd ed. Philadelphia, PA: SIAM, 1999, vol. 23, SIAM's Classic in Applied Mathematics.
8. ∞ Optimal Control and Related Minimax Design Problems. Boston, MA: Birkhäuser, 1995.
9. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, MA, 1996.
10. Y. Feng, B. D. Anderson, M. Rotkowitz, "A game theoretic algorithm to compute local stabilizing solutions to HJBI equations in nonlinear H∞ control," Automatica, vol. 45, no. 4, pp. 881-888, 2009.
11. B. A. Finlayson, The method of weighted residuals and variational principles. New York: Academic Press, 1990.
12. K. Hornik, M. Stinchcombe, H. White, Universal Approximation of an unknown mapping and its derivatives using multilayer feedforward networks, /eural /etworks, vol. 3, pp. 551-560, 1990.
13. R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, Cambridge, Massachusetts, 1960.
14. P. Ioannou and B. Fidan, Adaptive Control Tutorial, SIAM, Advances in Design and Control, PA, 2006.
15. D. Kleinman, "On an Iterative Technique for Riccati Equation Computations," IEEE Transactions on Automatic Control, vol. 13, pp. 114- 115, February, 1968.
16. F.L. Lewis, S. Jagannathan, A. Yesildirek, /eural /etwork Control of Robot Manipulators and /onlinear Systems, Taylor & Francis 1999.
17. F. L. Lewis, V. L. Syrmos, Optimal Control, John Wiley, 1995.
18. V. Nevistic, J. A. Primbs, "Constrained nonlinear optimal control: a converse HJB approach," Technical Report 96-021, California Institute of Technology, 1996.
19. ∞ control," IEEE Transactions on Automatic Control, vol. 37, no. 6, pp. 770-784, Jun. 1992.
20. E. W. Sandberg, "Notes on uniform approximation of time varying systems on finite time intervals," IEEE Transactions on Circuits and Systems-1: Fundamental Theory and Apprications, vol. 45, no. 8, pp. 863-865.
21. J. Si, A. Barto, W. Powel, D. Wunch, Handbook of Learning and Approximate Dynamic Programming, John Wiley, New Jersey, 2004.
22. E. D. Sontag, H. J. Sussman, "Nonsmooth control Lyapunov functions," IEEE Proc. CDC95, pp. 2799-2805. 1995.
23. R. S. Sutton, A. G. Barto, Reinforcement Learning - An Introduction, MIT Press, Cambridge, Massachusetts, 1998.
24. G. Tao, Adaptive Control Design and Analysis, Adaptive and Learning Systems for Signal Processing, Communications and Control Series, Hoboken, NJ: Wiley-Interscience, 2003.
25. S. Tijs, Introduction to Game Theory, Hindustan Book Agency, India, 2003.
26. K. G. Vamvoudakis, F. L. Lewis, "Online Actor-Critic Algorithm to Solve the Continuous-Time Infinite Horizon Optimal Control Problem," Automatica, vol. 46, no. 5, pp. 878-888, 2010.
27. K. G. Vamvoudakis, and F. L. Lewis, "Online Actor Critic Algorithm to solve the Continuous-Time Infinite Horizon Optimal Control Problem," Proc. Int. Joint Conf. on /eural /etworks, pp.3180-3187, Atlanta, June 2009.
28. D. Vrabie, K. Vamvoudakis, and F. Lewis, "Adaptive optimal controllers based on generalized policy iteration in a continuous-time framework," Proc. of the IEEE Mediterranean Conf. on Control and Automation, pp. 1402-1409, June 2009.
29. D. Vrabie, Online Adaptive Optimal Control for Continuous Time Systems, Ph.D. Thesis, Dept. of Electrical Engineering, Univ. Texas at Arlington, Arlington, TX, USA, 2009.
30. P.J. Werbos, Beyond Regression: New Tools for Prediction and Analysis in the Behavior Sciences, Ph.D. Thesis, 1974.
31. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," Handbook of Intelligent Control, ed. D.A. White and D.A. Sofge, New York: Van Nostrand Reinhold, 1992.