An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

Automatica

Volumn 47, Issue 1, 2011, Pages 207-214

  Zhang, Huaguang ^a   Wei, Qinglai ^b   Liu, Derong ^b  

^a NORTHEASTERN UNIVERSITY   (China)

^b INSTITUTE OF AUTOMATION   (China)

Author keywords

Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Neural network; Zero sum differential games

Indexed keywords

ADAPTIVE CRITIC DESIGNS; ADAPTIVE DYNAMIC PROGRAMMING; APPROXIMATE DYNAMIC PROGRAMMING; CONTINUOUS TIME; CONVERGENCE PROPERTIES; DIFFERENTIAL GAMES; OPTIMAL CONTROLS; PERFORMANCE INDICES; SADDLE POINT; SIMULATION EXAMPLE; STABILITY ANALYSIS;

CONTROL; GAME THEORY; NEURAL NETWORKS; OPTIMIZATION;

DYNAMIC PROGRAMMING;

EID: 78650805234     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2010.10.033     Document Type: Article

References (21)

1. M. Abu-Khalaf, F.L. Lewis, and J. Huang Policy iterations on the HamiltonJacobiIsaacs equation for state feedback control with input saturation IEEE Transactions on Automatic Control 51 12 2006 1989 1995
2. M. Abu-Khalaf, F.L. Lewis, and J. Huang Neurodynamic programming and zero-sum games for constrained control systems IEEE Transactions on Neural Networks 19 7 2008 1243 1252
3. A. Al-Tamimi, F.L. Lewis, and M. Abu-Khalaf Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control Automatica 43 3 2007 473 481 (Pubitemid 46209050)
4. M. Bardi, and I. Capuzzo-Dolcetta Optimal control and viscosity solutions of HamiltonJacobiBellman equations 1997 Birkhuser Press Boston
5. T. Basar, and P. Bernhard H∞ optimal control and related minimax design problems 1995 Birkhuser Press Boston
6. T. Basar, and G.J. Olsder Dynamic noncooperative game theory 1982 Academic Press New York
7. G. Bianchini, R. Genesio, A. Parenti, and A. Tesi Global H∞ controllers for a class of nonlinear systems IEEE Transactions on Automatic Control 49 2 2004 244 249
8. H.S. Chang, J. Hu, M.C. Fu, and S.I. Marcus Adaptive adversarial multi-armed bandit approach to two-person zero-sum Markov games IEEE Transactions on Automatic Control 55 2 2010 463 468
9. Cloutier, J. R. (1997). State-dependent Riccati equation techniques: an overview. In Proceeding of the American control conference. Albuquerque, NM. June (pp. 932936).
10. J. Engwerda Uniqueness conditions for the affine open-loop linear quadratic differential game Automatica 44 2 2008 504 511
11. Jain, R., & Watrous, J. (2009). Parallel approximation of non-interactive zero-sum quantum games. In Proceeding of 24th annual IEEE conference on computational complexity. Paris, France. July (pp. 243253).
12. D. Jiang Strictly pure Nash equilibria and expected equilibria in a symmetrical 0-1 game and its dual game ICIC Express Letters 3 3 2009 295 300
13. M. Jimenez-Lizarraga, M. Basin, and A.M. Alcorta-Garcia Equilibrium in linear quadratic stochastic games with unknown parameters ICIC Express Letters 3 2 2009 107 114
14. X. Liao, L. Wang, and P. Yu Stability of dynamical systems 2007 Elsevier Press Amsterdam, The Netherland
15. G. Owen Game theory 1982 Acadamic Press New York
16. P. Shi Limited HamiltonJacobiIsaacs equations for singularly perturbed zero-sum dynamic (discrete time) games SIAM Journal on Control and Optimization 41 3 2002 826 850
17. P. Tsiotras, M. Corless, and M. Rotea An L 2 disturbance attenuations solution to the nonlinear benchmark problem International Journal of Robust and Nonlinear Control 8 2 1998 311 330
18. X. Wang Numerical solution of optimal control for scaled systems by hybrid functions International Journal of Innovative Computing, Information and Control 4 4 2008 849 856
19. F.Y. Wang, H. Zhang, and D. Liu Adaptive dynamic programming: an introduction IEEE Computational Intelligence Magazine 4 2 2009 39 47
20. Q.L. Wei, H.G. Zhang, and J. Dai Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions Neurocomputing 72 79 2009 1839 1848
21. H.G. Zhang, Q.L. Wei, and Y.H. Luo A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 38 4 2008 937 942