A new iteration approach to solve a class of finite-horizon continuous-time nonaffine nonlinear zero-sum game

International Journal of Innovative Computing, Information and Control

Volumn 7, Issue 2, 2011, Pages 597-608

  Zhang, Xin ^a,b   Zhang, Huaguang ^a,b   Wang, Xingyuan ^c   Luo, Yanhong ^a,b  

^a NORTHEASTERN UNIVERSITY   (China)

^b BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^c DALIAN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Approximation theory; Iteration algorithm; Nonaffine nonlinear system; Riccati equation; Zero sum game

Indexed keywords

CONTINUOUS TIME; ITERATION ALGORITHMS; LINEAR QUADRATIC; LINEAR TIME VARYING; LIPSCHITZ CONTINUITY; NON-AFFINE NONLINEAR SYSTEMS; NONAFFINE NONLINEAR SYSTEM; NUMERICAL EXAMPLE; OPTIMAL STRATEGIES; RICCATI DIFFERENTIAL EQUATION; STATE TRAJECTORY; ZERO-SUM GAME;

APPROXIMATION ALGORITHMS; APPROXIMATION THEORY; CONTINUOUS TIME SYSTEMS; CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS; NONLINEAR EQUATIONS; NONLINEAR SYSTEMS; OPTIMAL SYSTEMS; OPTIMIZATION; RICCATI EQUATIONS;

GAME THEORY;

EID: 79251509877     PISSN: 13494198     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. A. Al-Tamimi, M. Abu-Khalaf, F. L. Lewis, Adaptive critic designs for discrete-time zero-sum games with application to H-infinity control, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 37, no. 1, pp. 240-247, 2007.
2. A. Al-Tamimi, F. L. Lewis and M. Abu-Khalaf, Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control, Automatica, vol. 43, no. 3, pp. 473-481, 2007. (Pubitemid 46209050)
3. B. S. Chen, C. S. Tseng and H. J. Uang, Fuzzy differential games for nonlinear stochastic systems: Suboptimal approach, IEEE Transactions on Fuzzy Systems, vol. 10, no. 2, pp. 222-233, 2002.
4. Birkhauser, H-infinity Optimal Control and Related Minimax Design Problems: A Dynamical Game Approach, Boston, 1995.
5. D. S. Leslie and E. J. Collins, Individual Q-learning in normal form games, SIAM Journal on Control and Optimization, vol. 44, no. 2, pp. 495-514, 2005.
6. D. Jiang, S. Zhang, Realizability of expected Nash equilibria of n-person condition games under strong knowledge system, International Journal of Innovative Computing, Information Control, vol. 2, no. 4, pp. 761-770, 2006.
7. D. Jiang, Static, completely static, and rational games of complete information and their different Nash equilibria, International Journal of Innovative Computing, Information Control, vol. 4, no. 3, pp. 651-659, 2008.
8. D. Jiang, Strictly pure Nash equilibria and expected equilibria in a symmetrical 0-1 game and its dual game, ICIC Express Letters, vol. 3, no. 3(A), pp. 295-300, 2009.
9. F. Y. Wang, H. G. Zhang and D. R. Liu, Adaptive dynamic programming: An introduction, IEEE Computational Intelligence Magazine, pp. 39-47, 2009.
10. H. S. Chang and S. I. Marcus, Two-person zero-sum markov games: Receding horizon approach, IEEE Transactions on Automatic Control, vol. 48, no. 11, pp. 1951-1961, 2003.
11. H. G. Zhang, Q. L. Wei and Y. H. Luo, A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 38, no. 4, pp. 937-942, 2008.
12. H. G. Zhang, Y. H. Luo and D. R. Liu, Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints, IEEE Transactions on Neural Networks, vol. 20, no. 9, pp. 1490-503, 2009.
13. K. S. Hwnag, J. Y. Chiou and T. Y. Chen, Reinforcement learning in zero-sum markov games for robot soccer systems, 2004 IEEE International Conference on Networking, Sensing and Control, Taipei, pp. 1110-1114, 2004.
14. L. L. Cui, H. G. Zhang, B. Chen and Q. Q. Zhang, Asymptotic tracking control scheme for mechanical systems with external disturbances and friction, Neurocomputing, vol. 73, no. 7-9, pp. 1293-1302, 2010.
15. L. Zhu, P. Lu, Z. Jing, S. Hu, A new robust adaptive control scheme for non-affine nonlinear systems based on shlnn disturbance observer, International Journal of Innovative Computing, Information and Control, vol. 5, no. 6, pp. 1633-1642, 2009.
16. M. Abu-Khalaf, F. L. Lewis and J. Huang, Policy iterations on the Hamilton-Jacobi-Isaacs equation for H-infinity state feedback vontrol with input saturation, IEEE Transactions on Automatic Control, vol. 51, no. 12, pp. 1989-1995, 2006.
17. M. Abu-Khalaf, F. L. Lewis, J. Huang, Neurodynamic programming and zero-sum games for constrained control systems, IEEE Transactions on Neural Networks, vol. 19, no. 7, pp. 1243-1252, 2008.
18. M. Jimenez-Lizarraga, L. Fridman, Robust Nash strategies based on integral sliding mode control for a two players uncertain linear affine-quadratic game, International Journal of Innovative Computing, Information and Control, vol. 5, no. 2, pp. 241-252, 2009.
19. M. Jimenez-Lizarraga, M. Basin and M. A. Alcorta-Garcia, Equilibrium in linear quadratic stochastic games with unknown parameters, ICIC Express Letters, vol. 3, no. 2, pp. 107-114, 2009.
20. P. Zhang, Some results on two-person zero-sum linear quadratic differential games, SIAM Journal on Control and Optimization, vol. 43, no. 16, pp. 2157-2165, 2005. (Pubitemid 41641381)
21. Q. L. Wei, H. G. Zhang and D. R. Liu, A new approach to solve a class of continuous-time non-linear quadratic zero-sum game using ADP, IEEE International Conference on Networking, Sensing and Control, Sanya, China, pp. 507-512, 2008.
22. Q. L. Wei, H. G. Zhang and L. L. Cui, Data-based optimal control for discrete-time zero-sum games of 2-D systems using adaptive critic designs, ACTA Automatic Sinica, vol. 35, no. 6, pp. 682-692, 2009.
23. R. Laraki and E. Solan, The value of zero-sum stopping games in continuous time, SIAM Journal on Control and Optimization, vol. 43, no. 5, pp. 1913-1922, 2005.
24. R. Goebel, Convexity in zero-sum differential games, Proc. of the 41th IEEE Conference on Decision and Control, Las Vegas, NV, pp. 3964-3969, 2002.
25. S. P. Bank, D. McCaffrey, Lie algebras, structure of nonlinear systems and chaotic motion, International Journal of Bifurcation and Chaos, vol. 8, no. 7, pp. 1437-1462, 1998.
26. T. Cimen and S. P. Banks, Nonlinear optimal tracking control with application to super-tankers for autopilot design, Automatica, vol. 40, no. 10, pp. 1948-1862, 2004.
27. T. Cimen, S. P. Banks, Global optimal feedback control for general nonlinear systems with non-quadratic performance criteria, Systems and Control Letters, vol. 53, no. 5, pp. 328-346, 2005.
28. X. Hua, K. Mizukami, Linear-quadratic zero-sum differential games for generalized state space system, IEEE Transactions on Automatic Control, vol. 39, no. 1, pp. 143-147, 1994.