Zero-sum two-player game theoretic formulation of affine nonlinear discrete-time systems using neural networks

IEEE Transactions on Cybernetics

Volumn 43, Issue 6, 2013, Pages 1641-1655

  Mehraeen, Shahab ^a   Dierks, Travis ^b   Jagannathan, S ^c   Crow, Mariesa L ^c  

^a LOUISIANA STATE UNIVERSITY   (United States)

^b DRS Sustainment Systems Inc   (United States)

^c University of Missouri Rolla   (United States)

Author keywords

Hamilton Jacobi Isaacs (HJI); neural networks (NNs); nonlinear discrete time (DT) systems; optimal control

Indexed keywords

AFFINE NONLINEAR CONTROL SYSTEM; HAMILTON-JACOBI-ISAACS; NEURAL NETWORKS (NNS); NONLINEAR AFFINE SYSTEM; NONLINEAR DISCRETE-TIME; NONLINEAR DISCRETE-TIME SYSTEMS; OPTIMAL CONTROLS; SUCCESSIVE APPROXIMATION APPROACH;

CONTROL; DIGITAL CONTROL SYSTEMS; NEURAL NETWORKS; NONLINEAR CONTROL SYSTEMS;

DISCRETE TIME CONTROL SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; FEEDBACK SYSTEM; GAME; HUMAN; NONLINEAR SYSTEM; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; FEEDBACK; GAME THEORY; HUMANS; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 84890058601     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2227253     Document Type: Article

References (28)

1. S. Jagannathan, Neural Network Control of Nonlinear Discrete-Time Systems. Boca Raton, FL: CRC Press, 2006.
2. W. Lin and C. I. Byrnes, "H∞ control of discrete-time nonlinear systems," IEEE Trans. Autom. Control, vol. 41, no. 4, pp. 494-510, Apr. 1996.
3. J. H. Doyle, K. Glover, P. Khargonekar, and B. Francis, "State-space solutions to standardH2 andH∞ control problems," IEEE Trans. Autom. Control, vol. 34, no. 8, pp. 831-847, Aug. 1989.
4. T. Basar and P. Bernard, H∞ Optimal Control and Related Minimax Design Problems. Cambridge, MA: Birkhäuser, 1995.
5. J. C. Willems, "Dissipative dynamical systems Part I: General theory," Arch. Rational Mech. Anal., vol. 45, no. 1, pp. 321-351, Jan. 1972.
6. A. J. Van Der Schaft, "L2-gain analysis of nonlinear systems and nonlinear state feedback H∞ control," IEEE Trans. Autom. Control, vol. 37, no. 6, pp. 770-784, Jun. 1992.
7. J. Huang and C. F. Lin, "Numerical approach to computing nonlinear H∞ control laws," J. Guid. Control Dyn., vol. 18, no. 5, pp. 989-994, Sep./Oct. 1995.
8. J. Huang, "An algorithm to solve the discrete HJI equation arising in the L2 gain optimization problem," Int. J. Control, vol. 72, no. 1, pp. 49-57, 1999.
9. M. Abu-Khalaf, J. Huang, and F. Lewis, Nonlinear H2/H∞ Constrained Feedback Control. London, U.K.: Springer-Verlag, 2006.
10. R. W. Beard and T. W. McLain, "Successive Galerkin approximation algorithms for nonlinear optimal and robust control," Int. J. Control, vol. 71, no. 5, pp. 717-743, 1998. (Pubitemid 128552979)
11. M. Abu-Khalaf, F. L. Lewis, and J. Huang, "Neural network H∞ state feedback control with actuator saturation: The nonlinear benchmark problem," in Proc. ICC, 2005, pp. 1-9. (Pubitemid 41651486)
12. B. Anderson, Y. Feng, and W. Chen, "A game theoretic algorithm to solve Riccati and Hamilton-Jacobi-Bellman-Isaacs (HJBI) equations in H infinity control," in Optimization and Optimal Control; Theory and Applications. New York: Springer-Verlag, pp. 277-308.
13. M. Johnson, S. Bhasin, andW. E. Dixon, "Nonlinear two-player zero-sum game approximate solution using a policy iteration algorithm," in Proc. IEEE Conf. Decision Control, Orlando, FL, 2011, pp. 142-147.
14. K. G. Vamvoudakis and F. L. Lewis, "Online solution of nonlinear twoplayer zero-sum games using synchronous policy iteration," in Proc. 49th IEEE Conf. Decision Control, 2010, pp. 3040-3047.
15. Z. Chen and S. Jagannathan, "Generalized Hamilton-Jacobi-Bellman formulation-based neural network control of affine nonlinear discretetime systems," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 90-106, Jan. 2008. (Pubitemid 351279228)
16. A. Al Tamimi, F. L. Lewis, and M. Abu Khalaf, "Discrete-time- nonlinear HJB solution using approximate dynamic programming," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 943-949, Aug. 2008.
17. H. Zhang, Y. Luo, and D. Liu, "Neural network based near optimal control for a class of discrete-time affine nonlinear systems with control constraints," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1490-1503, Sep. 2009.
18. H. G. Zhang, Q. L. Wei, and Y. H. Luo, "A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 937-942, Aug. 2008.
19. A. Al Tamimi, M. Abu Khalaf, and F. L. Lewis, "Model-free Q-learning designs for discrete-time zero-sum games with application to H∞ control," Automatica, vol. 43, no. 3, pp. 473-481, Mar. 2007. (Pubitemid 46209050)
20. C. A. Desoer and M. Vidyasagar, Feedback Systems: Input-Output Properties. New York: Academic, 1975.
21. J. A. Ball and J. W. Helton, "Nonlinear H∞ control theory for stable plants," Math. Control Signals Syst., vol. 5, pp. 233-261, 1992.
22. G. Bianchini, R. Genesio, A. Parenti, and A. Tesi, "GlobalH∞ controllers for a class of nonlinear systems," IEEE Trans. Autom. Control, vol. 49, no. 2, pp. 244-249, Feb. 2004.
23. M. Abu-Khalaf, F. L. Lewis, and J. Huang, "Policy iterations on the Hamilton-Jacobi-Isaacs equation for H∞ state feedback control with input saturation," IEEE Trans. Autom. Control, vol. 51, no. 12, pp. 1989-1995, Dec. 2006. (Pubitemid 46002295)
24. F. L. Lewis and V. L. Syrmos, Optimal Control. New York:Wiley, 1995.
25. B. A. Finlayson, The Method of Weighted Residuals and Variational Principles. New York: Academic, 1972.
26. A. A. Al-Tamimi, "Discrete-time control algorithms and adaptive intelligent system designs," Ph.D. dissertation, Univ. Texas, Arlington, TX, 2007.
27. A. Al-Tamimi, D. Vrabie, M. Abu-Khalaf, and F. L. Lewis, "Modelfree approximate dynamic programming schemes for linear systems," in Proc. IJCNN, Aug. 12-17, 2007, pp. 371-378.
28. F. L. Lewis, S. Jagannathan, and A. Yesildirek, Neural Network Control of Robot Manipulators and Nonlinear Systems. New York: Taylor & Francis, 1999.