Multiperson zero-sum differential games for a class of uncertain nonlinear systems

International Journal of Adaptive Control and Signal Processing

Volumn 28, Issue 3-5, 2014, Pages 205-231

  Liu, Derong ^a   Wei, Qinglai ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Adaptive dynamic programming; Multiperson zero sum differential games; Neural networks; Uncertain nonlinear systems

Indexed keywords

CONTROL; DYNAMIC PROGRAMMING; GAME THEORY; NEURAL NETWORKS; NONLINEAR SYSTEMS; OPTIMAL SYSTEMS; STABILITY;

ADAPTIVE DYNAMIC PROGRAMMING; OPTIMAL CONTROL POLICY; OPTIMAL SOLUTIONS; PERFORMANCE INDICES; SIMULATION EXAMPLE; STABILITY PROPERTIES; UNCERTAIN NONLINEAR SYSTEMS; ZERO-SUM DIFFERENTIAL GAMES;

ITERATIVE METHODS;

EID: 84899122972     PISSN: 08906327     EISSN: 10991115     Source Type: Journal    
DOI: 10.1002/acs.2349     Document Type: Article

References (41)

1. Werbos PJ. Approximate dynamic programming for real-time control and neural modeling. In Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches, White DA, Sofge DA (eds). Van Nostrand Reinhold: New York, 1992. ch. 13.
2. Prokhorov DV, Wunsch DC. Adaptive critic designs. IEEE Transactions on Neural Networks 1997; 8 (5): 997-1007.
3. Murray JJ, Cox CJ, Lendaris GG, Saeks R. Adaptive dynamic programming. IEEE Transactions on Systems Man, and Cybernetics-Part C: Applications and Reviews 2002; 32 (2):140-153.
4. Wang FY, Zhang H, Liu D. Adaptive dynamic programming: an introduction. IEEE Computational Intelligence Magazine 2009; 4 (2):39-47.
5. Enns R, Si J. Helicopter trimming and tracking control using direct neural dynamic programming. IEEE Transactions on Neural Networks 2003; 14 (4):929-939.
6. Bertsekas DP, Tsitsiklis JN. Neuro-Dynamic Programming. Athena Scientific: MA, 1996.
7. Abu-Khalaf M, Lewis FL. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica 2005; 41 (5):779-791.
8. Vamvoudakis KG, Lewis FL. Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica 2010; 46 (5):878-888.
9. Wang D, Liu D, Wei Q. Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach. Neurocomputing 2012; 78 (1):14-22.
10. Zhang H, Wei Q, Liu D. An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games. Automatica 2011; 47 (1):207-214.
11. Zhang H, Wei Q, Luo Y. A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 2008; 38 (4):937-942.
12. Lewis FL, Vrabie D. Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Circuits and Systems Magazine 2009; 9 (3):32-50.
13. Wang FY, Jin N, Liu D, Wei Q. Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with-error bound. IEEE Transactions on Neural Networks 2011; 22 (1):24-36.
14. Beard R. Improving the Closed-Loop Performance of Nonlinear Systems. PhD thesis, Rensselaer Polytechnic Institute, Troy, New York, 1995.
15. Al-Tamimi A, Lewis FL. Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. Proceedings of the IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, Honululu, USA, 2007; 38-43.
16. He H, Ni Z, Fu J. A three-network architecture for on-line learning and optimization based on adaptive dynamic programming. Neurocomputing 2012; 78 (1):3-13.
17. Lewis FL, Vamvoudakis KG. Reinforcement learning for partially observable dynamic processes: adaptive dynamic programming using measured output data. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 2011; 41 (1):14-25.
18. Liu D, Zhang Y, Zhang H. A self-learning call admission control scheme for CDMA cellular networks. IEEE Transactions on Neural Networks 2005; 16 (5):1219-1228.
19. Vamvoudakis KG, Lewis FL. Multi-Player non zero sum games: online adaptive learning solution of coupled Hamilton-Jacobi equations. Automatica 2011; 47 (8):1556-1569.
20. Wei Q, Zhang H, Dai J. Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions. Neurocomputing 2009; 72 (7-9):1839-1848.
21. Zhang X, Zhang H, Sun Q, Luo Y. Adaptive dynamic programming-based optimal control of unknown nonaffine nonlinear discrete-time systems with proof of convergence. Neurocomputing 2012; 91 (15):48-55.
22. Jamshidi M. Large-Scale Systems-Modeling and Control. North-Holland: Amsterdam, the Netherlands, 1982.
23. Basar T, Olsder GJ. Dynamic Noncooperative Game Theory. Academic: New York, 1982.
24. Desouky SF, Schwartz HM. Q. (λ)-learning adaptive fuzzy logic controllers for pursuit-evasion differential games. International Journal of Adaptive Control and Signal Processing 2011; 5 (10):910-927.
25. Basar T, Bernhard P. H∞ Optimal Control and Related Minimax Design Problems. Birkhäuser Press: Boston, 1995.
26. Bertsekas DP. Convex analysis and optimization. Athena Scientific: Boston, MA, 2003.
27. Abu-Khalaf M, Lewis FL, Huang J. Policy iterations on the Hamilton-Jacobi-Isaacs equation for H∞ state feedback control with input saturation. IEEE Transactions on Automatic Control 2006; 51 (12):1989-1995.
28. Abu-Khalaf M, Lewis FL, Huang J. Neurodynamic programming and zero-sum games for constrained control systems. IEEE Transactions on Neural Networks 2008; 19 (7):1243-1252.
29. Al-Tamimi A, Lewis FL, Abu-Khalaf M. Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control. Automatica 2007; 43 (3):473-481.
30. Wei Q, Liu D, Nonlinear multi-person zero-sum differential games using iterative adaptive dynamic programming. The 30th Chinese Control Conference, Yantai, China, 2011; 2456-2461.
31. Petersen IR, Hollot CV. High gain observers applied to problems in the stabilization of uncertain linear systems, disturbance attenuation and N∞ optimization. International Journal of Adaptive Control and Signal Processing 1988; 2 (4):347-369.
32. Bardi M, Capuzzo-Dolcetta I. Optimal Control and Viscosity Solutions of Hamiilton-Jacobi-Bellman Equations. Birkhäuser: Boston, 1997.
33. Yong J. Dynamic Programming and Hamilton-Jacobi-Bellman Equation. Shanghai Science Press: Shanghai, 1991.
34. Gupta SK. Numerical Methods for Engineers. Wiley Eastern: New York, 1995.
35. Padhi R, Unnikrishnan N, Wang X, Balakrishman SN. A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems. Neural Networks 2006; 19 (10):1648-1660.
36. Marks IR. Introduction to Shannon Sampling and Interpolation Theory. Springer-Verlag: New York, 1991.
37. Hecht-Nielsen R. Theory of the backpropagation neural network. Proceedings of International Joint Conference on Neural Networks (IJCNN), Washington, DC, USA, 1989; 593-605.
38. Lippmann R. An introduction to computing with neural nets. IEEE Acoustics, Speech, and Signal Processing Magazine 1987; 4 (2):4-22.
39. Jagannathan S. Neural Network Control of Nonlinear Discrete-time Systems. CRC Press: Boca Raton, FL, 2006.
40. Si J, Wang YT. On-line learning control by association and reinforcement. IEEE Transactions on Neural Networks 2001; 12 (2):264-275.
41. Zhou K, Kang H. Neural Network Modelling and Matlab Simulations. Tsinghua University Press: Beijing, 2005.