Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

Automatica

Volumn 48, Issue 8, 2012, Pages 1825-1832

  Wang, Ding ^a   Liu, Derong ^a   Wei, Qinglai ^a   Zhao, Dongbin ^a   Jin, Ning ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b 1120 Science and Engineering Offices   (United States)

Author keywords

Adaptive critic designs; Adaptive dynamic programming; Approximate dynamic programming; Globalized dual heuristic programming; Intelligent control; Neural network; Optimal control

Indexed keywords

ADAPTIVE CRITIC DESIGNS; ADAPTIVE DYNAMIC PROGRAMMING; APPROXIMATE DYNAMIC PROGRAMMING; DUAL HEURISTIC PROGRAMMING; OPTIMAL CONTROLS;

ADAPTIVE ALGORITHMS; CONTROL; COST FUNCTIONS; DIGITAL CONTROL SYSTEMS; DYNAMIC PROGRAMMING; HEURISTIC PROGRAMMING; INTELLIGENT CONTROL; NEURAL NETWORKS; OPTIMAL CONTROL SYSTEMS;

DISCRETE TIME CONTROL SYSTEMS;

EID: 84864489666     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2012.05.049     Document Type: Article

References (29)

1. M. Abu-Khalaf, and F.L. Lewis Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach Automatica 41 5 2005 779 791
2. A. Al-Tamimi, F.L. Lewis, and M. Abu-Khalaf Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof IEEE Transactions on Systems, Man, and Cybernetics Part B: Cybernetics 38 4 2008 943 949
3. S.N. Balakrishnan, and V. Biega Adaptive-critic based neural networks for aircraft optimal control Journal of Guidance, Control, and Dynamics 19 4 1996 893 898
4. S.N. Balakrishnan, J. Ding, and F.L. Lewis Issues on stability of ADP feedback controllers for dynamic systems IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 38 4 2008 913 917
5. R.W. Beard, G.N. Saridis, and J.T. Wen Galerkin approximation of the generalized Hamilton-Jacobi-Bellman equation Automatica 33 12 1997 2159 2177
6. R.E. Bellman Dynamic programming 1957 Princeton University Press Princeton, NJ
7. D.P. Bertsekas, and J.N. Tsitsiklis Neuro-dynamic programming 1996 Athena Scientific Belmont, MA
8. Y. Chen, T. Edgar, and V. Manousiouthakis On infinite-time nonlinear quadratic optimal control Systems & Control Letters 51 3-4 2004 259 268
9. T. Dierks, B.T. Thumati, and S. Jagannathan Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence Neural Networks 22 5-6 2009 851 860
10. S. Jagannathan Neural network control of nonlinear discrete-time systems 2006 CRC Press Boca Raton, FL
11. S. Jagannathan, and P. He Neural-network-based state feedback control of a nonlinear discrete-time system in nonstrict feedback form IEEE Transactions on Neural Networks 19 12 2008 2073 2087
12. F.L. Lewis, and D. Vrabie Reinforcement learning and adaptive dynamic programming for feedback control IEEE Circuits and Systems Magazine 9 3 2009 32 50
13. Liu, D., & Jin, N. (2008). ε-adaptive dynamic programming for discrete-time systems. In Proceedings of the international joint conference on neural networks (pp. 1417-1424).
14. J.J. Murray, C.J. Cox, G.G. Lendaris, and R. Saeks Adaptive dynamic programming IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews 32 2 2002 140 153
15. J.A. Primbs, V. Nevistic, and J.C. Doyle A receding horizon generalization of pointwise min-norm controllers IEEE Transactions on Automatic Control 45 5 2000 898 909
16. D.V. Prokhorov, and D.C. Wunsch Adaptive critic designs IEEE Transactions on Neural Networks 8 5 1997 997 1007
17. J. Si, and Y.T. Wang On-line learning control by association and reinforcement IEEE Transactions on Neural Networks 12 2 2001 264 276
18. K.G. Vamvoudakis, and F.L. Lewis Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem Automatica 46 5 2010 878 888
19. G.K. Venayagamoorthy, R.G. Harley, and D.C. Wunsch Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator IEEE Transactions on Neural Networks 13 3 2002 764 773
20. Venayagamoorthy, G. K., Wunsch, D. C., & Harley, R. G. (2000). Adaptive critic based neurocontroller for turbogenerators with global dual heuristic programming. In Proceedings of the IEEE PES winter meeting (pp. 291-294).
21. D. Vrabie, and F.L. Lewis Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems Neural Networks 22 3 2009 237 246
22. F.Y. Wang, H. Zhang, and D. Liu Adaptive dynamic programming: an introduction IEEE Computational Intelligence Magazine 4 2 2009 39 47
23. C. Watkins, and P. Dayan Q-learning Machine Learning 8 3-4 1992 279 292
24. P.J. Werbos Approximate dynamic programming for real-time control and neural modeling D.A. White, D.A. Sofge, Handbook of intelligent control: neural, fuzzy, and adaptive approaches 1992 Van Nostrand Reinhold New York
25. P.J. Werbos ADP: the key direction for future research in intelligent control and understanding brain intelligence IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics 38 4 2008 898 900
26. P.J. Werbos Intelligence in the brain: a theory of how it works and how to build it Neural Networks 22 3 2009 200 212
27. G.G. Yen, and P.G. Delima Improving the performance of globalized dual heuristic programming for fault tolerant control through an online learning supervisor IEEE Transactions on Automation Science and Engineering 2 2 2005 121 131
28. H. Zhang, Y. Luo, and D. Liu Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints IEEE Transactions on Neural Networks 20 9 2009 1490 1503
29. H. Zhang, Q. Wei, and D. Liu An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games Automatica 47 1 2011 207 214