An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs

Information Sciences

Volumn 220, Issue , 2013, Pages 331-342

  Liu, Derong ^a   Wang, Ding ^a   Yang, Xiong ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Adaptive dynamic programming; Approximate dynamic programming; Control constraints; Globalized dual heuristic programming; Neural networks; Optimal control

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; APPROXIMATE DYNAMIC PROGRAMMING; CONTROL CONSTRAINT; DUAL HEURISTIC PROGRAMMING; OPTIMAL CONTROLS;

ALGORITHMS; CONTROL; DYNAMIC PROGRAMMING; DYNAMICAL SYSTEMS; HEURISTIC PROGRAMMING; NEURAL NETWORKS; NONLINEAR SYSTEMS; OPTIMAL CONTROL SYSTEMS;

ITERATIVE METHODS;

EID: 84868467610     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.07.006     Document Type: Conference Paper

References (37)

1. M. Abu-Khalaf, and F.L. Lewis Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach Automatica 41 2005 779 791
2. A. Al-Tamimi, F.L. Lewis, and M. Abu-Khalaf Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 38 2008 943 949
3. R.A. Aliev, W. Pedrycz, B.G. Guirimov, R.R. Aliev, U. Ilhan, M. Babagil, and S. Mammadli Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization Information Sciences 181 2011 1591 1608
4. R.E. Bellman Dynamic Programming 1957 Princeton University Press Princeton, NJ
5. D.P. Bertsekas, and J.N. Tsitsiklis Neuro-Dynamic Programming 1996 Athena Scientific Belmont, MA
6. D.P. Bertsekas Temporal difference methods for general projected equations IEEE Transactions on Automatic Control 56 2011 2128 2139
7. M.C. Campi, and S.M. Savaresi Direct nonlinear control design: the virtual reference feedback tuning (VRFT) approach IEEE Transactions on Automatic Control 51 2006 14 27
8. J.I. Canelon, L.S. Shieh, and N.B. Karayiannis A new approach for neural control of nonlinear discrete dynamic systems Information Sciences 174 2005 177 196
9. T. Dierks, B.T. Thumati, and S. Jagannathan Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence Neural Networks 22 2009 851 860
10. J. Ding, and S.N. Balakrishnan Approximate dynamic programming solutions with a single network adaptive critic for a class of nonlinear systems Journal of Control Theory and Applications 9 2011 370 380
11. H. Huang, H. Qin, Z. Hao, and A. Lim Example-based learning particle swarm optimization for continuous optimization Information Sciences 182 2012 125 138
12. K.S. Hwang, H.Y. Lin, Y.P. Hsu, and H.H. Yu Self-organizing state aggregation for architecture design of Q-learning Information Sciences 181 2011 2813 2822
13. S. Jagannathan Neural Network Control of Nonlinear Discrete-Time Systems 2006 CRC Press Boca Raton, FL
14. ∞ control design for unknown linear discrete-time systems via Q-learning with LMI Automatica 46 2010 1320 1326
15. A.U. Levin, and K.S. Narendra Control of nonlinear dynamical systems using neural networks: controllability and stabilization IEEE Transactions on Neural Networks 4 1993 192 206
16. F.L. Lewis, and V.L. Syrmos Optimal Control 1995 Wiley New York
17. F.L. Lewis, and D. Vrabie Reinforcement learning and adaptive dynamic programming for feedback control IEEE Circuits and Systems Magazine 9 2009 32 50
18. C.K. Lin Robust adaptive critic control of nonlinear systems using fuzzy basis function networks: an LMI approach Information Sciences 177 2007 4934 4946
19. Z. Man, K. Lee, D. Wang, Z. Cao, and C. Miao A new robust training algorithm for a class of single-hidden layer feedforward neural networks Neurocomputing 74 2011 2491 2501
20. S. Preitl, R.E. Precup, J. Fodor, and B. Bede Iterative feedback tuning in fuzzy control systems: theory and applications Acta Polytechnica Hungarica 3 2006 81 96
21. D.V. Prokhorov, and D.C. Wunsch Adaptive critic designs IEEE Transactions on Neural Networks 8 1997 997 1007
22. M.B. Radac, R.E. Precup, E.M. Petriu, and S. Preitl Application of IFT and SPSA to servo system control IEEE Transactions on Neural Networks 22 2011 2363 2375
23. J. Si, and Y.T. Wang On-line learning control by association and reinforcement IEEE Transactions on Neural Networks 12 2001 264 276
24. J. Si, A.G. Barto, W.B. Powell, and D.C. Wunsch Handbook of Learning and Approximate Dynamic Programming 2004 IEEE Press Wiley New York
25. K.G. Vamvoudakis, and F.L. Lewis Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem Automatica 46 2010 878 888
26. G.K. Venayagamoorthy, R.G. Harley, and D.C. Wunsch Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator IEEE Transactions on Neural Networks 13 2002 764 773
27. D. Vrabie, and F.L. Lewis Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems Neural Networks 22 2009 237 246
28. D. Wang, D. Liu, Optimal control for a class of unknown nonlinear systems via the iterative GDHP algorithm, in: Proceedings of 8th International Symposium on Neural Networks, Guilin, China, 2011, pp. 630-639.
29. D. Wang, D. Liu, Q. Wei, Adaptive dynamic programming for finite-horizon optimal tracking control of a class of nonlinear systems, in: Proceedings of the 30th Chinese Control Conference, Yantai, China, 2011, pp. 2450-2455.
30. F.Y. Wang, H. Zhang, and D. Liu Adaptive dynamic programming: an introduction IEEE Computational Intelligence Magazine 4 2009 39 47
31. F.Y. Wang, N. Jin, D. Liu, and Q. Wei Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with -error bound IEEE Transactions on Neural Networks 22 2011 24 36
32. X.S. Wang, Y.H. Cheng, and J.Q. Yi A fuzzy actor-critic reinforcement learning network Information Sciences 177 2007 3764 3781
33. P.J. Werbos Advanced forecasting methods for global crisis warning and models of intelligence General Systems Yearbook 22 1977 25 38
34. P.J. Werbos Approximate dynamic programming for real-time control and neural modeling D.A. White, D.A. Sofge, Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches 1992 Van Nostrand Reinhold New York
35. W. Wu, L. Li, J. Yang, and Y. Liu A modified gradient-based neuro-fuzzy learning algorithm and its convergence Information Sciences 180 2010 1630 1642
36. H. Zhang, Y. Luo, and D. Liu Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints IEEE Transactions on Neural Networks 20 2009 1490 1503
37. R. Zhang, Z.B. Xu, G.B. Huang, and D. Wang Global convergence of online BP training with dynamic learning rate IEEE Transactions on Neural Networks and Learning Systems 23 2012 330 341