Adaptive dynamic programming with stable value iteration algorithm for discrete-time nonlinear systems

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2012, Pages

  Wei, Qinglai ^a   Liu, Derong ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; DISCRETE-TIME NONLINEAR SYSTEMS; INFINITE HORIZONS; ITERATIVE CONTROL; OPTIMAL CONTROL POLICY; OPTIMAL CONTROL PROBLEM; PERFORMANCE INDICES; SIMULATION EXAMPLE; TRADITIONAL VALUES; VALUE ITERATION; VALUE ITERATION ALGORITHM;

DYNAMIC PROGRAMMING; NEURAL NETWORKS; NONLINEAR SYSTEMS; OPTIMAL CONTROL SYSTEMS;

ALGORITHMS;

EID: 84865095035     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2012.6252512     Document Type: Conference Paper

References (16)

1. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach," Automatica, vol. 41, no. 5, pp. 779-791, May 2005.
2. A. Al-Tamimi and F. L. Lewis, "Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof," in Proceedings of the IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, Honolulu, USA, Apr. 2007, pp. 38-43.
3. V. G. Boltyanskii, Optimal Control of Discrete Systems, New York, NY: John Wiley & Sons, 1978.
4. This book is a translation from Russian of Optimal'noe Upravlenie Diskretnymi Sistemami, Moscow: Izdatel'stvo Nauka, 1973.
5. R. E. Bellman, Dynamic Programming, Princeton, New Jersey: Princeton University Press, 1957.
6. R. Beard, Improving the Closed-Loop Performance of Nonlinear Systems, Ph.D thesis, Rensselaer Polytechnic Institute, Troy, NY, 1995.
7. F. L. Lewis and D. Vrabie, "Reinforcement learning and adaptive dynamic programming for feedback control," IEEE Circuits and Systems Magazine, vol. 9, no. 3, pp. 32-50, 2009.
8. X. Liao, L. Wang, and P. Yu, Stability of Dynamical Systems, Amsterdam: Elsevier Press, 2007.
9. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive dynamic programming," IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, vol.32, no.2, pp.140-153, May 2002.
10. F. Wang, N. Jin, D. Liu, and Q. Wei, "Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with ε-error bound," IEEE Transactions on Neural Networks, vol. 22, no. 1, pp. 24-36, Jan. 2011.
11. F. Y. Wang, H. Zhang, and D. Liu, "Adaptive dynamic programming: an introduction," IEEE Computational Intelligence Magazine, vol. 4, no. 2, pp. 39-47, 2009.
12. Q. L. Wei, H. G. Zhang, and J. Dai, "Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions," Neurocomputing, vol. 72, no. 7-9, pp. 1839-1848, 2009.
13. P. J. Werbos, "A menu of designs for reinforcement learning over time," in Neural Networks for Control, W.T. Miller, R.S. Sutton and P. J. Werbos, Ed., Cambridge: MIT Press, 1991, pp. 67-95.
14. H. Zhang, Y. Luo, and D. Liu, "The RBF neural network-based nearoptimal control for a class of discrete-time affine nonlinear systems with control constraint," IEEE Trans. Neural Networks, vol. 20, no. 9, pp. 1490-1503, Sep. 2009.
15. H. Zhang, Q. Wei, and D. Liu, "An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games," Automatica, vol. 47, no. 1, pp. 207-214, Jan. 2011.
16. H. Zhang, Q. Wei, and Y. Luo, "A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm," IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, vol. 38, no. 4, pp. 937-942, July 2008.