Optimality and convergence of adaptive optimal control by reinforcement synthesis

Automatica

Volumn 47, Issue 5, 2011, Pages 1047-1052

  Lin, Wei Song ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Adaptive optimal control; Convergence; Data based optimization; Reinforcement learning

Indexed keywords

ADAPTIVE OPTIMAL CONTROL; APPROXIMATE DYNAMIC PROGRAMMING; CONVERGENCE; CONVERGENCE CONDITIONS; DATA-BASED OPTIMIZATION; DUAL HEURISTIC DYNAMIC PROGRAMMING; LINEAR QUADRATIC REGULATOR PROBLEMS; MINIMUM PRINCIPLES; OPTIMAL CONTROL THEORY; OPTIMALITY; OPTIMALITY CONDITIONS; SEQUENTIAL OPTIMIZATION; SYNTHESIS ALGORITHMS;

ALGORITHMS; CONTROL; CONVERGENCE OF NUMERICAL METHODS; HEURISTIC PROGRAMMING; OPTIMIZATION; REINFORCEMENT; REINFORCEMENT LEARNING;

DYNAMIC PROGRAMMING;

EID: 79954867546     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2011.01.060     Document Type: Article

References (17)

1. A. Al-Tamimi, and F.L. Lewis Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38 4 2008 943 949
2. R. Bellman Dynamic programming 1957 Princeton University Press N.J., USA
3. S. Ferrari, and R.F. Stengel II Model-based adaptive critic designs Handbook of learning and approximate dynamic programming J. Si, A.G. Barto, W.B. Powell, D. Wunsch, IEEE Press series on Computational Intelligence 2004 65 92
4. R. Howard Dynamic programming and Markov processes 1960 MIT Press Cambridge, MA
5. B.C. Kuo Digital control systems 1992 Saunders College Publishing New York
6. F.L. Lewis Optimal control 1986 John Wiley and Sons Singapore
7. W.-S. Lin, and P.-C. Yang Adaptive critic motion control design of autonomous wheeled mobile robot by dual heuristic programming Automatica 44 11 2008 2716 2723
8. R. Padhi, and N. Unnikrishnan A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems Neural Networks 19 2006 1648 1660 (Pubitemid 44793175)
9. W.B. Powell Approximate dynamic programming: solving the curses of dimensionality 2008 Wiley
10. D. Prokhorov, and D. Wunsch Adaptive critic designs IEEE Transactions on Neural Networks 8 5 1997 997 1007 (Pubitemid 127763331)
11. Prokhorov, D., & Wunsch, D. (1997b). Convergence of critic-based training. In IEEE International Conference on Systems, Man, and Cybernetics.
12. Shannon, T.T. (1999). Partial, noisy and qualitative models for adap-tive critic based neuro-control. In International Conference on Neural Networks, Washington, D.C.
13. P. Werbos Approximate dynamic programming for real-time control and neural modeling White Sofge Handbook of Intelligent Control 1992 Van Nostrand Reinhold New York
14. P. Werbos ADP: goals, opportunities and principles IEEE Press series on Computational Intelligence 2004
15. Westerberg, A.W., & Stephanopoulos, G. (1974). A stronger version of the discrete minimum principle. Ind. Eng. Chem. Fundam. Published on May 1, 2002 on http://pubs.acs.org / doi:10.1021/i160051a013 13(3): 231237.
16. B. Widrow, and N. Gupta Punish/reward: learning with a critic in adaptive threshold systems IEEE Transactions on Systems, Man, and Cybernetics 3 5 1973 455 465
17. S.H. Zak Systems and control 2003 Oxford University Press New York