Constrained adaptive optimal control using a reinforcement learning agent

Automatica

Volumn 48, Issue 10, 2012, Pages 2614-2619

  Lin, Wei Song ^a,b   Zheng, Chen Hong ^b  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Adaptive optimal control; Approximate dynamic programming; Constrained optimization; Reinforcement learning

Indexed keywords

ADAPTATION RULES; ADAPTIVE OPTIMAL CONTROL; APPROXIMATE DYNAMIC PROGRAMMING; CONTROL ENGINEERS; CONTROL STRATEGIES; CONVERGENCE AND STABILITY; INEQUALITY CONSTRAINT; INFINITE HORIZONS; OPTIMAL CONTROL STRATEGY; OPTIMALITY CONDITIONS; OPTIMIZATION PROCEDURES; PONTRYAGIN'S MINIMUM PRINCIPLES; QUADRATIC REGULATORS; REAL WORLD ENVIRONMENTS; REINFORCEMENT LEARNING AGENT;

CONSTRAINED OPTIMIZATION; CONTROL;

REINFORCEMENT LEARNING;

EID: 84865457158     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2012.06.064     Document Type: Article

References (15)

1. R. Bellman Dynamic programming 1957 Princeton University Press NJ, USA
2. S. Haykin Neural networks and learning machines 3rd ed. 2009 Pearson Hong Kong
3. C.H. Houpis, and G.B. Lamont Digital control systems: theory, hardware, software 2nd ed. 1992 McGraw-Hill NewYork
4. B.C. Kuo Digital control systems 1992 Saunders College Publishing New York (Chapter 11)
5. F.L. Lewis, and D. Vrabie Reinforcement learning and adaptive dynamic programming for feedback control IEEE Circuits and Systems Magazine 9 2009 32 50
6. W.-S. Lin Optimality and convergence of adaptive optimal control by reinforcement synthesis Automatica 47 2011 1047 1052 http://dx.doi.org/doi:1010. 1016/j.automatica.2011.1001.1060
7. W.-S. Lin, and J.-W. Sheu Optimization of train regulation and energy usage of metro lines using an adaptive-optimal-control algorithm IEEE Transactions on Automation Science and Engineering 8 4 2011 855 864
8. W.-S. Lin, and C.-H. Zheng Energy management of fuel cell/ultracapacitor hybrid power system using an adaptive optimal-control method Journal of Power Sources 196 2011 3280 3289
9. Pontryagin, L. S.; & Boltyanskii, V. G. et al. (1962). The mathematical theory of optimal processes vol. 4: translation of a Russian book. ISBN: 2881240771.
10. W.B. Powell Approximate dynamic programming: solving the curses of dimensionality 2008 Wiley
11. D. Prokhorov, and D. Wunsch Adaptive critic designs IEEE Transactions on Neural Networks 8 2 1997 997 1007
12. S.S. Rao Engineering optimization theory and practice 4th ed. 2009 John Wiley & Sons
13. R.S. Sutton, and A. Sutton Reinforcement learning: an introduction 1998 MIT Press Cambridge, MA
14. P. Werbos Approximate dynamic programming for real-time control and neural modeling White Sofge Handbook of intelligent control 1992 Van Nostrand Rein-hold New York
15. A.Q. Xing Applications of the penalty function method in constrained optimal control problems Journal of Applied Mathematics and Simulation 2 4 1989 251 265