Concurrent learning-based approximate optimal Regulation

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2013, Pages 6256-6261

  Kamalapurkar, Rushikesh ^a   Walters, Patrick ^a   Dixon, Warren ^a  

^a UNIVERSITY OF FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ONLINE SYSTEMS; OPTIMAL CONTROL SYSTEMS;

DETERMINISTIC SYSTEMS; LYAPUNOV-BASED ANALYSIS; OPTIMAL CONTROL METHODS; OPTIMAL POLICIES; PARAMETRIC UNCERTAINTIES; PERSISTENCE OF EXCITATION; REGULATION PROBLEMS; UNIFORMLY ULTIMATELY BOUNDED;

HAMILTONIANS;

EID: 84902313433     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2013.6760878     Document Type: Conference Paper

References (23)

1. S. Bhasin, R. Kamalapurkar, M. Johnson, K. Vamvoudakis, F. L. Lewis, and W. Dixon, "A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems, " Automatica, vol. 49, no. 1, pp. 89-92, 2013.
2. K. Vamvoudakis and F. Lewis, "Online synchronous policy iteration method for optimal control, " in Recent Advances in Intelligent Control Systems. Springer, 2009, pp. 357-374.
3. K. Vamvoudakis and F. Lewis, "Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem, " Automatica, vol. 46, pp. 878-888, 2010.
4. D. Vrabie, M. Abu-Khalaf, F. Lewis, and Y. Wang, "Continuous-time ADP for linear systems with partially unknown dynamics, " in Proc. IEEE Int. Symp. Approx. Dyn. Program. Reinf. Learn., 2007, pp. 247- 253.
5. D. Vrabie and F. Lewis, "Neural network approach to continuoustime direct adaptive optimal control for partially unknown nonlinear systems, " Neural Netw., vol. 22, no. 3, pp. 237 - 246, 2009.
6. T. Dierks, B. Thumati, and S. Jagannathan, "Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence, " Neural Netw., vol. 22, no. 5-6, pp. 851-860, 2009.
7. T. Dierks and S. Jagannathan, "Optimal tracking control of affine nonlinear discrete-time systems with unknown internal dynamics, " in Proc. IEEE Conf. Decis. Control, 2009, pp. 6750-6755.
8. H. Zhang, L. Cui, X. Zhang, and Y. Luo, "Data-driven robust approx-imate optimal tracking control for unknown general nonlinear systems using adaptive dynamic programming method, " IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 2226-2236, 2011.
9. K. Doya, "Reinforcement learning in continuous time and space, " Neural Comput., vol. 12, no. 1, pp. 219-245, 2000.
10. A. AI-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Model-free gleaming designs for linear discrete-time zero-sum games with application to H(X) control, " Automatica, vol. 43, pp. 473-481, 2007.
11. A. AI-Tamimi, F. L. Lewis, and M. Abu-Khalaf "Discrete-time nonlinear HJB solution using approximate dynamic programming: Convergence proof, " IEEE Trans. Syst. Man Cybern. Part B Cybern., vol. 38, pp. 943-949, 2008.
12. R. Padhi, N. Unnikrishnan, X. Wang, and S. Balakrishnan, "A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems, " Neural Netw., vol. 19, no. 10, pp. 1648-1660, 2006.
13. P. Mehta and S. Meyn, "Q-learning and pontryagin's minimum principle, " in Proc. IEEE Conf Decis. Control, Dec. 2009, pp. 3598 -3605.
14. K. Narendra and A. Annaswamy, Stable Adaptive Systems. PrenticeHall, Inc., 1989.
15. P. Ioannou and J. Sun, Robust Adaptive Control. Prentice Hall, 1996.
16. G. Y. Chowdhary and E. N. Johnson, "Theory and flight-test validation of a concurrent-learning adaptive controller, " J. Guid. Contr. Dynam., vol. 34, no. 2, pp. 592-607, March 2011.
17. G. Chowdhary, T. Yucelen, M. Mlihlegg, and E. N. Johnson, "Concurrent learning adaptive control of linear systems with exponentially convergent bounds, " Int. J. Adapt Control Signal Process., 2012.
18. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
19. F. Lewis, K. Liu, and A. Yesildirek, "Neural net robot controller with guaranteed tracking performance, " in Proc. IEEE Int. Symp. Intell. Control, Chicago, Illinois, 1993, pp. 225-231.
20. K. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks, " IEEE Trans. Neural Networks, vol. 1, no. 1, pp. 4-27, 1990.
21. Y. Konda and J. TsitsikIis, "On actor-critic algorithms, " SIAM J. Contr. Optim., vol. 42, no. 4, pp. 1143-1166, 2004.
22. T. Dierks and S. Jagannathan, "Optimal control of affine nonlinear continuous-time systems, " in Proc. Am. Control Conf, 2010, pp. 1568- 1573.
23. H. K. Khalil, Nonlinear Systems, 3rd ed. Prentice Hall, 2002.