Near-optimal online control of uncertain nonlinear continuous-time systems based on concurrent learning

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2014, Pages 231-238

  Yang, Xiong ^a   Liu, Derong ^a   Wei, Qinglai ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLOSED LOOP SYSTEMS; CONCURRENCY CONTROL; E-LEARNING; NETWORK ARCHITECTURE; NEURAL NETWORKS; NONLINEAR SYSTEMS; ONLINE SYSTEMS; OPTIMAL CONTROL SYSTEMS;

NEAR-OPTIMAL CONTROL; NEURAL NETWORKS (NNS); NONLINEAR CONTINUOUS-TIME SYSTEMS; ON-LINE CONTROLS; OPTIMAL CONTROLS; PERSISTENCE OF EXCITATION; STABILIZING CONTROL; UNIFORM ULTIMATE BOUNDEDNESS;

CONTINUOUS TIME SYSTEMS;

EID: 84908495829     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2014.6889462     Document Type: Conference Paper

References (22)

1. F. L. Lewis, D. Vrabie, and V. L. Syrmos, Optimal Control (3rd edn.). New Jersey: John Wiley & Sons, Inc., 2012.
2. D. Liu and Q. Wei, "Finite-approximation-error-based optimal control approach for discrete-time nonlinear systems", IEEE Trans. Cybern., vol. 43, no. 2, pp. 779-789, Apr. 2013.
3. D. Liu, D. Wang, and X. Yang, "An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs", Inf. Sci., vol. 220, pp. 331-342, Jan. 2013.
4. X. Yang, D. Liu, and Q. Wei, "Neuro-optimal control of unknown nonaffine nonlinear systems with saturating actuators", in Proc. 3rd IFAC International Conference on Intelligent Control and Automation Science, Chengdu, China, 2013, pp. 569-574.
5. ∞ control", IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 12, pp. 1884-1895, Dec. 2012.
6. R. E. Bellman, Dynamic Programming. New Jersey: Princeton University Press, 1957.
7. P. J. Werbos, Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences. Ph. D. Dissertation, Harvard University, USA, 1974
8. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling", in Handbook of Intelligent Control. D. A. White and D. A. Sofge, Eds. Van Nostrand Reinhold, New York, 1992.
9. R. S. Sutton and A. G. Barto, Reinforcement Learning-An Introduction. Cambridge, MA: MIT Press, 1998.
10. F. L. Lewis, D. Vrabie, and K. G. Vamvoudakis, "Reinforcement learning and feedback control: Using natural decision methods to design optimal adaptive controllers", IEEE Control Syst. Mag., vol. 32, no. 6, pp. 76-105, Nov. 2012.
11. F. L. Lewis and D. Liu, Reinforcement Learning and Approximate Dynamic Programming for Feedback Control. Hoboken, New Jersey: Wiley, 2013.
12. X. Yang, D. Liu, and D. Wang, "Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints", Int. J. Control, vol. 87, no. 3, pp. 553-566, 2014.
13. D. Liu, X. Yang, and H. Li, "Adaptive optimal control for a class of continuous-time affine nonlinear systems with unknown internal dynamics", Neural Comput. Appl., vol. 23, no. 7-8, pp. 1843-1850, Dec. 2013.
14. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach", Automatica, vol. 41, no. 5, pp. 779-791, May 2005.
15. K. G. Vamvoudakis and F. L. Lewis, "Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem", Automatica, vol. 46, no. 5, pp. 878-888, May 2010.
16. S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis, F. L. Lewis, and W. E. Dixon, "A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems", Automatica, vol. 49, no. 1, pp. 82-92, Jan. 2013.
17. T. Dierks and S. Jagannathan, "Optimal control of affine nonlinear continuous-time systems", in Amer. Control Conf., Baltimore, MD, USA, 2010, pp. 1568-1573.
18. X. Yang, D. Liu, and Y. Huang, "Neural-network-based online optimal control for uncertain non-linear continuous-time systems with control constraints", IET Contr. Theory Appl., vol. 7, no. 17, pp. 2037-2047, Nov. 2013.
19. F. Abdollahi, H. A. Talebi, and R. V. Patel, "A stable neural networkbased observer with application to flexible-joint manipulators", IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 118-129, Jan. 2006.
20. K. Hornik, M. Stinchcombe, and H. White, "Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks", Neural Netw., vol. 3, no. 5, pp. 551-560, 1990.
21. F. L. Lewis, S. Jagannathan, and A. Yesildirek, Neural Network Control of Robot Manipulators and Nonlinear Systems. London: Taylor & Francis, 1999.
22. G. V. Chowdhary, Concurrent Learning for Convergence in Adaptive Control without Persistency of Excitation. Ph. D. Dissertation, Georgia Institute of Technology, USA, 2010.