Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2007, Pages 5942-5947

  Yang, Qinmin ^a   Jagannathan, S ^a  

^a Missouri University of Science and Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COST FUNCTIONS; DISCRETE EVENT SIMULATION; DYNAMICAL SYSTEMS; NEURAL NETWORKS; ONLINE SYSTEMS; REINFORCEMENT LEARNING;

NONLINEAR FUNCTIONS; TRACKING ERROR DYNAMICS; UNIFORMLY ULTIMATE BOUNDEDNESS (UUB);

NONLINEAR SYSTEMS;

EID: 62749083865     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2007.4434959     Document Type: Conference Paper

References (12)

1. S. A. Billings and W. S. F. Voon, "A prediction-error and stepwise regression algorithm for nonlinear systems," in International Journal of Control 44, pp. 803-822, 1986.
2. O. Adetona, E. Garcia, and L. H. Keel, "A new method for the control of discrete nonlinear dynamic systems using neural networks," IEEE Trans. Neural Networks, vol. 11, pp. 102-112, Jan. 2000.
3. O. Adetona, S. Sathananthan, and L. H. Keel, "Robust adaptive control of nonaffine nonlinear plants with small input signal changes," IEEE Trans. Neural Networks, vol. 15, pp. 408-416, Mar. 2004.
4. J. Si, A. G. Barto, W. B. Powell, and D. Wunsch, Eds., "Handbook of Learning and App. Dynamic Programming", Wiley-IEEE Press, 2004.
5. D. Prokhorov and D. Wunsch, "Adaptive critic designs", IEEE Trans. Neural Networks, Vol. 8, No.5, p.997-1007, 1997.
6. P. J. Werbos, "Building and understanding adaptive systems: A statistical/numerical approach to factory automation and brain research," IEEE Transactions on Systems, Man, and Cybernetics 17, pp. 7-20, 1987.
7. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Networks, vol. 12, no. 2, pp. 264-276, Mar.2001.
8. Qinmin Yang and S. Jagannathan, "Online reinforcement learning-based neural network controller design for affine nonlinear discrete-time systems", Proc. of American Control Conference, 2007.
9. M. S. Ahmed, "Neural-net-based direct adaptive control for a class of nonlinear plants," IEEE Trans. On Automatic Control, vol. 45, pp. 119-124, 2000.
10. D. P. Bertsekas, "Dynamic Programming and Optimal Control. Belmont," MA: Athena Scientific, 2000.
11. B. Igelnik and Y. H. Pao, "Stochastic choice of basis functions in adaptive function approximation and the functional-link net," IEEE Trans. Neural Network, vol. 6, no. 6, pp. 1320-1329, Nov. 1995.
12. S. Jagannathan, "Neural Network Control of Nonlinear Discrete-time Systems", Taylor and Francis (CRC Press), Boca Raton, FL 2006.