Online reinforcement learning-based neural network controller design for affine nonlinear discrete-time systems

Proceedings of the American Control Conference

Volumn , Issue , 2007, Pages 4774-4779

  Qinmin, Yang ^a   Jagannathan, S ^a  

^a Architectural and Environmental Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; CELLULAR RADIO SYSTEMS; CONTINUOUS TIME SYSTEMS; CONTROL EQUIPMENT; DIGITAL CONTROL SYSTEMS; DISCRETE TIME CONTROL SYSTEMS; EDUCATION; ERROR ANALYSIS; FUNCTION EVALUATION; IMAGE CLASSIFICATION; INTERNET; NEURAL NETWORKS; ONLINE SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; WEIGHING;

ACTION NETWORK; ADAPTIVE CRITIC DESIGNS (ADCS); ADAPTIVE CRITICS; BELLMAN EQUATIONS; BOUNDED DISTURBANCES; CONTROL SIGNALLING; GENERAL (CO); MULTI-INPUT AND MULTI-OUTPUT (MIMO); NEURAL NETWORK CONTROLLERS; NONLINEAR DISCRETE-TIME SYSTEMS; ON LINE LEARNING; OPTIMAL COSTS; OPTIMAL SOLUTIONS; REINFORCEMENT LEARNING NEURAL NETWORK; SYSTEM TRAJECTORIES; TRACKING ERRORS; TWO-LINK; UNIFORMLY ULTIMATE BOUNDEDNESS (UUB);

ADAPTIVE CONTROL SYSTEMS;

EID: 46449134925     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACC.2007.4282709     Document Type: Conference Paper

References (15)

1. R. Bellman and S. Dreyfus, "Applied Dynamic Programming," Princeton, NJ: Princeton Univ. Press, 1962.
2. D. Kirk, Optimal Control Theory: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1970.
3. R. Luus, "Iterative Dynamic Programming", CRC Press, Boca Raton, FL, 2000.
4. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuron like adaptive elements that can solve difficult learning control problems," IEEE Trans. Syst., Man, Cybern., vol. 13, pp. 834-847, 1983.
5. R. S. Sutton and A. G. Barto, "Reinforcement Learning: An Introduction", the MIT Press, Cambridge, MA, 1998.
6. G. Boone, "Efficient reinforcement learning: Model-based acrobot control." in Proc. of IEEE Int. Conf. on Robotics and Automation, pp. 229 - 234, Albuquerque, NM, 1997.
7. J. Si, A. G. Barto, W. B. Powell, and D. Wunsch, Eds., "Handbook of Learning and Approximate Dynamic Programming", Wiley-IEEE Press, 2004.
8. D. Prokhorov and D. Wunsch, "Adaptive critic designs", IEEE Trans. Neural Networks, Vol. 8, No.5, p.997-1007, 1997.
9. W. T. Miller, R. S. Sutton, and P. J. Werbos, Eds., "Neural Networks for Control", Cambridge, MA, MIT Press, 1990.
10. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Networks, vol. 12, no. 2, pp. 264-276, Mar.2001.
11. P. He and S. Jagannathan, "Reinforcement learning-based output feedback control of nonlinear systems with input constraints", IEEE Trans. Syst., Man, Cybern., vol. 35, pp. 150-154, 2005.
12. Y. Kim and F.L. Lewis, "Optimal design of CMAC neural network controller for Robot Manipulators," IEEE Trans. Systems, Man, and Cybernetics, vol. 30, no. 1, pp. 22-31, Feb 2000.
13. S. Jagannathan, "Neural Network Control of Nonlinear Discrete-time Systems," Taylor & Francis, FL, 2007.
14. D. P. Bertsekas, "Dynamic Programming and Optimal Control. Belmont," MA: Athena Scientific, 2000.
15. B. Igelnik and Y. H. Pao, "Stochastic choice of basis functions in adaptive function approximation and the functional-link net," IEEE Trans. Neural Network, vol. 6, no. 6, pp. 1320-1329, Nov. 1995.