Control of nonaffine nonlinear discrete-time systems using reinforcement-learning-based linearly parameterized neural networks

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 4, 2008, Pages 994-1001

  Yang, Qinmin ^a   Vance, Jonathan Blake ^a   Jagannathan, S ^a  

^a Architectural and Environmental Engineering   (United States)

Author keywords

Adaptive critic; Adaptive dynamic programming; Lyapunov stability; Neural network control; Reinforcement learning control

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPOSITE STRUCTURES; CONTINUOUS TIME SYSTEMS; CONTROL SYSTEMS; DIGITAL CONTROL SYSTEMS; DYNAMICS; EDUCATION; FEEDBACK CONTROL; LEARNING SYSTEMS; MATHEMATICAL PROGRAMMING; NEURAL NETWORKS; NONLINEAR SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; STANDARDS; SYSTEM STABILITY; SYSTEMS ENGINEERING; TELECOMMUNICATION NETWORKS; VEGETATION;

ACTOR-CRITIC; ADAPTIVE CRITIC; ADAPTIVE DYNAMIC PROGRAMMING; CLOSED-LOOP SYSTEMS; CONTROL SCHEMES; DISCRETE-TIME SYSTEMS; LINEARLY PARAMETERIZED NEURAL NETWORKS; LYAPUNOV APPROACH; LYAPUNOV STABILITY; NEURAL NETWORK (NN); NEURAL NETWORK CONTROL; NONLINEAR AUTOREGRESSIVE MOVING AVERAGE WITH EXOGENOUS INPUT; NONLINEAR DISCRETE-TIME SYSTEMS; OPTIMAL CONTROL; PARAMETERIZED; REINFORCEMENT LEARNING CONTROL; SIMULATION RESULTS; SYSTEM DYNAMICS; TRACKING ERROR DYNAMICS;

DISCRETE TIME CONTROL SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; FEEDBACK SYSTEM; NONLINEAR SYSTEM; REINFORCEMENT; SIGNAL PROCESSING; SYSTEM ANALYSIS; THEORETICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; FEEDBACK; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PROGRAMMING, LINEAR; REINFORCEMENT (PSYCHOLOGY); SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 49049091364     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.926607     Document Type: Article

References (12)

1. M. Krstic, I. Kanellakopoulos, and P. Kokotovic, Nonlinear and Adaptive Control Design. New York: Wiley, 1995.
2. S. Jagannathan, Neural Network Control of Nonlinear Discrete-time Systems. Boca Raton, FL: Taylor & Francis, 2006.
3. D. Prokhorov and D. Wunsch, "Adaptive critic designs," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 997-1007, Sep. 1997.
4. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 264-276, Mar. 2001.
5. Q. Yang and S. Jagannathan, "Online reinforcement learning-based neural network controller design for affine nonlinear discrete-time systems," in Proc. Amer. Control Conf., 2007, pp. 4774-4779.
6. P. J. Werbos, "A menu of designs for reinforcement learning over time," in Neural Networks for Control, W. T. Miller, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA: MIT Press, 1990, ch. 3.
7. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive dynamic programming," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev. vol. 32, no. 2, pp. 140-153, May 2002.
8. M. T. Rosenstein and A. G. Barto, "Supervised actor-critic reinforcement learning," in Handbook of Learning and Approximate Dynamic Programming, J. Si, A. G. Barto, W. B. Powell, and D. Wunsch, Eds. Piscataway, NJ: IEEE Press, 2004, pp. 359-377.
9. D. P. Bertsekas, Dynamic Programming and Optimal Control. Belmont. Belmont, MA: Athena Scientific, 2000.
10. O. Adetona, S. Sathananthan, and L. H. Keel, "Robust adaptive control of nonaffine nonlinear plants with small input signal changes," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 408-416, Mar. 2004.
11. M. S. Ahmed, "Neural-net-based direct adaptive control for a class of nonlinear plants," IEEE Trans. Autom. Control, vol. 45, no. 1, pp. 119-124, Jan. 2000.
12. B. Igelnik and Y. H. Pao, "Stochastic choice of basis functions in adaptive function approximation and the functional-link net," IEEE Trans. Neural Netw., vol. 6, no. 6, pp. 1320-1329, Nov. 1995.