Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming

Neurocomputing

Volumn 73, Issue 16-18, 2010, Pages 3020-3027

  Song, Ruizhuo ^a   Zhang, Huaguang ^a   Luo, Yanhong ^a   Wei, Qinglai ^b  

^a NORTHEASTERN UNIVERSITY   (China)

^b INSTITUTE OF AUTOMATION   (China)

Author keywords

Adaptive dynamic programming; Approximate dynamic programming; Nonlinear systems; Optimal control; Saturating actuators; Time delays

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; APPROXIMATE DYNAMIC PROGRAMMING; CONVERGENCE ANALYSIS; HEURISTIC DYNAMIC PROGRAMMING; ITERATIVE ALGORITHM; NONLINEAR DISCRETE-TIME; OPTIMAL CONTROL LAW; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROL SCHEME; OPTIMAL CONTROLS; OPTIMAL FEEDBACK CONTROL; PERFORMANCE INDICES; SATURATING ACTUATOR; SATURATION NONLINEARITY; SIMULATION EXAMPLE; TIME-DELAY SYSTEMS;

ACTUATORS; ADAPTIVE CONTROL SYSTEMS; ALGORITHMS; CONTROL; CONVERGENCE OF NUMERICAL METHODS; DELAY CONTROL SYSTEMS; DISCRETE TIME CONTROL SYSTEMS; GLOBAL OPTIMIZATION; HEURISTIC PROGRAMMING; ITERATIVE METHODS; NEURAL NETWORKS; NONLINEAR SYSTEMS; OPTIMIZATION; TIME DELAY;

DYNAMIC PROGRAMMING;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION ALGORITHM; CONTROL SYSTEM; FEASIBILITY STUDY; HEURISTIC DYNAMIC PROGRAMMING; MATHEMATICAL ANALYSIS; NONLINEAR DISCRETE TIME DELAY SYSTEM; NONLINEAR SYSTEM; OPTIMAL CONTROL; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SIMULATION; SYSTEM ANALYSIS;

EID: 78649933699     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.07.005     Document Type: Article

References (26)

1. Al-Tamimi A., Lewis F.L., Abu-Khalaf M. Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control. Automatica 2007, 43:473-481.
2. A. Al-Tamimi, F.L. Lewis, Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof, in: IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, 2007.
3. Al-Tamimi A., Lewis F.L., Abu-Khalaf M. Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2008, 38:943-949.
4. Saberi A., Lin Z., Teel A. Control of linear systems with saturating actuators. IEEE Transactions on Automatic Control 1996, 41:368-378.
5. Lu C., Si J., Xie X.R. Direct heuristic dynamic programming for damping oscillations in a large power system. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2008, 38:1008-1013.
6. Zheng C., Jagannathan S. Generalized Hamilton-Jacobi-Bellman formulation-based neural network control of affine nonlinear discrete-time systems. IEEE Transactions on Neural Networks 2008, 19:90-106.
7. Lewis F.L. Applied Optimal Control and Estimation 1992, Prentice-Hall.
8. Lewis F.L., Vrabie D. Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Circuits and Systems Magazine 2009, 9:40-58.
9. Wang F.Y., Zhang H.G., Liu D.R. Adaptive dynamic programming: an introduction. IEEE Computational Intelligence Magazine 2009, 4:39-47.
10. Du H.B., Chen X.C. NN-based output feedback adaptive variable structure control for a class of non-affine nonlinear systems: a nonseparation principle design. Neurocomputing 2009, 72:2009-2016.
11. Zhang H.G., Luo Y.H., Liu D.R. Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints. IEEE Transactions on Neural Networks 2009, 20:1490-1503.
12. Zhang H.G., Wei Q.L., Luo Y.H. A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Transactions on System, Man, and Cybernetics, Part B 2008, 38:937-942.
13. Sussmann H., Sontag E.D., Yang Y. A general result on the stabilization of linear systems using bounded controls. IEEE Transactions on Automatic Control 1994, 39:2411-2425.
14. Murray J.J., Cox C.J., Saeks R. Adaptive dynamic programming. IEEE Transactions on Systems, Man, and Cybernetics, Part C 2002, 32:140-153.
15. Abu-Khalaf M., Lewis F.L. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica 2005, 41:779-791.
16. Manu M.Z., Mohammad J. Time-Delay Systems Analysis, Optimization and Applications 1987, North-Holland, NY, USA.
17. He P., Jagannathan S. Reinforcement learning neural-network-based controller for nonlinear discrete-time systems with input constraints. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2007, 37:425-436.
18. Werbos P.J. Approximate dynamic programming for real-time control and neural modeling. Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches 1992, Van Nostrand Reinhold, New York, (Chapter 13). D.A. White, D.A. Sofge (Eds.).
19. Wei Q.L., Zhang H.G., Liu D.R., Zhao Y. An optimal control scheme for a class of discrete-time nonlinear systems with time delays using adaptive dynamic programming. Acta Automatica Sinica 2010, 36:121-129.
20. Wei Q.L., Zhang H.G., Dai J. Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions. Neurocomputing 2009, 72:1839-1848.
21. Zhu Q., Zhang T.P., Fei S.M., Zhang K.J., Li T. Adaptive neural control for a class of output feedback time delay nonlinear systems. Neurocomputing 2009, 72:1985-1992.
22. Bellman R.E. Dynamic Programming 1957, Princeton University Press, Princeton, NJ.
23. R.Z. Song, D.S. Yang, H.G. Zhang, Near-optimal control laws based on heuristic dynamic programming iteration algorithm, in: International Conference on Networking, Sensing and Control, 2010, pp. 261-266.
24. Powell W.B. Approximate Dynamic Programming: Solving the Curses of Dimensionality 2009, Wiley, New York.
25. Chang W.D., Hwang R.C., Hsieh J.G. Stable direct adaptive neural controller of nonlinear systems based on single auto-tuning neuron. Neurocomputing 2002, 48:541-554.
26. Luo Y.H., Zhang H.G., Cao N., Chen B. Near-optimal stabilization for a class of nonlinear systems with control constraint based on single network greedy iterative DHP algorithm. ACTA Automatica Sinica 2009, 35:1436-1445.