Dual Heuristic dynamic Programming for nonlinear discrete-time uncertain systems with state delay

Neurocomputing

Volumn 134, Issue , 2014, Pages 222-229

  Wang, Bin ^a   Zhao, Dongbin ^a   Alippi, Cesare ^a,b   Liu, Derong ^a  

^a INSTITUTE OF AUTOMATION   (China)

^b POLITECNICO DI MILANO   (Italy)

Author keywords

Discrete time; Dual Heuristic dynamic Programming (DHP); Neural networks; Nonlinear uncertain system; Time delay

Indexed keywords

CONTROL; DIGITAL CONTROL SYSTEMS; DISCRETE TIME CONTROL SYSTEMS; FEEDFORWARD NEURAL NETWORKS; ITERATIVE METHODS; NEURAL NETWORKS; TIME DELAY; UNCERTAIN SYSTEMS;

DISCRETE TIME SYSTEM; DISCRETE-TIME; DUAL HEURISTIC DYNAMIC PROGRAMMING; NONLINEAR DISCRETE-TIME; NONLINEAR DISCRETE-TIME SYSTEMS; NONLINEAR TIME DELAYS; NONLINEAR UNCERTAIN SYSTEMS; OPTIMAL CONTROL POLICY;

DYNAMIC PROGRAMMING;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SYSTEM; DISCRETE TIME; DUAL HEURISTIC DYNAMIC PROGRAMMING; FEEDBACK SYSTEM; LEARNING ALGORITHM; MATHEMATICAL MODEL; NONLINEAR SYSTEM; PRIORITY JOURNAL; TIME; TIME DELAY; VALIDITY;

EID: 84896543600     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.06.037     Document Type: Article

References (28)

1. Manu M.Z., Mohammad J. Time-Delay Systems. Analysis, Optimization and Applications 1987, North-Holland, New York, USA.
2. Niculescu S.I. Delay Effects on Stability. a Robust Control Approach 2001, Springer, New York.
3. Fliess M., Marquez R., Mounier H. An extension of predictive control, PID regulators and smith predictors to some linear delay systems. Int. J. Control 2002, 75(10):728-743.
4. Shafiei Z., Shenton A.T. Frequency-domain design of PID controllers for stable and unstable systems with time delay. Automatica 1997, 33(12):2223-2232.
5. Shen J.C., Chen B.S., Kung F.C. Memoryless stabilization of uncertain dynamic delay systems. Riccati equation approach. IEEE Trans. Autom. Control 1991, 36:638-640.
6. Nguang S.K. Robust stabilization of a class of time-delay nonlinear systems. IEEE Trans. Autom. Control 2000, 45(4):756-762.
7. F.E. Sarabi, H. Khatibi, Robust stability analysis and synthesis of linear time-delay Systems via LMIs, in: Proceedings of the 49th IEEE Conference on Decision and Control (CDC), 2010, pp. 615-620.
8. N. Xie, G.Y. Tang, P. Liu, Optimal guaranteed cost control for nonlinear discrete-time uncertain systems with state delay, in: Proceedings of the 5th World Congress on Intelligent Control and Automation (WCICA), 2004, pp. 893-896.
9. Zhang H.G., Lun S.Y., Liu D.R. Fuzzy H ∞ filter design for a class of nonlinear discrete-time systems with multiple time delays. IEEE Trans. Fuzzy Syst. 2007, 15(3):453-469.
10. S.Y. Han, G.Y. Tang, Optimal tracking control for discrete-time systems with delayed state and input, in: Proceedings of the 8th IEEE International Conference on Control and Automation (ICCA), 2010, pp. 1694-1698.
11. Gao Z., Ding S.X. State and disturbance estimator for time-delay systems with application to fault estimation and signal compensation. IEEE Trans. Signal Process. 2007, 55(12):5541-5551.
12. Wei Q.L., Zhang H.G., Liu D.R., Zhao Y. An optimal control scheme for a class of discrete-time nonlinear systems with time delays using adaptive dynamic programming. Acta Autom. Sinica 2010, 36:121-129.
13. P.J. Werbos, Advanced forecasting methods for global crisis warning and models of intelligence, General Syst. Yearbook 22 (1977) 25-38.
14. P.J. Werbos, Approximate dynamic programming for real-time control and neural modeling, in: Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches, D.A. White, D.A. Sofge (Ed.), Van Nostrand Reinhold, New York, vol. 13, 1992.
15. Murray J.J., Cox C.J., Lendaris G.G., Saeks R. Adaptive dynamic programming. IEEE Trans. Syst. Man Cybern. C, Appl. Rev. 2002, 32(2):140-153.
16. Wang F.Y., Zhang H.G., Liu D.R. Adaptive dynamic programming: an introduction. IEEE Comput. Intell. Mag. 2009, 4(2):39-47.
17. D.R. Liu, Q.L. Wei, Adaptive dynamic programming for a class of discrete-time non-affine nonlinear systems with time-delays, in: Proceedings of the International Joint Conference on Neural Networks (IJCNN), 2010, pp. 1-6.
18. Song R.Z., Zhang H.G., Luo Y.H., Wei Q.L. Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming. Neurocomputing 2010, 73(16):3020-3027.
19. Zhang H.G., Song R.Z., Wei Q.L., Zhang T.Y. Optimal tracking control for a class of nonlinear discrete-time systems with time delays based on heuristic dynamic programming. IEEE Trans. Neural Netw. 2011, 22(12):1851-1862.
20. R.Z. Song, D.S. Yang, H.G. Zhang, Near-optimal control laws based on heuristic dynamic programming iteration algorithm, in: Proceedings of the International Conference on Networking, Sensing and Control, 2010, pp. 261-266.
21. Zhao D.B., Bai X.R., Wang F.Y., Xu J., Yu W.S. DHP for coordinated freeway ramp metering. IEEE Trans. Intell. Transp. Syst. 2011, 12(4):990-999.
22. Zhao D.B., Zhang Z., Dai Y.J. Self-teaching adaptive dynamic programming for Go-Moku. Neurocomputing 2012, 78(1):23-29.
23. Wang D., Liu D.R., Zhao D.B., Huang Y.Z., Zhang D.H. A neural-network-based iterative GDHP approach for solving a class of nonlinear optimal control problems with control constraints. Neural Comput. Appl. 2011, 2(22):219-227.
24. Vrabie D., Lewis F. Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems. Neural Netw. 2009, 22(3):237-246.
25. Hua C.C., Guan X.P., Shi P. Robust backstepping control for a class of time delay systems. IEEE Trans. Autom. Control 2005, 50(6):894-899.
26. A. Al-Tamimi, F.L. Lewis, Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof, in: IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, 2007.
27. Al-Tamimi A., Lewis F.L., Abu-Khalaf M. Discrete-time nonlinear HJB solution using approximate dynamic programming. convergence proof. IEEE Trans. Syst. Man Cybern. B Cybern. 2008, 38(4):943-949.
28. Abu-Khalaf M., Lewis F.L. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica 2005, 41(5):779-791.