Convergence analysis and application of fuzzy-HDP for nonlinear discrete-time HJB systems

Neurocomputing

Volumn 149, Issue Part A, 2015, Pages 124-131

  Zhu, Yuanheng ^a   Zhao, Dongbin ^a   Liu, Derong ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Discrete time nonlinear system; HDP; T S fuzzy system

Indexed keywords

COST FUNCTIONS; FUZZY SYSTEMS; HEURISTIC PROGRAMMING; MEMBERSHIP FUNCTIONS;

CONVERGENCE ANALYSIS; DISCRETE-TIME NONLINEAR SYSTEMS; HAMILTON JACOBI BELLMAN; HEURISTIC DYNAMIC PROGRAMMING; MATHEMATICAL SOLUTIONS; NONLINEAR DISCRETE-TIME; T S FUZZY SYSTEM; UNIVERSAL APPROXIMATORS;

DYNAMIC PROGRAMMING;

ARTICLE; CORRELATION COEFFICIENT; DISCRETE TIME HAMILTON JACOBI BELLMAN SYSTEM; DISCRETE TIME NONLINEAR SYSTEM; FUZZY SYSTEM; HEURISTIC DYNAMIC PROGRAMMING ALGORITHMN; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; NONLINEAR SYSTEM; SIMULATION; SYSTEM ANALYSIS; TANAKA SUGENO FUZZY SYSTEM;

EID: 84961288449     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.11.055     Document Type: Article

References (30)

1. Bellman R., Dreyfus S. Applied Dynamic Programming 1962, Princeton University Press, Princeton, NJ.
2. Borgers T., Sarin R. Learning through reinforcement and replicator dynamics. J. Econ. Theory 1997, 77(1):1-17.
3. Dalton J., Balakrishnan S.N. A neighboring optimal adaptive critic for missile guidance. Math. Comput. Model. 1996, 23(1):175-188.
4. Tsitsiklis J.N., Van Roy B. An analysis of temporal-difference learning with function approximation. IEEE Trans. Autom. Control 1997, 42:674-690.
5. Werbos P.J. Using adaptive dynamic programming to understand and replicate brain intelligence. the next level design. Neurodynamics of Higher-Level Cognition and Consciousness 2007, Springer-Verlag, Berlin, Germany. R. Kozma (Ed.).
6. Werbos P.J. Foreword-ADP. the key direction for future research in intelligent control and understanding brain intelligence. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 2008, 38(4):898-900.
7. Si J., Wang Y.T. On-line learning control by association and reinforcement. IEEE Trans. Neural Netw. 2001, 12(2):264-276.
8. D.B. Zhao, J.Q. Yi, D.R. Liu, Particle swarm optimized adaptive dynamic programming, in: Proceedings of the 2007 IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, 2007, pp. 32-37.
9. T. Li, D.B. Zhao, J.Q. Yi, Heuristic dynamic programming strategy with eligibility traces, in: Proceedings of the American Control Conference, IEEE, Seattle, USA, 2008, pp. 4535-4540.
10. Zhao D.B., Dai Y.J., Zhang Z. Computational intelligence in urban traffic signal control. a survey. IEEE Trans. Syst. Man Cybern. C 2012, 42(4):485-494.
11. Zhao D.B., Bai X.R., Wang F.Y., Xu J., Yu W.S. DHP method for ramp metering of freeway traffic. IEEE Trans. Intell. Transp. Syst. 2011, 12(4):990-999.
12. Xu D., Zhao D.B., Yi J.Q., Tan X.M. Trajectory tracking control of omnidirectional wheeled mobile manipulators: robust neural network based sliding mode approach. IEEE Trans. Syst. Man Cybern. B: Cybern. 2009, 39(3):788-799.
13. Jiang Z., Jiang Y. Robust adaptive dynamic programming for linear and nonlinear systems. an overview. Eur. J. Control 2013, 19(5):417-425.
14. Liu D., Wang D., Yang X. An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs. Inf. Sci. 2013, 220(20):331-342.
15. Werbos P.J. Approximate dynamic programming for real-time control and neural modeling. Handbook of Intelligent Control 1992, Van Nostrand Reinhold, New York, (Chapter 13). D.A. White, D.A. Sofge (Eds.).
16. Prokhorov D.V., Wunsch D.C. Adaptive critic designs. IEEE Trans. Neural Netw. 1997, 8(5):997-1007.
17. T. Landelius, Reinforcement learning and distributed local model synthesis (Ph.D. dissertation), Linkoping University, Sweden, 1997.
18. Al-Tamimi A., Lewis F.L., Abu-Khalaf M. Discrete-time nonlinear HJB solution using approximate dynamic programming. convergence proof. IEEE Trans. Syst. Man Cybern. B 2008, 38(4):943-949.
19. A. Al-Tamimi, F.L. Lewis, Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof, in: Proceedings of the IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, Honolulu, HI, April 2007, pp. 38-43.
20. Al-Tamimi A., Abu-Khalaf M., Lewis F.L. Adaptive critic designs for discrete time zero-sum games with application to Hinfty control. IEEE Trans. Syst. Man Cybern. B 2007, 37(1):240-247.
21. Tan X.M., Zhao D.B., Yi J.Q., Xu D. Adaptive integrated control for omnidirectional mobile manipulators based on neural-network. Int. J. Cogn. Inform. Natural Intell. 2009, 4(4):34-53.
22. Zhang E.Q., Shi S.J., Weng Z.X. Fuzzy systems using triangle MFs as interpolation functions. Acta Autom. Sin. 2001, 27(6):784-890.
23. Wang L.X., Mendel J.M. Fuzzy basis function, universal approximation, and orthogonal least squares learning. IEEE Trans. Neural Netw. 1992, 3(5):807-814.
24. Ying H. General SISO Takagi-Sugeno fuzzy systems with linear rule consequent are universal approximators. IEEE Trans. Fuzzy Syst. 1998, 6:582-587.
25. Lee C.C. Fuzzy logic in control systems. fuzzy logic controller-Part I. IEEE Trans. Syst. Man Cybern. 1990, 20:404-418.
26. A. Katbab, Fuzzy logic and controller design-a review, in: Proceedings of IEEE South-Eastern '95. 'Visualize the Future', Raleigh, NC, March 1995, pp. 443-449.
27. Wang L.X. Stable adaptive fuzzy control of nonlinear systems. IEEE Trans. Fuzzy Syst. I 1993, 146-155.
28. Zhang J., Zhang H., Luo Y., Liang H. Nearly optimal control scheme using adaptive dynamic programming based on generalized fuzzy hyperbolic model. Acta Autom. Sin. 2013, 39(2):142-148.
29. Y.H. Zhu, D.B. Zhao, H.B. He, Integration of fuzzy controller with adaptive dynamic programming, in: Proceedings of the 10th World Congress on Intelligent Control and Automation (WCICA'2012), Beijing, China, July 2012, pp. 310-315.
30. D.B. Zhao, Y.H. Zhu, H.B. He, Neural and fuzzy dynamic programming for under-actuated systems, in: 2012 International Joint Conference on Neural Networks (IJCNN'2012), Brisbane, Australia, June 2012, pp. 1895-1901.