Neural and fuzzy dynamic programming for under-actuated systems

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2012, Pages

  Zhao, Dongbin ^a   Zhu, Yuanheng ^a   He, Haibo ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b The University of Rhode Island   (United States)

Author keywords

adaptive dynamic programming; cart pole plant; fuzzy control; nerual network; pendubot; underactutaed sysmem

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; CART-POLE PLANT; CONTROL PERFORMANCE; CONTROL ZONES; FASTER CONVERGENCE; FUZZY CONTROLLERS; FUZZY DYNAMIC PROGRAMMING; FUZZY MEMBERSHIP; FUZZY PRIORS; LEARNING CONVERGENCE; OPTIMAL CONTROLS; PENDUBOTS; PERFORMANCE EVALUATOR; PRIOR INFORMATION; SYSTEM STATE; UNDER-ACTUATED SYSTEMS; UNDERACTUTAED SYSMEM;

FUZZY CONTROL; NEURAL NETWORKS; POLES; ROBOTS;

DYNAMIC PROGRAMMING;

EID: 84865084700     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2012.6252630     Document Type: Conference Paper

References (23)

1. R. Bellman and S. Dreyfus, Applied Dynamic Programming. Princeton, N. J.: Princeton Univ. Press, 1962.
2. T. Borgers and R. Sarin, "Learning through reinforcement and replicator dynamics," J. Economic Theory, vol. 77, no. 1, pp. 1-17, 1997.
3. J. Dalton and S. N. Balakrishnan, "A neighboring optimal adaptive critic for missile guidance," Math. Comput. Modeling, vol. 23, no. 1, pp. 175-188, 1996.
4. J. N. Tsitsiklis and B. Van Roy, "An analysis of temporal-difference learning with function approximation," IEEE Trans. Automat. Contr., vol. 42, pp. 674-690, May 1997.
5. P. J. Werbos, "Using adaptive dynamic programming to understand and replicate brain intelligence: The next level design," in Neurodynamics of Higher-Level Cognition and Consciousness, R. Kozma, Ed. Berlin, Germany: Springer-Verlag, 2007.
6. P. J. Werbos, "Foreword - ADP: the key direction for future research in intelligent control and understanding brain intelligence," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 38, no. 4, pp. 898-900, 2008.
7. C.-C. Lee, "Fuzzy logic in control systems: fuzzy logic controller-Part I," IEEE Trans. Syst., Man, Cybern., vol. 20, pp. 404-418, 1990.
8. A. Katbab, "Fuzzy logic and controller design-a review," in Proc. IEEE Southeastcon, Raleigh, NC, Mar. 1995, pp. 443-449.
9. L.-X. Wang, "Stable adaptive fuzzy control of nonlinear systems" IEEE Trans. Fuzzy Syst., vol. I, pp. 146-155, Jan. 1993.
10. T. Shannon, G. Lendaris, "Adaptive critic based approximate dynamic programming for tuning fuzzy controllers," in Proc. IEEE Int. Conf. Fuzzy Systems, San Antonio, May, 2000.
11. G. G. Lendaris, R. A. Santiago, and M. S. Carroll. "Dual heuristic programming for fuzzy control," Proceeedings of IFSA / NAFIPS Conference,Vancouver,B.C., July 2002.
12. S. Mohagheghi, G. K. Venayagamoorthy, and R. G. Harley, "Adaptive critic designs based neuro-fuzzy controller for a static compensator in a multimachine power system," IEEE Trans. Power Syst., vol. 21, no. 4, pp. 1744-1754, Nov. 2006.
13. T. Li, D. B. Zhao, and J. Q. Yi, "Adaptive dynamic neuro-fuzzy system for traffic signal control," in Proc. IEEE International Joint Conference on Neural Networks, Hong Kong, June 2008, pp. 1840-1846.
14. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," in Handbook of Intelligent Control, D. A. White and D. A. Sofge, Eds. New York: Van Nostrand Reinhold, 1992, ch. 13.
15. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs," IEEE Trans. Neural Networks, vol. 8, no. 5, pp. 997-1007, Sept. 1997.
16. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. on Neural Networks, vol.12, no.2, pp. 264-276, 2001.
17. D. B. Zhao, J. Q. Yi, and D. R. Liu, "Particle swarm optimized adaptive dynamic programming," in Proc. IEEE Int. Symp. Approximate Dynamic Programming and Reinforcement Learning, 2007, pp. 32-37.
18. H. He and B. Liu, "A hierarchical learning architecture with multiple-goal representations based on adaptive dynamic programming," in Proc. IEEE Int. Conf. Networking, Sensing and Control, Chicago, April, 2010, pp. 286-291.
19. T. Li, D. B. Zhao, and J. Q. Yi. "Heuristic dynamic programming strategy with eligibility traces," in IEEE Proc. American Control Conference. Seattle, USA, 2008. 4535-4540.
20. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuronlike adaptive elements that can solve difficult learning control problems," IEEE Trans. Syst., Man. and Cyhern. vol. 13, pp. 834-846, Oct. 1983.
21. M. J. Zhang and T. J. Tarn, "Hybrid control of the pendubot," IEEE/ASME Trans. on Mechatronics. vol. 7, pp.79-86, 2002.
22. M. W. Spong and D. J. Block, Pendubot Installation and User Guide. Mechatronic System Inc. 1997.
23. M. A. Perez-Cisneros, R. Leal-Ascencio, and P. A. Cook, "Reinforcement learning neurocontroller applied to a 2-dof manipulator," in Proc. IEEE Int. Sym. Intel. Contr., Mexico, 2001, pp.56-61.