Design and implementation of Fuzzy Policy Gradient gait Learning method for walking pattern generation of humanoid robots

International Journal of Fuzzy Systems

Volumn 13, Issue 4, 2011, Pages 369-382

  Su, Yu Te ^a   Chong, Kiah Yang ^a   Li, Tzuu Hseng S ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

FPGL; Fuzzy logic control; Humanoid robot; PGRL

Indexed keywords

COMPUTER CIRCUITS; EFFICIENCY; FUZZY LOGIC; GAIT ANALYSIS; MACHINE DESIGN; REINFORCEMENT LEARNING;

DESIGN AND IMPLEMENTATIONS; FUZZY LOGIC CONTROL; FUZZY POLICY GRADIENT LEARNING; GAIT LEARNING; GAIT PATTERN; GRADIENT LEARNING; GRADIENT LEARNING METHODS; HUMANOID ROBOT; POLICY GRADIENT; POLICY GRADIENT REINFORCEMENT LEARNING;

ANTHROPOMORPHIC ROBOTS;

EID: 84863049955     PISSN: 15622479     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (26)

1. http://www.scientificamerican.com/
2. http://kondo-robot.com/sys/
3. http://www.hitecrcd.co.jp/
4. http://www.robotis.com/xe/
5. http://www.aldebaran-robotics.com/en
6. M. Y. Shieh and K. H. Chang, "An Optimized Neuro-Fuzzy Controller Design for Bipedal locomotion," Int. J. of Fuzzy Syst., vol. 11 no. 3, pp. 137-145, Sep. 2009.
7. M. S. Wang, Y. S. Kung, and Y. M. Tu, "Fuzzy Logic Control Design for a Stair-Climbing Robot," Int. J. of Fuzzy Syst., vol. 11 no. 3, pp. 164-173, Sep. 2009
8. S. Kajita, T. Nagasaki, K. Kaneko, and H. Hirukawa, "ZMP-based biped running control," IEEE Trans. Robotics, vol. 14, no. 2, pp. 63-72, Jun. 2007.
9. P. Sardain and G. Bessonnet, "Forces acting on a biped robot. Center of pressure-zero moment point," IEEE Trans. Syst. Man Cybern. Part A-Syst. Hum., vol. 34, pp. 630-372, Sep. 2004.
10. Q. Huang and Y. Nakamura, "Sensory reflex control for humanoid walking," IEEE Trans. Robotics, vol. 21, no. 5, pp. 977-984, Oct. 2005. (Pubitemid 41489347)
11. Y. D. Kim, B. J. Lee, J. H. Ryu, and J. H. Kim, "Landing force control for humanoid robot by time-domain passivity approach," IEEE Trans. Robotics, vol. 23, no. 6, pp. 1294-1301, Dec. 2007.
12. J. Morimoto, G. Endo, J. Nakanishi, and G. Cheng, "A biologically inspired biped locomotion strategy for humanoid robots: Modulation of sinusoidal patterns by a coupled oscillator model," IEEE Trans. Robotics, vol. 24, no. 1, pp. 185-191, Feb. 2008. (Pubitemid 351411207)
13. N. Kohl and P. Stone, "Policy gradient reinforcement learning for fast quadrupedal locomotion," in Proc. IEEE Int. Conf. Robotics and Automation, vol. 3, pp. 2619-2624, 2004.
14. A. Cherubini, F. Giannone, L. Iocchi, and P.F. Palamara, "An extended policy gradient algorithm for robot task learning," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and System, pp. 4121-4126, 2007.
15. A. Cherubini, F. Giannone, L. Iocchi, M. Lombardo, and G. Oriolo, "Policy gradient learning for a humanoid soccer robot," Robotics and Autonomous Systems, vol. 57, pp. 808-818, Apr. 2009.
16. Z. Youcef and C. Pierre, "Control of the trajectory of a hexapod robot based on distributed Q-learning," in Proc. IEEE Int. conf. Ind. Electron., vol. 1, pp. 277-282, 2004.
17. S.-H. Yang and Y.-P. Chen, "Intelligent Forecasting System Using Grey Model Combined with Neural Network," Int. J. of Fuzzy Syst., vol. 13 no. 1, pp. 8-15, Mar. 2011.
18. C.-J. Lin and S.-C. Su, "Protein 3D HP Model Folding Simulation Using a Hybrid of Genetic Algorithm and Particle Swarm Optimization," Int. J. of Fuzzy Syst., vol. 13 no. 2, pp. 140-147, June 2011.
19. T.-H. S. Li, Y.-T. Su, S.-W. Lai, and J.-J. Hu, "Walking Motion Generation, Synthesis, and Control for Biped Robot by using PGRL, LPI and Fuzzy Logic," IEEE Trans. Syst., Man, Cybern. B, Cybern, vol. 41, no. 3, pp.736-748, 2011.
20. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its application to modeling and control," IEEE Trans. Syst. Man and Cybern., vol. 15, no. 1, pp. 116-132, 1985.
21. M.-Y. Hsiao, T.-H. S. Li, J.-Z. Lee, C.-H. Chao, and S.-H. Tsai, "Design of Interval Type-2 Fuzzy Sliding-Mode Controller," Information Sciences, vol. 178, no. 2, pp. 1696-1716, Mar. 2008.
22. S. Park, Y. Han, and H. Hahn, "Fuzzy Controller based Biped Robot Balance Control using 3D Image," Int. J. of Fuzzy Syst., vol. 11 no. 3, pp. 202-212, Sep. 2009.
23. C.-C. Wong, C.-L. Hwang, K.-H. Huang, Y.-Y. Hu, and C.-T. Cheng, "Design and Implementation of Vision-Based Fuzzy Obstacle Avoidance Method on Humanoid Robot," Int. J. of Fuzzy Syst., vol. 13 no. 1, pp. 45-54, Mar. 2011.
24. R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour, Policy gradient methods for reinforcement learning with function approximation, in: Advances in Neural Information Processing Systems 12, MIT Press, 2000.
25. R. E. Kalman, "A new approach to linear filtering and prediction problems," ASME Jour. Basic Engineering, vol. 82, no. 1, pp. 35-45, 1960.
26. M. J. Er, F. Liu, and M. B. Li, "Self-constructing Fuzzy Neural Networks with Extended Kalman Filter," Int. J. of Fuzzy Syst., vol. 12 no. 1, pp. 66-72, Mar. 2010.