Integration of coordination architecture and behavior fuzzy learning in quadruped walking robots

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 37, Issue 4, 2007, Pages 670-681

  Gu, Dongbing ^a   Hu, Huosheng ^a  

^a UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

Behavior based control; Fuzzy logic controller (FLC); Reinforcement learning (RL)

Indexed keywords

BEHAVIOR-BASED CONTROL; FUZZY LEARNING; FUZZY LOGIC CONTROLLER;

CONTROL SYSTEM SYNTHESIS; FUZZY CONTROL; FUZZY LOGIC; REAL TIME CONTROL; REINFORCEMENT LEARNING; ROBOT LEARNING; ROBUST CONTROL;

ROBOTICS;

EID: 34447332815     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2007.897491     Document Type: Article

References (47)

1. J. Albus, "Outline for a theory of intelligence," IEEE Trans. Syst., Man, Cybern., vol. 21, no. 3, pp. 473-509, May/Jun. 1991.
2. R. Brooks, "A robust layered control system for a mobile robot," IEEE J. Robot. Autom., vol. 2, no. 1, pp. 14-23, Mar. 1986.
3. R. C. Arkin, Behavior-Based Robotics. Cambridge, MA: MIT Press, 1998.
4. R. C. Arkin and T. Balch, "AuRA: Principles and practice in review," Exp. Theor. Artif. Intell., vol. 9, no. 2, pp. 175-189, 1997.
5. R. G. Simmons, "Structured control for autonomous robots," IEEE Trans. Robot. Autom., vol. 10, no. 1, pp. 34-43, Feb. 1994.
6. R. J. Firby, "An investigation into reactive planning in complex domains," in Proc. Natl. Conf. Artif. Intell.: Seattle, WA, Jul. 1987, pp. 202-206.
7. M. Georgeff and A. Lansky, "Reactive reasoning and planning," in Proc. Natl. Conf. Artif. Intell., Seattle, WA, Jul. 1987, pp. 972-978.
8. D. M. Lyons and A. J. Hendriks, "Planning for reactive robot behaviour," in Proc. Int. Conf. Robot. Autom. Nice: France, May 1992, pp. 2675-2680.
9. J. J. Borrelly et al., "The ORCCAD architecture," Int. J. Robot. Res., vol. 17, no. 4, pp. 338-359, Apr. 1998.
10. D.W. Payton, J. K. Rosenblatt, and D.M. Keirsey, "Plan guided reaction," IEEE Trans. Syst.,Man, Cybern., vol. 20, no. 6, pp. 1370-1382, Nov. 1990.
11. S. Mitra and Y. Hayashi, "Neuro-fuzzy rule generation: Survey in soft computing framework," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 748-768, May 2000.
12. J. R. Jang, "ANFIS: Adaptive-neural-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May/ Jun. 1993.
13. C. T. Lin and C. S. G. Lee, "Neural-network-based fuzzy logic control and decision system," IEEE Trans. Comput., vol. 40, no. 12, pp. 1320-1336, Dec. 1991.
14. D. Nauck, F. Klawonn, and R. Kruse, Foundations of Neuro-Fuzzy Systems, Hoboken, NJ: Wiley, 1997.
15. H. R. Beom and H. S. Cho, "A sensor-based navigation for a mobile robot using fuzzy logic and reinforcement learning," IEEE Trans. Syst., Man, Cybern., vol. 25, no. 3, pp. 464-477, Mar. 1995.
16. H. R. Berenji and P. Khedkar, "Learning and tuning fuzzy logic controllers through reinforcements," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 724-740, Sep. 1992.
17. P. Y. Glorennec and L. Jouffe, "Fuzzy Q-learning," in Proc. 6th IEEE Int. Conf. Fuzzy Syst., 1997, vol. 2, pp. 659-662.
18. L. Jouffe, "Fuzzy inference system learning by reinforcement methods," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 28, no. 3, pp. 338-355, Aug. 1998.
19. C. T. Lin and C. P. Jou, "GA-based fuzzy reinforcement learning for control of a magnetic bearing system," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 30, no. 2, pp. 276-289, Apr. 2000.
20. A. Bonarini, "Evolutionary learning of fuzzy rules: Competition and cooperation," in Fuzzy Modelling: Paradigms and Practice, W. Pedrycz, Ed. Norwell, MA: Kluwer, pp. 265-284, 1996.
21. C. F. Juang, J. Y. Lin, and C. T. Lin, "Genetic reinforcement learning through symbiotic evolution for fuzzy controller design," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 30, no. 2, pp. 290-301, Apr. 2000.
22. S. J. Kang, C. H. Woo, H. S. Hwang, and K. B. Woo, "Evolutionary design of fuzzy rule base for nonlinear system modelling and control," IEEE Trans. Fuzzy Syst., vol. 8, no. 1, pp. 37-45, Feb. 2000.
23. C. L. Karr and E. J. Gentry, "Fuzzy control of pH using genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 1, no. 1, p. 46, Feb. 1993.
24. D. Leitch and P. Probert, "New techniques for genetic development of a class of fuzzy controllers," IEEE Trans. Syst., Man., Cybern. C, Appl. Rev., vol. 28, no. 1, pp. 112-123, Feb. 1998.
25. V. Matellan, C. Fernandez, and J. M. Molina, "Genetic learning of fuzzy reactive controllers," Robot. Auton. Syst., vol. 25, pp. 33-41, 1998.
26. Y. Shi, R. Eberhart, and Y. Chen, "Implementation of evolutionary fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 7, no. 2, pp. 109-119, Apr. 1999.
27. L. P. Kaelbling and A. W. Moor, "Reinforcement learning: A survey," J. Artif. Intell. Res., vol. 4, pp. 237-285, 1996.
28. D. E. Moriarty, A. C. Schultz, and J. J. Grefenstette, "Evolutionary algorithms for reinforcement learning," J. Artif. Intell. Res., vol. 11, pp. 241-276, 1999.
29. A. Homaifar and E. McCormick, "Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 3, no. 2, pp. 129-139, Apr. 1995.
30. R. Volpe, I. Nesnas, T. Estlin, D. Mutz, R. Petras, and H. Das, "The CLARAty architecture for robotic autonomy," in Proc. 2001 IEEE Aerosp. Conf., Big Sky, MT, pp. 10-17.
31. E. Coste-Maniere and R. Simmons, "Architecture, the backbone of robotic systems," in Proc. 2000 IEEE Int. Conf. Robot. Autom. San Francisco, CA, Apr., pp. 67-72.
32. P. Pirjanian, "Behaviour co-ordination mechanism - State-of-the-art," Inst. Robot. Intell. Syst., Sch. Eng., Univ. Southern California, Los Angeles, Tech. Rep. IRIS-99-375, Oct. 1999.
33. M. Veloso, E. Winner, S. Lenser, J. Bruce, and T. Balch, "Vision-servoed localization and behaviour-based planning for an autonomous quadruped-legged robot," presented at the AIPS 2000, Breckenridge, CO.
34. M. Asada, H. Kitano, I. Noda, and M. Veloso, "RoboCup: Today and tomorrow - What we have learned," Artif. Intell., vol. 110, no. 2, pp. 193-214, Jun. 1999.
35. H. Kitano, M. Fujita, S. Zrehen, and K. Kageyama, "Sony legged robot for RoboCup challenge," in Proc. 1998 IEEE Int. Conf. Robot. Autom. Leuven, Belgium, pp. 2605-2612.
36. J. Kosecka and R. Bajcsy, "Discrete event systems for autonomous mobile agents," Robot. Auton. Syst., vol. 12, pp. 187-198, 1994.
37. A. Bonarini, "Comparing reinforcement learning algorithms applied to crisp and fuzzy learning classifier systems," in Proc. Int. Conf. Learn. Classif. Syst., San Francisco, CA: Morgan Kaufmann, 1999, pp. 228-235.
38. J. Grefenstette and A. Schultz, "An evolutionary approach to learning in robots," presented at the Mach. Learn. Workshop Robot Learn., New Brunswick, NJ, 1994.
39. A. Ram, R. Arkin, G. Boone, and M. Pearce, "Using genetic algorithms to learn reactive control parameters for autonomous robotic navigation," J. Adapt. Behav., vol. 2, no. 3, pp. 277-303, 1994.
40. L. Steels, "Emergent functionality in robotic agents through on-line evolution," in Proc. 4th Int. Workshop Synth. Simul. Living Syst. Artif. Life IV, R. Brooks and P. Maes, Eds. Cambridge, MA: MIT Press, 1994, pp. 8-14.
41. H. Hu and D. Gu, "Reactive behaviours and agent architecture for Sony legged robots to play football," Int. J. Ind. Robot, vol. 28, no. 1, pp. 45-53, Jan. 2001.
42. D. Gu and H. Hu, "Learning and evolving of Sony legged robots," in Proc. Int. Workshop - Recent Adv. Mob. Robots: Leicester, U.K., Jun. 2000, pp. 52-59.
43. R. C. Arkin and D. MacKenzie, "Temporal coordination of perceptual algorithms for mobile robot navigation," IEEE Trans. Robot. Autom. vol. 10, no. 3, pp. 276-286, Jun. 1994.
44. J. T. Feddema, R. D. Robinett, and B. J. Driessen, "Designing stable finite state machine behaviours using phase plane analysis and variable structure control," in Proc. 1998 IEEE Int. Conf. Robot. Autom., Leuven, Belgium, pp. 1134-1141.
45. K.-Y. Fok and M. R. Kabuka, "An automatic navigation system for vision guided vehicles using a double heuristic and a finite state machine," IEEE Trans. Robot. Autom., vol. 7, no. 1, pp. 181-189, Feb. 1991.
46. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, 3rd ed. Berlin, Germany: Springer-Verlag, 1996.
47. D. Golubovic and H. Hu, "An interactive software environment for gait generation and control design of Sony legged robots," in Proc. 6th Int. Symp. RoboCup, Fukuoku, Japan, 2002, pp. 24-25.