A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 33, Issue 1, 2003, Pages 17-27

  Ye, Cang ^a   Yung, Nelson H C ^b   Wang, Danwei ^c  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Fuzzy system; Obstacle avoidance; Reinforcement learning; Supervised learning; Virtual environment (VE)

Indexed keywords

ALGORITHMS; COLLISION AVOIDANCE; LEARNING SYSTEMS; MEMBERSHIP FUNCTIONS; MOBILE ROBOTS; SIMULATORS; VIRTUAL REALITY;

SUPERVISED LEARNING;

FUZZY SETS;

EID: 0037278069     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2003.808179     Document Type: Article

References (35)

1. B. H. Krogh and D. Feng, "Dynamic generation of subgoals for autonomous mobile robots using local feedback information," IEEE Trans. Automat. Contr., vol. 34, pp. 483-493, May 1989.
2. N. S. V. Rao, "Robot navigation in unknown generalized polygonal terrains using vision sensors," IEEE Trans. Syst., Man, Cybern., vol. 25, pp. 947-962, June 1995.
3. V. J. Lumelsky et al., "Dynamic path planning in sensor-based terrain acquisition," IEEE Trans. Robot. Automat., vol. 6, pp. 530-540, Aug. 1990.
4. N. A. V. Rao and S. S. Iyengar, "Autonomous robot navigation in unknown terrains: Incidental learning and environment exploration," IEEE Trans. Syst., Man, Cybern., vol. 20, pp. 1443-1449, Nov./Dec. 1990.
5. J. Borestein and Y. Koren, "Real-time obstacle avoidance for fast mobile robot," IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 1179-1186, Sept./Oct. 1989.
6. J.H. Chung and N. Ahuja, "An analytical tractable potential field model of free space and its application in obstacle avoidance," IEEE Trans. Syst., Man, Cybern. B, vol. 28, pp. 729-736, Oct. 1998.
7. Y. Koren and J. Borenstein, "Potential field methods and their inherent limitations for mobile robot navigation," Proc. IEEE Int. Conf. Robotics and Automation, pp. 1398-1404, 1991.
8. R. A. Brooks, "A robust layered control system for a mobile robot," IEEE J. Robot. Automat., vol. RA-2, no. 1, pp. 14-23, 1986.
9. E. Gat and R. Desai et al., "Behavior control for exploration of planetary surfaces," IEEE Trans. Robot. Automat., vol. 10, pp. 490-503, Aug. 1994.
10. M. Colombetti and M. Dorigo et al., "Behavior analysis and training-A methodology for behavior engineering," IEEE Trans. Syst., Man, Cybern. B, vol. 26, pp. 365-380, June 1996.
11. J. Donnart and J. Meyer, "Learning reactive and planning rules in a motivationally autonomous animation," IEEE Trans. Syst., Man, Cybern. B, vol. 26, pp. 381-395, June 1996.
12. C. Thorpe, M. Hebert, T. Kanade, and S. Shafer, "Vision and navigation for the Carnegie-Mellon NAVLAB," IEEE Trans. Pattern Anal. Machine Intell., vol. 10, pp. 362-373, Mar. 1988.
13. K. T. Song and J. C. Tai, "Fuzzy navigation of a mobile robot," Proc. IEEE/RSJ Int. Conf. Intelligent Robotics and Systems, pp. 621-627, 1992.
14. E. Tunstel, "Coordination of distributed fuzzy behaviors in mobile robot control," Proc. IEEE Int. Conf. Syst., Man, Cybern., pp. 4009-4014, 1995.
15. J. Yen and N. Pfluger, "A fuzzy logic based extension to Payton and Rosenblatt's command fusion method for mobile robot navigation," IEEE Trans. Syst., Man, Cybern., vol. 25, pp. 971-978, June 1995.
16. A. Homaifar and E. MCCormick, "Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 3, pp. 129-139, May 1995.
17. H. R. Beom and H. S. Cho, "A sensor-based navigation for a mobile robot using fuzzy logic and reinforcement learning," IEEE Trans. Syst., Man, Cybern., vol. 25, pp. 464-477, Mar. 1995.
18. N.H.C. Yung and C. Ye, "An intelligent mobile vehicle navigator based on fuzzy logic and reinforcement learning," IEEE Trans. Syst., Man, Cybern. B, vol. 29, pp. 314-321, Apr. 1999.
19. L. Jouffle, "Fuzzy inference system learning by reinforcement methods," IEEE Trans. Syst., Man, Cybern. C, vol. 28, pp. 338-355, Sept. 1998.
20. S. Yamada, M. Nakashima, and S. Shiono, "Reinforcement learning to train a cooperative network with both discrete and continuous output neurons," IEEE Trans. Neural Networks, vol. 9, pp. 1502-1508, Nov. 1998.
21. A. Bonarini, C. Bonacina, and M. Matteucci, "An approach to the design of reinforcement function in real world, agent-based application," IEEE Trans. Syst., Man, Cybern. B, vol. 31, pp. 288-301, June 2001.
22. C.K. Chak, G. Feng, and J. Ma, "An adaptive fuzzy neural network for mimo system model approximation in high-dimensional spaces," IEEE Trans. Syst., Man, Cybern. B, vol. 28, pp. 436-446, June 1998.
23. C. F. Juang and C. T. Lin, "An on-line self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, pp. 12-32, Feb. 1998.
24. C. T. Lin and C. S. G. Lee, "Neural-network-based fuzzy logic control and decision system," IEEE Trans. Comput., vol. 40, no. 12, pp. 1320-1336, 1991.
25. _, "Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems," IEEE Trans. Fuzzy Syst., vol. 2, pp. 46-63, Feb. 1994.
26. C.J. Lin and C. T. Lin, "Reinforcement learning for an art-based fuzzy adaptive learning control network," IEEE Trans. Neural Networks, vol. 7, pp. 709-731, May 1996.
27. C. Ye and N. H. C. Yung, "Vehicle navigation strategy based on behavior fusion," Proc. IEEE Int. Conf. Syst., Man, Cybern., pp. 3698-3703, 1997.
28. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: Macmillan, 1994.
29. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation," Neural Netw., vol. 1, no. 4, pp. 295-307, 1988.
30. P. Arabshahi, J. J. Choi, R. J. Marks, II, and T. P. Caudell, "Fuzzy parameter adaptation in optimization: Some neural net training examples," IEEE Comput. Sci. Eng., vol. 3, no. 1, pp. 57-65, Spring 1996.
31. Handbook of Intelligent Control, Van Nostrand, New York, 1992, pp. 527-559. The role of exploration in learning control.
32. H. R. Berenji and P. Khedkar, "Learning and tuning fuzzy logic controllers through reinforcements," IEEE Trans. Neural Networks, vol. 3, pp. 724-740, Sept. 1992.
33. N.H.C. Yung and C. Ye, "Expectations-An autonomous mobile vehicle simulator," Proc. IEEE Int. Conf. Syst., Man, Cybern., pp. 2290-2295, 1997.
34. C. Ye, "Behavior-based fuzzy navigator of mobile vehicle in unknown and dynamically changing environment," Ph.D. dissertation, Dept. EEE, University of Hong Kong, Hong Kong, 1999.
35. J.C. Latombe, Robot Motion Planning. Norwell, MA: Kluwer, 1991.