Different learning methodologies for vision-based navigation behaviors

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 19, Issue 8, 2005, Pages 949-975

  Cicirelli, G ^a   D'Orazio, T ^a,b,c   Distante, A ^a,b,d,e,f,g  

^a INSTITUTE OF INTELLIGENT SYSTEMS FOR AUTOMATION   (Italy)

^b CNR   (Italy)

^c Institute of Intelligent Systems for Automation of the CNR   (Italy)

^d Robot Vision Group   (Spain)

^e Institute of Intelligent System for Automation (ISSIA CNR)   (Côte d’Ivoire)

^f UNIVERSITY OF SALENTO   (Italy)

^g Faculty of Engineering ^*  (Italy)

Author keywords

Behavior based navigation; Learning by components; Neural networks; Reinforcement learning

Indexed keywords

BEHAVIOR-BASED NAVIGATION; DOOR-RECOGNITION; LEARNING BY COMPONENTS; REINFORCEMENT LEARNING;

COMPUTER VISION; FUZZY SETS; MOTION PLANNING; NAVIGATION SYSTEMS; NEURAL NETWORKS; OBJECT RECOGNITION;

LEARNING SYSTEMS;

EID: 29344445215     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S021800140500440X     Document Type: Article

References (42)

1. R. C. Arkin, Behavior-Based Robotics (MIT Press, Cambridge, MA, 1998).
2. M. Asada, S. Noda, S. Tawaratsumida and K. Hosoda, Purposive behavior acquisition for a real robot by vision-based reinforcement learning, Mach. Learn. 23 (1996) 279-303.
3. O. Aycard, P. Laroche and F. Charpillet, Mobile robot localization in dynamic environments using places recognition, in Proc. IEEE Int. Conf. Robotics & Automation, Leuven, Belgium (May 16-20, 1998).
4. C. Balkenius, Natural inteligence for autonomous agents, in Proc. Int. Workshop on Mechatronical Computer Systems for Perception and Action, Hamstad University (1993), pp. 181-189.
5. M. Betke and L. Gurvits, Mobile robot localization using landmarks, IEEE Trans. Robot. Automat. 13(2) (1997) 251-263.
6. D. L. Boley, E. S. Steinmetz and K. Sutherland, Robot localization from landmarks using recursive total least squares, in Proc. IEEE Conf. Robotics and Automation, Minneapolis MN (IEEE Computer Society Press, 1996), pp. 1381-1386.
7. R. Brooks, Intelligence without reason, in Proc. IJCAI, Sydney, Australia (1991), pp. 569-595.
8. R. A. Brooks, Intelligence without representation, Artif. Intell. 47 (1991) 139-159.
9. P. E. Lopez de Teruel, A. Ruiz, G. Garca-Mateos and J. M. Garca, Real-time extraction of colored segments for robot visual navigation, 3rd Int. Conf. Computer Vision Systems (2003), pp. 428-437.
10. G. Dedeoglu and G. Sukhatme, Landmark-based matching algorithm for cooperative mapping by autonomous robots, Fifth Int. Symp. Distributed Autonomous Robotic Systems (DARS 2000) (2000), pp. 251-260.
11. G. Dedeoglu, M. Mataric and G. S. Sukhatme, Incremental, on-line topological map building with a mobile robot, Photonics East Conf. - Mobile Robots XIV - SPIE 99, Boston, MA (1999), pp. 129-139.
12. T. D'Orazio and G. Cicirelli, Q-learning: computation of optimal q-values for evaluating the learning level in robotic tasks, J. Exp. Theoret. Artif. Intell. 13 (2001) 241-270.
13. M. Dorigo and M. Colombetti, Robot Shaping: An Experiment in Behavior Engineering (MIT Press/Bradfords Book, 1998).
14. G. Dudek and C. Zhang, Vision-based robot localization without explicit object models, in Proc. Int. Conf. Robotics and Automation, Minneapolis, MN (IEEE Press, 1996).
15. C. Eberst, M. Andersson and H. I. Christensen, Vision-based door-traversal for autonomous mobile robots, IEEE/RSJ Conf. Intelligent Robots and Systems (November 2000), pp. 620-625.
16. J. A. Freeman and D. M. Skapura, Neural Networks Algorithms, Applications and Programming Techniques (Addison Wesley Publishing Company, 1993).
17. A. Hauck and N. Stoffler, A hierarchic world model supporting video-based localisation, exploration and object identification, Asian Conf. Computer Vision (1995).
18. A. Johannet and I. Sarda, Goal-directed behaviors by reinforcement learning, Neurocomput. 28 (1999) 107-125.
19. N. Kehtarnavaz, N. C. Griswold and D. S. Kang, Stop-sign recognition based on color-shape processing, Mach. Vis. Appl. 6 (1993) 206-208.
20. D. Kortenkamp and T. Weymouth, Topological mapping for mobile robots using a combination of sonar and vision sensing, Twelfth National Conf. Artificial Intelligence (AAAI-94), Seattle, Washington (1994).
21. A. Kosaka and A. C. Kak, Fast vision-guided mobile robot navigation using model-based reasoning and prediction of uncertainties, Comput. Vis. Graph. Imag. Process. Imag. Underst. 56(3) (1992) 271-329.
22. J. J. Leonard and H. F. Durrant-Whyte, Mobile robot localization by tracking geometric beacons, IEEE Trans. Robot. Automat. 7(3) (1991) 376-382.
23. S. Mahadevan and J. Connell, Automatic programming of behavior-based robots using reinforcement learning, Artif. Intell. 55(2/3) (1992) 311-365.
24. S. Mahadevan, G. Theochaous and N. Khaleeli, Rapid concept learning for mobile robots, Mach. Learn. J. 31(1-3) (1998) 239-251.
25. F. Michaud and M. Mataric, Representation of behavioral history for learning in nostationary conditions, Robot. Auton. Syst. 29(2/3) (1999) 187-200.
26. A. Mohan, C. Papageorgiou and T. Poggio, Example-based object detection in images by components, IEEE Trans. Patt. Anal. Mach. Intell. 23(4) (2001) 349-361.
27. I. Moon, J. Miura and Y. Shirai, On-line viewpoint and motion planning for efficient visual navigation under uncertainty, Robot. Auton. Syst. 28 (1999) 237-248.
28. S. K. Nayar and T. Poggio, Early Visual Learning (Oxford University Press, 1996).
29. M. A. Penna and J. Wu, Models for map building and navigation, IEEE Trans. Syst. Man Cybern. 23(5) (1993) 1276-1301.
30. A. Saffiotti, K. Konolige and E. H. Ruspini, A multivalued logic approach to integrating planning and control, Artif. Intell. 76(1-2) (1995) 481-526.
31. M. V. Srinivasan and S. Venkatesh, From Living Eyes to Seeing Machines (Oxford University Press, 1997).
32. K.-K. Sung, Learning and example selection for object and pattern detection, Technical Report 1572, AI Lab, Ph.D. thesis (January, 1996).
33. R. S. Sutton and A. G. Barto, Reinforcement Learning. An Introduction, A Bradford(MIT Press, 1998).
34. S. Thrun, Finding landmarks for mobile robot navigation, in Proc. IEEE Int. Conf. Robotics and Automation (ICRA-98), Piscataway (May 16-20, 1998) (IEEE Computer Society), pp. 958-963.
35. S. Thrun, Learning metric-topological maps for indoor mobile robot navigation, Artif. Intell. 99(1) (1998) 21-71.
36. S. Thrun, W. Burgard and D. Fox, A probabilistic approach to concurrent mapping and localization for mobile robots, Mach. Learn. 31 (1998) 29.
37. S. Thrun, J. S. Gutmann, D. Fox, W. Burgard and B. J. Kuipers, Integrating topological and metric maps for mobile robot navigation: A statistical approach, in Proc. 15th National Conf. Artificial Intelligence (AAAI-98) and 10th Conf. Innovative Applications of Artificial Intelligence (IAAI-98), Menlo Park (July 26-30, 1998) (AAAI Press), pp. 989-996.
38. C. J. Watkins and P. Dayan, Technical note - q-learning, Mach. Learn. 8(3-4) (1992) 323-339.
39. H. Xu and H. Van Brussel, A behavior-based blackboard architecture for reactive and efficient task execution of an autonomous robot, Robot. Auton. Syst. 22 (1997) 115-132.
40. T. Yamaguchi, M. Masubuchi, K. Fujihara and M. Yachida, Realtime reinforcement learning for a real robot in the real environment, in Proc. 1996 IROS Conf. (1996), pp. 1321-1327.
41. K. C. Yow and R. Cipolla, Feature-based human face detection, Imag. Vis. Comput. 15 (1997) 713-735.
42. A. Zelinsky, Mobile robot map making using sonar, J. Robot. Syst. 8(5) (1991) 557-577.