Learning metric-topological maps for indoor mobile robot navigation

Artificial Intelligence

Volumn 99, Issue 1, 1998, Pages 21-71

  Thrun, Sebastian ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Autonomous robots; Exploration; Mobile robots; Neural networks; Occupancy grids; Path planning; Planning; Robot mapping; Topological maps

Indexed keywords

ARTIFICIAL INTELLIGENCE; MOBILE ROBOTS; MOTION PLANNING; NEURAL NETWORKS; TOPOLOGY;

OCCUPANCY GRIDS; ROBOTIC MAPPING; TOPOLOGICAL MAPS;

ROBOT LEARNING;

EID: 0031998630     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0004-3702(97)00078-7     Document Type: Article

References (123)

1. T. Balch, G. Boone, T. Collins, H. Forbes, D. MacKenzie, J.C. Santamaria, Io, Ganymede and Callisto -a multiagent robot janitorial team, AI Magazine 16 (1) (1995).
2. A.G. Barto, S.J. Bradtke, S.P. Singh, Learning to act using real-time dynamic programming, Artificial Intelligence 72 (1995) 81-138.
3. K. Basye, T. Dean, L.P. Kaelbling, Learning dynamics: system identification for perceptually challenged agents, Artificial Intelligence 72 (1995) 139-171.
4. R.E. Bellman, Dynamic Programming, Princeton University Press, Princeton, NJ, 1957.
5. M. Betke, L. Gurvits, Mobile robot localization using landmarks, Technical Report SCR-94-TR-474, Siemens Corporate Research, Princeton, NJ, 1993; also: IEEE Trans. Robotics and Automation (to appear).
6. M. Betke, L. Gurvits, Mobile robot localization using landmarks, Technical Report SCR-94-TR-474, Siemens Corporate Research, Princeton, NJ, 1993; also: IEEE Trans. Robotics and Automation (to appear).
7. J. Bondy, U. Murty, Graph Theory with Applications, Elsevier, New York, 1976.
8. J. Borenstein, B. Everett, L. Feng, Navigating Mobile Robots: Systems and Techniques, A.K. Peters, Ltd., Wellesley, MA, 1996.
9. J. Borenstein and Y. Koren, The vector field histogram - fast obstacle avoidance for mobile robots, IEEE J. Robotics and Automation 7 (3) (1991) 278-288.
10. J. Buhmann, W. Burgard, A.B. Cremers, D. Fox, T. Hofmann, F. Schneider, J. Strikos, S. Thrun, The mobile robot Rhino, AI Magazine 16 (1) (1995).
11. W. Burgard, D. Fox, D. Hennig, T. Schmidt, Estimating the absolute position of a mobile robot using position probability grids, in: Proceedings AAAI-96, Portland, OR AAAI Press/MIT Press, Menlo Park, CA, 1996.
12. W. Burgard, D. Fox, D. Hennig, T. Schmidt, Position tracking with position probability grids, in: Proceedings 1st Euromicro Workshop on Advanced Mobile Robots, IEEE Computer Society Press, 1996.
13. W. Burgard, D. Fox, S. Thrun, Active mobile robot localization, in: Proceedings IJCAI-97, Nagoya, Japan, 1997.
14. J. Canny, The Complexity of Robot Motion Planning, MIT Press, Cambridge, MA, 1987.
15. J.F. Canny, B.R. Donald, Simplified Voronoi diagrams, Discrete Comput. Geom. 3 (1988) 219-236.
16. R. Chatila, J.-P. Laumond, Position referencing and consistent world modeling for mobile robots, in: Proceedings 1985 IEEE International Conference on Robotics and Automation, St. Louis, MO, 1985.
17. H. Choset, Sensor based motion planning: the hierarchical generalized Voronoi graph, Ph.D. Thesis, California Institute of Technology, Pasadena, CA, 1996.
18. H. Choset, I. Konuksven, J.W. Burdick, Sensor based planning for a planar rod robot, in: Proceedings IEEE/SICE/RSJ International Conference on Multisensor Fusion on Multisensor Fusion and Integration for Intelligent Systems, Washington, DC, 1996.
19. H. Choset, I. Konuksven, A. Rizzi, Sensor based planning: a control law for generating the generalized Voronoi graph, in: Proceedings IEEE International Conference on Advanced Robotics, Washington, DC, 1996 (submitted).
20. E. Chown, S. Kaplan, D. Kortenkamp, Prototypes, location, and associative networks (plan): towards a unified theory of cognitive mapping, Cognitive Sci. 19 (1995) 1-51.
21. L. Chrisman, Reinforcement learning with perceptual aliasing: the perceptual distinction approach, in: Proceedings AAAI-92, San Jose, CA, AAAI Press/MIT Press, Menlo Park, CA, 1992.
22. T.S. Collet, B.A. Cartwright. Landmark learning in bees, J. Comparative Physiology (January 1985).
23. I.J. Cox, Blanche - an experiment in guidance and navigation of an autonomous robot vehicle, IEEE Trans. Robotics and Automation 7 (2) (1991) 193-204.
24. I.J. Cox, Modeling a dynamic environment using a bayesian multiple hypothesis approach, Artificial Intelligence 66 (1994) 311-344.
25. R.H. Crites, A.G. Barto, Improving elevator performance using reinforcement learning, in: D. Touretzky, M. Mozer, M.E. Hasselmo (Eds.), Advances in Neural Information Processing Systems, Vol. 8, MIT Press, Cambridge, MA, 1996.
26. J. Crowley, World modeling and position estimation for a mobile robot using ultrasonic ranging, in: Proceedings 1989 IEEE International Conference on Robotics and Automation, Scottsdale, AZ, 1989, pp. 674-680.
27. P. Dayan, G.E. Hinton, Feudal reinforcement learning, in: J.E. Moody, S.J. Hanson, R.P. Lippmann (Eds.), Advances in Neural Information Processing Systems, Vol. 5, Morgan Kaufmann, San Mateo, CA, 1993.
28. T.L. Dean, M. Boddy, An analysis of time-dependent planning, in: Proceeding AAAI-92, San Jose, CA, AAAI Press/MIT Press, Menlo Park, CA, 1988, pp. 49-54.
29. T.L. Dean, S.-H. Lin, Decomposition techniques for planning in stochastic domains, in: Proceedings IJCAI-95, Montreal, Canada, 1995.
30. B.N. Delaunay, Sur la sphere vide, Izv. Akad. Nauk SSSR, Otdelenie Matematicheskii i Estestvennyka Nauk (Bull. Acad. Sci. USSR) 7 (1934) 793-800.
31. R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, Wiley, New York, 1973.
32. A. Elfes, Sonar-based real-world mapping and navigation, IEEE J. Robotics and Automation 3 (3) (1987) 249-265.
33. A. Elfes, Occupancy grids: a probabilistic framework for robot perception and navigation, Ph.D. Thesis, Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 1989.
34. S. Engelson, Passive map learning and visual place recognition, Ph.D. Thesis, Department of Computer Science, Yale University, New Haven, CT, 1994.
35. S. Engelson, D. McDermott, Error correction in mobile robot map learning, in: Proceedings 1992 IEEE International Conference on Robotics and Automation, Nice, France, 1992, pp. 2555-2560.
36. C. Fedor, TCX. An interprocess communication system for building robotic architectures. Programmer's guide to version 10.xx, Carnegie Mellon University, Pittsburgh, PA, 1993.
37. D. Fox, W. Burgard, S. Thrun, The dynamic window approach to collision avoidance, IEEE Robotics and Automation (to appear); also: Technical Report IAI-TR-95-13, University of Bonn, 1995.
38. T. Fröhlinghaus, J.M. Buhmann, Real-time phase-based stereo for a mobile robot, in: Proceedings 1st Euromicro Workshop on Advanced Mobile Robots, IEEE Computer Society Press, 1996.
39. T. Fröhlinghaus, J.M. Buhmann, Regularizing phase-based stereo, in: Proceedings 13th International Conference on Pattern Recognition, Vienna, Austria, 1996.
40. L.J. Guibas, D.E. Knuth, M. Sharir, Randomized incremental construction of Delaunay and Voronoi diagrams, Algorithmica 7 (1992) 381-413; also in: Proceedings 17th International Colloquium on Automata, Languages and Programming, Warwick, England, 1990, pp. 414-431.
41. L.J. Guibas, D.E. Knuth, M. Sharir, Randomized incremental construction of Delaunay and Voronoi diagrams, Algorithmica 7 (1992) 381-413; also in: Proceedings 17th International Colloquium on Automata, Languages and Programming, Warwick, England, 1990, pp. 414-431.
42. J.-S. Gutmann, Vergleich von Algorithmen zur Selbstlokalisierung eines mobilen Roboters, Master's Thesis, University of Ulm, Ulm, Germany, 1996.
43. D. Guzzoni, A. Cheyer, L. Julia, K. Konolige, Many robots make short work, AI Magazine 18 (1) (1997) 55-64.
44. J. Hertz, A. Krogh, R.G. Palmer, Introduction to the Theory of Neural Computation, Addison-Wesley, Redwood City, CA, 1991.
45. R. Hinkel, T. Knieriemen, Environment perception with a laser radar in a fast moving robot, in: Proceedings Symposium on Robot Control, Karlsruhe, Germany, 1988, pp. 68.1-68.7.
46. R. Holte, T. Mkadmi, R.M. Zimmer, A.J. MacDonald, Speeding up problem solving by abstraction: a graph oriented approach, Artificial Intelligence 85 (1996) 321-361.
47. R.A. Howard, Dynamic Programming and Markov Processes, MIT Press, Cambridge, MA/Wiley, New York, 1960.
48. L.P. Kaelbling, Hierarchical learning in stochastic domains: preliminary results, in: P.E. Utgoff (Ed.), Proceedings 10th International Conference on Machine Learning, Amherst, MA, Morgan Kaufmann, San Mateo, CA, 1993, pp. 167-173.
49. L.P. Kaelbling, A.R. Cassandra, J.A. Kurien, Acting under uncertainty: Discrete bayesian models for mobile-robot navigation, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 1996.
50. L.P. Kaelbling, M.L. Liftman, A.W. Moore, An introduction to reinforcement learning, in: L. Steels (Ed.), The Biology and Technology of Intelligent Autonomous Agents, Springer, Berlin, 1995, pp. 90-127.
51. R.E. Kalman, A new approach to linear filtering and prediction problems, Trans. ASME J. Basic Engineering 82 (1960) 35-45.
52. L. Kavraki, J.-C. Latombe, Randomized preprocessing of configuration space for fast path planning, in: IEEE International Conference on Robotics and Automation, San Diego, CA, 1994, pp. 2138-2145.
53. S. King, C. Weiman, Helpmate autonomous mobile robot navigation system, in: Proceedings SPIE Conference on Mobile Robots, Boston, MA, 1990, Vol. 2352, pp. 190-198.
54. C.A. Knoblock, Automatically generating abstractions for planning, Artificial Intelligence 68 (1994) 243-302.
55. S. Koenig, R. Simmons, Passive distance learning for robot navigation, in: L. Saitta (Ed.), Proceedings 13th International Conference on Machine Learning, Bari, Italy, 1996.
56. D. Kortenkamp, R.P. Bonassi, R. Murphy (Eds.), AI-based Mobile Robots: Case Studies of Successful Robot Systems, MIT Press, Cambridge, MA (to appear).
57. D. Kortenkamp, I. Nourbakhsh, D. Hinkle, The 1996 AAAI Mobile Robot Competition and Exhibition, AI Magazine 18 (1) (1997) 25-32.
58. D. Kortenkamp, T. Weymouth, Topological mapping for mobile robots using a combination of sonar and vision sensing, in: Proceedings AAAI-94, Seattle, WA, AAAI Press/MIT Press, Menlo Park, CA, 1994, pp. 979-984.
59. R. Kuc, M.W. Siegel, Physically based simulation model for acoustic sensor robot navigation, IEEE Trans. Pattern Recognition Machine Intell. (1987).
60. B. Kuipers, Y.-T. Byun, A robust qualitative method for spatial learning in unknown environments, in: Proceedings AAAI-88, St. Paul, MN, AAAI Press/MIT Press, Menlo Park, CA, 1988.
61. B.J. Kuipers, Y.-T. Byun, A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations, Robotics and Autonomous Systems 8 (1991) 47-63.
62. B.J. Kuipers, T.S. Levitt, Navigation and mapping in large-scale space, AI Magazine 9 (2) (1988) 25-43.
63. J.-C. Latombe, Robot Motion Planning, Kluwer Academic Publishers, Boston, MA, 1991.
64. J.J. Leonard, H.F. Durrant-Whyte, Directed Sonar Sensing for Mobile Robot Navigation, Kluwer Academic Publishers, Boston, MA, 1992.
65. J.J. Leonard, H.F. Durrant-Whyte, I.J. Cox, Dynamic map building for an autonomous mobile robot, Internat. J. Robotics Res. 11 (4) (1992) 89-96.
66. L.-J. Lin, Self-supervised learning by reinforcement and artificial neural networks, Ph.D. Thesis, Carnegie Mellon University, School of Computer Science, Pittsburgh, PA, 1992.
67. L. Ljung, System Identification - Theory for the User, Prentice-Hall, Englewood Cliffs, NJ, 1987.
68. F. Lu, E. Milios, Globally consistent range scan alignment for environment mapping, Autonomous Robots 4 (1997) 333-349.
69. F. Lu, E. Milios, Robot pose estimation in unknown environments by matching 2d range scans, J. Intelligent and Robotic Systems (to appear).
70. M.J. Matarić, A distributed model for mobile robot environment-learning and navigation, Master's Thesis, MIT, Cambridge, MA, 1990; also: MIT, AI Lab, Technical Report AITR-1228.
71. R.A. McCallum, Instance-based state identification for reinforcement learning, in: G. Tesauro, D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems, Vol. 7, MIT Press, Cambridge, MA, 1995.
72. T.M. Mitchell, Machine Learning, McGraw-Hill, New York, 1997.
73. A.W. Moore, The parti-game algorithm for variable resolution reinforcement learning in multidimensional state-spaces, in: J.D. Cowan, G. Tesauro, J. Alspector (Eds.), Advances in Neural Information Processing Systems, Vol. 6, Morgan Kaufmann, San Mateo, CA, 1994, pp. 711-718.
74. A.W. Moore, C.G. Atkeson, Prioritized sweeping: reinforcement learning with less data and less time, Machine Learning 13 (1993) 103-130.
75. H.P. Moravec, Sensor fusion in certainty grids for mobile robots, AI Magazine 9 (2) (1988) 61-74.
76. H.P. Moravec, A. Elfes, High resolution maps from wide angle sonar, in: Proceedings IEEE International Conference on Robotics and Automation, St. Louis, MO, 1985, pp. 116-121.
77. M.C. Mozer, J.R. Bachrach, Discovering the structure of a reactive environment by exploration. Technical Report CU-CS-451-89, Department of Computer Science, University of Colorado, Boulder, CO, 1989.
78. U. Nehmzow, T. Smithers, J. Hallam, Location recognition in a mobile robot using self-organizing feature maps, in: G. Schmidt (Ed.), Information Processing in Autonomous Mobile Robots, Springer, Berlin, 1991.
79. H. Neven, G. Schöner, Dynamics parametrically controlled by image correlations organize robot navigation. Biological Cybernetics (to appear).
80. N.J. Nilsson, Principles of Artificial Intelligence, Springer, Berlin, 1982.
81. I. Nourbakhsh, R. Powers, S. Birchfield, DERVISH an office-navigating robot, AI Magazine 16 (2) (1995) 53-60.
82. C. O'Dúnlaing, C.K. Yap, A retraction method for planning the motion of a disk, J. Algorithms 6 (1982) 104-111.
83. C.W. Omlin and C.L. Giles, Constructing deterministic finite-state automata in recurrent neural networks, J. ACM 45 (6) (1996) 937.
84. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann, San Mateo, CA, 1988.
85. L. Peters, H. Surmann, S. Guo, K. Beck, J. Huser, Moria fuzzy Logik gesteuertes, autonomes Fahrzeug, 1994.
86. D. Pierce, B.J. Kuipers, Learning to explore and build maps, in: Proceedings AAAI-94, Seattle, WA, AAAI Press/MIT Press, Menlo Park, CA, 1994, pp. 1264-1271.
87. D.A. Pomerleau, Knowledge-based training of artificial neural networks for autonomous robot driving, in: J.H. Connell, S. Mahadevan (Eds.), Robot Learning, Kluwer Academic Publishers, Dordrecht, 1993, pp. 19-43.
88. M.L. Puterman, Markov Decision Processes, John Wiley & Sons, New York, 1994.
89. L.R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in: Proc. IEEE, 1989 (IEEE Log Number 8825949).
90. J.H. Reif, Complexity of the mover's problem and generalizations, in: Proceedings 20th Annual IEEE Symposium on Foundations of Computer Science, 1979, pp. 421-427.
91. W.D. Rencken, Concurrent localisation and map building for mobile robots using ultrasonic sensors, in: Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, Yokohama, Japan, 1993, pp. 2129-2197.
92. R.L. Rivest, R.E. Schapire, Diversity-based inference of finite automata, in: Proceedings 28th Annual IEEE Symposium on Foundations of Computer Science, Los Angeles, CA, 1987.
93. R.L. Rivest, R.E. Schapire, A new approach to unsupervised learning in deterministic environments, in: P. Langley (Ed.), Proceedings 4th International Workshop on Machine Learning, Irvine, CA, 1987, pp. 364-375.
94. D.E. Rumelhart, G.E. Hinton, R.J. Williams, Learning internal representations by error propagation, in: D.E. Rumelhart, J.L. McClelland, and the PDP Research Group (Eds.), Parallel Distributed Processing, Vols. I and II, MIT Press, Cambridge, MA, 1986.
95. S. Russell, P. Norvig, Artificial Intelligence: A Modern Approach, Prentice-Hall, Englewood Cliffs, NJ, 1995.
96. B. Schiele, J. Crowley, A comparison of position estimation techniques using occupancy grids, in: Proceedings IEEE International Conference on Robotics and Automation, San Diego, CA, 1994, pp. 1628-1634.
97. F.E. Schneider, Sensorinterpretation und Kartenerstellung für mobile Roboter, Master's Thesis, Department of Computer Science III, University of Bonn, 1994.
98. J.T. Schwartz, M. Scharir, J. Hopcroft, Planning, Geometry and Complexity of Robot Motion, Ablex Publishing Corporation, Norwood, NJ, 1987.
99. H Shatkay, L. Kaelbling, Learning topological maps with weak local odometric information, in: Proceedings IJCAI-97, Nagoya, Japan, 1997.
100. D. Shepard, A two-dimensional interpolation function for irregularly spaced data, in: Proceedings 23rd National Conference of the ACM, 1968, pp. 517-523.
101. R. Simmons, The 1994 AAAI Robot Competition and Exhibition, AI Magazine 16 (1) (1995).
102. R. Simmons, S. Koenig, Probabilistic robot navigation in partially observable environments, in: Proceedings IJCAI-95, Montreal, Quebec, 1995, pp. 1080-1087.
103. S.P. Singh, Transfer of learning by composing solutions for elemental sequential tasks, Machine Learning 8 (1992).
104. R.S. Sutton (Ed.), Reinforcement Learning, Kluwer Academic Publishers, Boston, MA, 1992.
105. G.J. Tesauro, Practical issues in temporal difference learning, Machine Learning 8 (1992).
106. S. Thrun, Exploration and model building in mobile robot domains, in: E. Ruspini (Ed.), Proceedings ICNN-93, IEEE Neural Network Council, San Francisco, CA, 1993, pp. 175-180,
107. S. Thrun, A Bayesian approach to landmark discovery and active perception for mobile robot navigation, Technical Report CMU-CS-96-122, Carnegie Mellon University, School of Computer Science, Pittsburgh, PA, 1996.
108. S. Thrun, To know or not to know: on the utility of models in mobile robotics, AI Magazine 18 (1) (1997) 47-54.
109. S. Thrun, A. Bücken, Integrating grid-based and topological maps for mobile robot navigation, in: Proceedings AAAI-96, Portland, OR, AAAI Press/MIT Press, Menlo Park, CA, 1996.
110. S. Thrun, A. Bücken, W. Burgard, D. Fox, T. Fröhlinghaus, D. Hennig, T. Hofmann, M. Krell, T. Schimdt, Map learning and high-speed navigation in RHINO, in: D. Kortenkamp, R.P. Bonasso, R. Murphy (Eds.), Al-based Mobile Robots: Case Studies of Successful Robot Systems. MIT Press, Cambridge, MA (to appear).
111. S. Thrun, D. Fox, W. Burgard, A probabilistic approach to concurrent mapping and localization for mobile robots, Machine Learning and Autonomous Robots (joint issue), to appear.
112. S. Thrun, A. Schwartz, Finding structure in reinforcement learning, in: G. Tesauro, D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems, Vol. 7, MIT Press, Cambridge, MA, 1995.
113. M.C. Torrance, Natural communication with robots, Master's Thesis, MIT Department of Electrical Engineering and Computer Science, Cambridge, MA, 1994.
114. S. Udupa, Collision detection and avoidance in computer controlled manipulators, Ph.D. Thesis, Department of Mechanical Engineering, California Institute of Technology, Pasadena, CA, 1977.
115. V. Vapnik, Estimations of Dependences Based on Statistical Data, Springer, Berlin, 1982.
116. P. Wallossek, Realistische Simulation eines mobilen Roboters in Echtzeit, Master's Thesis, Department of Computer Science III, University of Bonn, 1995.
117. G. Weiß, C. Wetzler, E. von Puttkamer, Keeping track of position and orientation of moving indoor systems by correlation of range-finder scans, in: Proceedings International Conference on Intelligent Robots and Systems, 1994, pp. 595-601.
118. S. Whitehead, J. Karlsson, J. Tenenberg, Learning multiple goal behavior via task decomposition and dynamic policy merging, in: J.H. Connell, S. Mahadevan (Eds.), Robot Learning, Kluwer Academic Publishers, Dordrecht, 1993, pp. 45-78.
119. E. Wolfart, R.B. Fisher, A. Walker, Position refinement for a navigating robot using motion information based on honey bee strategies, in: Proceedings International Symposium on Robotic Systems (SIR 95), Pisa, Italy, 1995; also: DAI Research Paper No 751, Department of Artificial Intelligence, University of Edinburgh, Scotland.
120. B. Yamauchi, R. Beer, Spatial learning for navigation in dynamic environments, in: Learning Autonomous Robots (special issue), IEEE Trans. Systems Man Cybernet. - Part B: Cybernetics (1996); also: http://www.aic.nrl.navy.mil/~yamauchi/.
121. B. Yamauchi, P. Langley, Place recognition in dynamic environments, in: Mobile Robots (special issue), J. Robotic Systems (to appear); also: http://www.aic.nrl.navy.mil/~yamauchi/.
122. W. Zhang, T.G. Dietterich, High-performance job-shop scheduling with a time-delay td( lambda) network, in: D. Touretzky, M. Mozer, M.E. Hasselmo (Eds.), Advances in Neural Information Processing Systems, Vol. 8, MIT Press, Cambridge, MA, 1996, pp. 1024-1030.
123. U.R. Zimmer, Robust world-modeling and navigation in a real world, Neurocomput. 13 (2-4) (1996).