Hierarchical Learning of Navigational Behaviors in an Autonomous Robot using a Predictive Sparse Distributed Memory

Machine Learning

Volumn 31, Issue 1-3, 1998, Pages 87-113

  Rao, Rajesh P N ^a,c   Fuentes, Olac ^b,c  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b INSTITUTO POLITÉCNICO NACIONAL   (Mexico)

^c University of Rochester   (United States)

Author keywords

Autonomous navigation; Basis vectors; Competitive learning; Perceptual aliasing; Predictive sparse distributed memory; Sensorimotor learning; Stochastic hill climbing; Teleoperation

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS; HIERARCHICAL SYSTEMS; LEARNING SYSTEMS; MARKOV PROCESSES; NAVIGATION; VECTORS; COLLISION AVOIDANCE; COMPUTER SIMULATION; CONTROL SYSTEM SYNTHESIS; MOBILE ROBOTS; MOTION PLANNING; SENSORS; STOCHASTIC CONTROL SYSTEMS;

AUTONOMOUS NAVIGATION; BASIS VECTORS; COMPETITIVE LEARNING; HIERARCHICAL LEARNING; PERCEPTUAL ALIASING; PREDICTIVE SPARSE DISTRIBUTED MEMORY; SENSORIMETER LEARNING; STOCHASTIC HILL-CLIMBING; SENSORIMOTOR LEARNING;

MOBILE ROBOTS; ROBOT LEARNING;

EID: 0032045146     PISSN: 08856125     EISSN: None     Source Type: Journal    
DOI: 10.1023/a:1007492624519     Document Type: Article

References (54)

1. Albus, J. (1971). A theory of cerebellar functions. Math. Bio., 10:25-61.
2. Asada, M., Uchibe, E., Noda, S., Tawaratsumida, S., & Hosoda, K. (1994). Coordination of multiple behaviors acquired by a vision-based reinforcement learning. In Proceedings of the 1994 IEEE/RSJ International Conference on Intelligent Robots an Systems, pages 917-924, Munich, Germany.
3. Beer, R. & Gallagher, J. (1992). Evolving dynamical neural networks for adaptive behavior. Adaptive Behavior, 1:91-122.
4. Brooks, R. A. (1986). A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 2(1):14-22.
5. Broomhead, D. S. & Lowe, D. (1988). Multivariable functional interpolation and adaptive networks. Complex Systems, 2:321-355.
6. Chrisman, L. (1992). Reinforcement learning with perceptual aliasing. In Proceedings of the Eleventh National Conference on Artificial Intelligence.
7. Cliff, D., Husbands, P., & Harvey, I. (1992). Evolving visually guided robots. In Meyer, J. A., Roitblat, H., and Wilson, S., editors, From Animals to Animats 2: Proceedings of the Second International Conference on the Simulation of Adaptive Behavior, pages 374-383. Cambridge, MA: MIT Press.
8. Connell, J. H. (1990). Minimalist mobile robotics: A colony-style architecture for an artificial creature. Academic Press, Boston, MA.
9. Dayan, P. & Hinton, G. (1993). Feudal reinforcement learning. In Hanson, S., Cowan, J., and Giles, C., editors, Advances in Neural Information Processing Systems 5, pages 271-278. San Mateo, CA: Morgan Kaufmann.
10. de Bourcier, P. (1993). Animate navigation using visual landmarks. Cognitive Science Research Papers 277, University of Sussex at Brighton.
11. Elfes, A. (1987). Sonar-based real-world mapping and navigation. IEEE Journal of Robotics and Automation, 3:249-265.
12. Fuentes, O. & Nelson, R. C. (1997). Learning dextrous manipulation skills using the evolution strategy. In Proceedings of the 1997 IEEE International Conference on Robotics and Automation, Albuquerque, New Mexico.
13. Fuentes, O., Rao, R. P. N., & Wie, M. V. (1995). Hierarchical learning of reactive behaviors in an autonomous mobile robot. In Proceedings of the IEEE International Conf. on Systems, Man, and Cybernetics.
14. Hackbusch, W. (1985). Multi-grid methods and applications. Berlin: Springer-Verlag.
15. Hertz, J., Krogh, A., & Palmer, R. (1991). Introduction to the Theory of Neural Computation. Addison-Wesley Publishing Company, Inc., Redwood City, CA.
16. Hinton, G., McClelland, J., & Rumelhart, D. (1986). Distributed representations. In Parallel Distributed Processing: Explorations in the Microstructure of Cognition, volume 1. MIT Press, Cambridge, MA.
17. Joglekar, U. D. (1989). Learning to read aloud: A neural network approach using sparse distributed memory. Technical Report 89.27, Research Institute for Advanced Computer Science, NASA Ames Research Center.
18. Jordan, M. (1986). Attractor dynamics and parallelism in a connectionist sequential machine. In Proceedings of the 1986 Cognitive Science Conference.
19. Kaelbling, L. (1993a). Hierarchical reinforcement learning: Preliminary results. In Proceedings of the Tenth International Conference on Machine Learning, pages 167-173. San Mateo, CA: Morgan Kaufmann.
20. Kaelbling, L. P. (1993b). Learning in embedded systems. MIT Press, Cambridge, MA.
21. Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237-285.
22. Kanerva, P. (1988). Sparse Distributed Memory. Cambridge, MA: Bradford Books.
23. Kanerva, P. (1993). Sparse distributed memory and related models. In Hassoun, M. H., editor, Associative Neural Memories, pages 50-76. New York: Oxford University Press.
24. Krose, B. J. A. & Eecen, M. (1994). A self-organizing representation of sensor space for mobile robot navigation. In IEEE/RSJ/GI International Conference on Intelligent Robots an Systems, pages 9-14.
25. Kuipers, B. J. & Byun, Y.-T. (1988). A robust, qualitiative approach to a spatial learning mobile robot. In SPIE Cambridge Symposium on Optical and Optoelectronic Engineering: Advances in Intelligent Robotics Systems.
26. Lewis, M. A., Fagg, A. H., & Solidum, A. (1992). Genetic programming approach to the construction of a neural network for control of a walking robot. In Proceedings of the 1992 IEEE International Conference on Robotics and Automation, Nice, France.
27. Maes, P. & Brooks, R. A. (1990). Learning to coordinate behaviors. In Proceedings of AAAI-90, pages 796-802.
28. Mahadevan, S. & Connell, J. (1991). Scaling reinforcement learning to robotics by exploiting the subsumption architecture. In Proceedings of the Eighth International Workshop on Machine Learning.
29. Marr, D. (1969). A theory of cerebellar cortex. J. Physiol. (London), 202:437-470.
30. Mataric, M. (1992). Integration of representation into goal-driven behavior-based robot. IEEE Transactions on Robotics and Automation, 8(3):304-312.
31. McCallum, R. A. (1996). Hidden state and reinforcement learning with instance-based state identification. IEEE Trans. on Systems, Man and Cybernetics, 26(3):464-473.
32. McIlwain, J. T. (1991). Distributed spatial coding in the superior colliculus: A review. Visual Neuroscience, 6:3-13.
33. Nehmzow, U. & Smithers, T. (1991). Mapbuilding using self-organizing networks in "Really Useful Robots". In Meyer, J.-A. and Wilson, S. W., editors, From Animals to Animats 1: Proceedings of the First International Conference on Simulation of Adaptive Behavior, pages 152-159. Cambridge, MA: MIT Press.
34. Nelson, R. C. (1991). Visual homing using an associative memory. Biological Cybernetics, 65:281-291.
35. Nolfi, S. (1997). Using emergent modularity to develop control systems for mobile robots. Adaptive Behavior, 5:343-363.
36. Nowlan, S. (1990). Maximum likelihood competitive learning. In Touretzky, D., editor, Advances in Neural Information Processing Systems 2, pages 574-582. San Mateo, CA: Morgan Kaufmann.
37. Pierce, D. & Kuipers, B. (1991). Learning hill-climbing functions as a strategy for generating behaviors in a mobile robot. In From Animals to Animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior, pages 327-336.
38. Poggio, T. & Girosi, F. (1990). Networks for approximation and learning. Proc. IEEE, 78:1481-1497.
39. Pomerleau, D. (1989). ALVINN: An autonomous land vehicle in a neural network. In Touretzky, D., editor, Advances in Neural Information Processing Systems, volume 1, pages 305-313. Morgan Kaufmann, San Mateo.
40. Pomerleau, D. (1991). Efficient training of artificial neural networks for autonomous navigation. Neural Computation, 3(1):88-97.
41. Prager, R. W. & Fallside, F. (1989). The modified Kanerva model for automatic speech recognition. Computer Speech and Language, 3(1):61-81.
42. Rao, R. P. N. & Ballard, D. H. (1995a). An active vision architecture based on iconic representations. Artificial Intelligence (Special Issue on Vision), 78:461-505.
43. Rao, R. P. N. & Ballard, D. H. (1995b). Learning saccadic eye movements using multiscale spatial filters. In Tesauro, G., Touretzky, D. S., and Leen, T. K., editors, Advances in Neural Information Processing Systems 7, pages 893-900. Cambridge, MA: MIT Press.
44. Rao, R. P. N. & Ballard, D. H. (1995c). Natural basis functions and topographic memory for face recognition. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pages 10-17.
45. Rao, R. P. N. & Ballard, D. H. (1995d). Object indexing using an iconic sparse distributed memory. In Proceedings of the International Conference on Computer Vision (ICCV), pages 24-31.
46. Rao, R. P. N. & Ballard, D. H. (1997). Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Computation, 9(4):721-763.
47. Rao, R. P. N. & Fuentes, O. (1995). Perceptual homing by an autonomous mobile robot using sparse self-organizing sensory-motor maps. In Proceedings of World Congress on Neural Networks (WCNN), pages II380-II383.
48. Rao, R. P. N. & Fuentes, O. (1996). Learning navigational behaviors using a predictive sparse distributed memory. In From Animals to Animats 4: Proceedings of the Fourth Int. Conf. on Simulation of Adaptive Behavior (SAB), pages 382-390.
49. Rogers, D. (1990). Predicting weather using a genetic memory: A combination of Kanerva's sparse distributed memory and Holland's genetic algorithms. In Touretzky, D. S., editor, Advances in Neural Information Processing Systems 2, pages 455-464. Morgan Kaufmann.
50. Singh, S. (1992). Transfer of learning by composing solutions of elemental sequential tasks. Machine Learning, 8:323-339.
51. Tani, J. & Fukumura, N. (1994). Learning goal-directed sensory-based navigation of a mobile robot. Neural Networks, 7(3):553-563.
52. Whitehead, S. & Ballard, D. (1991). Learning to perceive and act by trial and error. Machine Learning, 7(1):45-83.
53. Wixson, L. (1991). Scaling reinforcement learning techniques via modularity. In Proceedings of the Eighth International Workshop on Machine Learning, pages 368-372. Morgan Kaufmann.
54. Yair, E., Zeger, K., & Gersho, A. (1992). Competitive learning and soft competition for vector quantizer design. IEEE Trans. Signal Processing, 40(2):294-309.