Unsupervised learning of reflexive and action-based affordances to model adaptive navigational behavior

Frontiers in Neurorobotics

Volumn 4, Issue MAY, 2010, Pages

  Weiller, Daniel ^a   Läer, Leonhard ^a   Engel, Andreas K ^b   König, Peter ^a  

^a UNIVERSITY OF OSNABRÜCK   (Germany)

^b UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

Adaptive behavior; Four arm maze; Navigation; Place cells; Reflexes; Unsupervised learning

Indexed keywords

EID: 84865088599     PISSN: None     EISSN: 16625218     Source Type: Journal    
DOI: 10.3389/fnbot.2010.00002     Document Type: Article

References (40)

1. Alexander, H. W., and Sporns, O. (2002). An embodied model of learning, plasticity and reward. Adapt. Behav. 10, 143-159.
2. Arleo, A., and Gerstner, W. (2000). Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity. Biol. Cybern. 83, 287-299.
3. Arleo, A., Smeraldi, F., and Gerstner, W. (2004). Cognitive navigation based on nonuniform gabor space sampling, unsupervised growing networks, and reinforcement learning. IEEE Trans. Neural. Netw. 15, 639-652.
4. Bach, J. (2003). "The MicroPsi agent architecture," in Proceedings of ICCM-5, International Conference on Cognitive Modeling. Bamberg, Germany. 15-20.
5. Bach, J., and Vuine, R. (2003). "Designing agents with MicroPsi node nets," in Proceedings of KI 2003, (Berlin/Heidelberg: Springer), 164-178.
6. Blum, K. I., and Abbott, L. F. (1996). A model of spatial map formation in the hippocampus of the rat. Neural. Comput. 8, 85-93.
7. Burgess, N., Donnett, J. G., Jeffery, K. J., and O'Keefe, J. (1997). Robotic and neuronal simulation of the hippocampus and rat navigation. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 29, 352, 1535-1543.
8. Cuperlier, N., Quoy, M., and Gaussier, P. (2007). Neurobiological inspired mobile robot navigation and planning. Front. Neurorobotics. 1, 24. doi:10.3389/neuro.12.003.2007.
9. Edelman, G. M. (2007). Learning in and from brain-based devices. Science 318, 1103-1105.
10. Flash, T., and Sejnowski, T. J. (2001). Computational approaches to motor control. Curr. Opin. Neurobiol. 11, 655-662.
11. Foster, D. J., Morris, R. G., and Dayan, P. (2000). A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10, 1-16.
12. Franzius, M., Sprekeler, H., and Wiskott, L. (2007). Slowness leads to place, head-direction, and spatial-view cells. PLoS Comput. Biol. 3, e166. doi:10.1371/journal.pcbi.0030166.
13. Gaussier, P., Revel, A., Banquet, J. P., and Babeau, V. (2002). From view cells and place cells to cognitive map learning: processing stages of the hippocampal system. Biol. Cybern. 86, 15-28.
14. Gerstner, W., and Abbott, L. F. (1997). Learning navigational maps through potentiation and modulation of hippocampal place cells. J. Comput. Neurosci. 4, 79-94.
15. Gibson, J. J. (1977). "The theory of affordances," in Perceiving, Acting, and Knowing. Towards an Ecological Psychology, eds R. Shaw and J. Bransford (Hoboken, NJ: John Wiley & Sons Inc.), 127-143.
16. Kaplan, F., and Oudeyer, P.-Y. (2007). In search of the neural circuits of intrinsic motivation. Front. Neurosci. 1, 225-236. doi:10.3389/neuro.01.1.1.017.2007.
17. König, P., and Krüger, N. (2006). Symbols as self-emergent entities in an optimization process of feature extraction and predictions. Biol. Cybern. 94, 325-334.
18. Körding, K. P., Kayser, C., Einhäuser, W., and König, P. (2004). How are complex cell properties adapted to the statistics of natural stimuli? J. Neurophysiol. 91, 206-212.
19. Lungarella, M., Netta, G., Pfeiffer, R., and Sandini, G. (2003). Developmental robotics: a survey. Cogn. Sci. 14, 151-190.
20. McCallum, R. A. (1993). "Overcoming incomplete perception with utile distinction memory," in Machine Learning: Proceedings of the Tenth International Conference, Amherst, MA, USA.
21. Millan, J. d. R. (1996). Rapid, safe, and incremental learning of navigational strategies. IEEE Trans. Syst. Man. Cybern. 26, 408-420.
22. Moore, A. W. (1991). "Variable resolution dynamic programming: efficiently learning action maps in multivariate real-valued state-spaces," in Machine Learning: Proceedings of the Eight International Conference, Chicago, IL, USA.
23. Morris, R. (1984). Developments of a water-maze procedure for studying spatial learning in the rat. J. Neurosci. Methods 11, 47-60.
24. Morris, R. G., Garrud, P., Rawlins, J. N., and O'Keefe, J. (1982). Place navigation impaired in rats with hippocampal lesions. Nature 297, 681-683.
25. O'Keefe, J., and Dostrovsky, J. (1971). The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 34, 171-175.
26. O'Keefe, J., and Nadel, L. (1978). The Hippocampus as a Cognitive Map. New York: Oxford University Press.
27. Olshausen, B. A., and Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607-609.
28. Olton, D. S., and Samuelson, R. J. (1976). Remembrance of places passed: Spatial memory in rats. Exp. Psychol. Anim. Behav. Process 2, 97-116.
29. Oudeyer, P.-Y., Kaplan, F., and Hafner, V. (2007). Intrinsic motivation systems for autonomous mental development. IEEE Trans. Evol. Comput. 11, 265-286.
30. Schaal, S., and Schweighofer, N. (2005). Computational motor control in humans and robots. Curr. Opin. Neurobiol. 15, 675-682.
31. Singh, S. P., Jaakkola, T., and Jordan, M. I. (1995). Reinforcement learning with soft state aggregation. Nips 7.
32. Sprekeler, H., Michaelis, H., and Wiskott, L. (2007). Slowness: an objective for spike-time-dependent plasticity? PLoS Comp Biol. 3, 112. doi: 10.1371/journal.pcbi.0030112.
33. Strosslin, T., Sheynikhovich, D., Chavarriaga, R., and Gerstner, W. (2005). Robust self-localisation and navigation based on hippocampal place cells. Neural. Netw. 18, 1125-1140. [Epub 2005 Nov 2].
34. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
35. Todorov, E. (2004). Optimality principles in sensorimotor control. Nat. Neurosci. 7, 907-915.
36. Tolman, E. C. (1948). Cognitive maps in rats and man. Psychol. Rev. 55, 189-208.
37. Trullier, O., and Meyer, J. A. (2000). Animat navigation using a cognitive graph. Biol. Cybern. 83, 271-285.
38. Wilson, R. A., and Keil, F. C. (1999). The MIT Encyclopedia of the Cognitive Sciences. Cambridge: MIT Press.
39. Wolpert, D. M., and Ghahramani, Z. (2000). Conputational principles of movement in neuroscience. Nat. Neurosci. 2000, 1212-1217.
40. Wyss, R., König, P., and Verschure, P. F. (2006). A model of the ventral visual system based on temporal stability and local memory. PLoS Biol. 4, e120. doi: 10.1371/josurnal.pbio.0040120.