Event based self-supervised temporal integration for multimodal sensor data

Journal of Integrative Neuroscience

Volumn 4, Issue 2, 2005, Pages 265-282

  Barakova, Emilia I ^a   Lourens, Tino ^b  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b HONDA RESEARCH INSTITUTE JAPAN CO LTD   (Japan)

Author keywords

Multimodal integration; Navigation; Proprioception; Robotics

Indexed keywords

ARTICLE; ENVIRONMENTAL FACTOR; EXPERIMENTAL DESIGN; LEARNING; NONHUMAN; PROPRIOCEPTION; PSYCHOPHYSIOLOGY; ROBOTICS; SENSOR; SENSORY SYSTEM ELECTROPHYSIOLOGY; SIMULATION; VISION;

ANIMALS; AUTOMATIC DATA PROCESSING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PERCEPTION; RECOGNITION (PSYCHOLOGY); SENSATION; TRANSDUCERS;

EID: 20944436365     PISSN: 02196352     EISSN: None     Source Type: Journal    
DOI: 10.1142/S021963520500077X     Document Type: Article

References (46)

1. Andersen RA, Multimodal integration for the representation of space in the posterior parietal cortex, Philos T Roy Soc B 352 (1360):1421-1428, (1360):1421-1428, 1997.
2. Babeau V, Gaussier P, Joulain C, Revel A, Banquet J, Merging visual place recognition and path integration for cognitive map learning, in From animals to animats 6, Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior, MIT Press, Cambridge, MA, 101-110, 2000.
3. Banquet J, Gaussier P, Quoy M, Revel A, From reflex to planning: Multimodal, versatile, complex systems in biorobotics, Behav Brain Sci(1360):1421-1428, 24(6):1051-1053, 2001.
4. Barakova EI, Zimmer UR, Global spatial modeling based on dynamics identification according to discriminated static sensations, in Proceedings of Underwater Technology, IEEE, Tokyo, 2000.
5. Benevento LA, Fallon J, Davis BJ, Rezak M, Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey, Exp Neurol 57:849-872, 1977.
6. Blair H, Sharp P, Anticipatory head direction signals in anterior thalamus: Evidence for a thalamocortical circuit that integrates angular head motion to compute head direction, J Neurosci 15:6260-6270, 1995.
7. Bruce C, Desimone R, Gross CG, Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque, J Neurophysiol 46:369-384, 1981.
8. Canon LK, Directed attention and maladaptive "adaptation" to displacement of the visual field, J Exp Psychol 88:403-408, 1971.
9. Chance SS, Gaunet F, Beall AC, Loomis JC, Locomotion mode affects the updating of objects encountered during travel: The contribution of vestibular and proprioceptive inputs to path integration, Presence-Teleop Virt 7:168-178, 1998.
10. Eagleman DM, Sejnowski TJ, Motion integration and postdiction in visual awareness, Science 287(5460):2036-2038, 2000.
11. Elfes A, Sonar-based real-world mapping and navigation, IEEE J Robotic Autom RA-3(3):249-265, June 1987.
12. Fritzke B, A growing neural gas network learns topologies, in Advances in Neural Information Processing Systems 7, MIT Press, Cambridge, MA, 1995.
13. Graziano MS, Hu XT, Gross CG, Visuospatial properties of ventral premotor cortex, J Neurophysiol 77:2268-2292, 1997.
14. Graziano MS, Yap GS, Gross CG, Coding of visual space by premotor neurons, Science 266:1054-1057, 1994.
15. Hahnloser RHR, Emergence of neural integration in the head-direction system by visual supervision, Neuroscience 120(3):877-891, 2003.
16. Hikosaka K, Iwai E, Saito H, Tanaka K, Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey, J Neurophysiol 60:1615-1637, 1988.
17. Hyvarinen J, Shelepin Y, Distribution of visual and somatic functions in the parietal associative area 7 of the monkey, Brain Res 169:561-564, 1979.
18. Jousmaki V, Hari R, Parchment-skin illusion: Sound-biased touch, Curr Biol 8(6):R190, 1998.
19. Kam M, Zhu X, Kalata P, Sensor fusion for mobile robot navigation, Proc IEEE 85(1):108-119, 1997.
20. Kelso JAS, Cook E, Olson ME, Epstein W, Allocation of attention and the locus of adaptation to displaced vision, J Exp Psychol Human 1:237-245, 1975.
21. Loomis JM, Da Silva JA, Fujita N, Fukusima SS, Visual space perception and visually directed action, J Exp Psychol Human 18:906-921, 1992.
22. Lourens T, Würtz RP, Extraction and matching of symbolic contour graphs, Int J Pattern Recogn 17(7):1279-1302, 2003.
23. Martinetz TM, Berkovich SG, Schulten KJ, Neural gas network for vector quantization and its application to time-series prediction, IEEE T Neural Networ 4:558-569, 1993.
24. Menzel R, Geiger K, Chittka L, Joerges J, Kunze J, Ller U, The knowledge base of bee navigation, J Exp Biol 199(Pt 1):141-146, 1996.
25. Mittelstaedt ML, Mittelstaedt H, Idiothetic navigation in humans: Estimation of path length, Exp Brain Res 139:318-332, 2001.
26. Pick HL, Warren DH, Hay JC, Sensory conflict in judgments of spatial direction, Percept Psychophys 6:203-205, 1969.
27. Ranck JJ, Head-direction cells in the deep cell layers of the dorsal presubiculum in freely-moving rats, Soc Neurosci 10:599, 1984.
28. Rieser JJ, Ashmead DH, Talor CR, Youngquist GA, Visual perception and the guidance of locomotion without vision to previously seen targets, Perception 19:675-689, 1990.
29. Roumeliotis S, Bekey G, Extended kalman filter for frequent local and infrequent global sensor data fusion, Proc SPIE 3209:11-22, 1997.
30. Save E, Poucet B, Involvement of the hippocampus and associative parietal cortex in the use of proximal and distal landmarks for navigation, Behav Brain Res 109(2):195-206, 2000.
31. Schlack A, Hoffmann KP, Bremmer F, Interaction of linear vestibular and visual stimulation in the macaque ventral intraparietal area (vip), J Neurosci 21:23-29, 2001.
32. Schmolesky M, Wang Y, Hanes DP, Thompson KG, Leutgeb S, Schall JD, Leventhal AD, Signal timing across the macaque visual system, J Neurophysiol 79:3272-3278, 1998.
33. Schroeder CE, Mehta AD, Foxe JJ, Determinants and mechanisms of attentional modulation of neural processing, Front Biosci 6:672-684, 2001.
34. Seltzer B, Pandya DN, Afferent cortical connections and architechtonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey, Brain Res 149:1-24, 1978.
35. Seth AK, McKinstry JL, Edelman GM, Krichmar JL, Visual binding through reentrant connectivity and dynamic synchronization in a brain-based device, Cereb Cortex 14:1185-1199, 2004.
36. Stein BE, Meredith MA, The Merging of the Senses, MIT Press, Cambridge, MA, 1993.
37. Taube J, Muller R, Ranck J, Head-direction cells recorded from the postsubiculum in freely moving rats: II. Effects of environmental manipulations, J Neurosci 10:436-447, 1990.
38. Tononi G, Sporns O, Edelman GM, Reentry and the problem of integrating multiple cortical areas: Simulation of dynamic integration in the visual system, Cereb Cortex 2:310-335, 1992.
39. Van Beers RJ, Sittig AC, Denier van der Gon JJ, Integration of proprioceptive and visual position-information: An experimentally supported model, J Neurophysiol 81:1355-1364, 1999.
40. Warren DH, Schmitt TL, On the plasticity of visual-proprioceptive bias effects, J Exp Psychol Human 4:302-310, 1978.
41. Wehner R, Michel B, Antonsen P, Visual navigation in insects: Coupling of egocentric and geocentric information, J Exp Biol 199 (1):129-140, 1996.
42. Welch RB, Widawski MH, Harrington J, Warren DH, An examination of the relationship between visual capture and prism adaptation, Percept Psychophys 25:126-132, 1979.
43. Zeki S, Functional specialization in the visual cortex of the rhesus monkey, Nature 274:423-428, 1978.
44. Zhang K, Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: A theory, J Neurosci 16:2112-2126, 1996.
45. Zimmer UR, Robust world-modelling and navigation in a real world, Neurocomputing 13:247-260, 1996.
46. Zugaro M, Berthoz A, Wiener S, Background, but not foreground, spatial cues are taken as references for head-direction responses by rat anterodorsal thalamic neurons, J Neurosci 21 RC145:1-5, 2001.