A computational perspective on the neural basis of multisensory spatial representations

Nature Reviews Neuroscience

Volumn 3, Issue 9, 2002, Pages 741-747

  Pouget, Alexandre ^a   Deneve, Sophie ^a,b   Duhamel, Jean Renà ^b  

^a UNIVERSITY OF ROCHESTER   (United States)

^b INSTITUT DES SCIENCES COGNITIVES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; BIOLOGICAL MODEL; BRAIN; DEPTH PERCEPTION; EYE MOVEMENT; HUMAN; NERVE CELL; NERVE CELL NETWORK; NERVE TRACT; NONLINEAR SYSTEM; ORIENTATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REVIEW; SENSATION;

ANIMALS; BRAIN; EYE MOVEMENTS; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURAL PATHWAYS; NEURONS; NONLINEAR DYNAMICS; ORIENTATION; PSYCHOMOTOR PERFORMANCE; SENSATION; SPACE PERCEPTION;

EID: 0036716263     PISSN: 1471003X     EISSN: 14710048     Source Type: Journal    
DOI: 10.1038/nrn914     Document Type: Article

References (44)

1. Spence, C. & Driver, J. Crossmodal Space and Crossmodal Attention (Oxford Univ. Press, Oxford, UK, in the press).
2. Yuille, A. L. & Bulthoff, H. H. in Perception as Bayesian inference (eds Knill, D. C. & Richards, W.) 123-162 (Cambridge Univ. Press, New York, 1996).
3. Ernst, M. O. & Banks, M. S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433 (2002).
4. Deneve, S., Latham, P & Pouget, A. Efficient computation and cue integration with noisy population codes. Nature Neurosci. 4, 826-831 (2001).
5. Pena, J. L. & Konishi, M. Auditory spatial receptive fields created by multiplication. Science 292, 249-252 (2001).
6. Gross, C. & Graziano, M. S. A. Multiple representations of space in the brain. Neuroscientist 1, 43-50 (1995).
7. Andersen, R. Multimodal integration for the representation of space in the posterior parietal cortex. Phil. Trans. R. Soc. Lond. B 352, 1421-1428 (1997).
8. Rizzolatti, G., Luppino, G. & Matelli, M. Organization of the cortical motor system: new concepts. Electroencephalogr. Clin. Neurophysiol. 106, 283-296 (1998).
9. Colby, C. & Goldberg, M. Space and attention in parietal cortex. Annu. Rev. Neurosci. 22, 319-349 (1999).
10. Jay, M. F. & Sparks, D. L. Sensorimotor integration in the primate superior colliculus. I. Motor convergence. J. Neurophysiol. 57, 22-34 (1987).
11. Duhamel, J., Bremmer, F., BenHamed, S. & Graf, W. Spatial invariance of visual receptive fields in parietal cortex neurons. Nature 389, 845-848 (1997).
12. Stricanne, B., Andersen, R. & Mazzoni, P. Eye- centered, head-centered, and intermediate coding of remembered sound locations in area LIP. J. Neurophysiol. 76, 2071-2076 (1996).
13. Cohen, Y. & Andersen, R. Reaches to sounds encoded in an eye-centered reference frame. Neuron 27, 647-652 (2000).
14. Buneo, C. A., Jarvis, M. R., Batista, A. P. & Andersen, R. A. Direct visuomotor transformations for reaching. Nature 416, 632-636 (2002).
15. Graziano, M., Hu, X. & Gross, C. Visuospatial properties of ventral premotor cortex. J. Neurophysiol. 77, 2268-2292 (1997).
16. Knill, D. C. Ideal observer perturbation analysis reveals human strategies for inferring surface orientation from texture. Vision Res. 38, 2635-2656 (1998).
17. Jacobs, R. A. & Fine, I. Experience-dependent integration of texture and motion cues to depth. Vision Res. 39, 4062-4075 (1999).
18. Anastasio, T. J., Patton, P. E. & Belkacem-Boussaid, K. Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Comput. 12, 1165-1187 (2000).
19. Colonius, H. & Diederich, A. in Advances in Neural information Processing Systems (eds Dietterich, T. G., Becker, S. & Ghahramani, Z.) (in the press).
20. Poggio, T. A theory of how the brain might work. Cold Spring Harb. Symp. Quant. Biol. 55, 899-910 (1990).
21. Pouget, A. & Sejnowski, T. A neural model of the cortical representation of egocentric distance. Cereb. Cortex 4, 314-329 (1994).
22. Pouget, A. & Sejnowski, T. Spatial transformations in the parietal cortex using basis functions. J. Cogn. Neurosci. 9, 222-237 (1997).
23. Pouget, A., Zhang, K., Deneve, S. & Latham, P. E. Statistically efficient estimation using population codes. Neural Comput. 10, 373-401 (1998).
24. Deneve, S., Latham, P. & Pouget, A. Reading population codes: a neural implementation of ideal observers. Nature Neurosci. 2, 740-745 (1999).
25. Ito, M. Neurophysiological aspects of the cerebellar motor control system. Int. J. Neurol. 7, 162-176 (1970).
26. Kawato, M., Furawaka, K. & Suzuki, R. A hierarchical neural-network model for control and learning of voluntary movement. Biol. Cybern. 57, 169-185 (1987).
27. Jordan, M. & Rumelhart, D. Forward models: supervised learning with a distal teacher. Cogn. Sci. 16, 307-354 (1992).
28. Pouget, A. & Snyder, L. Computational approaches to sensorimotor transformations. Nature Neurosci. 3, 1192-1198 (2000).
29. Zipser, D. & Andersen, R. A back-propagation programmed network that stimulates response properties of a subset of posterior parietal neurons. Nature 331, 679-684 (1988).
30. Burnod, Y. et al. Visuomotor transformations underlying arm movements toward visual targets: a neural network model of cerebral cortical operations. J. Neurosci. 12, 1435-1453 (1992).
31. Groh, J. & Sparks, D. Two models for transforming auditory signals from head-centered to eye-centered coordinates. Biol. Cybern. 67, 291-302 (1992).
32. Salinas, E. & Abbot, L. Transfer of coded information from sensory to motor networks. J. Neurosci. 15, 6461-6474 (1995).
33. Grossberg, S., Roberts, K., Aguilar, M. & Bullock, D. A neural model of multimodal adaptive saccadic eye movement control by superior colliculus. J. Neurosci. 17, 9706-9725 (1997).
34. Andersen, R., Essick, G. & Siegel, R. Encoding of spatial location by posterior parietal neurons. Science 230, 456-458 (1985).
35. Boussaoud, D., Barth, T. & Wise, S. Effects of gaze on apparent visual responses of frontal cortex neurons. Exp. Brain Res. 93, 423-434 (1993).
36. Trotter, Y. & Celebrini, S. Gaze direction controls response gain in primary visual-cortex neurons. Nature 398, 239-242 (1999).
37. Xing, J. & Andersen, R. A. Models of the posterior parietal cortex which perform multimodal integration and represent space in several coordinate frames. J. Cogn. Neurosci. 12, 601-614 (2000).
38. Robinson, D. A. Implications of neural networks for how we think about brain function. Behav. Brain Sci. 15, 644-655 (1992).
39. Driver, J. & Spence, C. Crossmodal links in spatial attention. Phil. Trans. R. Soc. Lond. B Biol. Sci. 353, 1319-1331 (1998).
40. Enright, J. The non-visual impact of eye orientation on eye-hand coordination. Vision Res. 35, 1611-1618 (1995).
41. Lewald, J. & Ehrenstein, W. The effect of eye position on auditory lateralization. Exp. Brain Res. 104, 1586-1597 (1996).
42. Henriques, D., Klier, E., Smith, M., Lowy, D. & Crawford, J. Gaze-centered remapping of remembered visual space in an open-loop pointing task. J. Neurosci. 18, 1583-1594 (1998).
43. Pouget, A., Ducom, J. C., Torri, J. & Bavelier, D. Multisensory spatial representations in eye-centered coordinates. Cognition 83, B1-B11 (2002).
44. Bertelson, P. in Cognitive Contributions to the Perception of Spatial and Temporal Events (eds Ashersleben, G., Bachmann, T. & Musseler, J.) 347-362 (Elsevier, Amsterdam, 1999).