Learning Multisensory Integration and Coordinate Transformation via Density Estimation

PLoS Computational Biology

Volumn 9, Issue 4, 2013, Pages

  Makin, Joseph G ^a   Fellows, Matthew R ^a   Sabes, Philip N ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EQUIVALENCE CLASSES; INTEGRATION; POPULATION STATISTICS;

COORDINATE TRANSFORMATIONS; DENSITY ESTIMATION; LATENT VARIABLE; MULTISENSORY; MULTISENSORY INTEGRATION; NEURAL COMPUTATIONS; OBSERVED DATA; POPULATION ACTIVITIES; SENSORY PROCESSING; VIA DENSITY;

LEARNING SYSTEMS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BRAIN FUNCTION; CONTROLLED STUDY; COORDINATE TRANSFORMATION; COVARIANCE; DENSITY ESTIMATION; MATHEMATICAL MODEL; MULTISENSORY INTEGRATION; PREDICTION; SENSORY STIMULATION; STATISTICAL CONCEPTS; SYNAPTIC TRANSMISSION;

ANIMALIA;

EID: 84876907437     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003035     Document Type: Article

References (67)

1. van Beers RJ, Sittig A, van Der Gon JJD, (1999) Integration of proprioceptive and visual positioninformation: An experimentally supported model. Journal of Neurophysiology 81: 1355-1364.
2. Ma WJ, Beck JM, Latham PE, Pouget A, (2006) Bayesian inference with probabilistic population codes. Nature Neuroscience 9: 1423-1438.
3. Ernst MO, Banks MS, (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415: 429-433.
4. Alais D, Burr D, (2004) The ventriloquist effect results from near-optimal bimodal integration. Current biology: CB 14: 257-62.
5. Kording KP, Wolpert DM, (2004) Bayesian integration in sensorimotor learning. Nature 427: 244-7.
6. Stocker AA, Simoncelli EP, (2006) Noise characteristics and prior expectations in human visual speed perception. Nature neuroscience 9: 578-85.
7. Knill DC, Pouget A, (2004) The Bayesian brain: the role of uncertainty in neural coding and computation. Trends in Neurosciences 27: 712-719.
8. Held R, Freedman SJ, (1963) Plasticity in Human Sensorimotor Control. Science 142: 455-462.
9. Knudsen EI, Knudsen PF, (1989) Vision calibrates sound localization in developing barn owls. Journal of Neuroscience 9: 3306-13.
10. Ghahramani Z, Wolpert DM, Jordan MI, (1996) Generalization to local remappings of the visuomotor coordinate transformation. Journal of Neuroscience 16: 7085-7096.
11. Simani M, McGuire LMM, Sabes PN, (2007) Visual-shift adaptation is composed of separable sensory and task-dependent effects. Journal of neurophysiology 98: 2827.
12. Redding GM, Rossetti Y, Wallace B, (2005) Applications of prism adaptation: a tutorial in theory and method. Neuroscience and biobehavioral reviews 29: 431-44.
13. Held R, Hein A, (1963) Movement-produced stimulation in the development of visually guided behavior. Physiological Psychology 56: 872-876.
14. Sur M, Pallas SL, Roe AW, (1990) Cross-modal plasticity in cortical development: differentiation and specification of sensory neocortex. TINS 13: 341-345.
15. Lyckman AW, Sur M, (2002) Role of Afferent Activity in the Development of Cortical Specification. Results and Problems in Cell Differentiation 39: 139-156.
16. Hinton GE, Osindero S, Teh Y, (2006) A fast learning algorithm for deep belief nets. Neural Computation 18: 1527-1554.
17. Hinton GE, (2002) Training Products of Experts by Minimizing Contrastive Divergence. Neural Computation 14: 1771-1800.
18. Sober S, Sabes PN, (2003) Multisensory integration during motor planning. Journal of Neuroscience 23: 6982-6992.
19. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE, (2012) Neural correlates of reliability-based cue weighting during multisensory integration. Nature neuroscience 15: 146-54.
20. Sober S, Sabes PN, (2005) Flexible strategies for sensory integration during motor planning. Nature Neuroscience 8: 490-497.
21. Körding KP, Beierholm U, Ma WJ, Quartz S, (2007) Causal inference in multisensory perception. PloS One 2: e943.
22. Ernst MO, Bülthoff HH, (2004) Merging the senses into a robust percept. Trends in cognitive sciences 8: 162-9.
23. McGuire LMM, Sabes PN, (2009) Sensory transformations and the use of multiple reference frames for reach planning. Nature neuroscience 12: 1056-61.
24. Davison AP, Fregnac Y, (2006) Learning Cross-Modal Spatial Transformations through Spike Timing-Dependent Plasticity. Journal of Neuroscience 26: 5604-5615.
25. Xing J, Andersen RA, (2000) Models of the posterior parietal cortex which perform multimodal integration and represent space in several coordinate frames. Journal of cognitive neuroscience 12: 601-14.
26. Salinas E, Abbott LF, (1995) Transfer of Coded Information from Sensory to Motor Networks. Journal of Neuroscience 15: 6461-6474.
27. Denève S, Latham PE, Pouget A, (2001) Efficient computation and cue integration with noisy population codes. Nature Neuroscience 4: 826-831.
28. Duhamel JR, Bremmer F, Ben Hamed S, (1997) GrafW (1997) Spatial invariance of visual receptive fields in parietal cortex neurons. Nature 389: 845-8.
29. McGuire LMM, Sabes PN, (2011) Heterogeneous representations in the superior parietal lobule are common across reaches to visual and proprioceptive targets. Journal of Neuroscience 31: 6661-73.
30. Avillac M, Denève S, Olivier E, Pouget A, Duhamel JR, (2005) Reference frames for representing visual and tactile locations in parietal cortex. Nature Neuroscience 8: 941-949.
31. Bremner LR, Andersen RA, (2012) Coding of the Reach Vector in Parietal Area 5d. Neuron 75: 342-351.
32. Pesaran B, Nelson MJ, Andersen RA, (2006) Dorsal premotor neurons encode the relative position of the hand, eye, and goal during reach planning. Neuron 51: 125-34.
33. Buneo CA, Andersen RA, (2006) The posterior parietal cortex: sensorimotor interface for the planning and online control of visually guided movements. Neuropsychologia 44: 2594-606.
34. Duhamel J, Colby CL, Goldberg ME, Colby CL, Goldberg ME, (1998) Ventral Intraparietal Area of the Macaque: Congruent Visual and Somatic Response Properties Ventral Intraparietal Area of the Macaque: Congruent Visual and Somatic Response Properties. Journal of Neurophysiology 79: 126-136.
35. Ferraina S, Johnson PB, Garasto MR, Ercolani L, Bianchi L, et al. (1997) Combination of Hand and Gaze Signals During Reaching: Activity in Parietal Area 7m of the Monkey. Journal of Neurophysiology 77: 1034-1038.
36. Galletti C, Gamberini M, Kutz DF, Fattori P, Luppino G, et al. (2001) The cortical connections of area V6: an occipito-parietal network processing visual information. The European journal of neuroscience 13: 1572-88.
37. Graziano MS, (1999) Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proceedings of the National Academy of Sciences of the United States of America 96: 10418-21.
38. Shipp S, Blanton M, Zeki S, (1998) A visuo-somatomotor pathway through superior parietal cortex in the macaque monkey: cortical connections of areas V6 and V6A. The European journal of neuroscience 10: 3171-93.
39. Battaglia-Mayer A, Caminiti R, Lacquaniti F, Zago M, Sapienza RL, et al. (2003) Multiple Levels of Representation of Reaching in the Parieto-frontal Network. Cerebral cortexCerebral cortex 13: 1009-1022.
40. Graziano MSA, (1998) Spatial maps for the control of movement and Charles G Gross. Current Opinion in Neurobiology 8: 195-201.
41. Johnson PB, Ferraina S, Bianchi L, Caminiti R, (1996) Cortical networks for visual reaching: physiological and anatomical organization of frontal and parietal lobe arm regions. Cerebral cortex (New York, NY: 1991) 6: 102-19.
42. Lewis JW, Van Essen DC, (2000) Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. The Journal of comparative neurology 428: 112-37.
43. Wise SP, Boussaoud D, Johnson PB, Caminiti R, (1997) Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. Annual review of neuroscience 20: 25-42.
44. Chang SWC, Snyder LH, (2010) Idiosyncratic and systematic aspects of spatial representations in the macaque parietal cortex. Proceedings of the National Academy of Sciences of the United States of America 107: 7951-6.
45. Sabes PN, (2011) Sensory integration for reaching: Models of optimality in the context of behavior and the underlying neural circuits. Progress in brain research 191: 195-209.
46. Wu S, Amari Si, (2005) Computing with continuous attractors: stability and online aspects. Neural computation 17: 2215-39.
47. Verstynen T, Sabes PN, (2011) How each movement changes the next: an experimental and theoretical study of fast adaptive priors in reaching. The Journal of neuroscience: the official journal of the Society for Neuroscience 31: 10050-9.
48. Földiák P (1993) The 'ideal homunculus': Statistical inference from neural population responses. In: Eeckman FH, Bower JM, editors, Computation and neural systems, Norwell, MA: Norwell, MA: Kluwer Academic Publishers, chapter 9. pp. 55-60.
49. Olshausen BA, Field D, (1997) Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research 37: 3311-3325.
50. Ghahramani Z (1995) Factorial learning and the EM algorithm. In: Tesauro G, Touretzky DS, Leen TK, editors. Advances in neural information processing systems. Cambridge (MA): MIT Press.
51. Barlow HB, (1961) Possible principles underlying the transformation of sensory messages. Sensory communication 1: 217-234.
52. Becker S, Hinton GE, (1992) Self-organizing neural network that discovers surfaces in random-dot stereograms. Nature 355: 161-163.
53. Yildirim I, Jacobs Ra, (2012) A rational analysis of the acquisition of multisensory representations. Cognitive science 36: 305-32.
54. Pouget A, Denève S, Duhamel JR, (2002) A computational perspective on the neural basis of multisensory spatial representations. Nature Reviews Neuroscience 3: 1-7.
55. Burnod Y, Grandguillaume P, Otto I, Ferraina S, Johnson PB, et al. (1992) Visuomotor transformations underlying arm movements toward visual targets: a neural network model of cerebral cortical operations. Journal of Neuroscience 12: 1435-53.
56. Attneave F, (1954) Some informational aspects of visual perception. Psychological review 61: 183-93.
57. Barlow HB, (2001) Redundancy reduction revisited. Network (Bristol, England) 12: 241-53.
58. Lewicki MS, Olshausen BA, (1999) Probabilistic framework for the adaptation and comparison of image codes. J Opt Soc Am 16: 1587-1601.
59. Lewicki MS, (2002) Efficient coding of natural sounds. Nature Neuroscience 5: 356-363.
60. Eichhorn J, Sinz F, Bethge M, (2009) Natural image coding in V1: how much use is orientation selectivity? PLoS computational biology 5: 1-16.
61. Dayan P, Abbott L, (2001) Theoretical Neuroscience. MIT Press pp. 101-106.
62. Welling M, Rosen-Zvi M, Hinton GE (2004) Exponential Family Harmoniums with an Application to Information Retrieval. In: Neural Information Processing Systems 17. pp. 1481-1488.
63. McCullagh P, Nelder JA (1989) Generalized Linear Models. 2nd edition. London: Chapman and Hall/CRC. pp. 26-32.
64. Sohl-Dickstein J, Battaglino P, DeWeese MR, (2011) Minimum Probability Flow Learning. Proc. ICML 2011: 905-912.
65. Bell CC, Caputit A, Grant K, Serrier J, (1993) Storage of a sensory pattern by anti-Hebbian synaptic plasticity in an electric fish. PNAS 90: 4650-4654.
66. Lisman J, (1989) A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proceedings of the National Academy of Sciences of the United States of America 86: 9574-8.
67. Hinton GE, Salakhutdinov RR, (2006) Reducing the Dimensionality of Data with Neural Networks. Science 313: 504-507.