Decentralized multisensory information integration in neural systems

Journal of Neuroscience

Volumn 36, Issue 2, 2016, Pages 532-547

  Zhang, Wen Hao ^a,b   Chen, Aihua ^c   Rasch, Malte J ^b   Wu, Si ^b  

^a Chinese Academy of Sciences   (China)

^b BEIJING NORMAL UNIVERSITY   (China)

^c B326 Science Building   (China)

Author keywords

Continuous attractor neural network; Decentralized information integration

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYES THEOREM; BRAIN FUNCTION; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; MIDDLE TEMPORAL GYRUS; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; SENSORIMOTOR INTEGRATION; SENSORY STIMULATION; SIGNAL DETECTION; STIMULUS RESPONSE; ANIMAL; BIOLOGICAL MODEL; COMPUTER SIMULATION; HUMAN; INFORMATION PROCESSING; NERVE CELL; NERVE TRACT; PHYSIOLOGY; SENSATION;

ANIMALS; AUTOMATIC DATA PROCESSING; BAYES THEOREM; COMPUTER SIMULATION; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURAL PATHWAYS; NEURONS; SENSATION;

EID: 84954310967     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0578-15.2016     Document Type: Article

References (62)

1. Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14:257-262. CrossRef Medline
2. Alvarado JC, Rowland BA, Stanford TR, Stein BE (2008) A neural network model of multisensory integration also accounts for unisensory integration in superior colliculus. Brain Res 1242:13-23. CrossRef Medline
3. Avillac M, Denève S, Olivier E, Pouget A, Duhamel JR (2005) Reference frames for representing visual and tactile locations in parietal cortex. Nat Neurosci 8:941-949. CrossRef Medline
4. Baizer JS, Ungerleider LG, Desimone R (1991) Organization of visual inputs to the inferior temporal and posterior parietal cortex in macaques. J Neurosci 11:168 -190. Medline
5. Beck JM, Latham PE, Pouget A (2011) Marginalization in neural circuits with divisive normalization. J Neurosci 31:15310 -15319. CrossRef Medline
6. Ben-Yishai R, Bar-Or RL, SompolinskyH (1995) Theory of orientation tuning in visual cortex. Proc Natl Acad Sci U S A 92:3844 -3848. CrossRef Medline
7. Bertin RJ, Berthoz A (2004) Visuo-vestibular interaction in the reconstruction of travelled trajectories. Exp Brain Res 154:11-21. CrossRef Medline
8. Boussaoud D, Ungerleider LG, Desimone R (1990) Pathways for motion analysis: cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. J Comp Neurol 296:462- 495. CrossRef Medline
9. Bresciani JP, Dammeier F, ErnstMO (2006) Vision and touch are automatically integrated for the perception of sequences of events. J Vis 6:554- 564. Medline
10. Britten KH, Shadlen MN, Newsome WT, Movshon JA (1992) The analysis of visual motion: a comparison of neuronal and psychophysical performance. J Neurosci 12:4745- 4765. Medline
11. Carandini M, Heeger DJ, Movshon JA (1997) Linearity and normalization in simple cells of the macaque primary visual cortex. J Neurosci 17:8621- 8644. Medline
12. Chen A, DeAngelis GC, Angelaki DE (2011a) A comparison of vestibular spatiotemporal tuning in macaque parietoinsular vestibular cortex, ventral intraparietal area, and medial superior temporal area. J Neurosci 31:3082-3094. CrossRef Medline
13. Chen A, DeAngelis GC, AngelakiDE (2011b) Convergence of vestibular and visual self-motion signals in an area of the posterior sylvian fissure. J Neurosci 31:11617-11627. CrossRef Medline
14. Chen A, Deangelis GC, Angelaki DE (2013) Functional specializations of the ventral intraparietal area for multisensory heading discrimination. J Neurosci 33:3567-3581. CrossRef Medline
15. Clark JJ, Yuille AL (2013) Data fusion for sensory information processing systems, Vol 105. New York: Springer Science and Business Media.
16. Compte A, Brunel N, Goldman-Rakic PS, Wang XJ (2000) Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cereb Cortex 10:910 -923. CrossRef Medline
17. Dayan P, Abbott LF (2001) Theoretical neuroscience, Vol 806. Cambridge, MA: MIT.
18. Denève S, Pouget A (2004) Bayesian multisensory integration and crossmodal spatial links. J Physiol 98:249 -258. Medline
19. Denève S, Latham PE, Pouget A (1999) Reading population codes: a neural implementation of ideal observers. Nat Neurosci 2:740 -745. CrossRef Medline
20. Denève S, Latham PE, Pouget A (2001) Efficient computation and cue integration with noisy population codes. Nat Neurosci 4:826-831. CrossRef Medline
21. Durrant-Whyte H, Henderson TC (2008) Multisensor data fusion. In: Springer Handbook of Robotics (Siciliano B, Khatib O, eds), pp 585-610. New York: Springer.
22. Ernst MO (2005) A Bayesian view on multimodal cue integration. In: Human body perception from the inside out (Knoblich G, Grosjean M, Thornton I, Shiffrar M, eds), pp 105-131. Oxford: Oxford University.
23. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433. CrossRef
24. Fetsch CR, Turner AH, DeAngelis GC, Angelaki DE (2009) Dynamic reweighting of visual and vestibular cues during self-motion perception. J Neurosci 29:15601-15612. CrossRef Medline
25. Fetsch CR, DeAngelis GC, Angelaki DE (2013) Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons. Nat reviews Neuroscience 14:429-442. CrossRef Medline
26. Fung CC, Wong KY, Wu S (2010) A moving bump in a continuous manifold: a comprehensive study of the tracking dynamics of continuous attractor neural networks. Neural Comput 22:752-792. CrossRef Medline
27. Gabel SF, Misslisch H, Schaafsma SJ, Duysens J (2002) Temporal properties of optic flow responses in the ventral intraparietal area. Vis Neurosci 19:381-388. Medline
28. Gu Y, Angelaki DE, Deangelis GC (2008) Neural correlates of multisensory cue integration in macaque MSTd. Nat Neurosci 11:1201-1210. CrossRef Medline
29. Gu Y, Deangelis GC, Angelaki DE (2012) Causal links between dorsal medial superior temporal area neurons and multisensory heading perception. J Neurosci 32:2299 -2313. CrossRef Medline
30. Gu Y, Cheng Z, Yang L, DeAngelis GC, Angelaki DE (2015) Multisensory convergence of visual and vestibular heading cues in the pursuit area of the frontal eye field. Cereb Cortex. In press. Medline
31. Hillis JM, Ernst MO, Banks MS, Landy MS (2002) Combining sensory information: mandatory fusion within, but not between, senses. Science 298:1627-1630. CrossRef Medline
32. Jacobs RA (1999) Optimal integration of texture and motion cues to depth. Vision Res 39:3621-3629. CrossRef Medline
33. Kilpatrick ZP (2013) Interareal coupling reduces encoding variability in multi-area models of spatial working memory. Front Comput Neurosci 7:82. Medline
34. Körding KP, Wolpert DM (2004) The loss function of sensorimotor learning. Proc Natl Acad Sci U S A 101:9839 -9842. CrossRef Medline
35. Körding KP, Beierholm U,MaWJ, Quartz S, Tenenbaum JB, Shams L (2007) Causal inference in multisensory perception. PLoS One 2:e943. CrossRef Medline
36. Lewis JW, Van Essen DC (2000) Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J Comp Neurol 428:112-137. CrossRef Medline
37. Ma WJ, Beck JM, Latham PE, Pouget A (2006) Bayesian inference with probabilistic population codes. Nat Neurosci 9:1432-1438. CrossRef Medline
38. Magosso E, Cuppini C, Serino A, Di Pellegrino G, Ursino M (2008) A theoretical study of multisensory integration in the superior colliculus by a neural network model. Neural Netw 21:817- 829. CrossRef Medline
39. Moreno-Bote R, Beck J, Kanitscheider I, Pitkow X, Latham P, Pouget A (2014) Information-limiting correlations. Nat Neurosci 17:1410 -1417. CrossRef Medline
40. Morgan ML, Deangelis GC, Angelaki DE (2008) Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59:662- 673. CrossRef Medline
41. Ohshiro T, Angelaki DE, DeAngelis GC (2011) A normalization model of multisensory integration. Nat Neurosci 14:775-782. CrossRef Medline
42. Ponce-Alvarez A, Thiele A, Albright TD, Stoner GR, Deco G (2013) Stimulus-dependent variability and noise correlations in cortical MT neurons. Proc Natl Acad Sci U S A 110:13162-13167. CrossRef Medline
43. Pouget A, Denève S, Duhamel JR (2002) A computational perspective on the neural basis of multisensory spatial representations. Nat Rev Neurosci 3:741-747. CrossRef Medline
44. Pouget A, Dayan P, Zemel RS (2003) Inference and computation with population codes. Annu Rev Neurosci 26:381- 410. CrossRef Medline
45. Roach NW, Heron J, McGraw PV (2006) Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. Proc Biol Sci 273:2159 -2168. CrossRef Medline
46. Rumelhart DE, McClelland JL, PDP Research Group (1986) Explorations in the Microstructure of Cognition. In: Parallel Distributed Processing, Vol 1, Foundations. Cambridge, MA: MIT.
47. Sabes PN (2011) Sensory integration for reaching: models of optimality in the context of behavior and the underlying neural circuits. Prog Brain Res 191:195-209. CrossRef Medline
48. Samsonovich A, McNaughton BL (1997) Path integration and cognitive mapping in a continuous attractor neural network model. J Neurosci 17:5900 -5920. Medline
49. Sato Y, Toyoizumi T, Aihara K (2007) Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli. Neural Comput 19:3335-3355. CrossRef Medline
50. Senkowski D, Schneider TR, Foxe JJ, Engel AK (2008) Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci 31:401- 409. CrossRef Medline
51. Shams L, Ma WJ, Beierholm U (2005) Sound-induced flash illusion as an optimal percept. Neuroreport 16:1923-1927. CrossRef Medline
52. Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9:255-266. Medline
53. Tononi G, Edelman GM (1998) Consciousness and complexity. Science 282:1846 -1851. CrossRef Medline
54. Ursino M, Cuppini C, Magosso E, Serino A, di Pellegrino G (2009) Multisensory integration in the superior colliculus: a neural network model. J Comput Neurosci 26:55-73. CrossRef Medline
55. van Beers RJ, Sittig AC, Gon JJ (1999) Integration of proprioceptive and visual position-information: an experimentally supported model. J Neurophysiol 81:1355-1364. Medline
56. Vincent JL, Patel GH, Fox MD, Snyder AZ, Baker JT, Van Essen DC, Zempel JM, Snyder LH, Corbetta M, Raichle ME (2007) Intrinsic functional architecture in the anaesthetized monkey brain. Nature 447:83- 86. CrossRef Medline
57. Wimmer K, Nykamp DQ, Constantinidis C, Compte A (2014) Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory. Nat Neurosci 17:431- 439. CrossRef Medline
58. Wozny DR, Beierholm UR, Shams L (2008) Human trimodal perception follows optimal statistical inference. J Vis 8:24.1-24.11. Medline
59. Wu S, Amari S, Nakahara H (2002) Population coding and decoding in a neural field: a computational study. Neural Comput 14:999 -1026. CrossRef Medline
60. Wu S, Hamaguchi K, Amari S (2008) Dynamics and computation of continuous attractors. Neural Comput 20:994 -1025. CrossRef Medline
61. Zhang K (1996) Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory. J Neurosci 16:2112- 2126. Medline
62. Zhang W, Wu S (2012) Neural information processing with feedback modulations. Neural Comput 24:1695-1721. CrossRef Medline