Cortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception

PLoS Biology

Volumn 13, Issue 2, 2015, Pages

  Rohe, Tim ^a   Noppeney, Uta ^a,b  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; BAYESIAN CAUSAL INFERENCE; BAYESIAN LEARNING; BRAIN CORTEX; COGNITION; CONTROLLED STUDY; DEPTH PERCEPTION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING; HUMAN; HUMAN EXPERIMENT; INTRAPARIETAL SULCUS; MACHINE LEARNING; MALE; MULTISENSORY PERCEPTION; NEOCORTEX; NORMAL HUMAN; PERCEPTION; PREDICTION; VISION; VISUAL CORTEX; VISUAL STIMULATION; ANATOMY AND HISTOLOGY; AUDITORY STIMULATION; BAYES THEOREM; BRAIN MAPPING; EYE MOVEMENT; IMAGE PROCESSING; NERVE CELL NETWORK; NERVE TRACT; NUCLEAR MAGNETIC RESONANCE IMAGING; PARIETAL LOBE; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSICS; REACTION TIME;

ACOUSTIC STIMULATION; ADULT; AUDITORY CORTEX; AUDITORY PERCEPTION; BAYES THEOREM; BRAIN MAPPING; COGNITION; EYE MOVEMENTS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; NERVE NET; NEURAL PATHWAYS; PARIETAL LOBE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSICS; REACTION TIME; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 84924067613     PISSN: 15449173     EISSN: 15457885     Source Type: Journal    
DOI: 10.1371/journal.pbio.1002073     Document Type: Article

References (49)

1. Shams L, Beierholm UR, (2010) Causal inference in perception. Trends Cogn Sci 14: 425–432. doi: 10.1016/j.tics.2010.07.001 20705502
2. Koerding KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, et al. (2007) Causal inference in multisensory perception. PLoS ONE 2: e943. 17895984
3. Alais D, Burr D, (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14: 257–262. 14761661
4. Ernst MO, Banks MS, (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415: 429–433. 11807554
5. Hillis JM, Watt SJ, Landy MS, Banks MS, (2004) Slant from texture and disparity cues: optimal cue combination. J Vis 4: 967–992. 15669906
6. Jacobs RA, (1999) Optimal integration of texture and motion cues to depth. Vision Res 39: 3621−3629. 10746132
7. Knill DC, Saunders JA, (2003) Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Res 43: 2539–2558. 13129541
8. van Beers RJ, Wolpert DM, Haggard P, (2002) When feeling is more important than seeing in sensorimotor adaptation. Curr Biol 12: 834–837. 12015120
9. Landy MS, Maloney LT, Johnston EB, Young M, (1995) Measurement and modeling of depth cue combination: in defense of weak fusion. Vision Res 35: 389–412. 7892735
10. Roach NW, Heron J, McGraw PV, (2006) Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. Proc Biol Sci 273: 2159–2168. 16901835
11. Bertelson P, Radeau M, (1981) Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Attention, Perception, & Psychophysics 29: 578–584. doi: 10.1037/xhp0000031 25621585
12. Wallace MT, Roberson GE, Hairston WD, Stein BE, Vaughan JW, et al. (2004) Unifying multisensory signals across time and space. Exp Brain Res 158: 252–258. 15112119
13. Tian B, Reser D, Durham A, Kustov A, Rauschecker JP, (2001) Functional specialization in rhesus monkey auditory cortex. Science 292: 290–293. 11303104
14. Mishkin M, Ungerleider LG, Macko KA, (1983) Object vision and spatial vision: two cortical pathways. Trends in neurosciences 6: 414–417.
15. Lakatos P, Chen CM, O’Connell MN, Mills A, Schroeder CE, (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53: 279–292. 17224408
16. Kayser C, Petkov CI, Augath M, Logothetis NK, (2007) Functional imaging reveals visual modulation of specific fields in auditory cortex. J Neurosci 27: 1824–1835. 17314280
17. Lewis R, Noppeney U, (2010) Audiovisual synchrony improves motion discrimination via enhanced connectivity between early visual and auditory areas. J Neurosci 30: 12329–12339. doi: 10.1523/JNEUROSCI.5745-09.2010 20844129
18. Werner S, Noppeney U, (2010) Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J Neurosci 30: 2662–2675. doi: 10.1523/JNEUROSCI.5091-09.2010 20164350
19. Lee H, Noppeney U, (2014) Temporal prediction errors in visual and auditory cortices. Curr Biol 24: R309–R310. doi: 10.1016/j.cub.2014.02.007 24735850
20. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, et al. (2000) Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10: 77–83. 10978694
21. Noesselt T, Rieger JW, Schoenfeld MA, Kanowski M, Hinrichs H, et al. (2007) Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J Neurosci 27: 11431–11441. 17942738
22. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE, (2012) Neural correlates of reliability-based cue weighting during multisensory integration. Nat Neurosci 15: 146–154. doi: 10.1038/nn.2983 22101645
23. Morgan ML, Deangelis GC, Angelaki DE, (2008) Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59: 662–673. doi: 10.1016/j.neuron.2008.06.024 18760701
24. Fetsch CR, Deangelis GC, Angelaki DE, (2013) Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons. Nat Rev Neurosci 14: 429–442. doi: 10.1038/nrn3503 23686172
25. Ma WJ, Beck JM, Latham PE, Pouget A, (2006) Bayesian inference with probabilistic population codes. Nat Neurosci 9: 1432–1438. 17057707
26. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A, (2004) Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci 7: 1190–1192. 15475952
27. Bonath B, Noesselt T, Martinez A, Mishra J, Schwiecker K, et al. (2007) Neural basis of the ventriloquist illusion. Curr Biol 17: 1697–1703. 17884498
28. Ghazanfar AA, Schroeder CE, (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10: 278–285. 16713325
29. Macaluso E, Driver J, Frith CD, (2003) Multimodal spatial representations engaged in human parietal cortex during both saccadic and manual spatial orienting. Curr Biol 13: 990–999. 12814544
30. Hein G, Doehrmann O, Muller NG, Kaiser J, Muckli L, et al. (2007) Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. J Neurosci 27: 7881–7887. 17652579
31. Bonath B, Noesselt T, Krauel K, Tyll S, Tempelmann C, et al. (2014) Audio-visual synchrony modulates the ventriloquist illusion and its neural/spatial representation in the auditory cortex. Neuroimage 98: 25–434.
32. Colby CL, Goldberg ME, (1999) Space and attention in parietal cortex. Annu Rev Neurosci 22: 319−349. 10202542
33. Gottlieb JP, Kusunoki M, Goldberg ME, (1998) The representation of visual salience in monkey parietal cortex. Nature 391: 481–484. 9461214
34. Shomstein S, Yantis S, (2004) Control of attention shifts between vision and audition in human cortex. J Neurosci 24: 10702−10706. 15564587
35. Szczepanski SM, Konen CS, Kastner S, (2010) Mechanisms of spatial attention control in frontal and parietal cortex. J Neurosci 30: 148–160. doi: 10.1523/JNEUROSCI.3862-09.2010 20053897
36. Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG, (2010) The multifaceted interplay between attention and multisensory integration. Trends Cogn Sci 14: 400–410. doi: 10.1016/j.tics.2010.06.008 20675182
37. Algazi VR, Duda RO, Thompson DM, Avendano C, (2001) The cipic hrtf database. IEEE. pp. 99−102. doi: 10.1155/S1463924601000141 18968351
38. Brainard DH, (1997) The psychophysics toolbox. Spatial vision 10: 433–436. 9176952
39. Wozny DR, Beierholm UR, Shams L, (2010) Probability matching as a computational strategy used in perception. PLoS Comput Biol 6: e1000871. doi: 10.1371/journal.pcbi.1000871 20700493
40. Nagelkerke NJ, (1991) A note on a general definition of the coefficient of determination. Biometrika 78: 691–692.
41. Raftery AE, (1995) Bayesian model selection in social research. Sociological Methodology 25: 111–163.
42. Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ, (2009) Bayesian model selection for group studies. Neuroimage 46: 1004−1017. doi: 10.1016/j.neuroimage.2009.03.025 19306932
43. Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, et al. (1994) Statistical parametric maps in functional imaging: a general linear approach. Human brain mapping 2: 189–210.
44. Chang CC, Lin CJ, (2011) LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST) 2: 27.
45. Efron B, Tibshirani RJ, (1994) An introduction to the bootstrap. London: Chapmann and Hall. 25144107
46. Eickhoff SB, Stephan KE, Mohlberg H, Grefkes C, Fink GR, et al. (2005) A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage 25: 1325–1335. 15850749
47. Sereno MI, Dale AM, Reppas JB, Kwong KK, Belliveau JW, et al. (1995) Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science 268: 889–893. 7754376
48. Dale AM, Fischl B, Sereno MI, (1999) Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 9: 179–194. 9931268
49. Swisher JD, Halko MA, Merabet LB, McMains SA, Somers DC, (2007) Visual topography of human intraparietal sulcus. J Neurosci 27: 5326–5337. 17507555