Audiovisual functional magnetic resonance imaging adaptation reveals multisensory integration effects in object-related sensory cortices

Journal of Neuroscience

Volumn 30, Issue 9, 2010, Pages 3370-3379

  Doehrmann, Oliver ^a   Weigelt, Sarah ^b,c   Altmann, Christian F ^a,d   Kaiser, Jochen ^a   Naumer, Marcus J ^a  

^a GOETHE UNIVERSITY   (Germany)

^b MAX PLANCK INSTITUTE FOR BRAIN RESEARCH   (Germany)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d KYOTO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY CORTEX; AUDITORY STIMULATION; BRAIN REGION; CORPUS STRIATUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROIMAGING; NORMAL HUMAN; OBJECT RELATION; OCCIPITAL CORTEX; PRIORITY JOURNAL; SEMANTIC MEMORY; SENSORY CORTEX; SUBICULUM; VISUAL STIMULATION; VOCALIZATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY CORTEX; AUDITORY PATHWAYS; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NEUROPSYCHOLOGICAL TESTS; OCCIPITAL LOBE; PHOTIC STIMULATION; TEMPORAL LOBE; VISUAL CORTEX; VISUAL PATHWAYS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 77749341543     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.5074-09.2010     Document Type: Article

References (57)

1. Altmann CF, Deubelius A, Kourtzi Z (2004) Shape saliency modulates contextual processing in the human lateral occipital complex. J Cogn Neurosci 16:794-804.
2. Altmann CF, Doehrmann O, Kaiser J (2007) Selectivity for animal vocalizations in the human auditory cortex. Cereb Cortex 17:2601-2608.
3. Amedi A, Malach R, Hendler T, Peled S, Zohary E (2001) Visuo-haptic objectrelated activation in the ventral visual pathway. Nat Neurosci 4:324-330.
4. Amedi A, Stern WM, Camprodon JA, Bermpohl F, Merabet L, Rotman S, Hemond C, Meijer P, Pascual-Leone A (2007) Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex. Nat Neurosci 10:687-689.
5. Beauchamp MS (2005) Statistical criteria in FMRI studies of multisensory integration. Neuroinformatics 3:93-113.
6. Beauchamp MS, Lee KE, Argall BD, MartinA (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809-823.
7. Bergerbest D, Ghahremani DG, Gabrieli JD (2004) Neural correlates of auditory repetition priming: reduced fMRI activation in the auditory cortex. J Cogn Neurosci 16:966-977.
8. Clavagnier S, Falchier A, KennedyH (2004) Long-distance feedback projections to area V1: implications for multisensory integration, spatial awareness, and visual consciousness. Cogn Affect Behav Neurosci 4:117-126.
9. Clemo HR, Sharma GK, Allman BL, Meredith MA (2008) Auditory projections to extrastriate visual cortex: connectional basis for multisensory processing in "unimodal" visual neurons. Exp Brain Res 191:37-47.
10. DaleAM (1999) Optimal experimental design for event-related fMRI.Hum Brain Mapp 8:109-114.
11. Doehrmann O, Naumer MJ (2008) Semantics and the multisensory brain: how meaning modulates processes of audio-visual integration. Brain Res 1242:136-150.
12. Doehrmann O, Naumer MJ, Volz S, Kaiser J, Altmann CF (2008) Probing category selectivity for environmental sounds in the human auditory brain. Neuropsychologia 46:2776-2786.
13. Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on "sensory-specific" brain regions, neural responses, and judgments. Neuron 57:11-23.
14. Falchier A, Clavagnier S, Barone P, Kennedy H (2002) Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22:5749-5759.
15. Fiebach CJ, Gruber T, Supp GG (2005) Neuronal mechanisms of repetition priming in occipitotemporal cortex: spatiotemporal evidence from functional magnetic resonance imaging and electroencephalography. J Neurosci 25:3414-3422.
16. Friston KJ, Josephs O, Rees G, Turner R (1998) Nonlinear event-related responses in fMRI. Magn Reson Med 39:41-52.
17. Gagnepain P, Chételat G, Landeau B, Dayan J, Eustache F, LebretonK (2008) Spoken word memory traces within the human auditory cortex revealed by repetition priming and functional magnetic resonance imaging. J Neurosci 28:5281-5289.
18. Ghazanfar AA, Schroeder CE (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10:278-285.
19. Ghazanfar AA, Chandrasekaran C, Logothetis NK (2008) Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J Neurosci 28:4457-4469.
20. Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473-490.
21. Goebel R, Esposito F, Formisano E (2006) Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: from single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Hum Brain Mapp 27:392-401.
22. Grill-Spector K, Malach R (2001) fMR-adaptation: a tool for studying the functional properties of human cortical neurons. Acta Psychol (Amst) 107:293-321.
23. Gruber T, MüllerMM (2005) Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. Cereb Cortex 15:109-116.
24. Hein G, Doehrmann O, Müller NG, Kaiser J, Muckli L, Naumer MJ (2007) Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. J Neurosci 27:7881-7887.
25. Henson RN (2003) Neuroimaging studies of priming. Prog Neurobiol 70:53-81.
26. Henson R, Shallice T, Dolan R (2000) Neuroimaging evidence for dissociable forms of repetition priming. Science 287:1269-1272.
27. Hocking J, Price CJ (2008) The role of the posterior superior temporal sulcus in audiovisual processing. Cereb Cortex 18:2439-2449.
28. James TW, Gauthier I (2006) Repetition-induced changes in BOLD response reflect accumulation of neural activity. Hum Brain Mapp 27:37-46.
29. James TW, Humphrey GK, Gati JS, Servos P, Menon RS, GoodaleMA (2002) Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 40:1706-1714.
30. Kayser C, Petkov CI, Augath M, Logothetis NK (2005) Integration of touch and sound in auditory cortex. Neuron 48:373-384.
31. Kourtzi Z, Kanwisher N (2001) Representation of perceived object shape by the human lateral occipital complex. Science 293:1506-1509.
32. Koutstaal W, Wagner AD, Rotte M, Maril A, Buckner RL, Schacter DL (2001) Perceptual specificity in visual object priming: functional magnetic resonance imaging evidence for a laterality difference in fusiform cortex. Neuropsychologia 39:184-199.
33. Kriegeskorte N, Simmons WK, Bellgowan PS, Baker CI (2009) Circular analysis in systems neuroscience: the dangers of double dipping. Nat Neurosci 12:535-540.
34. Laguna P, Moody GB, Mark RG (1998) Power spectral density of unevenly sampled data by least-square analysis: performance and application to heart rate signals. IEEE Trans Biomed Eng 45:698-715.
35. Lakatos P, Chen CM, O'Connell MN, Mills A, Schroeder CE (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279-292.
36. Laurienti PJ, Perrault TJ, Stanford TR, Wallace MT, Stein BE (2005) On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Exp Brain Res 166:289-297.
37. Lerner Y, Hendler T, Ben-Bashat D, Harel M, Malach R (2001) A hierarchical axis of object processing stages in the human visual cortex. Cereb Cortex 11:287-297.
38. Lewis JW, Brefczynski JA, Phinney RE, Janik JJ, DeYoe EA (2005) Distinct cortical pathways for processing tool versus animal sounds. J Neurosci 25:5148-5158.
39. Mahon BZ, Milleville SC, Negri GA, Rumiati RI, Caramazza A, Martin A (2007) Action-related properties shape object representations in the ventral stream. Neuron 55:507-520.
40. Malach R, Reppas JB, Benson RR, Kwong KK, Jiang H, Kennedy WA, Ledden PJ, Brady TJ, Rosen BR, Tootell RB (1995) Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci U S A 92:8135-8139.
41. Martuzzi R, Murray MM, Michel CM, Thiran JP, Maeder PP, Clarke S, Meuli RA (2007) Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb Cortex 17:1672-1679.
42. Mesulam MM (1998) From sensation to cognition. Brain 121:1013-1052.
43. Murray MM, Camen C, Gonzalez Andino SL, Bovet P, Clarke S (2006) Rapid brain discrimination of sounds of objects. J Neurosci 26:1293-1302.
44. Noesselt T, Rieger JW, Schoenfeld MA, Kanowski M, Hinrichs H, Heinze HJ, Driver J (2007) Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J Neurosci 27:11431-11441.
45. Noppeney U, Josephs O, Hocking J, Price CJ, Friston KJ (2008) The effect of prior visual information on recognition of speech and sounds. Cereb Cortex 18:598-609.
46. Rockland KS, OjimaH (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50:19-26.
47. Romei V, Murray MM, Merabet LB, Thut G (2007) Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: Implications for multisensory Interactions. J Neurosci 27:11465-11472.
48. Schwarzbauer C, Davis MH, Rodd JM, Johnsrude I (2006) Interleaved silent steady state (ISSS) imaging: a new sparse imaging method applied to auditory fMRI. Neuroimage 29:774-782.
49. Simons JS, Koutstaal W, Prince S, Wagner AD, Schacter DL (2003) Neural mechanisms of visual object priming: evidence for perceptual and semantic distinctions in fusiform cortex. Neuroimage 19:613-626.
50. Staeren N, Renvall H, De Martino F, Goebel R, Formisano E (2009) Sound categories are represented as distributed patterns in the human auditory cortex. Curr Biol 19:498-502.
51. Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. New York: Thieme Medical Publishers.
52. Taylor KI, Moss HE, Stamatakis EA, Tyler LK (2006) Binding crossmodal object features in perirhinal cortex. Proc Natl Acad Sci U S A 103:8239-8244.
53. Turk-Browne NB, Yi DJ, Leber AB, Chun MM (2007) Visual quality determines the direction of neural repetition effects. Cereb Cortex 17:425-433.
54. van Atteveldt N, Formisano E, Goebel R, Blomert L (2004) Integration of letters and speech sounds in the human brain. Neuron 43:271-282.
55. Vuilleumier P, Henson RN, Driver J, Dolan RJ (2002) Multiple levels of visual object constancy revealed by event-related fMRI of repetition priming. Nat Neurosci 5:491-499.
56. Vul E, Harris C, Winkielman P, Pashler H (2009) Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspect Psychol Sci 4:274-290.
57. Weigelt S, Muckli L, Kohler A (2008) Functional magnetic resonance adaptation in visual neuroscience. Rev Neurosci 19:363-380.