Neural correlates of multisensory perceptual learning

Journal of Neuroscience

Volumn 32, Issue 18, 2012, Pages 6263-6274

  Powers, Albert R ^a,b   Hevey, Matthew A ^a   Wallace, Mark T ^a,b  

^a VANDERBILT UNIVERSITY   (United States)

^b VANDERBILT UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; BEHAVIOR; BOLD SIGNAL; CEREBELLUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NORMAL HUMAN; PERCEPTUAL LEARNING; PRIORITY JOURNAL; SENSORY SYSTEM; SUPERIOR TEMPORAL SULCUS; TASK PERFORMANCE; VISUAL CORTEX; VISUAL STIMULATION;

ADULT; AUDITORY PERCEPTION; BRAIN; CUES; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; NERVE NET; PSYCHOMOTOR PERFORMANCE; VISUAL PERCEPTION;

EID: 84860324468     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.6138-11.2012     Document Type: Article

References (82)

1. Alais D, Cass J (2010) Multisensory perceptual learning of temporal order: audiovisual learning transfers to vision but not audition. PLoS One 5:e11283.
2. Bai B, Kantor P (2007) A shape-based finite impulse response model for functional brain images. Proceedings of the 2007 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Washington, DC, April 12-16, pp 440-443.
3. Bai B, Kantor P, Shokoufandeh A (2007) Effectiveness of the finite impulse response modelin content-based f MRI image retrieval. Med Image Comput Comput Assist Interv 10:742-750.
4. Bao S, Chen L, Kim JJ, Thompson RF (2002) Cerebellar cortical inhibition and classical eyeblink conditioning. Proc Natl Acad Sci U S A 99:1592-1597.
5. Barnes CL, Pandya DN (1992) Efferent cortical connections of multimodal cortex of the superior temporal sulcus in the rhesus monkey. J Comp Neurol 318:222-244.
6. Baumann O, Mattingley JB (2010) Scaling of neural responses to visual and auditory motion in the human cerebellum. J Neurosci 30:4489-4495.
7. Bischoff M, Walter B, Blecker CR, Morgen K, Vaitl D, Sammer G (2007) Utilizing the ventriloquism-effect to investigate audio-visual binding. Neuropsychologia 45:578-586.
8. Biswal B, Yetkin FZ, Haughton VM, Hyde JS (1995) Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn Reson Med 34:537-541.
9. Blau V, Reithler J, van Atteveldt N, Seitz J, Gerretsen P, Goebel R, Blomert L (2010) Deviant processing of letters and speech sounds as proximate cause of reading failure: a functional magnetic resonance imaging study of dyslexic children. Brain 133:868-879.
10. Brock J, Brown CC, Boucher J, Rippon G (2002) The temporal binding deficit hypothesis of autism. Dev Psychopathol 14:209-224.
11. Brunswick N, McCrory E, Price CJ, Frith CD, Frith U (1999) Explicit and implicit processing of words and pseudowords by adult developmental dyslexics: a search for Wernicke's Wortschatz? Brain 122:1901-1917.
12. Bueti D, Bahrami B, Walsh V, Rees G (2010) Encoding of temporal probabilities in the human brain. J Neurosci 30:4343-4352.
13. Buracas GT, Boynton GM (2002) Efficient design of event-related fMRI experiments using M-sequences. Neuroimage 16:801-813.
14. Bushara KO, Grafman J, Hallett M (2001) Neural correlates of auditory-visual stimulus onset asynchrony detection. J Neurosci 21:300-304.
15. Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human hetero-modal cortex. Curr Biol 10:649-657.
16. Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of audio-visual integration sites in humans by application of electrophysio-logical criteria to the BOLD effect. Neuroimage 14:427-438.
17. Cappe C, Barone P (2005) Heteromodal connections supporting multisen-sory integration at low levels of cortical processing in the monkey. Eur J Neurosci 22:2886-2902.
18. Cappe C, Thut G, Romei V, Murray MM (2010) Auditory-visual multisensory interactions in humans: timing, topography, directionality, and sources. J Neurosci 30:12572-12580.
19. Chater N, Oaksford M (2008) The probabilistic mind: prospects for Bayesian cognitive science: Oxford UP.
20. Colonius H, Diederich A (2004) Multisensory interaction in saccadic reaction time: a time-window-of-integration model. J Cogn Neurosci 16:1000-1009.
21. Courchesne E (1995) New evidence of cerebellar and brainstem hypoplasia in autistic infants, children and adolescents: the MR imaging study by Hashimoto and colleagues. J Autism Dev Disord 25:19-22.
22. Courchesne E, Yeung-Courchesne R, Press GA, Hesselink JR, Jernigan TL (1988) Hypoplasia of cerebellar vermal lobules VI and VII in autism. N Engl J Med 318:1349-1354.
23. de Jong JJ, Hodiamont PP, Van den Stock J, de Gelder B (2009) Audiovisual emotion recognition in schizophrenia: reduced integration of facial and vocal affect. Schizophr Res 107:286-293.
24. Desimone R (1996) Neural mechanisms for visual memory and their role in attention. Proc Natl Acad Sci U S A 93:13494-13499.
25. Dhamala M, Assisi CG, Jirsa VK, Steinberg FL, Kelso JA (2007) Multisen-sory integration for timing engages different brain networks. Neuroimage 34:764-773.
26. Falchier A, Clavagnier S, Barone P, Kennedy H (2002) Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22:5749-5759.
27. Fawcett AJ, Nicolson RI, Maclagan F (2001) Cerebellar tests differentiate between groups of poor readers with and without IQ discrepancy. J Learn Disabil 34:119-135.
28. Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC (1995) Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn Reson Med 33:636-647.
29. Foss-Feig JH, Kwakye LD, Cascio CJ, Burnette CP, Kadivar H, Stone WL, Wallace MT (2010) An extended multisensory temporal binding window in autism spectrum disorders. Exp Brain Res 203:381-389.
30. Friston KJ, Harrison L, Penny W (2003) Dynamic causal modelling. Neuro-image 19:1273-1302.
31. Ghose GM, Yang T, Maunsell JH (2002) Physiological correlates of perceptual learning in monkey V1 and V2. J Neurophysiol 87:1867-1888.
32. Hackett TA, Stepniewska I, Kaas JH (1998) Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys. J Comp Neurol 394:475-495.
33. Hairston WD, Burdette JH, Flowers DL, Wood FB, Wallace MT (2005) Altered temporal profile of visual-auditory multisensory interactions in dyslexia. Exp Brain Res 166:474-480.
34. Hanslmayr S, Volberg G, Wimber M, Raabe M, Greenlee MW, Bäuml KH (2011) The relationship between brain oscillations and BOLD signal during memory formation: a combined EEG-fMRI study. J Neurosci 31:15674-15680.
35. Hoshino O (2004) Neuronal bases of perceptual learning revealed by a synaptic balance scheme. Neural Comput 16:563-594.
36. Innes-Brown H, Crewther D (2009) The impact of spatial incongruence on an auditory-visual illusion. PLoS One 4:e6450.
37. Jardri R, Pins D, Bubrovszky M, Lucas B, Lethuc V, Delmaire C, Vantyghem V, Despretz P, Thomas P (2009) Neural functional organization of hallucinations in schizophrenia: multisensory dissolution of pathological emergence in consciousness. Conscious Cogn 18:449-457.
38. Jenkins IH, Brooks DJ, Nixon PD, Frackowiak RS, Passingham RE (1994) Motor sequence learning: a study with positron emission tomography. J Neurosci 14:3775-3790.
39. Kasess CH, Stephan KE, Weissenbacher A, Pezawas L, Moser E, Windisch-berger C (2010) Multi-subject analyses with dynamic causal modeling. Neuroimage 49:3065-3074.
40. Kotani S, Kawahara S, Kirino Y (2003) Purkinje cell activity during learning a new timing in classical eyeblink conditioning. Brain Res 994:193-202.
41. Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT (2011) Altered auditory and multisensory temporal processing in autism spectrum disorders. Front Integr Neurosci 4:129.
42. Lancaster JL, Woldorff MG, Parsons LM, Liotti M, Freitas CS, Rainey L, Kochunov PV, Nickerson D, Mikiten SA, Fox PT (2000) Automated Talairach atlas labels for functional brain mapping. Hum Brain Mapp 10:120-131.
43. Lee L, Friston K, Horwitz B (2006) Large-scale neural models and dynamic causal modelling. Neuroimage 30:1243-1254.
44. Macaluso E, George N, Dolan R, Spence C, Driver J (2004) Spatial and temporal factors during processing of audiovisual speech: a PET study. Neu-roimage 21:725-732.
45. Maertens M, Pollmann S (2005) Interhemispheric resource sharing: decreasing benefits with increasing processing efficiency. Brain Cogn 58:183-192.
46. Maldjian JA, Laurienti PJ, Kraft RA, Burdette JH (2003) An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 19:1233-1239.
47. Meredith MA, Nemitz JW, Stein BE (1987) Determinants of multisensory integration insuperior colliculus neurons. I. Temporal factors.J Neurosci 7:3215-3229.
48. Miller EK, Li L, Desimone R (1991) A neural mechanism for working and recognition memory in inferior temporal cortex. Science 254:1377-1379.
49. Mishra J, Martinez A, Hillyard SA (2008) Cortical processes underlying sound-induced flash fusion. Brain Res 1242:102-115.
50. Mitchell SR, Reiss AL, Tatusko DH, Ikuta I, Kazmerski DB, Botti JA, Burnette CP, Kates WR (2009) Neuroanatomic alterations and social and communication deficitsinmonozygotic twins discordant for autism disorder. Am J Psychiatry 166:917-925.
51. Mostofsky SH, Powell SK, Simmonds DJ, Goldberg MC, Caffo B, Pekar JJ (2009) Decreased connectivity and cerebellar activity in autism during motor task performance. Brain 132:2413-2425.
52. Mukai I, Kim D, Fukunaga M, Japee S, Marrett S, Ungerleider LG (2007) Activations in visual and attention-related areas predict and correlate with the degree of perceptual learning. J Neurosci 27:11401-11411.
53. Noesselt T, Rieger JW, Schoenfeld MA, Kanowski M, Hinrichs H, Heinze HJ, Driver J (2007) Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J Neurosci 27:11431-11441.
54. Nozaradan S, Peretz I, Mouraux A (2011) Steady-state evoked potentials as an index of multisensory temporal binding. Neuroimage 60:21-28.
55. Paulesu E, Démonet JF, Fazio F, McCrory E, Chanoine V, Brunswick N, Cappa SF, Cossu G, Habib M, Frith CD, Frith U (2001) Dyslexia: cultural diversity and biological unity. Science 291:2165-2167.
56. Perrett SP, Ruiz BP, Mauk MD (1993) Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses. J Neurosci 13:1708-1718.
57. Powers AR 3rd, Hillock AR, Wallace MT (2009) Perceptual training narrows the temporal window of multisensory binding. J Neurosci 29:12265-12274.
58. Rademacher J, Morosan P, Schormann T, Schleicher A, Werner C, Freund HJ, Zilles K (2001) Probabilistic mapping and volume measurement of human primary auditory cortex. Neuroimage 13:669-683.
59. Reber PJ, Stark CE, Squire LR (1998) Cortical areas supporting category learning identified using functional MRI. Proc Natl Acad Sci U S A 95:747-750.
60. Redcay E (2008) The superior temporal sulcus performs a common function for social and speech perception: implications for the emergence of autism. Neurosci Biobehav Rev 32:123-142.
61. Rosa MJ, Bestmann S, Harrison L, Penny W (2010) Bayesian model selection maps for group studies. Neuroimage 49:217-224.
62. Ross LA, Saint-Amour D, Leavitt VM, Molholm S, Javitt DC, Foxe JJ (2007) Impaired multisensory processing in schizophrenia: deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophr Res 97:173-183.
63. Rumsey JM, Andreason P, Zametkin AJ, Aquino T, King AC, Hamburger SD, Pikus A, Rapoport JL, Cohen RM (1992) Failure to activate the left tem-poroparietal cortex in dyslexia. An oxygen 15 positron emission tomo-graphic study. Arch Neurol 49:527-534.
64. Schiltz C, Bodart JM, Dubois S, Dejardin S, Michel C, Roucoux A, Crom-melinck M, Orban GA (1999) Neuronal mechanisms of perceptual learning: changes in human brain activity with training in orientation discrimination. Neuroimage 9:46-62.
65. Schmahmann JD, Doyon J, McDonald D, Holmes C, Lavoie K, Hurwitz AS, Kabani N, Toga A, Evans A, Petrides M (1999) Three-dimensional MRI atlas of the human cerebellum in proportional stereotaxic space. Neuro-image 10:233-260.
66. Shams L, Kamitani Y, Shimojo S (2002) Visual illusion induced by sound. Brain Res Cogn Brain Res 14:147-152.
67. Shaywitz BA, Shaywitz SE, Pugh KR, Mencl WE, Fulbright RK, Skudlarski P, Constable RT, Marchione KE, Fletcher JM, Lyon GR, Gore JC (2002) Disruption of posterior brain systems for reading in children with developmental dyslexia. Biol Psychiatry 52:101-110.
68. Slutsky DA, Recanzone GH (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12:7-10.
69. Stein BE, Meredith MA (1993) The merging of the senses. Cambridge, MA: MIT.
70. Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ (2009) Bayesian model selection for group studies. Neuroimage 46:1004-1017.
71. Stephan KE, Penny WD, Moran RJ, den Ouden HE, Daunizeau J, Friston KJ (2010) Ten simple rules for dynamic causal modeling. Neuroimage 49:3099-3109.
72. Stevenson RA, Altieri NA, Kim S, Pisoni DB, James TW (2010) Neural processing of asynchronous audiovisual speech perception. Neuroimage 49:3308-3318.
73. Stoodley CJ, Stein JF (2011) The cerebellum and dyslexia. Cortex 47:101-116.
74. Stoodley CJ, Fawcett AJ, Nicolson RI, Stein JF (2005) Impaired balancing ability in dyslexic children. Exp Brain Res 167:370-380.
75. Szycik GR, Münte TF, Dillo W, Mohammadi B, Samii A, Emrich HM, Dietrich DE (2009) Audiovisual integration of speech is disturbed in schizophrenia: an fMRI study. Schizophr Res 110:111-118.
76. Teder-Sälejärvi WA, Di Russo F, McDonald JJ, Hillyard SA (2005) Effects of spatial congruity on audio-visual multimodal integration. J Cogn Neurosci 17:1396-1409.
77. Tomasi D, Ernst T, Caparelli EC, Chang L (2004) Practice-induced changes of brain function during visual attention: a parametric fMRI study at 4 Tesla. Neuroimage 23:1414-1421.
78. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Del-croix N, Mazoyer B, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15:273-289.
79. von Kriegstein K, Giraud AL (2006) Implicit multisensory associations influence voice recognition. PLoS Biol 4:e326.
80. Watkins S, Shams L, Josephs O, Rees G (2007) Activity in human V1follows multisensory perception. Neuroimage 37:572-578.
81. Wiersinga-Post E, Tomaskovic S, Slabu L, Renken R, de Smit F, Duifhuis H (2010) Decreased BOLD responses in audiovisual processing. Neurore-port 21:1146-1151.
82. Zilbovicius M, Meresse I, Chabane N, Brunelle F, Samson Y, Boddaert N (2006) Autism, the superior temporal sulcus and social perception. Trends Neurosci 29:359-366.