Tuning and disrupting the brain-modulating the McGurk illusion with electrical stimulation

Frontiers in Human Neuroscience

Volumn 8, Issue AUG, 2014, Pages

  Marques, Lucas Murrins ^a   Lapenta, Olivia Morgan ^a   Merabet, Lotfi B ^b   Bolognini, Nadia ^c   Boggio, Paulo Sérgio ^a  

^a MACKENZIE PRESBYTERIAN UNIVERSITY   (Brazil)

^b HARVARD MEDICAL SCHOOL   (United States)

^c ISTITUTO AUXOLOGICO ITALIANO   (Italy)

Author keywords

McGurk illusion; Multisensory integration; Parietal cortex; Speech; Superior temporal; Transcranial direct current stimulation

Indexed keywords

ADULT; ARTICLE; ARTIFICIAL NEURAL NETWORK; BRAIN DEPTH STIMULATION; CONTROLLED STUDY; CORTICAL SYNCHRONIZATION; ELECTROSTIMULATION; EYE FIXATION; EYE TRACKING; FEMALE; GAZE; HEADACHE; HUMAN; HUMAN EXPERIMENT; MALE; NECK PAIN; NEUROIMAGING; NORMAL HUMAN; PARIETAL CORTEX; POSTERIOR PARIETAL CORTEX; PRURITUS; RANDOMIZED CONTROLLED TRIAL; RIGHT HANDEDNESS; SENSORIMOTOR INTEGRATION; SPEECH PERCEPTION; SUPERIOR TEMPORAL SULCUS; TASK PERFORMANCE; TRANSCRANIAL DIRECT CURRENT STIMULATION; VISUAL ILLUSION; VISUAL STIMULATION;

EID: 84905447399     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00533     Document Type: Article

References (55)

1. Antal, A., and Paulus, W.(2008).Transcranial direct current stimulation and visual perception. Perception 37, 367-374.doi:10.1068/p5872
2. Baynes, K., Funnell, M.G., and Fowler, C.A.(1994).Hemispheric contributionsto the integration of visual and auditory information in speech perception. Percept. Psychophys. 55, 633-641.doi:10.3758/bf03211678
3. Beauchamp, M.S., Nath, A.R., and Pasalar, S.(2010).FMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J. Neurosci. 30, 2414-2417.doi:10.1523/jneurosci.4865-09.2010
4. Bolognini, N., Convento, S., Rossetti, A., and Merabet, L.B.(2013).Multisensory processing after a brain damage:clues on post-injury crossmodal plasticity from neuropsychology. Neurosci.Biobehav.Rev. 37, 269-278.doi:10.1016/j. neubiorev.2012.12.006
5. Bolognini, N., Fregni, F., Casati, C., Olgiati, E., andVallar, G.(2010b).Brain polarization of parietal cortex augments training-induced improvement of visual exploratory and attentional skills. BrainRes. 1349, 76-89.doi:10.1016/j. brainres.2010.06.053
6. Bolognini, N., and Maravita, A.(2011).Uncovering multisensory processing through non-invasive brain stimulation. Front. Psychol. 2:46.doi:10.3389/fpsyg. 2011.00046
7. Bolognini, N., andMaravita, A.(2012).Interactions between senses: updating on neural mechanisms and behavioral evidence. Front.Psychol. 3:122.doi:10. 3389/fpsyg.2012.00122
8. Bolognini, N., Olgiati, E., Rossetti, A., andMaravita, A.(2010a).Enhancing multisensory spatial orienting by brain polarization of the parietal cortex. Eur. J. Neurosci. 31, 1800-1806.doi:10.1111/j.1460-9568.2010.07211.x
9. Bolognini, N., Rossetti, A., Casati, C., Mancini, F., and Vallar, G.(2011).Neuro-modulation of multisensory perception: atDCSstudyofthesound-induced flash illusion. Neuropsychologia 49, 231-237.doi:10.1016/j.neuropsychologia. 2010.11.015
10. Brunoni, A.R., Nitsche, M.A., Bolognini, N., Bikson, M., Wagner, T., Merabet, L., et al.(2012).Clinical research with transcranial direct current stimulation (tDCS): challenges and future directions. Brain Stimul. 5, 175-195.doi:10. 1016/j.brs.2011.03.002
11. Bushara, K.O., Grafman, J., and Hallett, M.(2001).Neural correlates of auditory-visual stimulus onseta synchrony detection. J. Neurosci. 21, 300-304.
12. Calvert, G.A.(2001).Crossmodal processing in the humanbrain: insights from function nalneuroimaging studies. Cereb. Cortex 11, 1110-1123.doi:10. 1093/cercor/11.12.1110
13. Calvert, G.A., Brammer, M.J., and Iversen, S.D.(1998).Crossmodal identification. TrendsCogn.Sci. 2, 247-253.doi:10.1016/S1364-6613(98)01189-9
14. Colin, C., Radeau, M., and Deltenre, P.(2005).Top-down and bottom-up modulation of audiovisual integration in speech. Eur. J. Cogn. Psychol. 17, 541-560.doi:10.1080/09541440440000168
15. Convento, S., Vallar, G., Galantini, C., andBolognini, N.(2013).Neuromodulation of early multisensory interactions in the visual cortex. J. Cogn. Neurosci. 25, 685-696.doi:10.1162/jocn_a_00347
16. Dodd, B., McIntosh, B., Erdener, D., and Burnham, D.(2008).Perception of the auditory-visual illusion in speech perception by children with phonological disorders. Clin. Linguist. Phon. 22, 69-82.doi:10.1080/02699200701660100
17. Driver, J., and Noesselt, T.(2008).Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses and judgments. Neuron 57, 11-23.doi:10.1016/j.neuron.2007.12.013
18. Fadiga, L., Craighero, L., Buccino, G., and Rizzolatti, G.(2002).Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur.J. Neurosci. 15, 399-402.doi:10.1046/j.0953-816x.2001.01874.x
19. Fujisaki, W., Shimojo, S., Kashino, M., and Nishida, S.Y.(2004).Recalibration of audiovisual simultaneity. Nat.Neurosci. 7, 773-778.doi:10.1038/nn1268
20. Kilian-Hütten, N., Vroomen, J., and Formisano, E.(2011).Brain activation during audiovisual exposure anticipates future perception of ambiguous speech. Neu-roimage 57, 1601-1607.doi:10.1016/j.neuroimage.2011.05.043
21. Knill, D.C., and Pouget, A.(2004).The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27, 712-719.doi:10.1016/j. tins.2004.10.007
22. Kushnerenko, E., Teinonen, T., Volein, A., and Csibra, G.(2008).Electrophys-iological evidence of illusory audiovisual speech percept in human infants. Proc. Natl. Acad. Sci. USA 105, 11442-11445.doi:10.1073/pnas.08042 75105
23. Ladeira, A., Fregni, F., Campanhã, C., Valasek, C.A., De Ridder, D., Brunoni, A.R., et al.(2011).Polarity-dependent transcranial direct current stimulation effects on central auditory processing. PLoS One 6:e25399.doi:10.1371/journal.pone. 0025399
24. Lapenta, O.M., Fregni, F., Oberman, L., and Boggio, P.S.(2012).Bilateral temporal cortex transcranial direc tcurrent stimulation worsens male performancein a multisensory integrationtask. Neurosci. Lett. 527, 105-109.doi:10.1016/j. neulet.2012.08.076
25. Le Bel, R.M., Pineda, J.A., and Sharma, A.(2009).Motor-auditory-visualinte-gration: the role of the human mirror neuron system in communication and communication disorders. J. Commun. Disord. 42, 299-304.doi:10.1016/j. jcomdis.2009.03.011
26. Liberman, A.M., and Mattingly, I.G.(1985).The motor theory of speech perception revised. Cognition 21, 1-36.doi:10.1016/0010-0277(85)90021-6
27. Macaluso, E., George, N., Dolan, R., Spence, C., and Driver, J.(2004).Spatial and temporal factors during processing of audiovisual speech: a PET study. Neuroimage 21, 725-732.doi:10.1016/j.neuroimage.2003.09.049
28. Massaro, D.W., Cohen, M.M., and Gesi, A.T.(1993).Long-termtraining, transfer and retention in learningtoli pread. Percept. Psychophys. 53, 549-562.doi:10. 3758/bf03205203
29. McGurk, H., and MacDonald, J.(1976).Hearing lips and seeing voices. Nature 264, 746-748.doi:10.1038/264746a0
30. Meronen, A., Tiippana, K., Westerholm, J., and Ahonen, T.(2013).Audiovi-sual speech perception in children with developmental language disorder in degraded listening conditions. J. SpeechLang. Hear. Res. 56, 211-221.doi:10. 1044/1092-4388(2012/11-0270)
31. Nath, A.R., and Beauchamp, M.S.(2012).A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. Neuroimage 59, 781-787.doi:10.1016/j.neuroimage.2011.07.024
32. Neufeld, J., Sinke, C., Zedler, M., Dillo, W., Emrich, H.M., Bleich, S., et al.(2012). Disinhibited feedback as a cause of synesthesia: evidence from a functional connectivity study on auditory-visual synesthetes. Neuropsychologia 50, 1471-1477.doi:10.1016/j.neuropsychologia.2012.02.032
33. Nitsche, M.A., Cohen, L.G., Wassermann, E.M., Priori, A., Lang, N., Antal, A., et al.(2008).Transcranial direct current stimulation: stateoftheart 2008. Brain Stimul. 1, 206-223.doi:10.1016/j.brs.2008.06.004
34. Nitsche, M.A., and Paulus, W.(2000).Excitability changes in ducedin the human motor cortex by weak transcranial direct current stimulation. J. Physiol. 527(Pt.3), 633-639.doi:10.1111/j.1469-7793.2000.t01-1-00633.x
35. Noesselt, T., Bergmann, D., Heinze, H.J., Münte, T., and Spence, C.(2012).Coding of multisensory temporal patterns in human superior temporalsulcus. Front. Integr. Neurosci. 6:64.doi:10.3389/fnint.2012.00064
36. Norrix, L.W., Plante, E., and Vance, R.(2006).Auditory-visual speech integration by adults with and without language-learning disabilities. J. Commun.Disord. 39, 22-36.doi:10.1016/j.jcomdis.2005.05.003
37. Pekkola, J., Ojanen, V., Autti, T., Jääskeläinen, I.P., Möttönen, R., and Sams, M. (2006). Attention to visual speech gesturesenhances hemodynamicactivity in the left planum temporale. Hum. Brain Mapp. 27, 471-477.doi:10.1002/hbm. 20190
38. Priori, A., Mameli, F., Cogiamanian, F., Marceglia, S., Tiriticco, M., Mrakic-Sposta, S., et al.(2008).Lie-specific involvement of dorsolateral prefrontal cortexin deception. Cereb. Cortex 18, 451-455.doi:10.1093/cercor/bhm088
39. Pugh, K.R., offywitz, B.A., Shaywitz, S.E., Fulbright, R.K., Byrd, D., Skudlarski, P., et al.(1996).Auditory selective vattention:an fMRI investigation. Neuroimage 4, 159-173.doi:10.1006/nimg.1996.0067
40. Rossi, S., Hallett, M., Rossini, P.M., Pascual-Leone, A., and The Safetyof TMS ConsensusGroup.(2009).Safety, ethical considerations and application guide-lines for the use of transcranial magnetic stimulation in clinical practice and research. Clin. Neurophysiol. 120, 2008-2039.doi:10.1016/j.clinph.2009. 08.016
41. Saint-Amour, D., DeSanctis, P., Molholm, S., Ritter, W., and Foxe, J.J. (2007). Seeingvoices: high-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurkillu-sion. Neuropsychologia 45, 587-597.doi:10.1016/j.neuropsychologia.2006. 03.036
42. Sams, M., Aulanko, R., Hämäläinen, M., Hari, R., Lounasmaa, O.V., Lu, S.T., et al. (1991). Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci.Lett. 127, 141-145.doi:10.1016/0304-3940(91)90914-f
43. Sekiyama, K., Kanno, I., Miura, S., and Sugita, Y.(2003).Auditory-visualspeech perception examined by fMRI and PET. Neurosci.Res. 47, 277-287.doi:10. 1016/s0168-0102(03)00214-1
44. Shams, L., Kamitani, Y., andShimojo, S.(2000).Illusions. What you see is what you hear. Nature 408, 788.doi:10.1038/35048669
45. Skipper, J.I., vanWassenhove, V., Nusbaum, H.C., andSmall, S.L.(2007). Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb. Cortex 17, 2387-2399.doi:10. 1093/cercor/bhl147
46. Szycik, G.R., Stadler, J., Tempelman, C., andMünte, T.F.(2012).Examining the McGurk illusion using high-field 7 Tesla functional MRI. Front. Hum. Neurosci. 6:95.doi:10.3389/fnhum.2012.00095
47. Taylor, N., Isaac, C., andMilne, E.(2010).A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. J. Autism Dev. Disord. 40, 1403-1411.doi:10.1007/s10803-010-1000-4
48. Tuomainen, J., Andersen, T.S., Tiippana, K., and Sams, M.(2005).Audio-visual speechperceptionisspecial. Cognition 96, B13-B22.doi:10.1016/j.cognition. 2004.10.004
49. Vallar, G., and Bolognini, N.(2011).Behavioural facilitation following brainstimu-lation: implication for neurorehabilitation. Neuropsychol.Rehabil. 21, 618-649.doi:10.1080/09602011.2011.574050
50. VanderBurg, E., Alais, D., andCass, J.(2013).Rapid recalibration to audiovi-sual asynchrony. J. Neurosci. 33, 14633-14637.doi:10.1523/JNEUROSCI.1182-13.2013
51. Vroomen, J., Keetels, M., deGelder, B., andBertelson, P.(2004).Recalibration of temporal order perception by exposure to audio-visual asynchrony. Brain Res. Cogn. BrainRes. 22, 32-35.doi:10.1016/j.cogbrainres.2004.07.003
52. Wassermann, E.M., andGrafman, J.(2005).Recharging cognition with DC brainpolarization. Trends Cogn.Sci. 9, 503-505.doi:10.1016/j.tics.2005. 09.001
53. World Medical Organization.(1996).Declaration of Helsinki. Br. Med.J. 313, 1448-1449.doi:10.1136/bmj.313.7070.1448a
54. Young, L.R., andSheena, D.(1975).Survey of eye movement recording methods. Behav. Res. MethodsInstrum. 7, 397-429.doi:10.3758/bf03201553
55. Youse, K.M., Cienkowski, K.M., andCoelho, C.A.(2004).Auditory-visual speech perception in an adult with aphasia. Brain Inj. 18, 825-834.doi:10. 1080/02699000410001671784