Gone in a flash: Manipulation of audiovisual temporal integration using transcranial magnetic stimulation

Frontiers in Psychology

Volumn 4, Issue SEP, 2013, Pages

  Hamilton, Roy H ^a   Wiener, Martin ^a   Drebing, Daniel E ^a   Branch Coslett, H ^a,b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b MOSS REHABILITATION RESEARCH INSTITUTE   (United States)

Author keywords

Angular gyrus (AG); Audiovisual integration; Inferior parietal lobule (IPL); Noninvasive brain stimulation; Sound induced flash illusion; Transcranial magnetic stimulation

Indexed keywords

EID: 84885353400     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00571     Document Type: Article

References (40)

1. Arden, G. B., Wolf, J. E., and Messiter, C. (2003). Electrical activity in visual cortex associated with combined auditory and visual stimulation in temporal sequences known to be associated with a visual illusion. Vision Res. 43, 2469-2478.
2. Battelli, L., Pascual-Leone, A., and Cavanagh, P. (2007). The 'when' pathway of the right parietal lobe. Trends Cogn. Sci. 11, 204-210. doi:10.1016/j.tics.2007.03.001.
3. Bernstein, L. E., Auer, E. T., Wagner, M., and Ponton, C. W. (2008). Spatiotemporal dynamics of audiovisual speech processing. Neuroimage 39, 423-435. doi:10.1016/j.neuroimage.2007.08.035.
4. Bushara, K. O., Hanakawa, T., Immisch, I., Toma, K., Kansaku, K., and Hallett, M. (2003). Neural correlates of cross-modal binding. Nat. Neurosci. 6, 190-195. doi:10.1038/nn993.
5. Calvert, G. A. (2001). Crossmodal processing in the human brain:insights from functional neuroimaging studies. Cereb. Cortex 11, 1110-1123. doi:10.1093/cercor/11.12.1110.
6. Chambers, C. D., Payne, J. M., and Mattingley, J. B. (2007). Parietal disruption impairs reflexive spatial attention within and between sensory modalities. Neuropsychologia 45, 1715-1724. doi:10.1016/j.neuropsychologia.2007.01.001.
7. Chen, R., Classen, J., Gerloff, C., Celnik, P., Wassermann, E. M., Hallett, M., et al. (1997). Depression of motor cortex excitability by low-frequency transcranial magnetic stimulation. Neurology 48, 1398-1403.
8. De Gelder, B., and Bertelson, P. (2003). Multisensory integration, perception and ecological validity. Trends Cogn. Sci. 7, 460-467. doi:10.1016/j.tics.2003.08.014.
9. de Haas, B., Kanai, R., Jalkanen, L., and Rees, G. (2012). Grey matter volume in early human visual cortex predicts proneness to the sound-induced flash illusion. Proc. Biol. Sci. 279, 4955-4961.
10. Dehaene, S., Piazza, M., Pinel, P., and Cohen, L. (2003). Three parietal circuits for number processing. Neuropsychologia 20, 487-506.
11. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature 381, 66-68. doi:10.1038/381066a0.
12. Fendrich, R., and Corballis, P. M. (2001). The temporal cross-capture of audition and vision. Percept. Psychophys. 63, 719-725.
13. Fujisaki, W., Shimojo, S., Kashino, M., and Nishida, S. (2004). Recalibration of audiovisual simultaneity. Nat. Neurosci. 773-778. doi:10.1038/nn1268.
14. Fuster, J. M., Bodner, M., and Kroger, J. K. (2000). Cross-modal and cross-temporal association in neurons in the frontal cortex. Nature 405, 347-351. doi:10.1038/35012613.
15. Hamilton, R. H., Shenton, J. T., and Coslett, H. B. (2006). An acquired deficit of audiovisual speech processing. Brain Lang. 98, 66-73.
16. Kamke, M. R., Vieth, H. E., Cottrell, D., and Mattingley, J. B. (2012). Parietal disruption alters audiovisual binding in the sound-induced flash illusion. Neuroimage 62, 1334-1341. doi:10.1016/j.neuroimage.2012.05.063.
17. Lewald, J., and Gusky, R. (2003). Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cogn. Brain Res. 16, 468-478. doi:10.1016/S0926-6410(03)00074-0.
18. Martuzzi, R., Murray, M. M., Michel, C. M., Thiran, J. P., Maeder, P. P., Clarke, S., et al. (2007). Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb. Cortex 17, 1672-1679. doi:10.1093/cercor/bhl077.
19. McGurk, H., and MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748. doi:10.1038/264746a0.
20. Mishra, M., Martinez, A., Sejnowski, T. J., and Hillyard, S. A. (2007). Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 27, 4120-4131. doi:10.1523/JNEUROSCI.4912-06.2007.
21. Powers, A. III., Hillock, A., and Wallace, M. (2009). Perceptual training narrows the temporal window of multisensory binding. J. Neurosci. 29, 3501-3509. doi:10.1523/JNEUROSCI.3501-09.2009.
22. Pridmore, S., Fernandes Filho, J. A., Nahas, Z., Liberatos, C., and George, M. S. (1998). Motor threshold in transcranial magnetic stimulation:a comparison of a neurophysiological method and a visualization of movement method. J. ECT 14, 25-27. doi:10.1097/00124509-199803000-00004.
23. Raij, T., Ahveninen, J., Lin, F. H., Witzel, T., Jääskeläinen, I. P., Letham, B., et al. (2010). Onset timing of cross-sensory activations and multisensory interactions in auditory and visual sensory cortices. Eur. J. Neurosci. 31, 1772-1782. doi:10.1111/j.1460-9568.2010.07213.x.
24. Romei, V., Gross, J., and Thut, G. (2012). Sounds reset rhythms of visual cortex and corresponding human visual perception. Curr. Biol. 22, 807-813. doi:10.1016/j.cub.2012.03.025.
25. Shams, L., Iwaki, S., Chawla, A., and Battacharya, J. (2005). Early modulation of visual cortex by sound:an MEG study. Neurosci. Lett. 378, 76-81. doi:10.1016/j.neulet.2004.12.035.
26. Shams, L., Kamitani, Y., and Shimojo, S. (2000). Illusions. What you see is what you hear. Nature 408, 788. doi:10.1038/35048669.
27. Shams, L., Kamitani, Y., Thompson, S., and Shimojo, S. (2001). Sound alters visual evoked potentials in humans. Neuroreport 12, 3849-3852. doi:10.1097/00001756-200112040-00049.
28. Shams, L., Ma, W. J., and Beierholm, U. (2005). Sound-induced flash illusion as an optimal percept. Neuroreport 16, 1923-1927.
29. Shams, L., Yukiyasu, K., and Shimojo, S. (2002). Visual illusion induced by sound. Brain research. Cogn. Brain Res. 14, 147-152.
30. Slutsky, D. A., and Recanzone, G. H. (2001). Temporal and spatial dependency of the ventriloquism effect. Neuroreport, 12, 7-10. doi:10.1097/00001756-200101220-00009.
31. Snyder, J. J., and Chatterjee, A. (2004). Spatial-temporal anisometries following right parietal damage. Neuropsychologia 42, 1703-1708. doi:10.1016/j.neuropsychologia.2004.04.003.
32. Stein, B. E. (1998). Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp. Brain Res. 123, 124-135. doi:10.1007/s002210050553.
33. Templeton, W. B., Howard, I. P., and Lowman, A. E. (1966). Passively generated adaptation to prismatic distortion. Percept. Mot. Skills 22, 140-142. doi:10.2466/pms.1966.22.1.140.
34. Touge, T., Gerschlager, W., Brown, P., and Rothwell, J. C. (2001). Are the after-effects of low-frequency rTMS on motor cortex excitability due to changes in the efficacy of cortical synapses? Clin. Neurophysiol. 112, 2138-2145. doi:10.1016/S1388-2457(01)00651-4.
35. Wagner, T. Valero-Cabre, A., and Pascual-Leone, A. (2007). Noninvasive human brain stimulation. Annu. Rev. Biomed. Eng. 9, 527-565. doi:10.1146/annurev.bioeng.9.061206.133100.
36. Walsh, V., and Pascual-Leone, A. (2005). Transcranial Magnetic Stimulation:A Neuro-Chronometrics of Mind. Cambridge:The MIT Press.
37. Watkins, S., Shams, L., Josephs, O., and Rees, G. (2007). Activity in human V1 follows multisensory perception. Neuroimage 37, 572-578. doi:10.1016/j.neuroimage.2007.05.027.
38. Watkins, S., Shams, L., Tanaka, S., Haynes, J. D., and Rees, G. (2006). Sound alters activity in human V1 in association with illusory visual perception. Neuroimage 31, 1247-1256. doi:10.1016/j.neuroimage.2006.01.016.
39. Wilson, J. T. (1987). Interaction of simultaneous visual events. Perception 16, 375-383. doi:10.1068/p160375.
40. Zampini, M., Guest, S., Shore, D., and Spence, C. (2005). Audio-visual simultaneity judgments. Percept. Psychophys. 67, 531-544.