Auditory-driven phase reset in visual cortex: Human electrocorticography reveals mechanisms of early multisensory integration

NeuroImage

Volumn 79, Issue , 2013, Pages 19-29

  Mercier, Manuel R ^a,b   Foxe, John J ^a,c   Fiebelkorn, Ian C ^a   Butler, John S ^a   Schwartz, Theodore H ^b   Molholm, Sophie ^a,c  

^a ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^b NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

^c NEW YORK PRESBYTERIAN HOSPITAL   (United States)

Author keywords

Electro corticography (ECoG); Human visual cortex; Intracranial; Multimodal interaction; Oscillations

Indexed keywords

ARTICLE; AUDITORY FEEDBACK; AUDITORY STIMULATION; BRAIN DEPTH RECORDING; BRAIN REGION; CLINICAL ARTICLE; DURA MATER; ELECTROCORTICOGRAPHY; EVOKED AUDITORY RESPONSE; EVOKED VISUAL RESPONSE; HUMAN; INTRACTABLE EPILEPSY; LATENT PERIOD; LEFT HEMISPHERE; MULTISENSORY INTEGRATION; NEUROMODULATION; PRIORITY JOURNAL; REACTION TIME; SENSORY SYSTEM PARAMETERS; TASK PERFORMANCE; VISUAL CORTEX;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; BIOLOGICAL CLOCKS; BRAIN MAPPING; CUES; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; HUMANS; VISUAL CORTEX;

EID: 84877883921     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.04.060     Document Type: Article

References (83)

1. Allman B.L., Meredith M.A. Multisensory processing in "unimodal" neurons: cross-modal subthreshold auditory effects in cat extrastriate visual cortex. J. Neurophysiol. 2007, 98:545-549.
2. Allman B.L., Bittencourt-Navarrete R.E., Keniston L.P., Medina A.E., Wang M.Y., Meredith M.A. Do cross-modal projections always result in multisensory integration?. Cereb. Cortex 2008, 18:2066-2076.
3. Avillac M., Ben Hamed S., Duhamel J.R. Multisensory integration in the ventral intraparietal area of the macaque monkey. J. Neurosci. 2007, 27:1922-1932.
4. Becker R., Ritter P., Villringer A. Influence of ongoing alpha rhythm on the visual evoked potential. Neuroimage 2008, 39:707-716.
5. Belitski A., Gretton A., Magri C., Murayama Y., Montemurro M.A., Logothetis N.K., Panzeri S. Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. J. Neurosci. 2008, 28:5696-5709.
6. Benjamini Y., Hochberg Y. Controlling the false discovery rate - a practical and powerful approach to multiple testing. J. R. Stat. Soc. B Methodol. 1995, 57:289-300.
7. Besle J., Fort A., Giard M.-H. Interest and validity of the additive model in electrophysiological studies of multisensory interactions. Cogn. Process. 2004, 5.
8. Besle J., Schevon C.A., Mehta A.D., Lakatos P., Goodman R.R., McKhann G.M., Emerson R.G., Schroeder C.E. Tuning of the human neocortex to the temporal dynamics of attended events. J. Neurosci. 2011, 31:3176-3185.
9. Brandwein A.B., Foxe J.J., Russo N.N., Altschuler T.S., Gomes H., Molholm S. The development of audiovisual multisensory integration across childhood and early adolescence: a high-density electrical mapping study. Cereb. Cortex 2011, 21:1042-1055.
10. Brandwein A.B., Foxe J.J., Butler J.S., Russo N.N., Altschuler T.S., Gomes H., Molholm S. The development of multisensory integration in high-functioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs. Cereb. Cortex 2012, 23(6):1329-1341.
11. Butler J.S., Molholm S., Fiebelkorn I.C., Mercier M.R., Schwartz T.H., Foxe J.J. Common or redundant neural circuits for duration processing across audition and touch. J. Neurosci. 2011, 31:3400-3406.
12. Calvert G.A. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb. Cortex 2001, 11:1110-1123.
13. Cappe C., Barone P. Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur. J. Neurosci. 2005, 22:2886-2902.
14. Clavagnier S., Falchier A., Kennedy H. Long-distance feedback projections to area V1: implications for multisensory integration, spatial awareness, and visual consciousness. Cogn. Affect. Behav. Neurosci. 2004, 4:117-126.
15. Clemo H.R., Allman B.L., Donlan M.A., Meredith M.A. Sensory and multisensory representations within the cat rostral suprasylvian cortex. J. Comp. Neurol. 2007, 503:110-127.
16. Delorme A. Statistical methods. Encyclopedia of Medical Device and Instrumentation 2006, 240-264. Wiley Interscience. J.G. Webster (Ed.).
17. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 2004, 134:9-21.
18. Diederich A., Schomburg A., Colonius H. Saccadic reaction times to audiovisual stimuli show effects of oscillatory phase reset. PLoS One 2012, 7:e44910.
19. Engel A.K., Fries P. Beta-band oscillations-signalling the status quo?. Curr. Opin. Neurobiol. 2010, 20:156-165.
20. Falchier A., Clavagnier S., Barone P., Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 2002, 22:5749-5759.
21. Fiebelkorn I.C., Foxe J.J., Butler J.S., Mercier M.R., Snyder A.C., Molholm S. Ready, set, reset: stimulus-locked periodicity in behavioral performance demonstrates the consequences of cross-sensory phase reset. J. Neurosci. 2011, 31:9971-9981.
22. Fiebelkorn I.C., Snyder A.C., Mercier M.R., Butler J.S., Molholm S., Foxe J.J. Cortical cross-frequency coupling predicts perceptual outcomes. Neuroimage 2013, 69:126-137.
23. Fort A., Delpuech C., Pernier J., Giard M.H. Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res. Cogn. Brain Res. 2002, 14:20-30.
24. Foxe J.J., Schroeder C.E. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 2005, 16:419-423.
25. Foxe J.J., Morocz I.A., Murray M.M., Higgins B.A., Javitt D.C., Schroeder C.E. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res. Cogn. Brain Res. 2000, 10:77-83.
26. Foxe J.J., Wylie G.R., Martinez A., Schroeder C.E., Javitt D.C., Guilfoyle D., Ritter W., Murray M.M. Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J. Neurophysiol. 2002, 88:540-543.
27. Genovese C.R., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 2002, 15:870-878.
28. Giard M.H., Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 1999, 11:473-490.
29. Gingras G., Rowland B.A., Stein B.E. The differing impact of multisensory and unisensory integration on behavior. J. Neurosci. 2009, 29:4897-4902.
30. Gomez-Ramirez M., Kelly S.P., Molholm S., Sehatpour P., Schwartz T.H., Foxe J.J. Oscillatory sensory selection mechanisms during intersensory attention to rhythmic auditory and visual inputs: a human electrocorticographic investigation. J. Neurosci. 2011, 31:18556-18567.
31. Gray C.M., Konig P., Engel A.K., Singer W. Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 1989, 338:334-337.
32. Groppe D.M., Urbach T.P., Kutas M. Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. Psychophysiology 2011, 48:1711-1725.
33. Harrison N.R., Wuerger S.M., Meyer G.F. Reaction time facilitation for horizontally moving auditory-visual stimuli. J. Vis. 2010, 10:16.
34. Jones E.G. The thalamic matrix and thalamocortical synchrony. Trends Neurosci. 2001, 24:595-601.
35. Kayser C., Petkov C.I., Augath M., Logothetis N.K. Functional imaging reveals visual modulation of specific fields in auditory cortex. J. Neurosci. 2007, 27:1824-1835.
36. Kayser C., Petkov C.I., Logothetis N.K. Visual modulation of neurons in auditory cortex. Cereb. Cortex 2008, 18:1560-1574.
37. Kopell N., Ermentrout G.B., Whittington M.A., Traub R.D. Gamma rhythms and beta rhythms have different synchronization properties. Proc. Natl. Acad. Sci. U. S. A. 2000, 97:1867-1872.
38. Lakatos P., Shah A.S., Knuth K.H., Ulbert I., Karmos G., Schroeder C.E. An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. J. Neurophysiol. 2005, 94:1904-1911.
39. Lakatos P., Chen C.M., O'Connell M.N., Mills A., Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 2007, 53:279-292.
40. Lakatos P., O'Connell M.N., Barczak A., Mills A., Javitt D.C., Schroeder C.E. The leading sense: supramodal control of neurophysiological context by attention. Neuron 2009, 64:419-430.
41. Lancaster J.L., Woldorff M.G., Parsons L.M., Liotti M., Freitas C.S., Rainey L., Kochunov P.V., Nickerson D., Mikiten S.A., Fox P.T. Automated Talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 2000, 10:120-131.
42. Leitao J., Thielscher A., Werner S., Pohmann R., Noppeney U. Effects of parietal TMS on visual and auditory processing at the primary cortical level - a concurrent TMS-fMRI Study. Cereb. Cortex 2012, 23(4):873-884.
43. Makeig S., Westerfield M., Jung T.P., Enghoff S., Townsend J., Courchesne E., Sejnowski T.J. Dynamic brain sources of visual evoked responses. Science 2002, 295:690-694.
44. Makeig S., Debener S., Onton J., Delorme A. Mining event-related brain dynamics. Trends Cogn. Sci. 2004, 8:204-210.
45. Meredith M.A., Allman B.L. Subthreshold multisensory processing in cat auditory cortex. Neuroreport 2009, 20:126-131.
46. Meredith M.A., Stein B.E. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J. Neurophysiol. 1986, 56:640-662.
47. Meredith M.A., Allman B.L., Keniston L.P., Clemo H.R. Auditory influences on non-auditory cortices. Hear. Res. 2009, 258:64-71.
48. Miller J. Divided attention: evidence for coactivation with redundant signals. Cogn. Psychol. 1982, 14:247-279.
49. Mishra J., Martinez A., Sejnowski T.J., Hillyard S.A. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 2007, 27:4120-4131.
50. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 2002, 14:115-128.
51. Molholm S., Sehatpour P., Mehta A.D., Shpaner M., Gomez-Ramirez M., Ortigue S., Dyke J.P., Schwartz T.H., Foxe J.J. Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. J. Neurophysiol. 2006, 96:721-729.
52. Moran R.J., Molholm S., Reilly R.B., Foxe J.J. Changes in effective connectivity of human superior parietal lobule under multisensory and unisensory stimulation. Eur. J. Neurosci. 2008, 27:2303-2312.
53. Murray M.M., Molholm S., Michel C.M., Heslenfeld D.J., Ritter W., Javitt D.C., Schroeder C.E., Foxe J.J. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb. Cortex 2005, 15:963-974.
54. Naue N., Rach S., Struber D., Huster R.J., Zaehle T., Korner U., Herrmann C.S. Auditory event-related response in visual cortex modulates subsequent visual responses in humans. J. Neurosci. 2011, 31:7729-7736.
55. Neal J.W., Pearson R.C., Powell T.P. The connections of area PG, 7a, with cortex in the parietal, occipital and temporal lobes of the monkey. Brain Res. 1990, 532:249-264.
56. Oostenveld R., Fries P., Maris E., Schoffelen J.M. FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput. Intell. Neurosci. 2011, 2011:156869.
57. Penny W.D., Kiebel S.J., Kilner J.M., Rugg M.D. Event-related brain dynamics. Trends Neurosci. 2002, 25:387-389.
58. Perrin F., Pernier J., Bertrand O., Giard M.H., Echallier J.F. Mapping of scalp potentials by surface spline interpolation. Electroencephalogr. Clin. Neurophysiol. 1987, 66:75-81.
59. Raij T., Ahveninen J., Lin F.H., Witzel T., Jaaskelainen I.P., Letham B., Israeli E., Sahyoun C., Vasios C., Stufflebeam S., Hamalainen M., Belliveau J.W. Onset timing of cross-sensory activations and multisensory interactions in auditory and visual sensory cortices. Eur. J. Neurosci. 2010, 31:1772-1782.
60. Rasch M.J., Gretton A., Murayama Y., Maass W., Logothetis N.K. Inferring spike trains from local field potentials. J. Neurophysiol. 2008, 99:1461-1476.
61. Roach B.J., Mathalon D.H. Event-related EEG time-frequency analysis: an overview of measures and an analysis of early gamma band phase locking in schizophrenia. Schizophr. Bull. 2008, 34:907-926.
62. Rockland K.S., Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol. 2003, 50:19-26.
63. Rorden C., Brett M. Stereotaxic display of brain lesions. Behav. Neurol. 2000, 12:191-200.
64. Schroeder C.E., Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 2002, 14:187-198.
65. Schroeder C.E., Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Curr. Opin. Neurobiol. 2005, 15:454-458.
66. Schroeder C.E., Lakatos P. Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci. 2009, 32:9-18.
67. Seltzer B., Pandya D.N. Parietal, temporal, and occipital projections to cortex of the superior temporal sulcus in the rhesus monkey: a retrograde tracer study. J. Comp. Neurol. 1994, 343:445-463.
68. Senkowski D., Molholm S., Gomez-Ramirez M., Foxe J.J. Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study. Cereb. Cortex 2006, 16:1556-1565.
69. Senkowski D., Gomez-Ramirez M., Lakatos P., Wylie G.R., Molholm S., Schroeder C.E., Foxe J.J. Multisensory processing and oscillatory activity: analyzing non-linear electrophysiological measures in humans and simians. Exp. Brain Res. 2007, 177:184-195.
70. Senkowski D., Saint-Amour D., Hofle M., Foxe J.J. Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness. Neuroimage 2011, 56:2200-2208.
71. Shah A.S., Bressler S.L., Knuth K.H., Ding M., Mehta A.D., Ulbert I., Schroeder C.E. Neural dynamics and the fundamental mechanisms of event-related brain potentials. Cereb. Cortex 2004, 14:476-483.
72. Sherman S.M. The thalamus is more than just a relay. Curr. Opin. Neurobiol. 2007, 17:417-422.
73. Sherman S.M., Guillery R.W. The role of the thalamus in the flow of information to the cortex. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2002, 357:1695-1708.
74. Stanford T.R., Quessy S., Stein B.E. Evaluating the operations underlying multisensory integration in the cat superior colliculus. J. Neurosci. 2005, 25:6499-6508.
75. Stein B.E. Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp. Brain Res. 1998, 123:124-135.
76. Stein B.E., Meredith M.A. The merging of the senses 1993, MIT Press, Cambridge, Mass.
77. Tallon-Baudry C., Bertrand O., Delpuech C., Pernier J. Stimulus specificity of phase-locked and non-phase-locked 40Hz visual responses in human. J. Neurosci. 1996, 16:4240-4249.
78. Teder-Salejarvi W.A., McDonald J.J., Di Russo F., Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res. Cogn. Brain Res. 2002, 14:106-114.
79. Thorne J.D., De Vos M., Viola F.C., Debener S. Cross-modal phase reset predicts auditory task performance in humans. J. Neurosci. 2011, 31:3853-3861.
80. Tyll S., Bonath B., Schoenfeld M.A., Heinze H.J., Ohl F.W., Noesselt T. Neural basis of multisensory looming signals. Neuroimage 2012, 15(65):13-22.
81. Vidal J.R., Ossandon T., Jerbi K., Dalal S.S., Minotti L., Ryvlin P., Kahane P., Lachaux J.P. Category-specific visual responses: an intracranial study comparing gamma, beta, alpha, and ERP response selectivity. Front. Hum. Neurosci. 2010, 4:195.
82. von Stein A., Rappelsberger P., Sarnthein J., Petsche H. Synchronization between temporal and parietal cortex during multimodal object processing in man. Cereb. Cortex 1999, 9:137-150.
83. Werner S., Noppeney U. Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J. Neurosci. 2010, 30:2662-2675.