Evidence for Enhanced Multisensory Facilitation with Stimulus Relevance: An Electrophysiological Investigation

PLoS ONE

Volumn 8, Issue 1, 2013, Pages

  Barutchu, Ayla ^a,b,d   Freestone, Dean R ^b,d   Innes Brown, Hamish ^b   Crewther, David P ^c   Crewther, Sheila G ^a  

^a LA TROBE UNIVERSITY   (Australia)

^b BIONICS INSTITUTE   (Australia)

^c SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^d UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; CONTROLLED STUDY; EVENT RELATED POTENTIAL; FACILITATION; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MOTOR CONTROL; NEUROMODULATION; NORMAL HUMAN; OCCIPITAL LOBE; PARIETAL LOBE; RESPONSE TIME; RIGHT HEMISPHERE; STIMULUS RESPONSE; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY PERCEPTION; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; OCCIPITAL LOBE; PARIETAL LOBE; PHOTIC STIMULATION; REACTION TIME; VISUAL PERCEPTION;

EID: 84872766557     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0052978     Document Type: Article

References (69)

1. Stein BE, Burr D, Constantinidis C, Laurienti PJ, Alex Meredith M, et al. (2010) Semantic confusion regarding the development of multisensory integration: a practical solution. Europ J Neurosci 31: 1713-1720.
2. McDonald JJ, Teder-Salejarvi WA, Hillyard SA, (2000) Involuntary orienting to sound improves visual perception. Nature 407: 906-908.
3. Spence C, Driver J, (1996) Audiovisual links in endogenous covert spatial attention. J Exp Psychol Hum Percept Perform 22: 1005-1030.
4. Eimer M, Schroger E, (1998) ERP effects of intermodal attention and cross-modal links in spatial attention. Psychophysiology 35: 313-327.
5. McDonald JJ, Ward LM, (2000) Involuntary listening aids seeing: evidence from human electrophysiology. Psychol Sci 11: 167-171.
6. Czigler I, Balazs L, (2001) Event-related potentials and audiovisual stimuli: multimodal interactions. Neuroreport 12: 223-226.
7. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, et al. (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res 14: 115-128.
8. Giard MH, Peronnet F, (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cog Neurosci 11: 473-490.
9. Vidal J, Giard MH, Roux S, Barthelemy C, Bruneau N, (2008) Cross-modal processing of auditory-visual stimuli in a no-task paradigm: a topographic event-related potential study. Clinical Neurophysiology 119: 763-771.
10. Fort A, Delpuech C, Pernier J, Giard MH, (2002) Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res 14: 20-30.
11. Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG, (2010) The multifaceted interplay between attention and multisensory integration. Trends in Cog Sci 14: 400-410.
12. van Atteveldt NM, Formisano E, Goebel R, Blomert L, (2007) Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 36: 1345-1360.
13. van Ee R, van Boxtel JJ, Parker AL, Alais D, (2009) Multisensory congruency as a mechanism for attentional control over perceptual selection. The Journal of neuroscience: the official journal of the Society for Neuroscience 29: 11641-11649.
14. Puce A, Epling JA, Thompson JC, Carrick OK, (2007) Neural responses elicited to face motion and vocalization pairings. Neuropsychologia 45: 93-106.
15. Talsma D, Woldorff MG, (2005) Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J Cogn Neurosci 17: 1098-1114.
16. Sinnett S, Soto-Faraco S, Spence C, (2008) The co-occurrence of multisensory competition and facilitation. Acta Psychologica 128: 153-161.
17. Molholm S, Ritter W, Javitt DC, Foxe JJ, (2004) Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cerebral Cortex 14: 452-465.
18. Cappe C, Thelen A, Romei V, Thut G, Murray MM, (2012) Looming signals reveal synergistic principles of multisensory integration. J Neurosci 32: 1171-1182.
19. Giray M, Ulrich R, (1993) Motor coactivation revealed by response force in divided and focused attention. J Exp Psychol Hum Percept Perform 19: 1278-1291.
20. Miller J, (1982) Divided attention: evidence for coactivation with redundant signals. Cogn Psychol 14: 247-279.
21. Barutchu A, Crewther SG, Paolini AG, Crewther DP, (2003) The effects of modality dominance and accuracy on motor reaction times to unimodal and bimodal stimuli [Abstract]. Journal of Vision 3: 775a.
22. Senkowski D, Schneider TR, Foxe JJ, Engel AK, (2008) Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci 31: 401-409.
23. Senkowski D, Talsma D, Herrmann CS, Woldorff MG, (2005) Multisensory processing and oscillatory gamma responses: effects of spatial selective attention. Exp Brain Res 166: 411-426.
24. Kanayama N, Tame L, Ohira H, Pavani F, (2011) Top down influence on visuo-tactile interaction modulates neural oscillatory responses. Neuroimage.
25. Engel AK, Fries P, Singer W, (2001) Dynamic predictions: oscillations and synchrony in top-down processing. Nat Rev Neurosci 2: 704-716.
26. Pfurtscheller G, Aranibar A, (1979) Evaluation of event-related desynchronization (ERD) preceding and following voluntary self-paced movement. Electroencephalogr Clin Neurophysiol 46: 138-146.
27. Derambure P, Defebvre L, Dujardin K, Bourriez JL, Jacquesson JM, et al. (1993) Effect of aging on the spatio-temporal pattern of event-related desynchronization during a voluntary movement. Electroencephalogr Clin Neurophysiol 89: 197-203.
28. Toro C, Deuschl G, Thatcher R, Sato S, Kufta C, et al. (1994) Event-related desynchronization and movement-related cortical potentials on the ECoG and EEG. Electroencephalogr Clin Neurophysiol 93: 380-389.
29. Kaiser J, Birbaumer N, Lutzenberger W, (2001) Event-related beta desynchronization indicates timing of response selection in a delayed-response paradigm in humans. Neurosci Lett 312: 149-152.
30. Senkowski D, Molholm S, Gomez-Ramirez M, Foxe JJ, (2006) Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study. Cereb Cortex 16: 1556-1565.
31. Lakatos P, Chen CM, O'Connell MN, Mills A, Schroeder CE, (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53: 279-292.
32. Schroeder CE, Lakatos P, (2009) Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci 32: 9-18.
33. Ulrich R, Miller J, Schroter H, (2007) Testing the race model inequality: an algorithm and computer programs. Behav Res Methods 39: 291-302.
34. Picton TW, Bentin S, Berg P, Donchin E, Hillyard SA, et al. (2000) Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. Psychophysiology 37: 127-152.
35. Murray MM, Brunet D, Michel CM, (2008) Topographic ERP analyses: a step-by-step tutorial review. Brain Topography 20: 249-264.
36. Gratton G, Coles MG, Donchin E, (1983) A new method for off-line removal of ocular artifact. Electroencephalogr Clin Neurophysiol 55: 468-484.
37. Graimann B, Pfurtscheller G, (2006) Quantification and visualization of event-related changes in oscillatory brain activity in the time-frequency domain. Progress in Brain Research 159: 79-97.
38. Calvert GA, Thesen T, (2004) Multisensory integration: methodological approaches and emerging principles in the human brain. J Physiol 98: 191-205.
39. Calvert GA, (2001) Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 11: 1110-1123.
40. Guthrie D, Buchwald JS, (1991) Significance testing of difference potentials. Psychophysiology 28: 240-244.
41. Pfurtscheller G, Lopes da Silva FH, (1999) Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology 110: 1842-1857.
42. Graimann B, Huggins JE, Levine SP, Pfurtscheller G, (2002) Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data. Clinical Neurophysiology 113: 43-47.
43. Efron B, Tibshirani R (1993) An introduction to the bootstrap. new York: Champman & Hall.
44. Raij T, Uutela K, Hari R, (2000) Audiovisual integration of letters in the human brain. Neuron 28: 617-625.
45. Klucharev V, Mottonen R, Sams M, (2003) Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Brain Res Cogn Brain Res 18: 65-75.
46. Driver J, Noesselt T, (2008) Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57: 11-23.
47. Corbetta S, Mantovani G, Lania A, Borgato S, Vicentini L, et al. (2000) Calcium-sensing receptor expression and signalling in human parathyroid adenomas and primary hyperplasia. Clinical Endocrinology 52: 339-348.
48. Kastner S, Pinsk MA, De Weerd P, Desimone R, Ungerleider LG, (1999) Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron 22: 751-761.
49. Laycock R, Crewther DP, Fitzgerald PB, Crewther SG, (2007) Evidence for fast signals and later processing in human V1/V2 and V5/MT+: A TMS study of motion perception. J Neurophysiol 98: 1253-1262.
50. Bolognini N, Rossetti A, Casati C, Mancini F, Vallar G, (2011) Neuromodulation of multisensory perception: a tDCS study of the sound-induced flash illusion. Neuropsychologia 49: 231-237.
51. Polich J, (2007) Updating P300: an integrative theory of P3a and P3b. Clin Neurophysiol 118: 2128-2148.
52. Ranganath C, Rainer G, (2003) Neural mechanisms for detecting and remembering novel events. Nature Reviews Neuroscience 4: 193-202.
53. Schneider TR, Debener S, Oostenveld R, Engel AK, (2008) Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming. Neuroimage 42: 1244-1254.
54. Stekelenburg JJ, Vroomen J, (2007) Neural correlates of multisensory integration of ecologically valid audiovisual events. J Cogn Neurosci 19: 1964-1973.
55. Lebib R, Papo D, de Bode S, Baudonniere PM, (2003) Evidence of a visual-to-auditory cross-modal sensory gating phenomenon as reflected by the human P50 event-related brain potential modulation. Neurosci Lett 341: 185-188.
56. Ghazanfar AA, Chandrasekaran C, Logothetis NK, (2008) Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J Neurosci 28: 4457-4469.
57. Sakowitz OW, Quiroga RQ, Schurmann M, Basar E, (2001) Bisensory stimulation increases gamma-responses over multiple cortical regions. Brain Res Cogn Brain Res 11: 267-279.
58. Cacace AT, McFarland DJ, (2003) Spectral dynamics of electroencephalographic activity during auditory information processing. Hear Res 176: 25-41.
59. Yordanova J, Kolev V, Polich J, (2001) P300 and alpha event-related desynchronization (ERD). Psychophysiology 38: 143-152.
60. Mazaheri A, Picton TW, (2005) EEG spectral dynamics during discrimination of auditory and visual targets. Brain Res Cogn Brain Res 24: 81-96.
61. Aranibar A, Pfurtscheller G, (1978) On and off effects in the background EEG activity during one-second photic stimulation. Electroencephalogr Clin Neurophysiol 44: 307-316.
62. Neuper C, Wortz M, Pfurtscheller G, (2006) ERD/ERS patterns reflecting sensorimotor activation and deactivation. Prog Brain Res 159: 211-222.
63. Porro CA, Cettolo V, Francescato MP, Baraldi P, (2000) Ipsilateral involvement of primary motor cortex during motor imagery. Eur J Neurosci 12: 3059-3063.
64. Boecker H, Kleinschmidt A, Requardt M, Hanicke W, Merboldt KD, et al. (1994) Functional cooperativity of human cortical motor areas during self-paced simple finger movements. A high-resolution MRI study. Brain 117 (Pt 6):: 1231-1239.
65. Baraldi P, Porro CA, Serafini M, Pagnoni G, Murari C, et al. (1999) Bilateral representation of sequential finger movements in human cortical areas. Neurosci Lett 269: 95-98.
66. Kim SG, Ashe J, Hendrich K, Ellermann JM, Merkle H, et al. (1993) Functional magnetic resonance imaging of motor cortex: hemispheric asymmetry and handedness. Science 261: 615-617.
67. Chen R, Gerloff C, Hallett M, Cohen LG, (1997) Involvement of the ipsilateral motor cortex in finger movements of different complexities. Ann Neurol 41: 247-254.
68. Hoshiyama M, Kakigi R, Berg P, Koyama S, Kitamura Y, et al. (1997) Identification of motor and sensory brain activities during unilateral finger movement: spatiotemporal source analysis of movement-associated magnetic fields. Exp Brain Res 115: 6-14.
69. Knosche TR, Bastiaansen MC, (2002) On the time resolution of event-related desynchronization: a simulation study. Clin Neurophysiol 113: 754-763.