Congruency of auditory sounds and visual letters modulates mismatch negativity and P300 event-related potentials

International Journal of Psychophysiology

Volumn 79, Issue 2, 2011, Pages 137-146

  Andres, Allison J D ^a   Oram Cardy, Janis E ^a   Joanisse, Marc F ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Audiovisual integration; ERP; Event related potential; Mismatch negativity; MMN; P300

Indexed keywords

ADULT; ARTICLE; AUDITORY MEMORY; AUDITORY STIMULATION; COGNITION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; FEMALE; HUMAN; MALE; MISMATCH NEGATIVITY; NORMAL HUMAN; SENSORY SYSTEM; SOUND; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; CONTINGENT NEGATIVE VARIATION; ELECTROENCEPHALOGRAPHY; EVENT-RELATED POTENTIALS, P300; FEMALE; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOPHYSICS; REACTION TIME; SOUND; VOCABULARY; YOUNG ADULT;

EID: 79551619153     PISSN: 01678760     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijpsycho.2010.09.012     Document Type: Article

References (28)

1. Blau V., van Atteveldt N., Formisano E., Goebel R., Blomert L. Task-irrelevant visual letters interact with the processing of speech sounds in heteromodal and unimodal cortex. The European Journal of Neuroscience 2008, 28:500-509.
2. Blau V., van Atteveldt N., Ekkebus M., Goebel R., Blomert L. Reduced neural integration of letters and speech sounds links phonological and reading deficits in adult dyslexia. Current Biology 2009, 19:503-508.
3. Blau V., Reithler J., van Atteveldt N., Seitz J., Gerretsen P., Goebels R., Blomert L. Deviant processing of letters and speech sounds as proximate cause of reading failure: a functional magnetic resonance imaging study of dyslexic children. Brain 2010, 133:868-879.
4. Foxe J.J., Schroeder C.E. The case for feedforward multisensory convergence during early cortical processing. NeuroReport 2005, 16:419-423.
5. Froyen D.J.W., van Atteveldt N., Bonte M.L., Blomert L. Cross-modal enhancement indicates early automatic integration of letters and speech-sounds. Neuroscience Letters 2008, 430:23-28.
6. Froyen D.J.W., Bonte M.L., van Atteveldt N., Blomert L. The long road to automation: neurocognitive development of letter-speech sound processing. Journal of Cognitive Neuroscience 2009, 21(3):567-580.
7. Froyen D., van Atteveldt N., Blomert L. Exploring the role of low level visual processing in letter-speech sound integration: a visual MMN study. Frontiers in Integrative Neuroscience 2010, 13:1-9.
8. Herdman A.T., Fujioka T., Chau W., Ross B., Pantev C., Picton T.W. Cortical oscillations related to processing congruent and incongruent grapheme-phoneme pairs. Neuroscience Letters 2006, 399:61-66.
9. Holm A., Ranta-aho P.O., Sallinen M., Karjalainen P.A., Müller K. Relationship of P300 single-trial responses with reaction time and preceding stimulus sequence. International Journal of Psychophysiology 2006, 61:244-252.
10. Kutas M., McCarthy G., Donchin E. Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Science 1977, 197(4305):792-795.
11. Laurienti P.J., Wallace M.T., Maldjian J.A., Susi C.M., Stein B.E., Burdette J.H. Cross-modal sensory processing in the anterior cingulate and medial prefrontal cortices. Human Brain Mapping 2003, 19:213-223.
12. Magnan A., Ecalle J., Veuillet E., Collet L. The effects of an audio-visual training program in dyslexic children. Dyslexia 2004, 10:131-140.
13. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264:746-748.
14. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cognitive Brain Research 2002, 14:115-128.
15. Muller-Gass A., Stelmack R.M., Campbell K.B. The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the mismatch negativity. Brain Research 2006, 1078:112-130.
16. Näätänen R. Mismatch negativity (MMN): perspectives for application. International Journal of Psychophysiology 2000, 3:3-10.
17. Näätänen R., Paavilainen P., Rinne T., Alho K. The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clinical Neurophysiology 2007, 118:2544-2590.
18. Picton T.W., Alain C., Otten L., Ritter W., Achim A. Mismatch negativity: different water in the same river. Audiology & Neuro-Otology 2000, 5:111-139.
19. Polich J. Updating p300: an integrative theory of P3a and P3b. Clinical Neurophysiology 2007, 118(10):2128-2148.
20. Raij T., Uutela K., Hari R. Audiovisual integration of letters in the human brain. Neuron 2000, 28:617-625.
21. Saint-Amour D., De Sanctis P., Molholm S., Ritter W., Foxe J.J. Seeing voices: high-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia 2007, 45:587-597.
22. Sams M., Aulanko R., Hamalainen M., Hari R., Lounasmaa O.V., Lu S.T., et al. Seeing speech: visual information from lip movements modifies activities in the human auditory cortex. Neuroscience Letters 1991, 127:141-145.
23. Sumby W.H., Pollack I. Visual contribution to speech intelligibility in noise. The Journal of the Acoustical Society of America 1954, 26:212-215.
24. Teder-Sälejärvi W.A., McDonald J.J., Di Russo F., Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cognitive Brain Research 2002, 14(1):106-114.
25. van Atteveldt N., Formisano E., Goebel R., Blomert L. Integration of letters and speech sounds in the human brain. Neuron 2004, 43:271-282.
26. Van Atteveldt N., Formisano E., Goebel R., Blomert L. Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 2007, 36:1345-1360.
27. Wickens C.D., Israel J., Donchin E. The event related control potential as an index of task workload in adaptive man-machine systems. Proceedings of the 21st Annual Meeting of the Human Factors Society, USA 1977.
28. Widmann A., Kujala T., Tervaniemi M., Kujala A., Schröger E. From symbols to sounds: visual symbolic information activates sound representations. Psychophysiology 2004, 41:709-715.