Mismatch negativity with visual-only and audiovisual speech

Brain Topography

Volumn 21, Issue 3-4, 2009, Pages 207-215

  Ponton, Curtis W ^a   Bernstein, Lynne E ^b,c   Auer Jr , Edward T ^d  

^a Compumedics/Neuroscan Inc ^*  (United States)

^b HOUSE EAR INSTITUTE   (United States)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^d UNIVERSITY OF KANSAS   (United States)

Author keywords

Audiovisual speech processing; EEG; MMN; Visual speech processing

Indexed keywords

ADULT; AUDITORY STIMULATION; CLINICAL ARTICLE; CONFERENCE PAPER; ELECTROENCEPHALOGRAM; HUMAN; LATENT PERIOD; MISMATCH NEGATIVITY; PARIETAL LOBE; PHONETICS; PRIORITY JOURNAL; SPEECH; TEMPORAL CORTEX; VISUAL STIMULATION; ARTICLE; AUDITORY CORTEX; AUDITORY NERVOUS SYSTEM; BRAIN CORTEX; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; FEMALE; HISTOLOGY; MALE; NEUROPSYCHOLOGICAL TEST; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; SPEECH PERCEPTION; TEMPORAL LOBE; TIME; VISION; VISUAL SYSTEM;

ACOUSTIC STIMULATION; ADULT; AUDITORY CORTEX; AUDITORY PATHWAYS; BRAIN MAPPING; CEREBRAL CORTEX; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; PARIETAL LOBE; PHOTIC STIMULATION; REACTION TIME; SPEECH PERCEPTION; TEMPORAL LOBE; TIME FACTORS; VISUAL PATHWAYS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 70349568713     PISSN: 08960267     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10548-009-0094-5     Document Type: Conference Paper

References (39)

1. Astikainen P, Lillstrang E, Ruusuvirta T (2008) Visual mismatch negativity for changes in orientation-a sensory memorydependent response. Eur J NeuroSci 28:2319-2324
2. Bernstein LE, Auer ET Jr, Wagner M, Ponton CW (2008a) Spatiotemporal dynamics of audiovisual speech processing. NeuroImage 39:423-435
3. Bernstein LE, Lu ZL, Jiang J (2008b) Quantified acoustic-optical speech signal incongruity identifies cortical sites of audiovisual speech processing. Brain Res 1242:172-184
4. Calvert GA, Campbell R (2003) Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci 15:57-70
5. Calvert GA, Brammer MJ, Bullmore ET, Campbell R, Iversen SD, David AS (1999) Response amplification in sensory-specific cortices during crossmodal binding. Neuro Report 10:2619-2623
6. Capek CM, MacSweeney M, Woll B, Waters D, McGuire PK, David AS, Brammer MJ, Campbell R (2008) Cortical circuits for silent speechreading in deaf and hearing people. Neuropsychologia 46:1233-1241
7. Colin C, Radeau M, Soquet A, Demolin D, Colin F, Deltenre P (2002) Mismatch negativity evoked by the McGurk-MacDonald effect: a phonetic representation within short-term memory. Clin Neurophysiol 113:495-506
8. Colin C, Radeau M, Soquet A, Deltenre P (2004) Generalization of the generation of an MMN by illusory McGurk percepts: voiceless consonants. Clin Neurophysiol 115:1989-2000
9. Czigler I, Weisz J, Winkler I (2007) Backward masking and visual mismatch negativity: electrophysiological evidence for memorybased detection of deviant stimuli. Psychophysiology 44:610-619
10. Darvas F, Schmitt U, Louis AK, Fuchs M, Knoll G, Buchner H (2001) Spatio-temporal current density reconstruction (stCDR) from EEG/MEG-data. Brain Topogr 13:195-207 (Pubitemid 32247053)
11. Fuchs M, Wagner M, Kohler T, Wischmann H-A (1999) Linear and nonlinear current density reconstruction. J Clin Neurophysiol 16:267-295
12. Giard MH, Perrin F, Pernier J, Bouchet P (1990) Brain generators implicated in the processing of auditory stimulus deviance: a topographic event-related potential study. Psychophysiology 27:627-640
13. Grossman E, Donnelly M, Price R, Pickens D, Morgan V, Neighbor G, Blake R (2000) Brain areas involved in perception of biological motion. J Cogn Neurosci 12:711-720
14. Horvath J, Czigler I, Jacobsen T, Maess B, Schroger E, Winkler I (2008) MMN or no MMN: no magnitude of deviance effect on the MMN amplitude. Psychophysiology 45:60-69
15. Jasper HH (1958) The ten-twenty electrode system of the international federation. Electroencephalogr Clin Neurophysiol 10:371-375
16. Kislyuk DS, Mö ttönen R, Sams M (2008) Visual processing affects the neural basis of auditory discrimination. J Cogn Neurosci 20:2175-2184
17. Lebib R, Papo D, Douiri A, de Bode S, Dowens MG, Baudonniere P-M (2004) Modulations of 'late' event-related brain potentials in humans by dynamic audiovisual speech stimuli. Neurosci Lett 372:74-79
18. Lehmann D, Skrandies W (1980) Reference-free identification of components of checkerboard-evoked multichannel potential fields. Electroencephalogr Clin Neurophysiol 48:609-621
19. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748
20. Molholm S, Martinez A, Ritter W, Javitt DC, Foxe JJ (2005) The neural circuitry of pre-attentive auditory change-detection: an fMRI study of pitch and duration mismatch negativity generators. Cereb Cortex 15:545-551
21. Möttönen R, Krause CM, Tiippana K, Sams M (2002) Processing of changes in visual speech in the human auditory cortex. Cogn Brain Res 13:417-425
22. Näätänen R, Gaillard AWK, Mäntysalo S (1978) Early selectiveattention effect on evoked potential reinterpreted. Acta Psychol 42:313-329
23. Näätänen R, Jacobsen T, Winkler I (2005) Memory-based or afferent processes in mismatch negativity (MMN): a review of the evidence. Psychophysiology 42:25-32
24. Näätänen R, Paavilainen P, Rinne T, Alho K (2007) The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clin Neurophysiol 118:2544-2590
25. Pascual-Marqui R (2002) Standardized low resolution brain electromagnetic tomography (sLORETA): technical details. Methods Find Exp Clin Pharmacol 24D:5-12
26. Pazo-Alvarez O, Cadaveira F, Amenedo E (2003) MMN in the visual modality: a review. Biol Psychol 63:199-236
27. Ponton CW, Don M, Eggermont JJ, Kwong B (1997) Integrated mismatch negativity (MMNi): a noise-free representation of evoked responses allowing single-point distribution-free statistical tests. Electroencephalogr Clin Neurophysiol 104:143-150
28. Ponton CW, Auer ET Jr, Bernstein LE (2002) Neurocognitive basis for audiovisual speech perception: evidence from event-related potentials. In: 7th international congress of spoken language processing, Denver, CO, pp 1697-1700
29. Puce A, Perrett D (2003) Electrophysiology and brain imaging of biological motion. Philos Trans R Soc B-Biol Sci 358:435-445
30. Puce A, Allison T, Bentin S, Gore JC, McCarthy G (1998) Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci 18:2188-2199
31. Puce A, Smith A, Allison T (2000) ERPs evoked by viewing facial movements. Cogn Neuropsychol 17:221-239
32. Reale RA, Calvert GA, Thesen T, Jenison RL, Kawasaki H, Oya H, Howard MA, Brugge JF (2007) Auditory-visual processing represented in the human superior temporal gyrus. Neuroscience 145:162-184
33. Saint-Amour D, De Sanctis P, Molholm S, Ritter W, Foxe JJ (2007) Seeing voices: high-density electrical mapping and sourceanalysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia 45:587-597
34. Sams M, Aulanko R, Hamalainen M, Hari R, Lounasmaa OV, Lu ST, Simola J (1991) Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci Lett 127:141-145
35. Santi A, Servos P, Vatikiotis-Bateson E, Kuratate T, Munhall K (2003) Perceiving biological motion: dissociating visible speech from walking. J Cogn Neurosci 15:800-809
36. Scherg M (1990) Fundamentals of dipole source analysis. In: Grandori F, Hoke M, Romani GL (eds) Auditory evoked magnetic fields and electric potentials. Karger, Basel, pp 40-69
37. Scott SK, Johnsrude IS (2003) The neuroanatomical and functional organization of speech perception. Trends Neurosci 26:100-107
38. Wagner M, Fuchs M, Wischmann H-A, Ottenberg K, Dössel O (1995) Cortex segmentation from 3D MR images for MEG reconstructions. In: Baumgartner C, Deecke L, Stroink G, Williamson SJ (eds) Biomagnetism: fundamental research and clinical applications, vol 7 studies in applied electromagnetics and mechanics. Elsevier Science IOS Press, Amsterdam, The Netherlands, pp 433-438
39. Yvert B, Bertrand O, Thevenet M, Echallier JF, Pernier J (1997) A systematic evaluation of the spherical model accuracy in EEG dipole localization. Electroencephalogr Clin Neurophysiol 102:452-459