The effect of viewing speech on auditory speech processing is different in the left and right hemispheres

Brain Research

Volumn 1242, Issue , 2008, Pages 151-161

  Davis, Chris ^a   Kislyuk, Daniel ^b,c   Kim, Jeesun ^a   Sams, Mikko ^b  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

^b AALTO UNIVERSITY   (Finland)

^c ST PETERSBURG STATE UNIVERSITY   (Russian Federation)

Author keywords

Auditory evoked response; Auditory visual; Evoked response reduction; Hemispheric differences; Multisensory

Indexed keywords

ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; LEFT HEMISPHERE; MAGNETOENCEPHALOGRAPHY; MALE; OUTCOME ASSESSMENT; PRIORITY JOURNAL; RIGHT HEMISPHERE; SPEECH ANALYSIS; SPEECH PERCEPTION; TASK PERFORMANCE; VISUAL STIMULATION; WHITE NOISE;

ADULT; AUDITORY PERCEPTION; BRAIN; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MAGNETOENCEPHALOGRAPHY; MALE; REACTION TIME; VISUAL PERCEPTION;

EID: 55549106431     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2008.04.077     Document Type: Article

References (57)

1. Abrams D.A., Nicol T., Zecker S., and Kraus N. Right-hemisphere auditory cortex is dominant for coding syllable patterns in speech. J. Neurosci. 28 (2008) 3958-3965
2. Belin P., Zilbovicius M., Crozier S., Thivard L., Fontaine A., Masure M.C., and Samson Y. Lateralization of speech and auditory temporal processing. J. Cogn. Neurosci. 10 (1998) 536-540
3. Besle J., Fort A., Delpuech C., and Giard M.-H. Bimodal speech: early suppressive visual effects in human auditory cortex. Eur. J. Neurosci. 20 (2004) 2225-2234
4. Boemio A., Fromm S., Braun A., and Poeppel D. Hierarchical and asymmetric temporal sensitivity in human auditory cortices. Nat. Neurosci. 8 (2005) 389-395
5. Callan D.E., Jones J.A., Munhall K., Callan A.M., Kroos C., and Vatikiotis-Bateson E. Neural processes underlying perceptual enhancement by visual speech gestures. Neuroreport 14 (2003) 2213-2218
6. Calvert G.A., and Campbell R. Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 15 (2003) 57-70
7. Campbell R., MacSweeney M., Surguladze S., Calvert G., McGuire P., Suckling J., Brammer M.J., and David A.S. Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Cogn. Brain Res. 12 (2001) 233-243
8. Diesch E. Left and right hemifield advantages of fusions and combinations in audiovisual speech perception. Q. J. Exp. Psychol. 48A (1995) 320-333
9. Ghazanfar A.A., Maier J.X., Hoffman K.L., and Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci. 25 (2005) 5004-5012
10. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
11. Giraud A.-L., Kleinschmidt A., Poeppel D., Lund T.E., Frackowiak R.S.J., and Lauf H. Endogenous Cortical Rhythms Determine Cerebral Specialization for Speech Perception and Production. Neuron 56 (2007) 1127-1134
12. Grant K.W., Greenberg S., Poeppel D., and van Wassenhove V. Effects of spectro-temporal asynchrony in auditory and auditory-visual speech processing. Semin. hear. 25 (2004) 241-255
13. Grant K.W., van Wassenhove V., and Poeppel D. Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony. Speech commun. 44 (2004) 43-53
14. Greenberg S., and Arai T. What are the essential cues for understanding spoken language?. IEICE trans. inf. syst. 87 (2004) 1059-1070
15. Hazan V., and Rosen S. Individual variability in the perception of cues to place contrasts in initial stops. Percept. Psychophys. 49 (1991) 187-200
16. Heinks-Maldonado T.H., Nagarajan S.S., and Houde J.F. Magnetoencephalographic evidence for a precise forward model in speech production. Neuroreport 17 (2006) 1375-1379
17. Hickok G., and Poeppel D. The cortical organization of speech processing. Nat. Rev. Neurosci. 8 (2007) 393-402
18. Hutsler J., and Galuske R.A.W. Hemispheric asymmetries in cerebral cortical networks. Trends Neurosci. 26 (2003) 429-435
19. Hyde K., Peretz I., and Zatorre R. Evidence for the role of the right auditory cortex in fine pitch resolution. Neuropsychologia 46 (2008) 632-639
20. Jääskeläinen I.P., Ojanen V., Ahveninen J., Auranen T., Levänen S., Möttönen R., Tarnanen I., and Sams M. Adaptation of neuromagnetic N1 responses to phonetic stimuli by visual speech in humans. Neuroreport 15 (2004) 2741-2744
21. Jääskeläinen I., Kauramäki J., Tujunen J., and Sams M. Formant transition-specific adaptation by lipreading of left auditory cortex N1m. Neuroreport 19 (2008) 93-97
22. Jamison H.L., Watkins K.E., Bishop D.V.M., and Matthews P.M. Hemispheric specialization for processing auditory nonspeech stimuli. Cereb. Cortex 16 (2006) 1266-1275
23. Klucharev V., Möttönen R., and Sams M. Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Cogn. Brain Res. 18 (2003) 65-75
24. Kuriki S., Okita Y., and Hirata Y. Source analysis of magnetic field responses from the human auditory cortex elicited by short speech sounds. Exp. Brain Res. 104 (1995) 144-152
25. Liégeois-Chauvel C., Giraud K., Badier J.M., Marquis P., and Chauvel P. Intracerebral evoked potentials in pitch perception reveal a functional asymmetry of human auditory cortex. Ann. N.Y. Acad. Sci. 930 (2001) 117-132
26. Liikkanen L.A., Tiitinen H., Alku P., Leino S., Yrttiaho S., and May P.J.C. The right-hemispheric auditory cortex in humans is sensitive to degraded speech sounds. Neuroreport 18 (2007) 601-605
27. Lutkenhöner B., and Steinsträter O. High-precision neuromagnetic study of the functional organization of the human auditory cortex. Audiol. Neurotol. 3 (1998) 191-213
28. Martikainen M.H., Kaneko K., and Hari R. Suppressed Responses to Self-triggered Sounds in the Human Auditory Cortex. Cereb. Cortex 15 (2005) 299-302
29. Miki K., Watanabe S., and Kakigi R. Interaction between auditory and visual stimulus relating to the vowel sounds in the auditory cortex in humans: A magnetoencephalographic study. Neurosci. Lett. 357 (2004) 199-202
30. Möttönen R., Krause C.M., Tiippana K., and Sams M. Processing of changes in visual speech in the human auditory cortex. Brain Res. Cogn. Brain Res. 13 (2002) 417-425
31. Näätänen R., and Picton T.W. The N1 wave of the human electric and magnetic response to sound: A review and an analysis of the component structure. Psychophysiology 24 (1987) 375-425
32. Näätänen R., and Winkler I. The concept of auditory stimulus representation in cognitive neuroscience. Psychol. Bull. 125 (1999) 826-859
33. Nakasato N., Fujita S., Seki K., Kawamura T., Matani A., Tamura I., Fujiwara S., and Yoshimoto T. Electroencephalogr. Clin. Neurophysiol. 94 (1995) 183-190
34. Nicholls M.E.R. Temporal Processing Asymmetries between the Cerebral Hemispheres: Evidence and Implications. Laterality 1 (1996) 97-137
35. Nicholls M.E.R., Schier M., Stough C.K.K., and Box A. Psychophysical and electrophysiologic support for a left hemisphere temporal processing advantage. Neuropsychiatr. Neuropsychol. Behav. Neurol. 12 (1999) 11-16
36. Olson I.R., Gatenby J.C., and Gore J.C. A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Cogn. Brain Res. 14 (2002) 129-138
37. Pantev C., Bertrand O., Eulitz C., Verkindt C., Hampson S., Schuierer G., and Elbert T. Specific tonotopic organizations of different areas of the human auditory cortex revealed by simultaneous magnetic and electric recordings. Electroencephalogr. Clin. Neurophysiol. 94 (1990) 26-40
38. Parviainen T., Helenius P., and Salmelin R. Cortical differentiation of speech and nonspeech sounds at 100 ms: Implications for dyslexia. Cereb. Cortex 15 (2005) 1054-1063
39. Poeppel D. Pure word deafness and the bilateral processing of the speech code. Cogn. Sci. 25 (2001) 679-693
40. Poeppel D. The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time'. Speech Commun. 41 (2003) 245-255
41. Rogers R.L., Papanicolaou A.C., Baumann S.B., Saydjari C., and Eisenberg H.M. Neuromagnetic evidence of a dynamic excitation pattern generating the N100 auditory response. Electroencephalogr. Clin. Neurophysiol. 77 (1990) 237-240
42. Saint-Amour D., De Sanctis P., Molholm S., Ritter W., and Foxe J.J. Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion. Neuropsychologia 45 (2007) 587-597
43. Sams M., Aulanko R., Hamalainen M., Hari R., Lounasmaa O.V., Lu S.T., and Simola J. Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci. Lett. 127 (1991) 141-145
44. Sandmann P., Eichele T., Specht K., Jäncke L., Rimol L.M., Nordby H., and Hugdahl K. Hemispheric asymmetries in the processing of temporal acoustic cues in consonant-vowel syllables. Restor. Neurol. Neurosci. 25 (2007) 227-240
45. Schönwiesner M., Rübsamen R., and Yves von Cramon D. Hemispheric asymmetry for spectral and temporal processing in the human antero-lateral auditory belt cortex. Eur. J. Neurosci. 22 (2005) 1521-1528
46. Schroeder M.R. Reference signal for signal quality studies. J. Acoust. Soc. Am. 44 (1968) 1735-1736
47. Scott S.K., Blank C.C., Rosen S., and Wise R.J.S. Identification of a pathway for intelligible speech in the left temporal lobe. Brain 123 (2000) 2400-2406
48. Shannon R.V., Zeng F.-G., Kamath V., Wygonski J., and Ekelid M. Speech recognition with primarily temporal cues. Science 270 (1995) 303-304
49. Skipper J.I., van Wassenhove V., Nusbaum H.C., and Small S.L. Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb. Cortex 17 (2007) 2387-2399
50. Stekelenburg J.J., and Vroomen J. Neural correlates of multisensory integration of ecologically valid audiovisual events. J. Cogn. Neurosci. 19 (2007) 1-10
51. Shtyrov Y., Kujala T., Palva S., Ilmoniemi R., and Näätänen R. Discrimination of speech and complex nonspeech sounds of different temporal structure in the left and right cerebral hemispheres. NeuroImage 12 (2000) 657-663
52. Sumby W.H., and Pollock I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26 (1954) 212-215
53. Trébuchon-Da Fonseca A., Giraud K., Badier J.-M., Chauvel P., and Liégeois-Chauvel C. Hemispheric lateralization of voice onset time (VOT) comparison between depth and scalp EEG recordings. NeuroImage 27 (2005) 1-14
54. van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U. S. A. 102 (2005) 1181-1186
55. Watkins K., and Paus T. Modulation of motor excitability during speech perception: The role of Broca's Area. J. Cogn. Neurosci. 16 (2004) 978-987
56. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., and McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb. Cortex 13 (2003) 1034-1043
57. Zatorre R.J., and Belin P. Spectral and temporal processing in human auditory cortex. Cereb. Cortex 11 (2001) 946-953