On the tip of the tongue: Modulation of the primary motor cortex during audiovisual speech perception

Speech Communication

Volumn 52, Issue 6, 2010, Pages 533-541

  Sato, Marc ^a   Buccino, Giovanni ^b   Gentilucci, Maurizio ^c   Cattaneo, Luigi ^d  

^a GIPSA LAB   (France)

^b UNIVERSITY MAGNA GRAECIA OF CATANZARO   (Italy)

^c UNIVERSITY OF PARMA   (Italy)

^d UNIVERSITY OF TRENTO   (Italy)

Author keywords

Audiovisual speech perception; McGurk effect; Mirror neuron system; Motor system; Motor theory of speech perception; Transcranial magnetic stimulation

Indexed keywords

AUDIO-VISUAL SPEECH; MCGURK EFFECT; MIRROR-NEURON SYSTEM; MOTOR SYSTEM; MOTOR SYSTEMS; SPEECH PERCEPTION; TRANSCRANIAL MAGNETIC STIMULATION;

COMPUTATIONAL LINGUISTICS; FUNCTIONAL ELECTRIC STIMULATION; INFORMATION THEORY; MAGNETIC MIRRORS; MIRRORS; PARTIAL DISCHARGES; SPEECH PROCESSING; TELECOMMUNICATION EQUIPMENT;

SPEECH COMMUNICATION;

EID: 77951105745     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.12.004     Document Type: Article

References (61)

1. Arbib M.A. From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics. Behav. Brain Sci. 28 2 (2005) 105-124
2. Benoît C., Mohamadi T., and Kandel S.D. Effects on phonetic context on audio-visual intelligibility of French. J. Speech Hear. Res. 37 (1994) 1195-1203
3. Besle J., Fort A., Delpuech C., and Giard M.H. Bimodal speech: early suppressive visual effects in human auditory cortex. Eur. J. Neurosci. 20 (2004) 2225-2234
4. Brancazio L., and Miller J.L. Use of visual information in speech perception: evidence for a visual rate effect both with and without a McGurk effect. Percept. Psychophys. 67 5 (2005) 759-769
5. Callan D.E., Jones J.A., Munhall K.G., Callan A.M., Kroos C., and Vatikiotis-Bateson E. Neural processes underlying perceptual enhancement by visual speech gestures. NeuroReport 14 (2003) 2213-2217
6. Callan D.E., Jones J.A., Munhall K.G., Callan A.M., Kroos C., and Vatikiotis-Bateson E. Multisensory integration sites identified by perception of spatial wavelet filtered visual speech gesture information. J. Cogn. Neurosci. 16 (2004) 805-816
7. Calvert G.A., and Campbell R. Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 15 1 (2003) 57-70
8. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10 11 (2000) 649-657
9. Chen C.H., Wu T., and Chu N.S. Bilateral cortical representation of the intrinsic lingual muscles. Neurology 52 (1999) 411-413
10. D'Ausilio A., Pulvermüller F., Salmas P., Bufalari I., Begliomini C., and Fadiga L. The motor somatotopy of speech perception. Curr. Biol. 19 5 (2009) 381-385
11. Fadiga L., Craighero L., Buccino G., and Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur. J. Neurosci. 15 (2002) 399-402
12. Fadiga L., Craighero L., and Olivier E. Human motor cortex excitability during the perception of others' action. Curr. Opin. Neurobiol. 15 (2005) 213-218
13. Galantucci B., Fowler C.A., and Turvey M.T. The motor theory of speech perception reviewed. Psychon. Bull. Rev. 13 3 (2006) 361-377
14. Gentilucci M., and Cattaneo L. Automatic audiovisual integration in speech perception. Exp. Brain Res. 167 (2005) 66-75
15. Gentilucci M., and Corballis M.C. From manual gesture to speech: a gradual transition. Neurosci. Biobehav. Rev. 30 (2006) 949-960
16. Grant K., Walden B.E., and Seitz P.F. Auditory-visual speech recognition by hearing-impaired subjects: consonant recognition, sentence recognition, and auditory-visual integration. J. Acoust. Soc. Am. 103 (1998) 2677-2690
17. Green K.P. The use of auditory and visual information during phonetic processing: implications for theories of speech perception. In: Campbell R., Dodd B., and Burnham D. (Eds). Hearing by Eye, II. Perspectives and Directions in Research on Audiovisual Aspects of Language Processing (1998), Psychology Press, Hove (UK) 3-25
18. Hertrich I., Mathiak K., Lutzenberger W., Menning H., and Ackermann H. Sequential audiovisual interactions during speech perception: a whole-head MEG study. Neuropsychologia 45 6 (2007) 1342-1354
19. Jones J., and Callan D.E. Brain activity during audiovisual speech perception: an fMRI study of the McGurk effect. NeuroReport 14 8 (2003) 1129-1133
20. Klucharev V., Möttönen R., and Sams M. Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Brain Res. Cogn. Brain Res. 18 (2003) 65-75
21. Liberman A.M., and Mattingly I.G. The motor theory of speech perception revised. Cognition 21 (1985) 1-36
22. Liberman A.M., and Whalen D.H. On the relation of speech to language. Trends Cogn. Sci. 3 7 (2000) 254-264
23. Liberman A.M., Cooper F.S., Shankweiler D.P., and Studdert-Kennedy M. Perception of the speech code. Psychol. Rev. 74 (1967) 431-461
24. MacLeod A., and Summerfield Q. Quantifying the contribution of vision to speech perception in noise. Brit. J. Audiol. 21 (1987) 131-141
25. Massaro D.W. Perceiving Talking Faces: From Speech Perception to a Behavioral Principle (1998), MIT Press, Cambridge, MA
26. McGurk H., and MacDonald J. Hearing lips and seeing voices. Nature 264 (1976) 746-748
27. Meister I.G., Wilson S.M., Deblieck C., Wu A.D., and Iacoboni M. The essential role of premotor cortex in speech perception. Curr. Biol. 17 19 (2007) 1692-1696
28. Möttönen, R., 2004. Cortical Mechanisms of Seeing and Hearing Speech. Unpublished PhD Thesis. Helsinki University of Technology, Laboratory of Computational Engineering, Espoo, Finland.
29. Möttönen R., Krause C.M., Tiippana K., and Sams M. Processing of changes in visual speech in the human auditory cortex. Brain Res. Cogn. Brain Res. 13 (2002) 417-425
30. Möttönen R., Schurmann M., and Sams M. Time course of multisensory interactions during audiovisual speech perception in humans: a magnetoencephalographic study. Neurosci. Lett. 363 (2004) 112-115
31. Muellbacher W., and Mamoli B. The course of cortico-hypoglossal projections in the human brainstem: functional testing using transcranial magnetic stimulation. Brain 120 (1997) 1909-1910
32. Muellbacher W., Mathis J., and Hess C.W. Electrophysiological assessment of central and peripheral motor routes to the lingual muscles. J. Neurol. Neurosurg. Psychiat. 57 (1994) 309-315
33. Nishitani N., and Hari R. Viewing lip forms: cortical dynamics. Neuron 36 (2002) 1211-1220
34. Ojanen, V., 2005. Neurocognitive Mechanisms of Audiovisual Speech Perception. Unpublished PhD Thesis. Helsinki University of Technology, Laboratory of Computational Engineering, Espoo, Finland.
35. Ojanen V., Möttönen R., Pekkola J., Jääskeläinen I.P., Joensuu R., Autti T., and Sams M. Processing of audiovisual speech in Broca's area. NeuroImage 25 (2005) 333-338
36. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9 (1971) 97-114
37. Paulesu E., Perani D., Blasi V., Silani G., Borghese A.A., De Giovanni U., Sensolo S., and Fazio F. A functional-anatomical model for lipreading. J. Neurophysiol. 90 (2003) 2005-2013
38. Pekkola J., Laasonen M., Ojanen V., Autti T., Jaaskelainen L.P., Kujala T., and Sams M. Perception of matching and conflicting audiovisual speech in dyslexic and fluent readers: an fMRI study at 3T. NeuroImage 29 3 (2006) 797-807
39. Pulvermüller F., Huss M., Kherif F., Moscoso del Prado Martin F., Hauk O., and Shtyrov Y. Motor cortex maps articulatory features of speech sounds. Proc. Natl. Acad. Sci. USA 103 20 (2006) 7865-7870
40. Reisberg D., McLean J., and Goldfield A. Easy to hear but hard to understand: a lipreading advantage with intact auditory stimuli. In: Campbell R., and Dodd B. (Eds). Hearing by Eye: The Psychology of Lipreading (1987), Lawrence Erlbaum Associates, London (UK) 97-113
41. Rizzolatti G., and Arbib M.A. Language within our grasp. Trends Neurosci. 21 (1998) 188-194
42. Rizzolatti G., and Craighero L. The mirror-neuron system. Annu. Rev. Neurosci. 27 (2004) 169-192
43. Rodel R.M., Laskawi R., and Markus H. Tongue representation in the lateral cortical motor region of thehuman brain as assessed by transcranialmagnetic stimulation. Ann. Otol. Rhinol. Laryngol. 112 1 (2003) 71-76
44. Rossini P.M., Barker A.T., Berardelli A., Caramia M.D., Caruso G., Cracco R.Q., Dimitrijevic M.R., Hallett M., Katayama Y., and Lucking C.H. Non-invasive electrical and magnetic stimulation of the brain, spinal cord and roots: basic principles and procedures for routine clinical application. Report of an IFCN committee. Electroencephalogr. Clin. Neurophysiol. 91 2 (1994) 79-92
45. Roy A.C., Craighero L., Fabbri-Destro M., and Fadiga L. Phonological and lexical motor facilitation during speech listening: a transcranial magnetic stimulation study. J. Physiol. Paris 102 1-3 (2008) 101-105
46. Sams M., Aulanko R., Hämäläinen M., Hari R., Lounasmaa O.V., Lu S.T., and Simola J. Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci. Lett. 127 (1991) 141-145
47. Sato M., Tremblay P., and Gracco V.L. A mediating role of the premotor cortex in phoneme segmentation. Brain Lang. 111 1 (2009) 1-7
48. Schwartz J.-L., Robert-Ribes J., and Escudier P. Ten years after summerfield: a taxonomy of models for audio-visual fusion in speech perception. In: Campbell R., Dodd B., and Burnham D. (Eds). Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech (1998), Psychology Press, Hove, UK 85-108
49. Schwartz J.-L., Sato M., and Fadiga L. The common language of speech perception and action: a neurocognitive perspective. Revue Française de Linguistique Appliquée 13 2 (2008) 9-22
50. Sekiyama K., Kanno I., Miura S., and Sugita Y. Audio-visual speech perception examined by fMRI and PET. Neurosci. Res. 47 (2003) 277-287
51. Skipper J.I., Nusbaum H.C., and Small S.L. Listening to talking faces: motor cortical activation during speech perception. NeuroImage 25 (2005) 76-89
52. Skipper J.I., van Wassenhove V., Nusbaum H.C., and Small S.L. Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb. Cortex 17 10 (2007) 2387-2399
53. Sumby W.H., and Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26 (1954) 212-215
54. Sundara M., Namasivayam A.K., and Chen R. Observation-execution matching system for speech: a magnetic stimulation study. NeuroReport 12 7 (2001) 1341-1344
55. Urban P.P., Hopf H.C., Connemann B., Hundemer H.P., and Koehler J. The course of cortico-hypoglossal projections in the human brainstem. Functional testing using transcranial magnetic stimulation. Brain 119 (1996) 1031-1038
56. van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. USA 102 (2005) 1181-1186
57. Wassermann E.M. Risk and safety of repetitive transcranial magnetic stimulation: report and suggested guidelines from the International Workshop on the Safety of Repetitive Transcranial Magnetic Stimulation, June 5-7, 1996. Electroencephalogr. Clin. Neurophysiol. 108 1 (1998) 1-16
58. Watkins K.E., and Paus T. Modulation of motor excitability during speech perception: the role of Broca's area. J. Cogn. Neurosci. 16 6 (2004) 978-987
59. Watkins K.E., Strafelle A.P., and Paus T. Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 41 3 (2003) 989-994
60. Wilson S.M., and Iacoboni M. Neural responses to non-native phonemes varying in producibility: evidence for the sensorimotor nature of speech perception. NeuroImage 33 1 (2006) 316-325
61. Wilson S.M., Saygin A.P., Sereno M.I., and Iacoboni M. Listening to speech activates motor areas involved in speech production. Nat. Neurosci. 7 (2004) 701-702