Multisensory and modality specific processing of visual speech in different regions of the premotor cortex

Frontiers in Psychology

Volumn 5, Issue MAY, 2014, Pages

  Callan, Daniel E ^a,b   Jones, Jeffery A ^c   Callan, Akiko ^a,b  

^a OSAKA UNIVERSITY   (Japan)

^b NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^c WILFRID LAURIER UNIVERSITY   (Canada)

Author keywords

Audio visual; Fmri; Internal model; Mirror system; Multisensory; Premotor

Indexed keywords

EID: 84904564614     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00389     Document Type: Article

References (59)

1. Alho, J., Sato, M., Sams, M., Schwartz, J., Tiitinen, H., and Jaaskelainen, I. (2012). Enhanced early-latency electromagnetic activity in the left premotor cortex is associated with successful phonetic categorization. Neuroimage 60, 1937-1946. doi: 10.1016/j.neuroimage.2012.02.011
2. Bernstein, L., Auer, E., Moore, J., Ponton, C., Don, M., and Singh, M. (2002). Visual speech perception without primary auditory cortex activation. Neuroreport 13, 311-315. doi: 10.1097/00001756-200203040-00013
3. Callan, A., Callan, D., Tajima, K., and Akahane-Yamada, R. (2006a). Neural processes involved with perception of non-native durational contrasts. Neuroreport 17, 1353-1357. doi: 10.1097/01.wnr.0000224774.66904.29
4. Callan, D., Callan, A., Gamez, M., Sato, M., and Kawato, M. (2010). Premotor cortex mediates perceptual performance. Neuroimage 51, 844-858. doi: 10.1016/j.neuroimage.2010.02.027
5. Callan, D., Callan, A., Honda, K., and Masaki, S. (2000a). Single-sweep EEG analysis of neural processes underlying perception and production of vowels. Cogn. Brain Res. 10, 173-176. doi: 10.1016/S0926-6410(00)00025-2
6. Callan, D. E., Callan, A. M., Kroos, C., and Vatikiotis-Bateson, E. (2001). Multimodal contribution to speech perception revealed by independent component analysis: a singlesweep EEG case study. Cogn. Brain Res. 10, 349-353. doi: 10.1016/S0926-6410(00)00054-9
7. Callan, D., Jones, J., Callan, A., and Akahane-Yamada, R. (2004a). Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory-auditory/orosensory internal models. Neuroimage 22, 1182-1194. doi: 10.1016/j.neuroimage.2004.03.006
8. Callan, D., Jones, J., Munhall, K., Callan, A., Kroos, C., and Vatikiotis-Bateson, E. (2003). Neural processes underlying perceptual enhancement by visual speech gestures. Neuroreport 14, 2213-2218. doi: 10.1097/00001756-200312020-00016
9. Callan, D., Jones, J., Munhall, K., Kroos, C., Callan, A., and Vatikiotis-Bateson, E. (2004b). Multisensory integration sites identified by perception of spatial wavelet filtered visual speech gesture information. J. Cogn. Neurosci. 16, 805-816. doi: 10.1162/089892904970771
10. Callan, D., Kawato, M., Parsons, L., and Turner, R. (2007). Speech and song: The role of the cerebellum. Cerebellum 6, 321-327. doi: 10.1080/14734220601187733
11. Callan, D., Kent, R., Guenther, F., and Vorperian, H. (2000b). An auditory-feedback-based neural network model of speech production that is robust to developmental changes in the size and shape of the articulatory system. J. Speech Lang. Hear. Res. 43, 721-736.
12. Callan, D., and Manto, M. (2013). "Cerebellar control of speech and song," in Handbook of the Cerebellum and Cerebellar Disorders, eds M. Manto, D. Gruol, J. Schmahmann, N. Koibuchi, and F. Rossi (New York, NY: Springer).
13. Callan, D., Tsytsarev, V., Hanakawa, T., Callan, A., Katsuhara, M., Fukuyama, H., et al. (2006b). Song and speech: brain regions involved with perception and covert production. Neuroimage 31, 1327-1342. doi: 10.1016/j.neuroimage.2006.01.036
14. Calvert, G. A., and Campbell, R. (2003). Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 15, 57-70. doi: 10.1162/089892903321107828
15. Calvert, G. A., Campbell, R., and Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10, 649-657. doi: 10.1016/S0960-9822(00)00513-3
16. Campbell, R., MacSweeney, M., Surguladze, S., Calvert, G. A., McGuire, P., Suckling, J., et al. (2001). Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Cogn. Brain Res. 12, 245-264. doi: 10.1016/S0926-6410(01)00054-4
17. Davachi, L., Maril, A., and Wagner, A. D. (2001). When keeping in mind supports later bringing to mind: neural markers of phonologi- cal rehearsal predict subsequent remembering. J. Cogn. Neurosci. 13, 1059-1070. doi: 10.1162/089892901753294356
18. Dubois, C., Otzenberger, H., Gounout, D., Sock, R., and Metz-Lutz, M. N. (2012). Visemic processing in audiovisual discrimination of natural speech: a simultaneous fMRI-EEG study. Neuropsychologia 50, 1316-1326. doi: 10.1016/j.neuropsychologia.2012.02.016
19. Friederici, A. (2009). Pathways to language: fiber tracts in the human brain. Trends Cogn. Sci. 13, 175-181. doi: 10.1016/j.tics.2009.01.001
20. Grant, K. W., and Braida, L. D. (1991). Evaluating the articulation index for audiovisual input. J. Acoust. Soc. Am. 89, 2952-2960. doi: 10.1121/1.400733
21. Guenther, F., and Vladusich, T. (2012). A neural theory of speech acquisition and production. J. Neurolinguist. 25, 408-422. doi: 10.1016/j.jneuroling.2009.08.006
22. Hickok, G., and Poeppel, D. (2000). Towards a functional neuroanatomy of speech perception. Trends Cogn. Sci. 4, 131-128. doi: 10.1016/S1364-6613(00)01463-7
23. Hickok, G., and Poeppel, D. (2004). Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 92, 67-99. doi: 10.1016/j.cognition.2003.10.011
24. Hickok, G., and Poeppel, D. (2007). The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393-402. doi: 10.1038/nrn2113
25. Iacoboni, M. (2008). The role of premotor cortex in speech perception: evidence from fMRI and rTMS. J. Physiol. 102, 31-34. doi: 10.1016/j.jphysparis.2008.03.003
26. Iacoboni, M., and Wilson, S. (2006). Beyond a single area: motor control and language within a neural architecture encompassing Broca's area. Cortex 42, 503-506. doi: 10.1016/S0010-9452(08)70387-3
27. Imamizu, H., Miyauchi, S., Tamada, T., Sasaki, Y., Takino, R., Putz, B., et al. (2000). Human cerebellar activity reflecting an acquired internal model of a new tool. Nature 403, 192-195. doi: 10.1038/35003194
28. Jonides, J., Schumacher, E. H., Smith, E. E., Koeppe, R. A., Awh, E., Reu-ter-Lorenz, P. A., et al. (1998). The role of pa- rietal cortex in verbal working memory. J. Neurosci. 18, 5026-5034.
29. Kawato, M. (1999). Internal models for motor control and trajectory planning. Curr. Opin. Neurobiol. 9, 718-727. doi: 10.1038/35003194
30. Liberman, A., Cooper, F., Shankweiler, D., and Studdert-Kennedy, M. (1967). Perception of speech code. Psychol. Rev. 74, 431-461. doi: 10.1037/h0020279
31. Liberman, A., and Mattingly, I. (1985). The motor theory of speech perception revised. Cognition 21, 1-36. doi: 10.1016/0010-0277(85)90021-6
32. Liberman, A., and Whalen, D. (2000). On the relation of speech to language. Trends Cogn. Sci. 4, 187-196. doi: 10.1016/S1364-6613(00)01471-6
33. Londei, A., D' Ausilio, A., Basso, D., Sestieri, C., Del Gratta, C., Romani, G., et al. (2010). Sensory-motor brain network connectivity for speech comprehension. Hum. Brain Mapp. 31, 567-580. doi: 10.1002/hbm.20888
34. Mashal, N., Solodkin, A., Dick, A., Chen, E., and Small, S. (2012). A network model of observation and imitation of speech. Front. Psychology. 3:84. doi: 10.3389/fpsyg.2012.00084
35. Meister, I., Wilson, S., Deblieck, C., Wu, A., and Iacoboni, M. (2007). The essential role of premotor cortex in speech perception. Curr. Biol. 17, 1692-1696. doi: 10.1016/j.cub.2007.08.064
36. Middleton, F. A., and Strick, P. (1997). Cerebellar output channels. Int. Rev. Neurobiol. 41, 61-82. doi: 10.1016/S0074-7742(08)60347-5
37. Nishitani, N., and Hari, R. (2002). Viewing lip forms: cortical dynamics. Neuron 36, 1211-1220. doi: 10.1016/S0896-6273(02)01089-9
38. Nishitani, N., Schurmann, M., Amunts, K., and Hari, R. (2005). Broca's region: from action to language. Physiology 20, 60-69. doi: 10.1152/physiol.00043.2004
39. Ojanen, V., Mottonen, R., Pekkol, J., Jaaskelainen, I., Joensuu, R., Autti, T., et al. (2005). Processing of audiovisual speech in Brocas area. Neuroimage 25, 333-338. doi: 10.1016/j.neuroimage.2004.12.001
40. Olson, I. R., Gatenby, J. G., and Gore, J. C. (2002). A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Cogn. Brain Res. 14, 129-138. doi: 10.1016/S0926-6410(02)00067-8
41. Paulesu, E., Perani, D., Blasi, V., Silani, G., Borghese, N. A., De Giovanni, U., et al. (2003). A functional-anatomical model for lip-reading. J. Neurophysiol. 90, 2005-2013. doi: 10.1038/35003194
42. Poeppel, D., Idsardi, W. J., and van Wassenhove, V. (2008). Speech perception at the interface of neurobiology and linguistics. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 1071-1086. doi: 10.1098/rstb.2007.2160
43. Rauschecker, J. (2011). An expanded role fore the dorsal auditory pathway in sensorimotor control and integration. Hear. Res. 271, 16-25. doi: 10.1016/j.heares.2010.09.001
44. Rauschecker, J., and Scott, S. (2009). Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 12, 718-724. doi: 10.1038/nn.2331
45. Saito, D., Yoshimura, K., Kochiyama, T., Okada, T., Honda, M., and Sadato, N. (2005). Cross-modal binding and activated attentional networks during audio-visual speech integration: a functional MRI study. Cereb. Cortex 15, 1750-1760. doi: 10.1093/cercor/bhi052
46. Sato, M., Tremblay, P., and Gracco, V. (2009). A mediating role of the premotor cortex in phoneme segmentation. Brain Lang. 111, 1-7. doi: 10.1016/j.bandl.2009.03.002
47. Schmahmann, J., and Pandya, D. N. (1997). The cerebrocerebellar system. Int. Rev. Neurobiol. 41, 31-60. doi: 10.1016/S0074-7742(08)60346-3
48. Schwartz, J., Basirat, A., Menard, L., and Sato, M. (2012). The perception-for-action-control theory (PACT): a perceptuo-motor theory of speech perception. J. Neurolinguist. 25, 336-354. doi: 10.1016/j.jneuroling.2009.12.004
49. Sekiyama, K., Kanno, I., Miura, S., and Sugita, Y. (2003). Auditory-visual perception examined by fMRI and PET. Neurosci. Res. 47, 277-287. doi: 10.1016/S0168-0102(03)00214-1
50. Skipper, J., Goldin-Meadow, S., Nusbaum, H., and Small, S. (2007a). Speech-associated gestures, Broca's area, and the human mirror system. Brain Lang. 101, 260-277. doi: 10.1016/j.bandl.2007.02.008
51. Skipper, J., van Wassenhove, V., Nusbaum, H., and Small, S. (2007b). Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb. Cortex 17, 2387-2399. doi: 10.1093/cercor/bhl147
52. Skipper, S., Nusbaum, H., and Small, S. (2005). Listening to talking faces: motor cortical activation during speech perception. Neuroimage 25, 76-89. doi: 10.1016/j.neuroimage.2004.11.006
53. Stein, B., and Meredith, M. (1993). The Merging of the Senses. Cambridge: MIT Press.
54. Sumby, W. H., and Pollack, I. (1954). Visual contribution to speech intelligibility in noise. J. Accoust. Soc. Am. 26, 212-215. doi: 10.1121/1.1907309
55. Tourville, J. Guenther, F. (2011). The DIVA model: a neural theory of speech acquisition and production. Lang. Cogn. Process. 26, 952-981. doi: 10.1080/01690960903498424
56. Wallace, M. T., Meredith, M. A., and Stein, B. E. (1992). Integration of multiple sensory modalities in cat cortex. Exp. Brain Res. 91, 484-488. doi: 10.1007/BF00227844
57. Wilson, R., and Strouse, A. (2002). Northwestern University auditory test no. 6 in multi-talker babble: a preliminary report. J. Rehabil. Res. Dev. 39, 105-114.
58. Wilson, S., and Iacoboni, M. (2006). Neural responses to non-native phonemes varying in producibility: evidence for the sensorimotor nature of speech perception. Neuroimage 33, 316-325. doi: 10.1016/j.neuroimage.2006.05.032
59. Wilson, S., Saygin, A., Sereno, M., and Iacoboni, M. (2004). Listening to speech activates motor areas involved in speech production. Nat. Neurosci. 7, 701-702. doi: 10.1038/nn1263