Control of spoken vowel acoustics and the influence of phonetic context in human speech sensorimotor cortex

Journal of Neuroscience

Volumn 34, Issue 38, 2014, Pages 12662-12677

  Bouchard, Kristofer E ^a,b,c   Chang, Edward F ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

ECoG; Motor control; Sensorimotor cortex; Sequences; Speech

Indexed keywords

ACOUSTIC ANALYSIS; ACOUSTIC FEATURE EXTRACTION; ARTICLE; ELECTROCORTICOGRAPHY; HUMAN; INFORMATION PROCESSING; MOTOR CONTROL; PRINCIPAL COMPONENT ANALYSIS; QUANTITATIVE ANALYSIS; SENSORIMOTOR CORTEX; SIGNAL PROCESSING; SPEECH AND LANGUAGE; TASK PERFORMANCE; VERBAL COMMUNICATION; VOWEL; BRAIN CORTEX; PHONETICS; PHYSIOLOGY; SEQUENCES; SPEECH;

ECOG; MOTOR CONTROL; SENSORIMOTOR CORTEX; SEQUENCES; SPEECH;

CEREBRAL CORTEX; HUMANS; PHONETICS; SPEECH; SPEECH ACOUSTICS;

EID: 84907153077     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1219-14.2014     Document Type: Article

References (60)

1. Afshar A, Santhanam G, Yu BM, Ryu SI, Sahani M, Shenoy KV (2011) Single-trial neural correlates of arm movement preparation. Neuron 71: 555-564. CrossRef Medline
2. Averbeck BB, Chafee MV, Crowe DA, Georgopolous AP (2002) Parallel processing of serial movements in prefrontal cortex. Proc Natl Acad Sci USA99:13172-13177. CrossRef Medline
3. Bell-Berti F, Harris KS (1975) Coarticulation in VCV and CVC utterances: some EMG data. J Acoust Soc Am 57:S70. CrossRef
4. Bohland JW, Guenther FH (2006) An fMRI investigation of syllable sequence production. Neuroimage 32:821-841. CrossRef Medline
5. Bohland JW, Bullock D, Guenther FH (2010) Neural representations and mechanisms for the performance of simple speech sequences. J Cogn Neurosci 22:1504-1529. CrossRef Medline
6. Bouchard KE, Mesgarani N, Johnson K, Chang EF (2013) Functional organization of human sensorimotor cortex for speech articulation. Nature 495:327-332. CrossRef Medline
7. Briggman KL, Kristan WB Jr (2006) Imaging dedicated and multifunctional neural circuits generating distinct behaviors. J Neurosci 26:10925-10933. CrossRef Medline
8. Briggman KL, Abarbanel HD, Kristan WB Jr (2005) Optical imaging of neuronal populations during decision-making. Science 307:896-901. CrossRef Medline
9. Browman CP, Goldstein L (1989) Articulatory gestures as phonological units. Haskins Laboratories Status Report on Speech Research 99:69-101.
10. Brown S, Laird AR, Pfordresher PQ, Thelen SM, Turkeltaub P, Liotti M (2009) The somatotopy of speech: phonation and articulation in the human motor cortex. Brain Cogn 70:31-41. CrossRef Medline
11. Chomsky N, Halle M (1968) The sound pattern of English. New York: Harper & Row.
12. Churchland MM, Afshar A, Shenoy KV (2006a) A central source of movement variability. Neuron 52:1085-1096. CrossRef Medline
13. Churchland MM, Yu BM, Ryu SI, Santhanam G, Shenoy KV (2006b) Neural variability in premotor cortex provides a signature of motor preparation. J Neurosci 26:3697-3712. CrossRef Medline
14. Churchland MM, Yu BM, Sahani M, Shenoy KV (2007) Techniques for extracting single-trial activity patterns from large-scale neural recordings. Curr Opin Neurobiol 17:609-618. CrossRef Medline
15. Crone NE, Miglioretti DL, Gordon B, Lesser RP (1998) Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. Brain 121: 2301-2315. CrossRef Medline
16. Daniloff R, Moll K (1968) Coarticulation of lip rounding. J Speech Hear Res 11:707-721. CrossRef Medline
17. Edwards E, Nagarajan SS, Dalal SS, Canolty RT, Kirsch HE, Barbaro NM, Knight RT (2010) Spatiotemporal imaging of cortical activation during verb generation and picture naming. Neuroimage 50:291-301. CrossRef Medline
18. Fowler CA (1980) Coarticulation and theories of extrinsic timing. J Phonetics 8:113-133.
19. Fowler CA, Rubin P, Remez RE, Turvey ME (1980) Implications for speech production of a general theory of action. In Language production (Butterworth B, ed). New York: Academic.
20. Fujimura O, Kakita Y (1975) Remarks on quantitative description of the lingual articulation. In: Frontiers of speech communication research (Lindblom B, Ohman SEG, eds). New York: Academic.
21. Golfinopoulos E, Tourville JA, Guenther FH (2010) The integration of large-scale neural network modeling and functional brain imaging in speech motor control. Neuroimage 52:862-874. CrossRef Medline
22. Gracco VL, Abbs JH (1986) Variant and invariant characteristics of speech movements. Exp Brain Res 65:156-166. Medline
23. Guenther FH (1995) Speech sound acquisition, coarticulation, and rate effects in a neural-network model of speech production. Psychol Rev 102: 594-621. CrossRef Medline
24. Guenther FH, Ghosh SS, Tourville JA (2006) Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang 96:280-301. CrossRef Medline
25. Guenther FH, Brumberg JS, Wright EJ, Nieto-Castanon A, Tourville JA, Panko M, Law R, Siebert SA, Bartels JL, Andreasen DS, Ehirim P, Mao H, Kennedy PR (2009) A wireless brain-machine interface for real-time speech synthesis. PLoS One 4:e8218. CrossRef Medline
26. Hamakawa T, Sakata T, Hario S, Watanabe A (2007) A real-time formant tracker based on the inverse filter control method. Acoust Sci Technol 28:271-274. CrossRef
27. Hardcastle WJ, Hewlett N (2006) Coarticulation. Cambridge, UK: Cambridge UP.
28. Hillenbrand J, Getty LA, Clark MJ, Wheeler K (1995) Acoustic characteristics of American English vowels. J Acoust Soc Am 97:3099-3111. CrossRef Medline
29. Jakobson R, Fant G, Halle M (1951) Preliminaries to speech analysis. The distinctive features and their correlates. Cambridge, MA: MIT.
30. Jones KE, Hamilton AF, Wolpert DM (2002) Sources of signal-dependent noise during isometric force production. J Neurophysiol 88:1533-1544. CrossRef Medline
31. Keating P (1990) Phonetic representations in a generative grammar. J Phonetics 18:321-334.
32. Kent RD, Minifie FD (1977) Coarticulation in recent speech production models. J Phonetics 5:115-133.
33. Kozhevnikov VA, Chistovich LA (1965) Speech: articulation and perception. Washington, DC: U.S. Joint Publications Research Service.
34. Ladefoged P, Johnson K (2011) A course in phonetics. Boston: Cengage Learning.
35. Leuthardt EC, Gaona C, Sharma M, Szrama N, Roland J, Freudenberg Z, Solis J, Breshears J, Schalk G (2011) Using the electrocorticographic speech network to control a brain-computer interface in humans. J Neural Eng 8:036004. CrossRef Medline
36. Levelt W (1999) Producing spoken language: a blueprint of the speaker. In: The neurocognition of language (Brown CM, Hagoort P, eds), pp 140. Oxford, UK: Oxford UP.
37. Lindblom B (1963) Spectrographic Study of Vowel Reduction. J Acoust Soc Am 35:1773. CrossRef
38. Lindblom B (1983) Economy of speech gestures. In: The production of speech (MacNeilage PF, ed). New York: Springer.
39. Long MA, Jin DZ, Fee MS (2010) Support for a synaptic chain model of neuronal sequence generation. Nature 468:394-399. CrossRef Medline
40. MacNeilage PF (2011) The production of speech. New York: Springer.
41. Maddieson I, Disner SF (1984) Patterns of sounds. Cambridge studies in speech science and communication. Cambridge, UK: Cambridge UP.
42. Mante V, Sussillo D, Shenoy KV, Newsome WT (2013) Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503:78-84. CrossRef Medline
43. Mazor O, Laurent G (2005) Transient dynamics versus fixed points in odor representations by locust antennal lobe projection neurons. Neuron 48: 661-673. CrossRef Medline
44. Noiray A, Cathiard MA, Ménard L, Abry C (2011) Test of the movement expansion model: anticipatory vowel lip protrusion and constriction in French and English speakers. J Acoust Soc Am 129:340-349. CrossRef Medline
45. Ohman SEG (1966) Coarticulation in VCV utterances: spectrographic measurements. J Acoust Soc Am 39:151-168. CrossRef Medline
46. Ostry DJ, Gribble PL, Gracco VL (1996) Coarticulation of jaw movements in speech production: is context sensitivity in speech kinematics centrally planned? J Neurosci 16:1570-1579. Medline
47. Pei X, Leuthardt EC, Gaona CM, Brunner P, Wolpaw JR, Schalk G (2011) Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition. Neuroimage 54:2960-2972. CrossRef Medline
48. Perkell JS (1986) Coarticulation strategies: preliminary implications of a detailed analysis of lower lip protrusion movements. Speech Commun 5:47-68.
49. Perkell JS, Nelson WL (1985) Variability in production of the vowels /i/ and /a/. J Acoust Soc Am 77:1889-1995. CrossRef Medline
50. Ray S, Maunsell JH (2011) Different origins of gamma rhythm and high-gamma activity in macaque visual cortex. PLoS Biol 9:e1000610. CrossRef Medline
51. Rhodes BJ, Bullock D, Verwey WB, Averbeck BB, Page MP (2004) Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives. Hum Mov Sci 23:699-746. CrossRef Medline
52. Schoppik D, Nagel KI, Lisberger SG (2008) Cortical mechanisms of smooth eye movements revealed by dynamic covariations of neural and behavioral responses. Neuron 58:248-260. CrossRef Medline
53. Shenoy KV, Sahani M, Churchland MM (2013) Cortical control of arm movements: a dynamical systems perspective. Annu Rev Neurosci 36: 337-359 CrossRef Medline
54. Sober SJ, Wohlgemuth MJ, Brainard MS (2008) Central contributions to acoustic variation in birdsong. J Neurosci 28:10370-10379. CrossRef Medline
55. Takai O, Brown S, Liotti M (2010) Representation of the speech effectors in the human motor cortex: somatotopy or overlap? Brain Lang 113:39-44. CrossRef Medline
56. Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5:1226-1235. CrossRef Medline
57. Watanabe A (2001) Formant estimation method using inverse-filter control. IEEE Trans Speech Audio Process 2001:317-326.
58. Whalen DH (1990) Coarticulation is largely planned. J Phonetics 18:3-35.
59. Wohlgemuth MJ, Sober SJ, Brainard MS (2010) Linked control of syllable sequence and phonology in birdsong. J Neurosci 30:12936-12949. CrossRef Medline
60. Yu BM, Cunningham JP, Santhanam G, Ryu SI, Shenoy KV, Sahani M (2009) Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. J Neurophysiol 102:614-635. CrossRef Medline