Movement goals and feedback and feedforward control mechanisms in speech production

Journal of Neurolinguistics

Volumn 25, Issue 5, 2012, Pages 382-407

  Perkell, Joseph S ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Feedback control; Feedforward control; Phonemic goals; Sensory goals; Speech motor control; Speech perception; Speech production

Indexed keywords

ACOUSTICS; ADAPTATION; ARTICLE; AUDITORY FEEDBACK; AUDITORY RESPONSE; BRAIN FUNCTION; CONSONANT; EVOKED SOMATOSENSORY RESPONSE; GESTURE; GRAMMAR; HEARING; HUMAN; JAW MOVEMENT; LARYNX MUSCLE; LINGUISTICS; MODEL; MOTOR CONTROL; NEUROPHYSIOLOGY; PHONEME; PHONETICS; POSITIVE FEEDBACK; PRIORITY JOURNAL; SOMATOSENSORY STIMULATION; SOUND INTENSITY; SPEECH ARTICULATION; SPEECH DISCRIMINATION; SPEECH PERCEPTION; VOWEL;

EID: 84860916251     PISSN: 09116044     EISSN: 18738052     Source Type: Journal    
DOI: 10.1016/j.jneuroling.2010.02.011     Document Type: Article

References (109)

1. Abbs J.H., Gracco V.L. Control of complex motor gestures - orofacial muscle responses to load perturbations of lip during speech. Journal of Neurophysiology 1984, 51:705-723.
2. Atal B.S., Chang J.J., Mathews M.V., Tukey J.W. Inversion of articulatory-to-acoustic transformation in the vocal tract by a computer-sorting technique. Journal of the Acoustical Society of America 1978, 63:1535-1555.
3. Baum S.R., McFarland D.H. The development of speech adaptation to an artificial palate. Journal of the Acoustical Society of America 1997, 102:2353-2359.
4. Beckman M.E., Jung T., Lee S., de Jong K.J., Krishnamurthy A.K., Ahalt S.C., et al. Variability in the production of quantal vowels revisited. Journal of the Acoustical Society of America 1995, 97:471-490.
5. Bradlow A.R., Kahane-Yamada R., Pisoni D.B., Tohkura Y. Training Japanese listeners to identify English /r/ and /l/: long-term retention of learning in perception and production. Perception and Psychophysics 1999, 61:977-985.
6. Browman C.P., Goldstein L. Articulatory gestures as phonological units. Phonology 1989, 6:201-251.
7. Browman, C. P., & Goldstein, L. (1990). Tiers in articulatory phonology with some implications for casual speech. Papers In: Laboratory phonology I: Between the grammar and physics of speech, J., Kingston, & M. E., Beckman (Eds.) (pp. 341-376).
8. Buchaillard S., Perrier P., Payan Y. A biomechanical model of cardinal vowel production: muscle activations and the impact of gravity on tongue positioning. Journal of the Acoustical Society of America 2009, 126:2033-2051.
9. Burnett T.A., Larson C.R. Early pitch-shift response is active in both steady & dynamic voice pitch control. Journal of the Acoustical Society of America 2002, 112:1058-1063.
10. Cai, S., Ghosh, S. S., Guenther, F. H., Perkell, J. S. Adaptive auditory feedback control of the production of the formant trajectories in the Mandarin triphthong /iau/ and its patterns of generalization, submitted for publication.
11. Chomsky N., Halle M. The sound pattern of English 1968, MIT Press, Cambridge, MA.
12. Cowie R.I.D., Douglas-Cowie E. Speech production in profound postlingual deafness. Hearing science & hearing disorders 1983, 183-230. Academic Press, London. M. Lutman, M.P. Haggard (Eds.).
13. Cowie R.I.D., Douglas-Cowie E. Postlingually acquired deafness: Speech deterioration & the wider consequence 1992, Hawthorne, New York.
14. Delattre P., Freeman D.C. A dialect study of American /r/ by x-ray motion picture. Linguistics 1968, 44:29-68.
15. Eimas P.D., Corbit J.D. Selective adaptation of linguistic feature detectors. Cognitive Psychology 1973, 4:99-109.
16. Fadiga L., Craighero L., Buccino G., Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: a TMS study. European Journal of Neuroscience 2002, 15:399-402.
17. Ferrari P.F., Fogassi L., Gallese V., Rizzolatti G. Mirror neurons responding to the observation of ingestive & communicative mouth actions in the monkey ventral premotor cortex. European Journal of Neuroscience 2003, 17:1703-1714.
18. Flege J.E., Fletcher S.G., Homeidan A. Compensating for a bite block in /s/ & /t/ production: palatographic, acoustic, perceptual data. Journal of the Acoustical Society of America 1988, 83:212-228.
19. Fowler C.A. An event approach to the study of speech perception from a direct-realist perspective. Journal of Phonetics 1986, 14:3-28.
20. Fowler C.A., Turvey M.T. Immediate compensation in bite-block speech. Phonetica 1980, 37:306-326.
21. Fry D.B. Duration & intensity as physical correlates of linguistic stress. Journal of the Acoustical Society of America 1955, 27:765-768.
22. Fujimura O., Kakita Y. Remarks on quantitative description of lingual articulation. Frontiers of speech communication research 1979, 17-24. Academic Press, San Diego. B. Lindblom, S. öhman (Eds.).
23. Fujimura O., Kiritani S., Ishida H. Computer controlled radiography for observation of movements of articulatory & other human organs. Computers in Biology & Medicine 1973, 3:371-384.
24. Ghosh, S. S., Matthies, M. L., Maas, E., Hanson, A, Tiede, M., Ménard, L., Guenther, F. H., Lane, H., Perkell, J. S. An investigation of the relation between sibilant production & somatosensory & auditory acuity. Journal of the Acoustical Society of America, submitted for publication.
25. Gomi H., Honda M. Compensatory articulation during bilabial fricative production by regulating muscle stiffness. Journal of Phonetics 2002, 30:261-279.
26. Groenen P., Maassen B., Crul T., Thoonen G. The specific relation between perception & production errors for place of articulation in developmental apraxia of speech. Journal of Speech & Hearing Research 1996, 39:468-482.
27. Guenther F.H. A neural network model of speech acquisition & motor equivalent speech production. Biological Cybernetics 1994, 72:43-53.
28. Guenther F.H. Speech sound acquisition, coarticulation, rate effects in a neural network model of speech production. Psychological Review 1995, 102:594-621.
29. Guenther F.H., Bohland J.W. Learning sound categories: a neural model and supporting experiments. Acoustical Science and Technology 2002, 23:213-220.
30. Guenther F.H., Espy-Wilson C., Boyce S., Matthies M.L., Zandipour M., Perkell J.S. Articulatory tradeoffs reduce acoustic variability during American English /r/ production. Journal of the Acoustical Society of America 1999, 105:2854-2865.
31. Guenther F.H., Ghosh S.S., Tourville J.A. Neural modeling & imaging of the cortical interactions underlying syllable production. Brain & Language 2006, 96:280-301.
32. Guenther F.H., Gjaja M.N. The perceptual magnet effect as an emergent property of neural map formation. Journal of the Acoustical Society of America 1996, 100:1111-1121.
33. Guenther F.H., Hampson M., Johnson D. A theoretical investigation of reference frames for the planning of speech movements. Psychological Review 1998, 105:611-633.
34. Guenther, F.H., & Vladusich, T. A neural theory of speech acquisition and production, Journal of Neurolinguistics, this issue.
35. Hamlet S.L., Stone M.L. Compensatory vowel characteristics resulting from the presence of different types of experimental dental prostheses. Journal of Phonetics 1976, 4:199-218.
36. Hamlet S.L., Stone M.L., McCarthy T. Persistence of learned motor patterns in speech. Journal of the Acoustical Society of America 1976, 60:S66. (A).
37. Honda M., Fujino A., Kaburagi T. Compensatory responses of articulators to unexpected perturbation of the palate shape. Journal of Phonetics 2002, 30:281-302.
38. Honda, M., Murano, E. Z. (2003). Effects of tactile & auditory feedback on compensatory articulatory response to an unexpected palatal perturbation. In: Proceedings of the 6th Speech Production Seminar, Sydney (pp. 97-100).
39. Houde J.F., Jordan M.I. Sensorimotor adaptation in speech production. Science 1998, 279:1213-1216.
40. Houde J.F., Jordan M.I. Sensorimotor adaptation of speech I: compensation & adaptation. Journal of Speech, Language, Hearing Research 2002, 45:295-310.
41. Jakobson R., Fant G., Halle M. Preliminaries to speech analysis 1951, MIT Press, Cambridge, MA.
42. Jamieson D.G., Rvachew S. Remediating speech production errors with sound identification training. Journal of Speech Language Pathology & Audiology 1992, 16:201-210.
43. Jenkins J.J., Strange W., Trent S.A. Context-independent dynamic information for the perception of coarticulated vowels. Journal of the Acoustical Society of America 1999, 106:438-448.
44. Jones J.A., Munhall K.G. Learning to produce speech with an altered vocal tract: the role of auditory feedback. Journal of the Acoustical Society of America 2003, 113:532-543.
45. Kelso J.A.S., Tuller B., Vatikiotis-Bateson E., Fowler C.A. Functionally specific articulatory cooperation following jaw perturbations during speech: evidence for coordinative structures. Journal of Experimental Psychology: Human Perception & Performance 1984, 10:812-832.
46. Kohler E., Keysers C., Umiltà M.A., Fogassi L., Gallese V., Rizzolatti G. Hearing sounds, understanding actions: action representation in mirror neurons. Science 2002, 297:846-848.
47. Labov W. The social Stratification of English in New York City 1966, Center for Applied Linguistics, Washington, D.C.
48. Ladefoged P., Maddieson I. Sounds of the world's languages 1996, Blackwell, Oxford.
49. Lane H., Denny M., Guenther F.H., Matthies M.L., Ménard L., Perkell J.S., et al. Effects of bite blocks & hearing status on vowel production. Journal of the Acoustical Society of America 2005, 118:1636-1646.
50. Lane H., Denny M., Guenther F.H., Matthies M.L., Perkell J.S., Stockmann E., et al. On the structure of phoneme categories in listeners with cochlear implants. Journal of Speech, Language & Hearing Research 2007, 50:2-14.
51. Lane H., Matthies M., Denny M., Guenther F.H., Perkell J.S., Stockmann E., et al. Effects of short- & long-term changes in auditory feedback on vowel & sibilant contrasts. Journal of Speech Language & Hearing Research 2007, 50:913-927.
52. Lane H., Webster J. Speech deterioration in postlingually deafened adults. Journal of the Acoustical Society of America 1991, 89:859-866.
53. Larson C.R., Burnett T.A., Bauer J.J., Kiran S., Hain T.C. Comparison of voice F0 responses to pitch-shift onset & offset conditions. Journal of the Acoustical Society of America 2001, 110:2845-2848.
54. Lehiste I. Suprasegmentals 1970, MIT Press, Cambridge.
55. Liberman A.M., Mattingly I.G. The motor theory of speech revised. Cognition 1985, 21:1-36.
56. Lindblom B. Explaining phonetic variation: a sketch of the H&H theory. Speech production & speech modeling 1990, 403-439. Kluwer Academic Publishers, Netherlands. W.J. Hardcastle, A. Marchal (Eds.).
57. Lindblom B., Engstrand O. In what sense is speech quantal. Journal of Phonetics 1989, 17:107-121.
58. Lindblom B., Lubker J., Gay T. Formant frequencies of some fixed-mandible vowels & a model of speech motor programming by predictive simulation. Journal of Phonetics 1979, 7:147-161.
59. Lindblom B., Sundberg J. Acoustical consequences of lip, tongue, jaw, larynx movement. Journal of the Acoustical Society of America 1971, 50:1166-1179.
60. Löfqvist A., Gracco V.L. Lip & jaw kinematics in bilabial stop consonant production. Journal of Speech Language & Hearing Research 1997, 40:877-893.
61. Lotto A.J., Hickok G.S., Holt L.L. Reflections on mirror neurons and speech perception. Trends in Cognitive Sciences 2009, 13:110-114.
62. Matthies M.L., Guenther F.H., Denny M., Perkell J.S., Burton E., Vick J., et al. Perception & production of /r/ allophones improve with hearing from a cochlear implant. Journal of the Acoustical Society of America 2008, 124:3191-3202.
63. Matthies M.L., Svirsky M.A., Perkell J.S., Lane H. Acoustic & articulatory measures of sibilant production with & without auditory feedback from a cochlear implant. Journal of Speech & Hearing Research 1996, 39:936-946.
64. Max, L., Wallace, M. E., Vincent, I. (2003). Sensorimotor adaptation to auditory perturbations during speech: acoustic & kinematic experiments. In: Proceedings of the 15th International Congress of Phonetic Sciences (pp. 1053-1056).
65. Miller J.D. Auditory-perceptual interpretation of the vowel. Journal of the Acoustical Society of America 1989, 85:2114-2134.
66. Munhall K.G., Löfqvist A., Kelso J.A.S. Lip-larynx coordination in speech: effects of mechanical perturbations to the lower lip. Journal of the Acoustical Society of America 1994, 95:3605-3616.
67. Nasir S.M., Ostry D.J. Speech motor learning in profoundly deaf adults. Nature Neuroscience 2008, 10:1217-1222.
68. Nearey T.M., Assmann P.F. Modeling the role of inherent spectral change in vowel identification. Journal of the Acoustical Society of America 1986, 80:1297-1308.
69. Nelson W.L. Physical principles for economies of skilled movements. Biological Cybernetics 1983, 46:135-147.
70. Nelson W.L., Perkell J.S., Westbury J.R. Mandible movements during increasingly rapid articulations of single syllables: preliminary observations. Journal of the Acoustical Society of America 1984, 75:945-951.
71. Newman R.S. Using links between speech perception & production to evaluate different acoustic metrics. Journal of the Acoustical Society of America 2003, 113:2850-2860.
72. Perkell J.S., Boyce S.E., Stevens K.N. Articulatory & acoustic correlates of the /s-sh/ distinction. Speech communication 1979, 109-113. Papers presented at the 97th meeting of the Acoustical Society of America, American Institute of Physics, New York. J.J. Wolf, D.H. Klatt (Eds.).
73. Perkell J.S., Cohen M., Svirsky M.A., Matthies M.L., Garabieta I., Jackson M.T.T. Electro-magnetic midsagittal articulometer (EMMA) systems for transducing speech articulatory movements. Journal of the Acoustical Society of America 1992, 92:3078-3096.
74. Perkell J.S., Denny M., Lane H., Guenther F.H., Matthies M.L., Tiede M., et al. Effects of masking on vowel & sibilant contrasts in normal-hearing speakers & postlingually deafened cochlear implant users. Journal of the Acoustical Society of America 2007, 121:505-514.
75. Perkell J.S., Guenther F.H., Lane H., Matthies M.L., Perrier P., Vick J., et al. A theory of speech motor control & supporting data from speakers with normal hearing & with profound hearing loss. Journal of Phonetics 2000, 28:233-372.
76. Perkell J.S., Guenther F.H., Lane H., Matthies M.L., Stockmann E., Tiede M. The distinctness of speakers' productions of vowel contrasts is related to their discrimination of the contrasts. Journal of the Acoustical Society of America 2004, 116:2338-2344.
77. Perkell J.S., Lane H., Denny M., Matthies M.L., Tiede M., Zandipour M., et al. Time course of speech changes in response to short-term changes in hearing state. Journal of the Acoustical Society of America 2007, 121:2296-2311.
78. Perkell, J. S., Lane, H., Ghosh, S. S., Matthies, M. L., Tiede, M., Guenther, F. H., et al. (2008). Mechanisms of vowel production: auditory goals & speaker acuity. In: Proceedings of the Eighth International Seminar on speech production, Strasbourg, France (pp. 29-32).
79. Perkell J.S., Matthies M.L., Ghosh S.S., Maas E., Hanson A., Guenther F.H., et al. Auditory & somatosensory goals for sibilants. Journal of the Acoustical Society of America 2008, 123:3459. (A).
80. Perkell J.S., Matthies M.L., Lane H., Guenther F.H., Wilhelms-Tricarico R., Wozniak J., et al. Speech motor control: acoustic goals, saturation effects, auditory feedback & internal models. Speech Communication 1997, 22:227-250.
81. Perkell J.S., Matthies M.L., Svirsky M.A., Jordan M.I. Trading relations between tongue-body raising & lip rounding in production of the vowel /u/: a pilot motor equivalence study. Journal of the Acoustical Society of America 1993, 93:2948-2961.
82. Perkell J.S., Matthies M.L., Tiede M., Lane H., Zandipour M., Marrone N., et al. The distinctness of speakers' /s/-/∫/ contrast is related to their auditory discrimination & use of an articulatory saturation effect. Journal of Speech, Language & Hearing Research 2004, 47:1259-1269.
83. Perkell J.S., Nelson W.L. Variability in production of the vowels /i/ & /a/. Journal of the Acoustical Society of America 1985, 77:1889-1895.
84. Perkell J.S., Zandipour M., Matthies M.L., Lane H. Economy of effort in different speaking conditions I: a preliminary study of intersubject differences & modeling issues. Journal of the Acoustical Society of America 2002, 112:1627-1641.
85. Plant G. The effects of an acquired profound hearing loss on speech production. British Journal of Audiology 1984, 18:39-48.
86. Purcell D.W., Munhall K.G. Compensation following real-time manipulation of formants in isolated vowels. Journal of the Acoustical Society of America 2006, 119:2288-2297.
87. Purcell D.W., Munhall K.G. Adaptive control of vowel formant frequency: evidence from real-time formant manipulation. Journal of the Acoustical Society of America 2006, 120:966-977.
88. Rizzolatti G., Arbib M.A. Language within our grasp. Trend in Neurosciences 1998, 21:188-194.
89. Rizzolatti G., Craighero L. The mirror-neuron system. Annual Review of Neuroscience 2004, 27:169-192.
90. Rvachew S. Speech perception training can facilitate sound production learning. Journal of Speech & Hearing Research 1994, 37:347-357.
91. Savariaux C., Perrier P., Orliaguet J.P. Compensation strategies for the perturbation of the rounded vowel [u] using a lip tube: a study of the control space in speech production. Journal of the Acoustical Society of America 1995, 98:2428-2842.
92. Shadle C.H. The effect of geometry on source mechanisms of fricative consonants. Journal of Phonetics 1991, 19:409-424.
93. Shaiman S. Kinematic & electromyographic responses to perturbation of the jaw. Journal of the Acoustical Society of America 1989, 86:78-88.
94. Shiller C.M., Sato M., Gracco V.L., Baum S. Perceptual recalibration of speech sounds following speech motor learning. Journal of the Acoustical Society of America 2009, 125:1103-1113.
95. Stevens K.N. On the quantal nature of speech. Journal of Phonetics 1989, 17:3-46.
96. Stevens K.N. Acoustic phonetics 1998, MIT Press, Cambridge, MA.
97. Stevens K.N., Keyser S.J. Primary features and their enhancement in consonants. Language 1989, 65:81-106.
98. Stevens K.N., Keyser S.J. Quantal theory, enhancement and overlap. Journal of Phonetics 2010, 38:10-19.
99. Tiede M., Perkell J.S., Zandipour M., Matthies M.L. Gestural timing effects in the 'perfect memory' sequence observed under three rates by electromagnetometry. Journal of the Acoustical Society of America 2001, 110:2657. (A).
100. Tiede, M., Shattuck-Hufnagel, S., Johnson, B., Ghosh, S. S., Matthies, M. L., Zandipour, M.& et al. (2007). Gestural phasing in /kt/ sequences contrasting within & cross word contexts. In: Proceedings of the 16th International Conference of Phonetic Sciences (ICPhS07), Saarbrücken, Germany (pp. 521-524).
101. Tiede, M. K., Ito, T., Ostry, D. J. (2006). Compensatory response to unexpected jaw perturbation triggered by formant transitions during speech. In: Proceedings of the Seventh International Seminar on Speech Production, Ubatuba, Brazil (pp. 217-224).
102. Tourville, J. A., Guenther, F. H., Ghosh, S. S., Reilly, K. J., Bohland, J. W., Nieto-Castanon, A. (2005). Effects of acoustic & articulatory perturbation on cortical activity during speech production. In: 11th Annual Meeting of the Organization for Human Brain Mapping (p. S49).
103. Tourville J.A., Reilly K.J., Guenther F.H. Neural mechanisms underlying auditory feedback control of speech. Neuroimage 2008, 39:1429-1443.
104. Tremblay S., Houle G., Ostry D.J. Specificity of speech motor learning. Journal of Neuroscience 2008, 5:2426-2434.
105. Tremblay S., Shiller D.M., Ostry D.J. Somatosensory basis of speech production. Letters to Nature 2003, 423:866-869.
106. Van Boven R.W., Johnson K.O. The limit of tactile spatial resolution in humans: grating orientation discrimination at the lip, tongue, finger. Neurology 1994, 44:2361-2366.
107. Vick J., Lane H., Perkell J.S., Matthies M.L., Gould J., Zandipour M. Speech perception, production & intelligibility improvements in vowel-pair contrasts in adults who receive cochlear implants. Journal of Speech, Language & Hearing Research 2001, 44:1257-1268.
108. Villacorta V., Perkell J.S., Guenther F.H. Sensorimotor adaptation to feedback perturbations of vowel acoustics & its relation to perception. Journal of the Acoustical Society of America 2007, 122:2306-3219.
109. Wohlert A.B. Tactile perception of spatial stimuli on the lip surface by young & older adults. Journal of Speech & Hearing Research 1996, 39:1191-1198.