Integration of auditory and somatosensory error signals in the neural control of speech movements

Journal of Neurophysiology

Volumn 106, Issue 2, 2011, Pages 667-679

  Feng, Yongqiang ^a   Gracco, Vincent L ^b,d   Max, Ludo ^c,d  

^a INSTITUTE OF ACOUSTICS   (China)

^b MCGILL UNIVERSITY   (Canada)

^c UNIVERSITY OF WASHINGTON   (United States)

^d HASKINS LABORATORIES   (United States)

Author keywords

Adaptation; Auditory feedback; Sensorimotor integration; Somatosensory feedback; Speech motor control

Indexed keywords

ACCURACY; ACOUSTICS; ADAPTATION; ADULT; ARTICLE; AUDITORY FEEDBACK; FEMALE; HEARING ACUITY; HUMAN; JAW MOVEMENT; KINEMATICS; MALE; PRIORITY JOURNAL; ROBOTICS; SENSORY FEEDBACK; SPEECH; TONGUE; VOWEL;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY CORTEX; FEEDBACK, PHYSIOLOGICAL; FEMALE; HUMANS; JAW; MALE; MOVEMENT; NEURAL PATHWAYS; NEURONS; SOMATOSENSORY CORTEX; SPEECH ACOUSTICS; YOUNG ADULT;

EID: 80051521856     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00638.2010     Document Type: Article

References (49)

1. Abbs JH, Gracco VL. Control of complex motor gestures: orofacial muscle responses to load perturbations of lip during speech. J Neurophysiol 51: 705-723, 1984.
2. Battaglia PW, Jacobs RA, Aslin RN. Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am A Opt Image Sci Vis 20: 1391-1397, 2003.
3. Baum SR, McFarland DH. The development of speech adaptation to an artificial palate. J Acoust Soc Am 102: 2353-2359, 1997.
4. Burnett TA, Freedland MB, Larson CR, Hain TC. Voice F0 responses to manipulations in pitch feedback. J Acoust Soc Am 103: 3153-3161, 1998.
5. Cohen HB. Some critical factors in prism-adaptation. Am J Psychol 79: 285-290, 1966.
6. Cohen J. Statistical Power Analysis for the Behavioral Sciences (2nd ed). Hillsdale, NJ: Erlbaum, 1988.
7. Ernst MO, Banks MS. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415: 429-433, 2002.
8. Folkins JW, Abbs JH. Lip and jaw motor control during speech: Responses to resistive loading of the jaw. J Speech Hear Res 18: 207-219, 1975.
9. Gescheider GA. Psychophysics: Method and Theory. Hillsdale, NJ: Erlbaum, 1976.
10. Ghahramani Z, Wolpert DM, Jordan MI. Computational models of sensorimotor integration. In: Self-Organization, Computational Maps and Motor Control, edited by Morasso PG, Sanguineti V. Amsterdam: Elsevier, 1997, p. 117-147.
11. Gracco VL, Abbs JH. Variant and invariant characteristics of speech movements. Exp Brain Res 65: 156-166, 1986.
12. Guenther FH, Ghosh SS, Tourville JA. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang 96: 280-301, 2006.
13. Guenther FH, Espy-Wilson CY, Boyce SE, Matthies ML, Zandipour M, Perkell JS. Articulatory tradeoffs reduce acoustic variability during american english /r/ production. J Acoust Soc Am 105: 2854-2865, 1999.
14. Hamlet SL, Geoffrey VC, Bartlett DM. Effect of a dental prosthesis on speaker-specific characteristics of voice. J Speech Hear Res 19: 639-650, 1976.
15. Honda M, Fujino A, Kaburagi T. Compensatory responses of articulators to unexpected perturbation of the palate shape. J Phonetics 30: 281-302, 2002.
16. Houde JF, Jordan MI. Sensorimotor adaptation of speech I: compensation and adaptation. J Speech Lang Hear Res 45: 295-310, 2002.
17. Houde JF, Jordan MI. Sensorimotor adaptation in speech production. Science 279: 1213-1216, 1998.
18. Ito T, Kimura T, Gomi H. The motor cortex is involved in reflexive compensatory adjustment of speech articulation. Neuroreport. 16: 1791-1794.
19. Jacobs RA. Optimal integration of texture and motion cues to depth. Vision Res 39: 3621-3629, 1999.
20. Jones JA, Munhall KG. Learning to produce speech with an altered vocal tract: the role of auditory feedback. J Acoust Soc Am 113: 532-543, 2003.
21. Max L, Wallace ME, Vincent I. Sensorimotor adaptation to auditory perturbations during speech: acoustic and kinematic experiments. In: Proceedings of the 15th International Congress of Phonetic Sciences, edited by Solé MJ, Recasens D, Romero J. Barcelona: Universitat Autonoma Barcelona, 2003, p. 1053-1056.
22. Max L. Stuttering and internal models for sensorimotor control: a theoretical perspective to generate testable hypotheses. In: Speech Motor Control in Normal and Disordered Speech, edited by Maassen B, Kent R, Peters HF, van Lieshout P, Hulstijn W. Oxford: Oxford Univ. Press, 2004, p. 357-388.
23. Miller JD. Auditory-perceptual interpretation of the vowel. J Acoust Soc Am 85: 2114-2134, 1989.
24. Nasir SM, Ostry DJ. Somatosensory precision in speech production. Curr Biol 16: 1918-1923, 2006.
25. Perkell JS, Lane H, Ghosh S, Matthies ML, Tiede M, Guenther F, Ménard L. Mechanisms of vowel production: auditory goals and speaker acuity. In: Proceedings of the 8th International Seminar on Speech Production, edited by Sock R, Fuchs S, Laprie Y. Strasbourg, France: 2008, p. 29-32.
26. Perkell JS, Guenther FH, Lane H, Matthies ML, Perrier P, Vick J, Wilhelms-Tricario R, Zandipour M. A theory of speech motor control and supporting data from speakers with normal hearing and with profound hearing loss. J Phonetics 28: 233-272, 2000.
27. Perkell JS, Matthies ML, Svirsky MA, Jordan MI. Trading relations between tongue-body raising and lip rounding in production of the vowel /u/: a pilot "motor equivalence" study. J Acoust Soc Am 93: 2948-2961, 1993.
28. Purcell DW, Munhall KG. Adaptive control of vowel formant frequency: evidence from real-time formant manipulation. J Acoust Soc Am 120: 966-977, 2006a.
29. Purcell DW, Munhall KG. Compensation following real-time manipulation of formants in isolated vowels. J Acoust Soc Am 119: 2288-2297, 2006b.
30. Savariaux C, Perrier P, Orliaguet JP. Compensation strategies for the perturbation of the rounded vowel [u] using a lip tube: a study of the control space in speech production. J Acoust Soc Am 98: 2428-2442, 1995.
31. Scheidt RA, Conditt MA, Secco EL, Mussa-Ivaldi FA. Interaction of visual and proprioceptive feedback during adaptation of human reaching movements. J Neurophysiol 93: 3200-3213, 2005.
32. Schöner G, Martin V, Reimann H, Scholz J. Motor equivalence and the uncontrolled manifold. In: Proceedings of the 8th International Seminar on Speech Production, edited by Sock R, Fuchs S, Laprie Y. Strasbourg, France: 2008, p. 23-28.
33. Scott SH. Optimal strategies for movement: success with variability. Nat Neurosci 5: 1110-1111, 2002.
34. Scott SH. Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci 5: 534-546, 2004.
35. Shadmehr R, Mussa-Ivaldi FA. Adaptive representation of dynamics during learning of a motor task. J Neurosci 14: 3208-3224, 1994.
36. Shiller DM, Houle G, Ostry DJ. Voluntary control of human jaw stiffness. J Neurophysiol 94: 2207-2217, 2005.
37. Shiller DM, Sato M, Gracco VL, Baum SR. Perceptual recalibration of speech sounds following speech motor learning. J Acoust Soc Am 125: 1103-1113, 2009.
38. Sober SJ, Sabes PN. Flexible strategies for sensory integration during motor planning. Nat Neurosci 8: 490-497, 2005.
39. Sober SJ, Sabes PN. Multisensory integration during motor planning. J Neurosci 23: 6982-6992, 2003.
40. Todorov E. Optimality principles in sensorimotor control. Nat Neurosci 7: 907-915, 2004.
41. Todorov E, Jordan MI. Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226-1235, 2002.
42. Tremblay S, Houle G, Ostry DJ. Specificity of speech motor learning. J Neurosci 28: 2426-2434, 2008.
43. Tremblay S, Shiller DM, Ostry DJ. Somatosensory basis of speech production. Nature 423: 866-869, 2003.
44. Vallabha GK, Tuller B. Systematic errors in the formant analysis of steadystate vowels. Speech Commun 38: 141-160, 2002.
45. van Beers RJ, Wolpert DM, Haggard P. When feeling is more important than seeing in sensorimotor adaptation. Curr Biol 12: 834-837, 2002.
46. van Beers RJ, Sittig AC, Gon JJ. Integration of proprioceptive and visual position-information: an experimentally supported model. J Neurophysiol 81: 1355-1364, 1999.
47. Villacorta VM, Perkell JS, Guenther FH. Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception. J Acoust Soc Am 122: 2306-2319, 2007.
48. Welch RB, Warren DH. Intersensory interactions. In: Handbook of Perception and Human Performance, edited by Boff KR, Kaufman L, Thomas JP. New York: Wiley, 1986, p. 25.1.362306-25.
49. Westbury JR, Lindstrom MJ, McClean MD. Tongues and lips without jaws: a comparison of methods for decoupling speech movements. J Speech Lang Hear Res 45: 651-662, 2002.