Linear degrees of freedom in speech production: Analysis of cineradio- and labio-film data and articulatory-acoustic modeling

Journal of the Acoustical Society of America

Volumn 109, Issue 5 I, 2001, Pages 2165-2180

  Beautemps, Denis ^a   Badin, Pierre ^a   Bailly, Gérard ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL ORGANS; COMPONENTS; DECOMPOSITION; FILMS; PRINCIPAL COMPONENT ANALYSIS;

CONSONANTS; VOWELS;

SPEECH ANALYSIS;

ACOUSTICS; ARTICLE; CINERADIOGRAPHY; HUMAN; LIP; PRIORITY JOURNAL; SOUND INTENSITY; SPEECH; SPEECH ARTICULATION; TONGUE;

EID: 0035025894     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.1361090     Document Type: Article

References (67)

1. Abry, C., Badin, P., and Scully, C. (1994). "Sound-to-gesture inversion in speech: The Speech Maps approach," in Advanced Speech Applications, edited by K. Varghese, S. Pfleger, and J. P. Lefèvre (Springer, Berlin), pp. 182-196.
2. Badin, P., Baricchi, E., and Vilain, A. (1997). "Determining tongue articulation: from discrete fleshpoints to continuous shadow," in Proceedings of the 5th EuroSpeech Conference (University of Patras, Wire Communication Laboratory, Patras, Greece), Vol. 1, pp. 47-50.
3. Badin, P., Mawass, K., and Castelli, E. (1995). "A model of frication noise source based on data from fricative consonants in vowel context," in Proceedings of the 13th International Congress of Phonetic Sciences, edited by K. Elenius and P. Branderud (Arne Strömbergs Grafiska Press, Stockholm, Sweden), Vol. 2, pp. 202-205.
4. Badin, P., Bailly, G., Raybaudi, M., and Segebarth, C. (1998). "A three-dimensional linear articulatory model based on MRI data," in Proceedings of the Third ESCA/COCOSDA International Workshop on Speech Synthesis (Jenolan Caves, Australia), pp. 249-254.
5. Badin P., Motoki, K., Miki, N., Ritterhaus, D., and Lallouache, T. M. (1994a). "Some geometric and acoustic properties of the lip horn," J. Acoust. Soc. Jpn. (E) 15, 243-253.
6. Badin, P., Borel, P., Bailly, G., Revéret, L., Baciu, M., and Segebarth, C. (2000). "Towards an audiovisual virtual talking head: 3D articulatory modeling of tongue, lips and face based on MRI and video images," in Proceedings of the 5th Seminar on Speech Production: Models and Data & CREST Workshop on Models of Speech Production: Motor Planning and Articulatory Modelling (Kloster Seeon, Germany), pp. 261-264.
7. Badin, P., and Fant, G. (1984). "Notes on vocal tract computation," Speech Transmission Laboratory - Quarterly Progress Status Report Vol. 2-3/ 1984, pp. 53-108.
8. Badin, P., Shadle, C. H., Pham Thi Ngoc, Y., Carter, J. N., Chiu, W., Scully, C., and Stromberg, K. (1994b). "Frication and aspiration noise sources: contribution of experimental data to articulatory synthesis," in Proceedings of the 3rd International Conference on Spoken Language Processing edited by Mike Edington (Yokohama, Japan), Vol. 1, pp. 163-166.
9. Baer, T., Gore, J. C., Gracco, L. C., and Nye, P. W. (1991). "Analysis of vocal tract shape and dimensions using magnetic resonance imaging: Vowels," J. Acoust. Soc. Am. 90, 799-828.
10. Bailly, G. (1993). "Resonances as possible representations of speech in the auditory-to-articulatory transform," in Proceedings of the 3rd Eurospeech Conference on Speech Communication and Technology (Berlin), Vol. 3, pp. 1511-1514.
11. Bailly, G., Badin, P., and Vilain, A. (1998). "Synergy between jaw and lips/tongue movements: Consequences in articulatory modelling," in Proceedings of the 5th International Conference on Spoken Language Processing, edited by R. H. Mannell, J. Robert-Ribes, and E. Vatikiotis-Bateson (Australian Speech Science and Technology Association, Inc., Sydney, Australia), Vol. 5, pp. 1859-1862.
12. Bailly, G., Castelli, E., and Gabioud, B. (1994). "Building prototypes for articulatory speech synthesis," in Proceedings of the 2nd ESCA/IEEE Workshop on Speech Synthesis (New York), pp. 9-12.
13. Beautemps, D., Badin, P., and Laboissière, R. (1995). "Deriving vocal-tract area functions from midsagittal profiles and formant frequencies: A new model for vowels and fricative consonants based on experimental data," Speech Commun. 16, 27-47.
14. Beautemps, D., Borel, P., and Manolios, S. (1999). "Hyper-articulated speech: Auditory and visual intelligibility," in Proceedings of the 6th European Conference on Speech Communication and Technology, Vol. 1 (Budapest, Hungary), pp. 109-112, September 1999.
15. Beautemps, D., Badin, P., Bailly, G., Galván, A., and Laboissière, R. (1996). "Evaluation of an articulatory-acoustic model based on a reference subject," in Proceedings of the 4th Speech Production Seminar (Autrans, France), pp. 45-48.
16. Boë, L. J., Gabioud, B., Schwartz, J. L., and Vallée, N. (1995). "Towards the unification of vowel spaces," in Proceedings of the XIIIth International Congress of Phonetic Sciences, edited by K. Elenius and P. Branderud (Arne Strombergs Grafiska Press, Stockholm, Sweden), Vol. 4, pp. 582-585.
17. Bothorel, A., Simon, P., Wioland, F., and Zerling, J. P. (1986). "Cinéradiographie des voyelles et consonnes du francais [Cineradiography of vowels and consonants in French]," Trav. de l'Inst. de Phonétique de Strasbourg, 296 pp.
18. Coker, C., and Fujimura, O. (1966). "Model for specification of the vocal-tract area function," J. Acoust. Soc. Am. 40, 1271.
19. Dang, J., and Honda, K. (1998). "Speech production of vowel sequences using a physiological articulatory model," in Proceedings of the 5th International Conference on Spoken Language Processing, edited by Robert H. Mannell and Jordi Robert-Ribes, Vol. 5 (Sydney, Australia R.H.), pp. 1767-1770.
20. Demolin, D., Giovanni, A., Hassid, S., Heim, C., Lecuit, V., and Soquet, A. (1997). "Direct and indirect measurements of subglottic pressure," Proceedings of Larynx 97 (Marseille, France), pp. 69-72.
21. Djéradi, A., Guérin, B., Badin, P., and Perrier, P. (1991). "Measurement of the acoustic transfer function of the vocal tract: a fast and accurate method," J. Phonetics 19, 387-395.
22. Edwards, J., and Harris, K. S. (1990). "Rotation and translation of the jaw during speech," J. Speech Hear. Res. 33, 550-562.
23. Engwall, O., and Badin, P. (1999). "Collecting and analyzing two- and three-dimensional MRI data for Swedish," Tal Musik Hörsel, Quarterly Progress Status Report. Stockholm Vol. 3-4, pp. 11-38.
24. Fowler, C. A., and Saltzman, E. (1993). "Coordination and coarticulation in speech production," Language and Speech 36, 171-195.
25. Fromkin, V. A. (1964). "Lip positions in American English vowels," Language and Speech 7, 215-225.
26. Gabioud, B. (1994). "Articulatory models in speech synthesis," in Fundamentals of Speech Synthesis and Speech Recognition, edited by E. Keller (Wiley, Chichester), pp. 215-230.
27. Harshman, R., Ladefoged, P., and Goldstein, L. (1977). "Factor analysis of tongue shape," J. Acoust. Soc. Am. 62, 693-707.
28. Heinz, J. M., and Stevens, K. N. (1965). "On the relations between lateral cineradiographs, area functions, and acoustic spectra of speech," Proceedings of the Fifth International Congress of Acoustics (Liége, Belgium), Paper A44.
29. Hoole, P. (1999). "On the lingual organization of the German vowel system," J. Acoust. Soc. Am. 106, 1020-1032.
30. Hoole, P., and Kroos, C. (1998). "Control of larynx height in vowel production," in Proceedings of the 5th International Conference on Spoken Language Processing, edited by R. H. Mannell, J. Robert-Ribes, and E. Vatikiotis-Bateson (Australian Speech Science and Technology Association, Inc., Sydney, Australia), Vol. 2, pp. 531-534.
31. Hoole, P., Wismüller, A., Leisinger, G., Kroos, C., Geumann, A., and Inoue, M. (2000). "Analysis of tongue configuration in multi-speaker, multi-volume MRI data," in Proceedings of the 5th Seminar on Speech Production: Models and Data & CREST Workshop on Models of Speech Production: Motor Planning and Articulatory Modelling (Kloster Seeon, Germany), pp. 157-160.
32. Kelso, J. A. S., Saltzman, E. L., and Tuller, B. (1986). "The dynamical theory of speech production: Data and theory," J. Phonetics 14, 29-60.
33. Laboissière, R., Ostry, D. J., and Feldman, A. G. (1996). "Control of multi-muscle systems: Human jaw and hyoid movements," Biol. Cybern. 74, 373-384.
34. Lallouache, M. T. (1990). "Un poste Visage-Parole. Acquisition et traitement de contours labiaux [A "Face-Speech" workstation. Acquisition and processing of labial contours]," Proceedings of the 18th Journées d'Etude sur la Parole (Montréal, Canada), pp. 282-286.
35. Liljencrants, J. (1971). "A Fourier series description of the tongue profile," Speech Transmission Laboratory - Quarterly Progress Status Report Vol. 4/1971, pp. 9-18.
36. Lindblom, B. E. F. and Sundberg, J. E. F. (1971). "Acoustical consequences of lip, tongue and jaw movements," J. Acoust. Soc. Am. 50, 1166-1179.
37. Lindblom, B. E. F., Lubker, J., and Gay, T. (1979). "Formant frequencies of some fixed-mandible vowels and a model of speech-motor programming by predictive simulation," J. Phonetics 7, 141-161.
38. Maeda, S. (1979). "Un modèle articulatoire de la langue avec des composantes linéaires," Proceedings of the 10th Journées d'Etude sur la Parole (Grenoble, France), pp. 152-163.
39. Maeda, S. (1982). "A digital simulation method of the vocal tract system," Speech Commun. 1, 199-299.
40. Maeda, S. (1990). "Compensatory articulation during speech: Evidence from the analysis and synthesis of vocal-tract shapes using an articulatory model," in Speech Production and Speech Modeling, edited by W. J. Hardcastle and A. Marchal (Kluwer Academic, The Netherlands), pp. 131-149.
41. Maeda, S. (1991). "On articulatory and acoustic variabilities," J. Phonetics 19, 321-331.
42. Matsuda, M., and Kasuya, H. (1999). "Acoustic nature of the whisper," in Proceedings of the 6th European Conference on Speech Communication and Technology, Vol. 1 (Budapest, Hungary), pp. 133-136, September 1999.
43. Mawass, K., Badin, P., and Bailly, G. (2000). "Synthesis of French fricatives by audio-video to articulatory inversion," Acta Acoustica 86, 136-146.
44. Mermelstein, P. (1973). "Articulatory model for the study of speech production" J. Acoust. Soc. Am. 53, 1070-1082.
45. Nix, D. A., Papcun, G., Hogden, J., and Zlokarnik, I. (1996). "Two cross-linguistic factors underlying tongue shapes for vowels," J. Acoust. Soc. Am. 99, 3707-3717.
46. Ostry, D., Vatikiotis-Bateson, E., and Gribble, P. (1997). "An examination of the degrees of freedom of human jaw motion in speech and mastication," J. Acoust. Soc. Am. 40, 1341-1351.
47. Payan, Y., and Perrier, P. (1997). "Synthesis of V-V sequences with a 2D biomechanical tongue model controlled by the equilibrium point hypothesis," Speech Commun. 22, 185-205.
48. Pelorson, X., Hirschberg, A., Wijnands, A. P. J., Bailliet, H., Vescovi, C., and Castelli, E. (1996). "Description of the flow through the vocal cords during phonation. Application to voiced sounds synthesis," Acta Acoustica 82, 358-361.
49. Perkell, J. S. (1974). "A physiological-oriented model of the tongue activity during speech production," Ph.D. dissertation, MIT, Cambridge.
50. Perkell, J. S. (1991). "Models, theory and data in speech production," Proceedings of the XIIth International Congress of Phonetic Sciences (Université de Provence, Aix-en-Provence, France), Vol. 1, pp. 182-191.
51. Perrier, P., Ostry, D. J., and Laboissière, R. (1996). "The equilibrium point hypothesis and its application to speech motor control," J. Speech, Language, and Hear. Res. 39, 365-578.
52. Perrier, P., Payan, P., Perkell, J. S., Zandipour, M., Pelorson, X., Coisy, V., and Matthies, M. (2000). "An attempt to simulate fluid-walls interactions during velar stops," in Proceedings of the 5th Seminar on Speech Production: Models and Data & CREST Workshop on Models of Speech Production: Motor Planning and Articulatory Modelling (Kloster Seeon, Germany), pp. 149-152.
53. Revéret, L., and Benoît, C. (1998). "A new 3D lip model for analysis and synthesis of lip motion in speech production," in Proceedings of the International Conference on Auditory-Visual Speech Processing/Second ESCA ETRW on Auditory-Visual Speech, edited by D. Burnham, J. Robert-Ribes, and E. Vatikiotis-Bateson (Terrigal-Sydney, Australia), pp. 207-212.
54. Sanguineti, V., Laboissière, R., and Ostry, D. J. (1998). "A dynamic biomechanical model for neural control of speech production," J. Acoust. Soc. Am. 103, 1615-1627.
55. Scully, C. (1991). "The representation in models of what speakers know," in Proceedings of the XIIth International Congress of Phonetic Sciences (Université de Provence, Aix-en-Provence, France), Vol. 1, pp. 192-197.
56. Shadle, C. H., and Scully, C. (1995). "An articulatory-acoustic-aerodynamic analysis of [s] in VCV sequences," J. Phonetics 23, 53-66.
57. Sorokin, V. N., Gay, T., and Ewan, W. G. (1980). "Some biomechanical correlates of jaw movements," J. Acoust. Soc. Am. Suppl. 1 68, S32.
58. Stark, J., Lindblom, B., and Sundberg, J. (1996). "APEX: An articulatory synthesis model for experimental and computational studies of speech production," TMH-QPSR 2/1996, pp. 45-48.
59. Stetson, R. H. (1928). "Motor phonetics. A study of speech movements in action," Archives Néerlandaises de Phonétique Expérimentale 3, 216.
60. Stromberg, K, Scully, C., Badin, P., and Shadle, C. H. (1994). "Aerodynamic patterns as indicators of articulation and acoustic sources for fricatives produced by different speakers," Institute of Acoustics 16, 325-333.
61. Tiede, M. K. (1996). "An MRI-based study of pharyngeal volume contrasts in Akan and English," J. Phonetics 24, 399-421.
62. Vilain, A., Abry, C., and Badin, P. (1998). "Coarticulation and degrees of freedom in the elaboration of a new articulatory plant: Gentiane," in Proceedings of the 5th International Conference on Spoken Language Processing, edited by R. H. Mannell, J. Robert-Ribes, and, E. Vatikiotis-Bateson (Australian Speech Science and Technology Association, Inc., Sydney, Australia), Vol. 7, pp. 3147-3150.
63. Vilain, A., Abry, C., Badin P., and Brosda, S. (1999). "From idiosyncratic pure frames to variegated babbling: Evidence from articulatory modeling," in Proceedings of the 14th International Congress of Phonetic Sciences, edited by J. J. Ohala, Y. Hasegawa, M. Ohala, D. Granville, and A. C. Bailey (Congress organizers at the Linguistics Department, University of California at Berkeley, San Francisco, CA), Vol. 3, pp. 2497-2500.
64. Westbury, J. R. (1988). "Mandible and hyoid bone movements during speech," J. Speech Hear. Res. 31, 405-416.
65. Westbury, J. R. (1994), "On coordinate systems and the representation of articulatory movements," J. Acoust. Soc. Am. 95, 2271-2273.
66. Wilhelms-Tricarico, R. (1995). "Physiological modeling of speech production: Methods for modeling soft-tissue articulators," J. Acoust. Soc. Am. 97, 3085-3098.
67. Zerling, J. P. (1984). "Phénomènes de nasalité et de nasalisation vocaliques: Étude cinéradiographique pour deux locuteurs [in French]," Trav. de l'Inst. de Phonétique de Strasbourg 16, 241-266.