Techniques For Estimating Vocal-Tract Shapes from the Speech Signal

IEEE Transactions on Speech and Audio Processing

Volumn 2, Issue 1, 1994, Pages 133-150

  Schroeter, Juergen ^a   Sondhi, Man Mohan ^a  

^a LUCENT TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; SPEECH SYNTHESIS;

INVERSE PROBLEM; SPEECH SIGNAL ACOUSTICAL PROPERTIES; SPEECH SIGNAL SHAPE ESTIMATION; VOCAL TRACT SHAPES; VOCAL TRACT TIME-VARYING GEOMETRY;

SPEECH RECOGNITION;

EID: 0028259480     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/89.260356     Document Type: Letter

References (79)

1. J.L. Flanagan, K. Ishizaka, and K.L. Shipley, “Signal models for low bitrate coding of speech,” J. Acoust. Soc. Am., vol. 68, no. 3, pp. 780–791, 1980.
2. J.L. Flanagan, K. Ishizaka, and K.L. Shipley, “Synthesis of speech from a dynamic model of the vocal cords and vocal tract,” Bell Syst. Tech. J., vol. 45, no. 3, pp. 199–229, 1975.
3. M.M. Sondhi and J. Schroeter, “A hybrid time-frequency domain articulatory speech synthesizer,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-35, no. 7, pp. 955–966, July 1987.
4. J. Schroeter, J.N. Larar, and M.M. Sondhi, “Speech parameter estimation using a vocal tract/cord model,” in Proc. IEEE int. Conf. Acoust., Speech, Signal Processing, vol. 1, 1987, pp. 308–311.
5. S. Maeda, “A digital simulation method of the vocal-tract system,” Speech Communicat., vol. 1, pp. 199–229, 1982.
6. P. Meyer, R. Wilhelms, and H.W. Strube, “A quasiarticulatory speech synthesizer for the German language running in real time,” J. Acoust. Soc. Am., vol. 82, no. 2, pp. 523–539, 1989.
7. J.N. Larar, J. Schroeter, and M.M. Sondhi, “Vector quantization of the articulatory space,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, no. 12, pp. 1812–1818, 1988.
8. M.M. Sondhi, “Resonances of a bent vocal tract,” J. Acoust. Soc. Am., vol. 79, no. 4, pp. 1113–1116, 1986.
9. J.L. Flanagan, Speech Analysis Synthesis and Perception, 2nd ed. New York: Springer, 1972.
10. M.M. Sondhi, “Model for wave propagation in a lossy vocal tract,” J. Acoust. Soc. Am., vol. 55, no. 5, pp. 1070–1075, 1974.
11. G. Borg, “Eine Umkehrung der Sturm-Liouvilleschen Eigenwertaufgabe,” (“An inversion of the Sturm-Liouville eigenvalue problem,” in German) Acta Mathematica, vol. 78, pp. 1–96, 1946.
12. B.S. Atal, “Determination of the vocal tract shape directly from the speech wave,” J. Acoust. Soc. Am., vol. 47, p. 65(A), 1970.
13. M.M. Sondhi, “Estimation of vocal-tract areas: the need for acoustical measurements,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-27, no. 3, pp. 268–273, 1979.
14. B. Gopinath and M.M. Sondhi, “Determination of the shape of the human vocal tract by acoustic measurements,” Bell Syst. Tech. J., vol. 49, no. 6, pp. 1195–1214, 1970.
15. M.R. Schroeder, “Determination of the geometry of the human vocal tract by acoustic measurements,” J. Acoust. Soc. Am., vol. 41, no. 4, pt. 2, pp. 1002–1010, 1967.
16. P. Mermelstein, “Determination of vocal tract shapes from measured formant frequencies,” J. Acoust. Soc. Am., vol. 41, no. 5, pp. 1283–1294, 1967.
17. M.M. Sondhi and B. Gopinath, “Determination of vocal tract shape from impulse response at the lips,” J. Acoust. Soc. Am., vol. 49, no. 6, pt. 2, pp. 1867–1873, 1971.
18. M.M. Sondhi and B. Gopinath, “Determination of the shape of a lossy vocal tract,” in Proc. Seventh Int. Congr. Acoust. (Budapest, Hungary), 1971.
19. J.R. Resnick, “Acoustic inverse scattering as a means for determining the area function of a lossy vocal tract: theoretical and experimental model studies,” Ph.D. dissertation, Johns Hopkins Univ., Baltimore, MD, 1979.
20. D.H. Klatt, “Review of text-to-speech conversion for English,” J. Acoust. Soc. Am., vol. 82, no. 3, pp. 737–793, 1987.
21. M.R. Portnoff, “A quasi-one-dimensional digital simulation for the time-varying vocal-tract,” S.B./S.M. thesis, M.I.T., Cambridge, MA, 1973.
22. E.L. Bocchieri, “An articulatory speech synthesizer, Ph.D. dissertation, Univ. of Florida, Gainesville, 1983.
23. J.L. Kelly and C.C. Lochbaum, “Speech synthesis,” in Proc. Fourth Int. Congr. Acoust., 1962, pp. 1-4, reprinted in Speech Synthesis, J.L. Flanagan and L.R. Rabiner, Eds. Stroudsburg, PA: Dowden, Hutchinson & Ross, 1973, pp. 127–130.
24. Y. Kabasawa, K. Ishizaka, and Y. Arai, “Simplified digital model of the lossy vocal tract and vocal cords,” in Proc. 11th Int. Congr. Acoust. (Paris, France), vol. 4, 1983, pp. 175–178.
25. H.W. Strube, “Time-varying digital filter and vocal tract models,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, vol. 2, 1982, pp. 923–926.
26. J. Schroeter, J.N. Larar, and S. Parthasarathy, “Vocal-Tract Areas versus Articulatory Parameters in Speech Production Modeling,” J. Acoust. Soc. Am., vol. 84, suppl. 1, S127.
27. W.L. Henke, “Dynamic articulatory model of speech production using computer simulation,” Ph.D. dissertation, M.I.T., Cambridge, MA, 1966.
28. G. Papcun, J. Hochberg, T.R. Thomas, F. Laroche, J. Zacks, and S. Levy, “Inferring articulation and recognizing gestures from acoustics with a neural network trained on x-ray microbeam data,” J. Acoust. Soc. Am., vol. 92, no. 2, pp. 688–700, 1992.
29. S. Maeda, “Compensatory articulation during speech: evidence from the analysis and synthesis of vocal-tract shapes using an articulatory model,” in Speech Production and Speech Modeling (NATO Advanced Study Institute series), W.J. Hardcastle and A. Marchai, Eds. Norwell, MA: Kluwer, 1990.
30. B.E.F. Lindblom and E.F. Sundberg, “Acoustical consequences of lip, tongue, jaw and larynx movement,” J. Acoust. Soc. Am., vol. 50, no. 4 (pt. 2), pp. 1166–1179, 1971.
31. J.S. Perkell, “A physiologically-oriented model of tongue activity in speech production,” Ph.D. dissertation, M.I.T., Cambridge, MA, 1974.
32. E.L. Saltzman and K.G. Munhall, “A dynamical approach to gestural patterning in speech production,” Ecological Psychol., vol. 1, no. 4, pp. 333–382, 1989.
33. S. Kiritani, S. Sekimoto, and H. Imagawa, “Parameter description of tongue point movements in vowel production,” Annu. Bull. RIHLP, vol. 11, pp. 31–37, 1977.
34. S. Maeda, “Un modele articulatoire de la langue avec des composantes linéaires,” (“An articulatory model of the tongue with linear components,” in French) in 10 è mes Journèes d' Ètude sur la Parole (Grenoble, France), May 30-June 1, 1979.
35. C.H. Coker and O. Fujimura, “A model for specification of vocal tract area function,” J. Acoust. Soc. Am., vol. 40, p. 1271(A), 1966.
36. P. Mermelstein, “Articulatory model for the study of speech production,” J. Acoust. Soc. Am., vol. 53, no. 4, pp. 1070–1082, 1973.
37. C.H. Coker, “A model of articulatory dynamics and control,” Proc. IEEE, vol. 64, no. 4, pp. 452–460, 1976.
38. B.S. Atal, J.J. Chang, M.V. Mathews, and J.W. Tukey, “Inversion of articulatory-to-acoustic transformation in the vocal tract by a computer-sorting technique,” J. Acoust. Soc. Am., vol. 63, no. 5, pp. 1535–1555, 1978.
39. G.H. Golub and C.F. Van Loan, Matrix Computations, 2nd ed. Baltimore, MD: The Johns Hopkins University Press, 1989.
40. J. Schroeter and M.M. Sondhi, “Speech coding based on physiological models of speech production,” in: Advances in Speech Signal Processing, S. Furai and M.M. Sondhi, Eds. New York: Dekker, 1992, pp. 231–267.
41. M. Stone, “A three-dimensional model of tongue movement based on ultrasound and x-ray microbeam data,” J. Acoust. Soc. Am., vol. 87, no. 5, pp. 2207–2217, 1990.
42. B. Tuller, S. Shao, and J.A.S. Kelso, “An evaluation of an alternating magnetic field device for monitoring tongue movements,” J. Acoust. Soc. Am., vol. 88, no. 2, pp. 674–679, 1990.
43. J.S. Perkell, et al., “Electromagnetic midsagittal articulometer systems for transducing speech articulatory movements,” J. Acoust. Soc. Am., vol. 92, no. 6, pp. 3078–3096, 1992.
44. T. Baer, J.C. Gore, L.C. Gracco, and P.W. Nye, “Analysis of vocal tract shape and dimensions using magnetic resonance imaging: vowels,” J. Acoust. Soc. Am., vol. 90, no. 2, pt. 1, pp. 799–828, 1991.
45. M.M. Sondhi and J.R. Resnick, “The inverse problem for the vocal tract: numerical methods, acoustical experiments and speech synthesis,” J. Acoust. Soc. Am., vol. 73, no. 3, pp. 985–1002, 1983.
46. J. Schroeter, P. Meyer, and S. Parthasarathy, “Evaluation of improved articulatory codebooks and codebook access distance measures,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, vol. 1, 1990, pp. 393–396.
47. P. Meyer, J. Schroeter, and M.M. Sondhi, “Design and evaluation of optimal cepstral lifters for accessing articulatory codebooks,” IEEE Trans. Signal Processing, vol. 39, no. 7, pp. 1493–1502, 1991.
48. J.N. Larar, Y.A. Alsaka, and D.G. Childers, “Variability in closed phase analysis of speech,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, vol. 3, 1985, pp. 1089–1092.
49. A.V. Oppenheim and R.W. Schafer, Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1975.
50. R. Wilhelms, “Schätzung von artikulatorischen Bewegungen eines stilisierten Artikulationsmodells aus dem Sprachsignal” (“Estimation of articulatory movements of a stylized articulatory model from the speech signal,” in German), doctoral dissertation, Univ. of Göttingen, FRG, 1987.
51. E. Krüger, “Optimierung von akustisch–artikulatorischen Schtzun-gen mit Hilfe eines Systemmodells” (“Optimization of acoustical–articulatory estimations using a system model,” in German), doctoral dissertation, Univ. of Göttingen, FRG, 1989.
52. J. Schroeter and M.M. Sondhi, “Dynamic programming search of articulatory codebooks,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, vol. 1, 1989, pp. 588–591.
53. J.D. Markel and A.H. Gray, Jr., Linear prediction of speech. New York: Springer, 1976.
54. F. Itakura, “Minimum prediction residual principle applied to speech recognition,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-23, no. 1, pp. 67–72, 1975.
55. H.T. Edwards, Applied Phonetics, The Sounds of American English. San Diego: Singular Publishing Group, 1992.
56. J.W. Möller, B.S. Atal and M.R. Schroeder, “Determination of articulatory parameters of the human vocal tract from acoustic measurements,” J. Acoust. Soc. Am., vol. 60, S77(A), 1976.
57. J.W. Möller, “Regressive Schötzung artikulatorischer Parameter aus dem Sprachsignal,” (“Regressive estimation of articulatory parameters from the speech signal,” in German), doctoral dissertation, Univ. of Göttingen, FRG, 1978.
58. B.S. Atal, “Towards determining articulator positions from the speech signal,” in Proc. Preprints Speech Communication Seminar, Stockholm, vol. 1, 1974, pp. 1–9.
59. E. Krüger, G. Panagos, S. Jockusch, and H.W. Strube, “Artikulatorisch-akustische Abbildung auf grund gemessener artikulatorischer Parameter,” (“Articulatory-acoustic mapping based on measured articulatory parameters,” in German) in Fortschritte der Akustik, DAGA 88, Bad Honnef: DPG-GmbH, pp. 677–680.
60. S. Rintani, K. Itoh, and O. Fujimura, “Tongue pellet tracking by a computer-controlled X-ray microbeam system,” J. Acoust. Soc. Am., vol. 57, no. 6, pt. 2, pp. 1516–1520, 1975.
61. D.R. Hush and B.G. Home, “Progress in supervised neural networks–what's new since Lippmann,” IEEE Signal Processing Mag., vol. 10, no. 1, pp. 8–39, Jan. 1993.
62. S. Parthasarathy and M.M. Sondhi, “Generalized radial basis functions for acoustic-to-articulatory mapping,” unpublished.
63. Y. Linde, A. Buzo, and R.M. Gray, “An algorithm for vector quantizer design,” IEEE Trans. Communicat., vol. 28, pp. 84–95, 1980.
64. J.L. Kuester and J.H. Mize, Optimization techniques with Fortran. New York: McGraw-Hill, 1973.
65. F. Soong and B.-H. Juang, “Optimal quantization of LSP parameters,” IEEE Trans. Speech, Audio Processing, vol. 1, no. 1, pp. 15–24, 1993.
66. B.S. Atal and O. Rioul, “Neural networks for estimating articulatory positions from speech,” J. Acoust. Soc. Am., vol. 86, suppl. 1, S67, 1989.
67. R.P. Lippmann, “An introduction to computing with neural nets,” IEEE Signal Processing Mag., vol. 4, no. 2, pp. 4–22, Apr. 1987.
68. A. Soquet, M. Saerens, and P. Jospa, “Acoustic-articulatory inversion based on a neural controller of a vocal tract model: further results,” in Artificial Neural Networks T. Kohonen, K. Mökisara, O. Simula, and J. Kangas, Eds. North Holland: Elsevier, 1991, pp. 371–376.
69. K. Shirai and T. Kobayashi, “Estimation of articulatory motion using neural networks,” J. Phonetics, vol. 19, pp. 379–385, 1991.
70. S. Jokusch, G. Panagos, and H.W. Strube, “Anwendung neuronaler Netzwerke auf die Schätzung von Sprachparametern,” (“Application of neural nets to the estimation of speech parameters,” in German), in Fortschritte der Akustik, DAGA′89, Bad Honnef: DPG-GmbH, pp. 315–318, 1989.
71. H. Wöhlbier and H.W. Strube, “Bestimmung der akustisch-artikulatorischen Abbildung an einem artikulatorischen Synthesemodell,” (“Determination of the acoustic-articulatory mapping with an articulatory synthesis model,” in German) in Fortschritte der Akustik,. DAGA′90, Bad Honnef: DPG-GmbH, pp. 1079–1082, 1990.
72. H.W. Strube and H. Wöhlbier, “Bestimmung artikulatorischer Steuerparameter zur Sprachsynthese mittels neuronaler Netzwerke,” (“Determination of articulatory control parameters for speech synthesis by neural networks,” in German) in: Fortschritte der Akustik, DAGA′91, Bad Honnef: DPG-GmbH, pp. 949–952, 1991.
73. R. Hecht-Nielsen, “Counter-propagation Networks,” in Proc. IEEE 1st Int. Conf. Neural Networks, vol. 2, 1987, pp. 19–32.
74. H. Robbins and S. Monro, “A stochastic approximation method,” Annu. Math. Stat., vol. 22, pp. 400–407, 1951.
75. H. Warneboldt and H.W. Strube, “Bestimmung der akustisch-artikulatorischen Abbildung für ein Vokaltraktmodell,” (“Determination of the acoustic-articulatory mapping for a model of the vocal tract,” in German), in Fortschritte der Akustik, DAGA′93, Bad Honnef: DPG-GmbH, 1993, in press.
76. T. Martinete and K. Schulten, “A ‘Neural Gas' Network Learns Topologies,” in Artificial Neural Networks, T. Kohonen, K. Mökisara, O. Simula, and J. Kangas, Eds. North Holland: Elsevier, 1991.
77. M.G. Rahim, C.C. Goodyear, W.B. Kleijn, J. Schroeter, and M.M. Sondhi, “On the use of neural networks in articulatory speech synthesis,” J. Acoust. Soc. Am., vol. 93, no. 2, pp. 1109–1121, 1993.
78. B.-H. Juang, L.R. Rabiner, and J.G. Wilpon, “On the use of bandpass liftering in speech recognition,” IEEE Trans. Acoustics, Speech, Signal Processing, vol. ASSP-35, no. 35, pp. 947–954, 1987.
79. S.K. Gupta and J. Schroeter, “Pitch-synchronous frame-by-frame and segment-based articulatory analysis-by-synthesis,” J. Acoust. Soc. Am., in press.