Data-driven articulatory inversion incorporating articulator priors

ITRW on Statistical and Perceptual Audio Processing, SAPA 2008

Volumn , Issue , 2008, Pages 29-34

  Lammert, Adam ^a   Ellis, Daniel P W ^b   Divenyi, Pierre ^a  

^a EBIRE   (United States)

^b Columbia University ^*  (United States)

Author keywords

Articulatory inversion; speech acoustics

Indexed keywords

SPEECH COMMUNICATION;

ACOUSTIC SPEECH; ARTICULATORY INVERSION; DATA DRIVEN; JOINT DISTRIBUTIONS; POSTERIOR DISTRIBUTIONS; SIMPLE++; SPACE-BASED; SPEECH ACOUSTICS; SPEECH SIGNALS; TUBE MODEL;

MAXIMUM LIKELIHOOD;

EID: 85020518900     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. P. Mermelstein and M. Schroeder, "Determination of Smoothed Cross-Sectional-Area Functions of the Vocal Tract from Formant Frequencies," The Journal of the Acoustical Society of America, vol. 37, p. 1186, 1965.
2. H. Wakita, "Direct estimation of the vocal tract shape by inverse filtering of acoustic speech waveforms," Audio and Electroacoustics, IEEE Transactions on, vol. 21, no. 5, pp. 417-427, 1973.
3. E. Borowski and J. Borwein, Dictionary of Mathematics. Harper Collins, 1991.
4. B. Lindblom, J. Lubker, and T. Gay, "Formant frequencies of some fixed-mandible vowels and a model of speech motor programming by predictive simulation," Journal of Phonetics, vol. 7, pp. 146-161, 1979.
5. S. Roweis, "Data Driven Production Models for Speech Processing," Unpublished Ph. D. Thesis, California Institute of Technology, Pasadena, CA, 1999.
6. B. Atal, J. Chang, M. Mathews, and J. Tukey, "Inversion of articulatory-to-acoustic tranformation in the vocal tract by a computer-sorting technique," J. Acoust. Soc. Am., vol. 63, no. 5, pp. 1535-1555, 1978.
7. J. Flanagan, Speech Analysis Synthesis and Perception. Springer, 1972.
8. S. Dusan and L. Deng, "Estimation of articulatory parameters from speech acoustics by kalman filtering," 1998. [Online]. Available: citeseer. ist.psu.edu/dusan98estimation.html
9. J. Hogden, A. Lofqvist, V. Gracco, I. Zlokarnik, P. Rubin, and E. Saltzman, "Accurate recovery of articulator positions from acoustics: New conclusions based on human data," The Journal of the Acoustical Society of America, vol. 100, pp. 1819-1834, 1996.
10. T. Okadome, S. Suzuki, and M. Honda, "Recovery of articulatory movements from acoustics with phonemic information," in Proc. 5th Seminar on Speech Production, Kloster Seeon, Germany, May 2000, pp. 229-232.
11. H. Richards, J. Mason, M. Hunt, and J. Bridle, "Deriving articulatory representations from speech with various excitation modes," Spoken Language, 1996. ICSLP 96. Proceedings., Fourth International Conference on, vol. 2, pp. 1233-1236, 1996.
12. M. Huckvale and I. Howard, "Teaching a Vocal Tract Simulation to Imitate Stop Consonants," in Ninth European Conference on Speech Communication and Technology. ISCA, 2005.
13. G. Papcun, J. Hochberg, T. Thomas, F. Laroche, J. Zacks, and S. Levy, "Inferring articulation and recognizing gestures from acoustics with a neural network trained on x-ray microbeam data," The Journal of the Acoustical Society of America, vol. 92, pp. 688-700, 1992.
14. P. Perrier, L. Ma, and Y. Payan, "Modeling the production of VCV sequences via the inversion of a biomechanical model of the tongue," in Proc. Interspeech, Lisbon, 2005, pp. 1041-1044.
15. M. Rahim, W. Keijn, J. Schroeter, and C. Goodyear, "Acoustic to articulatory parameter mapping using an assembly of neural networks," Acoustics, Speech, and Signal Processing, 1991. ICASSP-91., 1991 International Conference on, pp. 485-488, 1991.
16. K. Richmond, "Estimating articulatory parameters from the acoustic speech signal," Ph.D. dissertation, PhD thesis, Centre for Speech Technology Research, Edinburgh University, 2001.
17. G. Westerman and E. Miranda, "Modelling the development of mirror neurons for auditory-motor integration," Journal of New Music Research, vol. 31, no. 4, pp. 367-375, 2002.
18. K. Shirai and T. Kobayashi, "Considerations on articulatory dynamics for continuous speech recognition," Acoustics, Speech, and Signal Processing, IEEE International Conference on ICASSP'83., vol. 8, 1983.
19. K. Shirai and T. Kobayashi, "Estimating articulatory motion from speech wave," Speech Communication, vol. 5, no. 2, pp. 159-170, 1986.
20. S. Dusan and L. Deng, "Acoustic-to-articulatory inversion using dynamical and phonological constraints," Proc. 5th Seminar on Speech Production, pp. 237-240, May 2000.
21. S. King and A. Wrench, "Dynamical system modeling of articulator movement," in Proc. International Congress of Phonetic Sciences, San Francisco, CA, 1999.
22. G. Ramsay and L. Deng, "Optimal filtering and smoothing for speech recognition using astochastic target model," Spoken Language, 1996. ICSLP 96. Proceedings., Fourth International Conference on, vol. 2, pp. 1113-1116, 1996.
23. G. Bailly, "Learning to speak. sensori-motor control of speech movements," Speech Communication, vol. 22, no. 2-3, pp. 251-267, 1998. [Online]. Available: citeseer.ist.psu.edu/bailly98learning.html
24. F. Guenther, "Speech sound acquisition, coarticulation, and rate effects in a neural network model of speech production," Psychological Review, vol. 102, no. 3, pp. 594-621, 1995.
25. K. Markey, "The sensorimotor foundations of phonology: a computational model of early childhood articulatory and phonetic development," Ph.D. dissertation, University of Colorado, 1994.
26. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd Edition. Wiley, New York, 2001.
27. H. Nam, L. Goldstein, E. Saltzman, and D. Byrd, "TADA: An enhanced, portable Task Dynamics model in MATLAB," Acoustical Society of America Journal, vol. 115, no. 5, pp. 2430-2430, 2001.
28. D. P. W. Ellis, "PLP and RASTA (and MFCC, and inversion) in Matlab," 2005, online web resource. [Online]. Available: www.ee.columbia.edu/ dpwe/resources/matlab/rastamat/
29. S. Narayanan, K. Nayak, S. Lee, A. Sethy, and D. Byrd, "An approach to real-time magnetic resonance imaging for speech production," The Journal of the Acoustical Society of America, vol. 115, pp. 1771-1776, 2004.