Robust word recognition using articulatory trajectories and gestures

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 2038-2041

  Mitra, Vikramjit ^a   Nam, Hosung ^b   Espy Wilson, Carol ^a   Saltzman, Elliot ^b,c   Goldstein, Louis ^b,d  

^a UNIVERSITY OF MARYLAND   (United States)

^b HASKINS LABORATORIES   (United States)

^c BOSTON UNIVERSITY   (United States)

^d UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Articulatory phonology; Noise robust speech recognition; Speech gestures; Speech inversion; TADA model neural networks; Tract variables

Indexed keywords

ACOUSTIC NOISE; ACOUSTICS; GESTURE RECOGNITION; NEURAL NETWORKS; SPEECH COMMUNICATION; SPEECH SYNTHESIS; VOCABULARY CONTROL; SPEECH RECOGNITION;

ACOUSTIC INFORMATION; ACOUSTIC WAVEFORM; ARTICULATORY INFORMATIONS; ARTICULATORY PHONOLOGY; AUTOMATIC SPEECH RECOGNITION SYSTEM; NOISE ROBUST SPEECH RECOGNITION; SPEECH INVERSION; TRACT VARIABLES; NATURAL SPEECH; SPEECH GESTURE; TADA MODEL NEURAL NETWORK; VOCAL-TRACTS; WORD RECOGNITION;

SPEECH RECOGNITION; NEURAL NETWORK MODELS;

EID: 79959813685     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. H. Nam, L. Goldstein, E. Saltzman, and D. Byrd, "Tada: An enhanced, portable task dynamics model in MATLAB", J. Acoust. Soc. Am, Vol. 115, No.5, 2, pp. 2430, 2004.
2. K. Kirchoff, "Robust Speech Recognition Using Articulatory Information", PhD Thesis, University of Bielefeld, 1999.
3. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, "Tract variables for noise robust speech recognition", under review IEEE Trans. on Aud., Speech & Lang. Processing
4. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, Noise Robustness of Tract Variables and their Application to Speech Recognition, Proc. of Interspeech, pp. 2759-2762, Brighton, UK, 2009.
5. J. Ryalls and S. J. Behrens, "Introduction to Speech Science: From Basic Theories to Clinical Applications", Allyn & Bacon, 2000.
6. A. A. Wrench and H. J. William, "A multichannel articulatory database and its application for automatic speech recognition", In 5th Seminar on Speech Production: Models and Data, pp. 305-308, Bavaria, 2000.
7. J. Westbury "X-ray microbeam speech production database user's handbook", Univ. of Wisconsin, 1994
8. R.S. McGowan, "Recovering articulatory movement from formant frequency trajectories using task dynamics and a genetic algorithm: preliminary model tests", Speech Comm., Vol.14, Iss.1, pp. 19-48, Elsevier Science Publishers, 1994.
9. C. Browman and L. Goldstein, "Articulatory Gestures as Phonological Units", Phonology, 6: 201-251, 1989
10. C. Browman and L. Goldstein, "Articulatory Phonology: An Overview", Phonetica, 49: 155-180, 1992
11. H.M. Hanson, R.S. McGowan, K.N. Stevens and R.E. Beaudoin, "Development of rules for controlling the HLsyn speech synthesizer", Proc. of ICASSP, Vol.1, pp.85-88, 1999
12. H.G. Hirsch and D. Pearce, "The Aurora experimental framework for the performance evaluation of speech recognition systems under noisy conditions", In Proc. ISCA ITRW ASR2000, pp. 181-188, Paris, France, 2000.
13. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, "Retrieving Tract Variables from Acoustics: a comparison of different Machine Learning strategies", To appear in the IEEE Journal of Selected Topics on Signal Processing, Special Issue on Statistical Learning Methods for Speech and Language Processing, 2010.
14. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, Estimating Gestures from Speech: a Neural Network approach, under 1st revision in the J. of Acoust. Soc. of Am.
15. G. Papcun, J. Hochberg, T.R. Thomas, F. Laroche, J. Zachs and S. Levy, "Inferring articulation and recognizing gestures from acoustics with a neural network trained on X-ray microbeam data", J. of Acoust. Soc. Am, 92(2), pp. 688-700.
16. K. Richmond, "Estimating Articulatory parameters from the Acoustic Speech Signal", PhD Thesis, Univ. of Edinburgh, 2001.
17. E. Saltzman and K. Munhall, "A Dynamical Approach to Gestural Patterning in Speech Production", Ecological Psychology, 1(4), pp.332-382, 1989.
18. H. Hermansky and N. Morgan, "RASTA processing of speech", IEEE Trans. Speech Aud. Proces., 2, pp.578-589, 1994.
19. th meeting of the Acoust. Soc. of Am., Baltimore, 2010.