Robust speech recognition using articulatory gestures in a dynamic Bayesian network framework

2011 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2011, Proceedings

Volumn , Issue , 2011, Pages 131-136

  Mitra, Vikramjit ^a   Nam, Hosung ^b   Espy Wilson, Carol Y ^c  

^a SRI INTERNATIONAL   (United States)

^b HASKINS LABORATORIES   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC INFORMATION; ARTICULATORY GESTURES; DYNAMIC BAYESIAN NETWORK; HIDDEN VARIABLE; MICRO BEAMS; NOISY DATA; PHONE RECOGNITION; PROPOSED ARCHITECTURES; RECOGNITION SYSTEMS; ROBUST SPEECH RECOGNITION; SPATIO-TEMPORAL; SPEECH RECOGNITION ARCHITECTURES; UNIVERSITY OF WISCONSIN; VOCAL-TRACTS; WORD RECOGNITION;

EXPERIMENTS; SPEECH RECOGNITION;

INFORMATION USE;

EID: 84858964876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2011.6163918     Document Type: Conference Paper

References (34)

1. K. Kirchhoff, G. Fink, and G. Sagerer, "Combining acoustic and articulatory feature information for robust speech recognition", Speech Comm., vol. 37, pp. 303-319, 2000.
2. K. Kirchhoff, "Robust Speech Recognition Using Articulatory Information", PhD Thesis, University of Bielefeld, 1999.
3. M. Richardson, J. Bilmes and C. Diorio, "Hidden-articulator Markov models for speech recognition", Speech Comm., 41(2-3), pp. 511-529, 2003.
4. O. Schmidbauer, "Robust statistic modelling of systematic variabilities in continuous speech incorporating acoustic-articulatory relations", Proc. of ICASSP, pp. 616-619, 1989. (Pubitemid 20604192)
5. L. Deng, "A generalized hidden Markov model with state-conditioned trend functions of time for the speech signal", Sig. Proc., 27(1), pp. 65-78, 1992.
6. L. Deng and D. Sun, "A statistical approach to ASR using atomic units constructed from overlapping articulatory features", J. of Acoust. Soc. Am., 95, pp. 2702-2719, 1994. (Pubitemid 24152864)
7. K. Erler and L. Deng, "Hidden Markov model representation of quantized articulatory features for speech recognition", Comp., Speech & Lang., Vol. 7, pp. 265-282, 1993. (Pubitemid 23705305)
8. J. Frankel and S. King, "ASR - Articulatory Speech Recognition", Proc. of Eurospeech, pp. 599-602, Denmark, 2001.
9. J. Frankel, K. Richmond, S. King and P. Taylor, "An automatic speech recognition system using neural networks and linear dynamic models to recover and model articulatory traces", Proc. of ICSLP, Vol. 4, pp. 254-257, 2000.
10. K. Livescu, O. Cetin, M. Hasegawa-Johnson, S. King, C. Bartels, N. Borges, A. Kantor, P. Lal, L. Yung, A. Bezman, S. Dawson-Haggerty, B. Woods, J. Frankel, M. Magimai-Doss and K. Saenko, "Articulatory feature-based methods for acoustic and audio-visual speech recognition: Summary from the 2006 JHU Summer Workshop", Proc. of ICASSP, Vol. 4, pp. 621-624, 2007.
11. X. Zhuang, H. Nam, M. Hasegawa-Johnson, L. Goldstein and E. Saltzman, "Articulatory Phonological Code for Word Classification", Proc. of Interspeech, pp. 2763-2766, UK, 2009.
12. R. Daniloff and R. Hammarberg, "On defining coarticulation", J. of Phonetics, Vol. 1, pp. 239-248, 1973.
13. C. Browman and L. Goldstein, "Articulatory Gestures as Phonological Units", Phonology, 6: 201-251, 1989.
14. C. Browman and L. Goldstein, "Articulatory Phonology: An Overview", Phonetica, 49: 155-180, 1992.
15. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman and L. Goldstein, "Retrieving Tract Variables from Acoustics: a comparison of different Machine Learning strategies", IEEE J. of Selected Topics on Sig. Proc., Vol. 4(6), pp. 1027-1045, 2010.
16. P. Mermelstein, "Articulatory model for the study of speech production", J. Acoust. Soc. of Am., 53(4), pp. 1070-1082, 1973.
17. C. Browman and L. Goldstein, "Gestural specification using dynamically-defined articulatory structures", J. of Phonetics, Vol. 18, pp. 299-320, 1990.
18. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman and L. Goldstein, "Robust word recognition using articulatory trajectories and Gestures", Proc. of Interspeech, pp. 2038-2041, Japan, 2010.
19. H.G. Hirsch and D. Pearce, "The Aurora experimental framework for the performance evaluation of speech recognition systems under noisy conditions", In Proc. ISCA ITRW ASR2000, pp. 181-188, Paris, France, 2000.
20. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman and L. Goldstein, "Gesture-based Dynamic Bayesian Network for Noise robust Speech Recognition", Proc. of ICASSP, pp. 5172-5175, 2011.
21. ETSI ES 202 050 Ver. 1.1.5, (2007). Speech processing, transmission and quality aspects (STQ); distributed speech recognition; advanced frontend feature extraction algorithm; compression algorithms.
22. Westbury "X-ray microbeam speech production database user's handbook", Univ. of Wisconsin, 1994.
23. J. Yuan and M. Liberman, "Speaker identification on the SCOTUS corpus", J. Acoust. Soc. of Am., 123(5), pp. 3878, 2008.
24. H. Nam, V. Mitra, M. Tiede, E. Saltzman, L. Goldstein, C. Espy-Wilson and M. Hasegawa-Johnson, "A procedure for estimating gestural scores from natural speech", Proc. of Interspeech, pp. 30-33, Japan, 2010.
25. H. Nam, L. Goldstein, E. Saltzman and D. Byrd, "Tada: An enhanced, portable task dynamics model in matlab", J. Acoust. Soc. of Am., 115(5), 2, pp. 2430, 2004.
26. J. Bilmes, "GMTK: The Graphical Models Toolkit", SSLI Laboratory, Univ. of Washington, October 2002.
27. V. Mitra, I. Özbek, H. Nam, X. Zhou and C. Espy-Wilson, "From Acoustics to Vocal Tract Time Functions", Proc. of International Conference on Acoustics, Speech and Signal Processing, ICASSP, pp. 4497-4500, 2009.
28. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman and L. Goldstein, "Speech Inversion: Benefits of Tract Variables over Pellet Trajectories", Proc. of International Conference on Acoustics, Speech and Signal Processing, ICASSP, pp. 5188-5191, Prague, Czeck Rep., 2011.
29. X. Xiao, J. Li, E.S. Chng, H. Li and C. Lee, "A Study on the Generalization Capability of Acoustic Models for Robust Speech Recognition", IEEE Trans. Audio, Speech & Lang. Process, 18(6), pp. 1158-1169, 2010.
30. C. Chen and J. Bilmes, "MVA Processing of Speech Features", IEEE Trans. on Audio, Speech and Lang. Processing, 15(1), pp. 257-270, 2007.
31. http://portal.etsi.org/stq/kta/DSR/dsr.asp
32. X. Cui and A. Alwan, "Noise Robust Speech Recognition Using Feature Compensation Based on Polynomial Regression of Utterance SNR", IEEE Transs. on Speech and Audio Processing, Vol. 13(6), pp. 1161-1172, 2005. (Pubitemid 41605019)
33. M. Cooke, J. Barker, S. Cunningham and X. Shao, "An audio-visual corpus for speech perception and automatic speech recognition", Journal of Acoustic Society of America, Vol. 120, pp 2421-2424, 2006. (Pubitemid 44631681)
34. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, "Tract variables for noise robust speech recognition", IEEE Trans. on Audio, Speech and Language Processing, pp. 1913-1924, 2011