A procedure for estimating gestural scores from natural speech

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 30-33

  Nam, Hosung ^a   Mitra, Vikramjit ^b   Tiede, Mark ^a,c   Saltzman, Elliot ^a,d   Goldstein, Louis ^a,e   Espy Wilson, Carol ^b   Hasegawa Johnson, Mark ^f  

^a HASKINS LABORATORIES   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d BOSTON UNIVERSITY   (United States)

^e UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^f University of Illinois at Urbana Champaign   (United States)

Author keywords

Articulatory phonology; Gestures; TADA model; Time warping; Vocal tract variables; X ray microbeam data

Indexed keywords

SPEECH COMMUNICATION; SPEECH SYNTHESIS; VOCABULARY CONTROL; SPEECH RECOGNITION;

ARTICULATORY PHONOLOGY; GESTURES; MICRO BEAMS; TIME WARPING; VOCAL-TRACTS; APPLICATION MODELS; DYNAMICS MODELS; GESTURE; TASK DYNAMIC AND APPLICATION MODEL; TRACT VARIABLES; VOCAL TRACT VARIABLE; X-RAY MICROBEAM DATA; X-RAY MICROBEAMS;

SPEECH RECOGNITION; SPEECH COMMUNICATION;

EID: 79959846806     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. F.J. Huang, E. Cosatto and H.P. Graf, "Triphone based unit selection for concatenative visual speech synthesis", Proc. of ICASSP, Vol.2, pp.2037-2040, Orlando, FL, 2002.
2. C. Browman and L. Goldstein, "Articulatory Phonology: An Overview", Phonetica, 49: 155-180, 1992
3. E. Saltzman and K. Munhall, "A Dynamical Approach to Gestural Patterning in Speech Production", Ecological Psychology, 1(4), pp.332-382, 1989.
4. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, "Tract variables for noise robust speech recognition", under review IEEE Trans. on Audio, Speech and Language Processing.
5. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, Noise Robustness of Tract Variables and their Application to Speech Recognition, Proc. of Interspeech, pp. 2759-2762, 2009.
6. X. Zhuang, H. Nam, M. Hasegawa-Johnson, L. Goldstein and E. Saltzman, "Articulatory Phonological Code for Word Classification", Proc. of Interspeech, pp.2763-2766, UK, 2009.
7. H. Nam, L. Goldstein, E. Saltzman, and D. Byrd, "TADA: An enhanced, portable task dynamics model in MATLAB", J. Acoust. Soc. Am, Vol. 115, No.5, 2, pp. 2430, 2004.
8. H. Hanson and K. Stevens, "A quasiarticulatory approach to controlling acoustic source parameters in a Klatt-type formant synthesizer using HLsyn," J. Acoust. Soc. Am., 112, pp.1158-1182, 2002. (Pubitemid 35006671)
9. B.S. Atal, "Efficient coding of LPC parameters by temporal decomposition", Proc. of ICASSP, pp.81-84, 1983.
10. J.P. Sun, X. Jing and L. Deng, "Annotation and Use of Speech Production Corpus for Building Language-Universal Speech Recognizers", Proc. of International Symposium on Chinese Spoken Language Processing, Vol.3, pp.31-34, Beijing, 2000.
11. X. Zhuang, H. Nam, M. Hasegawa-Johnson, L. Goldstein and E. Saltzman, "The Entropy of Articulatory Phonological Code: Recognizing Gestures from Tract Variables", Proc. of Interspeech, Australia, pp. 1489-1492, 2008.
12. J. Tepperman, L. Goldstein, S. Lee and S. Narayanan, "Automatically rating pronunciation through articulatory phonology", Proc. of Interspeech, pp.2771-2774, 2009
13. J. Westbury "X-ray microbeam speech production database user's handbook", Univ. of Wisconsin, 1994.
14. J. Yuan and M. Liberman, "Speaker identification on the SCOTUS corpus," Proceedings of Acoustics, 2008.
15. H. Sakoe and S. Chiba, "Dynamic Programming Algorithm Optimization for Spoken Word Recognition", IEEE Trans. on Acoust., Speech & Signal Process., 26(1), pp.43-49, 1978. (Pubitemid 8601900)
16. L. Rabiner, A. Rosenberg and S. Levinson, "Considerations in Dynamic Time Warping Algorithms for Discrete Word Recognition", IEEE Trans. on ASSP., 26(6), pp.575-582, 1978. (Pubitemid 9437602)
17. T. M. Cover and J.A. Thomas, Elements of Information Theory, Wiley, New York, 1991.
18. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, L. Goldstein, "Estimating Gestures from Speech: a Neural Network approach", under 1st revision in the J. of Acoust. Soc. of Am.
19. E. Bresch, L. Goldstein and S. Narayanan, "An analysis-by-synthesis approach to modeling real-time MRI articulatory data using the Task Dynamic Application frame-work," 157th Meeting of the Acoustical Society of America, Portland, Oregon, May 2009.