Visuo-phonetic decoding using multi-stream and context-dependent models for an ultrasound-based silent speech interface

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2009, Pages 640-643

  Hueber, Thomas ^a,c   Benaroya, Elie Laurent ^a   Chollet, Gérard ^c   Denby, Bruce ^a,b   Dreyfus, Gérard ^a   Stone, Maureen ^d  

^a PSL RESEARCH UNIVERSITY   (France)

^b SORBONNE UNIVERSITÉ   (France)

^c INSTITUT TELECOM   (France)

^d UNIVERSITY OF MARYLAND DENTAL SCHOOL   (United States)

Author keywords

Multi stream modeling; Silent speech interface; Visual speech recognition

Indexed keywords

BASELINE SYSTEMS; CONTEXT DEPENDENT; CONTEXT INDEPENDENT; CRITICAL STEPS; DECODING PERFORMANCE; FEATURE EXTRACTION TECHNIQUES; LINGUISTIC CONSTRAINTS; MULTI-STREAM; MULTI-STREAM HIDDEN MARKOV MODEL; NEW APPROACHES; OPTICAL OBSERVATIONS; SPEECH DATABASE; SPEECH INTERFACE; SPEECH SIGNALS; VISUAL FEATURE; VISUAL SPEECH RECOGNITION;

ACOUSTIC WAVES; DATABASE SYSTEMS; DECODING; FEATURE EXTRACTION; HIDDEN MARKOV MODELS; HYDRAULICS; LINGUISTICS; SPEECH COMMUNICATION; ULTRASONIC IMAGING; ULTRASONICS;

SPEECH RECOGNITION;

EID: 70450206214     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Nakajima, Y., Kashioka, H., Shikano, K., Campbell, N., "Non-audible murmur recognition", Proc. of Eurospeech, pp. 2601-2604, 2003.
2. Tran V.-A., Bailly G., Loevenbruck H., Jutten C., "Improvement to a NAM captured whisper-to-speech system", Interspeech, Brisbane, Australia, pp. 1465-1498, 2008.
3. Maier-Hein, L., Metze, F., Schultz, T., Waibel, A., "Session independent non-audible speech recognition using surface electromyography", IEEE Workshop on Automatic Speech Recognition and Understanding, pp. 331-336, 2005.
4. Fagan, M.J., Ell, S.R, Gilbert, J.M., Sarrazin, E., Chapman, P.M., 2008. Development of a (silent) speech recognition system for patients following laryngectomy. Medical Engineering & Physics, vol. 30, issue 4, pp. 419-425.
5. Denby, B., Oussar, Y., Dreyfus, G., Stone, M., "Prospects for a Silent Speech Interface Using Ultrasound Imaging", IEEE ICASSP, Toulouse, France, pp. I365-I368, 2006.
6. Hueber, T., Chollet, G., Denby, B., Dreyfus, G., Stone, M., "Towards a Segmental Vocoder Driven by Ultrasound and Optical Images of the Tongue and Lips", Interspeech, pp. 2028-2031, Brisbane, Australia, 2008.
7. Stone, M., and Davis, E., "A Head and Transducer Support System for Making Ultrasound Images of Tongue/Jaw Movement", Journal of the Acoustical Society of America, vol. 98 (6), pp. 3107-3112, 1995.
8. Black, A. W., Lenzo, K., "Building voices in the Festival speech synthesis system", http://festvox.org/bsv, 2000.
9. Y. Yu and S. T. Acton, "Speckle Reducing Anisotropic Diffusion", IEEE Trans. on Image Proc., vol. 11, pp. 1260-1270, 2002.
10. Lucey, P., Potamianos, G., "Lipreading using profile versus frontal views", in Proc. IEEE MMSP'06, Canada, pp. 24-28, 2006.
11. Hueber, T., Aversano, G., Chollet, G., Denby, B., Dreyfus, G., Oussar, Y., Roussel, P., Stone, M., "Eigentongue Feature Extraction for an Ultrasound-Based Silent Speech Interface", IEEE ICASSP, Honolulu, pp. I1245-I1248, 2007.
12. Young, S., Evermann, G., Hain, T., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P., The HTK Book, September 2005, http://htk.eng.cam.ac.uk/.
13. Efron, B., "Nonparametric Estimates of Standard Error: The Jackknife, the Bootstrap and Other Methods", Biometrika, vol. 68, pp. 589-599, 1981.
14. Young, S. J., Odell, J. J., Woodland, P. C. "Tree-based state tying for high accuracy acoustic modeling", In Proc. of the Workshop on Human Language Technology, pp. 307-312, 1994.
15. Browman, C. P., Goldstein, L., "Gestural specification using dynamically-defined articulatory structures", Journal of Phonetics, 18, pp. 299-320, 1990.
16. Potamianos, G., Neti, C., Luettin, J., Matthews, I., "Audio-Visual Automatic Speech Recognition: An Overview". In: Issues in Visual and Audio-Visual Speech Processing, G. Bailly, E. Vatikiotis-Bateson, and P. Perrier (Eds.), MIT Press, 2004.
17. Bourlard, H., Dupont, S., "A new ASR approach based on independent processing and recombination of partial frequency bands", In Proc. ICSLP, pp. 426-429, 1996.
18. Livescu, K., Glass, J., "Feature-based pronunciation modeling for speech recognition", in Proc. HLT/NAACL, 2004.