Statistical mapping between articulatory and acoustic data for an ultrasound-based silent speech interface

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 593-596

  Hueber, Thomas ^a   Benaroya, Elie Laurent ^b   Denby, Bruce ^b,c   Chollet, Gérard ^d  

^a GIPSA LAB   (France)

^b PSL RESEARCH UNIVERSITY   (France)

^c SORBONNE UNIVERSITÉ   (France)

^d INSTITUT TELECOM   (France)

Author keywords

GMM; HMM; Multimodal; Silent speech interface; Statistical mapping; Ultrasound; Video

Indexed keywords

GMM; HMM; MULTI-MODAL; SPEECH INTERFACE; VIDEO;

HIDDEN MARKOV MODELS; NEURAL NETWORKS; SPEECH RECOGNITION; ULTRASONICS;

MAPPING;

EID: 84865772217     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Denby, B., Schultz, T., Honda, K., Hueber, T., et al., "Silent Speech Interfaces," Speech Communication, vol. 52, no. 4, pp. 270-287, 2010.
2. Nakajima, Y., Kashioka, H., Shikano, K., Campbell, N., "Nonaudible murmur recognition", in Proc. of Eurospeech, pp. 2601-2604, 2003.
3. Tran, V.-A., Bailly, G., Loevenbruck, H., Toda, T., "Improvement to a NAM-captured whisper-to-speech system", Speech Communication, vol. 52, no. 4, pp. 314-326, 2010.
4. Schultz, T., Wand, M., "Modeling coarticulation in EMG-based continuous speech recognition", Speech Communication, vol. 52, no. 4, pp. 341-353, 2010.
5. Jorgensen, C., Dusan, S. "Speech interfaces based upon surface electromyography", Speech Communication, vol. 52, no. 4, pp. 354-366, 2010.
6. Hueber, T., Benaroya, E.L., Chollet, G., Denby, B., Dreyfus, G., Stone, M., "Development of a Silent Speech Interface Driven by Ultrasound and Optical Images of the Tongue and Lips", Speech Communication, 52(4), pp. 288-300, 2010.
7. Hueber, T., Chollet, G., Denby, B., Dreyfus, G., Stone, M., "Towards a Segmental Vocoder Driven by Ultrasound and Optical Images of the Tongue and Lips", in Proc. of Interspeech, pp. 2028-2031, 2008.
8. Black, A. W., Lenzo, K., "Building voices in the Festival speech synthesis system", http://festvox.org/bsv, 2000.
9. Hueber, T., Chollet, G., Denby, B., Stone, M., "Acquisition of ultrasound, video and acoustic speech data for a silent-speech interface application", in Proc. of ISSP, pp. 365-369, 2008.
10. Hueber, T., Aversano, G., Chollet, G., Denby, B., Dreyfus, G., Oussar, Y., Roussel, P., Stone, M., "Eigentongue Feature Extraction for an Ultrasound-Based Silent Speech Interface", in Proc. of ICASSP, pp. I1245-I1248, 2007.
11. Stylianou, I., "Harmonic plus Noise Models for Speech, combined with Statistical Methods, for Speech and Speaker Modification," PhD thesis, Signal et Image, ENST Paris, Paris, 1990.
12. Kain, A., "High-resolution voice transformation," PhD thesis, OGI School of Science & Engineering, Oregon Health & Science University, 2001.
13. Young, S., Evermann, G., Hain, T., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P., The HTK Book, September 2005, http://htk.eng.cam.ac.uk/.
14. Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., Kitamura, T., "Speech parameter generation algorithms for HMM-based speech synthesis", in Proc. of ICASSP, pp. 1315-1318, 2000.
15. Imai, S., Sumita, K., Furuichi, C., "Mel Log Spectrum Approximation (MLSA) filter for speech synthesis", Electronics and Communications in Japan (Part I: Communications) 66, pp. 10-18, 1983.
16. Toda, T., Black, A.W., Tokuda, K., "Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model", Speech Communication vol. 50, no. 3, pp. 215-227, 2008.
17. Zen, H., Nankaku, Y., Tokuda, K., "Continuous Stochastic Feature Mapping Based on Trajectory HMMs", IEEE Trans. on Audio, Speech, and Language Processing, vol. 19, no. 2, pp. 417-430, 2011.
18. Hueber, T., Badin, P., Savariaux, C., Vilain, C., Bailly, G., "Differences in articulatory strategies between silent, whispered and normal speech ? a pilot study using electromagnetic articulography", in Proc. of ISSP, to appear, 2010.