Recognition and real time performances of a lightweight ultrasound based silent speech interface employing a language model

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 1005-1008

  Cai, Jun ^a,b   Denby, Bruce ^a,b   Roussel, Pierre ^b   Dreyfus, Gérard ^b   Crevier Buchman, Lise ^b  

^a SORBONNE UNIVERSITÉ   (France)

^b CNRS   (France)

Author keywords

Silent speech interface; Ultrasound imaging; Visual speech recognition; Vocal tract imaging

Indexed keywords

ACQUISITION DEVICE; LANGUAGE MODEL; REAL TIME PERFORMANCE; REAL-TIME TEST; SPEECH INTERFACE; ULTRASOUND IMAGING; VISUAL FEATURE EXTRACTION; VISUAL SPEECH; VISUAL SPEECH RECOGNITION; VOCAL-TRACTS;

COMPUTATIONAL LINGUISTICS; ULTRASONIC IMAGING; ULTRASONICS;

SPEECH RECOGNITION;

EID: 84865737746     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Denby, B., Schultz, T., Honda, K., et al., "Silent Speech Interfaces", Speech Communication, 52(4): 270-287, Apr. 2010.
2. Young, S., Evermann, G., Gales, M., et al., "The HTK Book", Online: http://htk.eng.cam.ac.uk/docs/docs.shtml, accessed on 15 Apr. 2010.
3. Hueber, T., Benaroya, E. L., Chollet, G., et al., "Development of a Silent Speech Interface Driven by Ultrasound and Optical Images of the Tongue and Lips", Speech Communication, 52(4): 288-300, Apr. 2010.
4. Hueber, T., Chollet, G., Denby, B., et al., "Visuo-Phonetic Decoding Using Multi-Stream and Context-Dependent Models for an Ultrasound-based Silent Speech Interface", Proc. INTERSPEECH 2009: 640-643, UK, Sept. 2009.
5. Hueber, T., Chollet, G., Denby, B., et al., "Towards a Segmental Vocoder Driven by Ultrasound and Optical Images of the Tongue and Lips", Proc. INTERSPEECH 2008: 2028-2031, Australia, Sept. 2008.
6. Hueber, T., Chollet, G., Denby, B., et al., "Phone Recognition from Ultrasound and Optical Video Sequences for a Silent Speech Interface", Proc. INTERSPEECH 2008: 2032-2035, Australia, Sept. 2008.
7. Hueber, T., "Reconstitution de la Parole par Imagerie Ultrasonore et Vidéo de l'Appareil Vocal: vers Une Communication Parlée Silencieuse", Doctorate Thesis, Université Pierre et Marie Curie, Dec. 2009.
8. Lee, A., Kawahara, T. and Shikano, K., "Julius - An Open Source Real-time Large Vocabulary Recognition Engine", Proc. EUROSPEECH 2001: 1691-1694, Denmark, Sept. 2001.
9. Hueber, T., Chollet, G., Denby, B., et al., "Acquisition of Ultrasound, Video and Acoustic Speech Data for a Silent-speech Interface Application", Proc. International Seminar on Speech Production: 365-369, Strasbourg, France, Dec. 2008.
10. Garofolo, J. S., Lamel, L. F., Fisher, W. M., et al., "TIMIT Acoustic-Phonetic Continuous Speech Corpus", Online: http://www.ldc.upenn. edu/Catalog/CatalogEntry.jsp?catalogId=LDC93S1, accessed on 22 Mar. 2011.
11. Garofalo, J., Graff, D., Paul, D., et al., "CSR-I (WSJ0) Complete", Online: http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp? catalogId=LDC93S6A, accessed on 22 Mar. 2011.
12. Graff, D., Cieri, C., "English Gigaword", Online: http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2003T05, accessed on 22 Mar. 2011.
13. Cai, J., Denby, B., "Transcripts of English Test Corpora", Online: http://ftp.espci.fr/shadow/SSI-Test/, accessed on 22 Mar. 2011.
14. Hueber, T., Aversano, G., Chollet, G., et al., "Eigentongue Feature Extraction for an Ultrasound-based Silent Speech Interface", Proc. of ICASSP 2007: 1245-1248, Honolulu, USA, Apr. 2007.
15. Rao, K. R. and Yip, P., "Discrete Cosine Transform: Algorithms, Advantages, Applications", Academic Press, Boston, 1990.