Improvement to a NAM-captured whisper-to-speech system

Speech Communication

Volumn 52, Issue 4, 2010, Pages 314-326

  Tran, Viet Anh ^a   Bailly, Gérard ^a   Lœvenbruck, Hélène ^a   Toda, Tomoki ^b  

^a GIPSA LAB   (France)

^b NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Audiovisual voice conversion; Non audible murmur; Silent speech interface; Whispered speech

Indexed keywords

COMPUTER-MEDIATED COMMUNICATION; DIMENSIONALITY REDUCTION; INPUT AND OUTPUTS; LINEAR DISCRIMINANT ANALYSIS; NON-AUDIBLE MURMUR; SPECTRAL ENVELOPES; SPEECH INTERFACE; SPEECH SYSTEMS; SUBJECTIVE EVALUATIONS; SUBJECTIVE TESTS; SYNTHESIZED SPEECH; TIME WINDOWS; UNVOICED SPEECH; VOICE CONVERSION; VOICED SEGMENT; VOICING DECISION; WHISPERED SPEECH;

DISCRIMINANT ANALYSIS; ESTIMATION; MAGNETOSTRICTIVE DEVICES; NEURAL NETWORKS; PRINCIPAL COMPONENT ANALYSIS; SPEECH COMMUNICATION; SPEECH RECOGNITION; VEHICLE ROUTING; WINDOWS;

SPEECH INTELLIGIBILITY;

EID: 76849105528     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.11.005     Document Type: Article

References (34)

1. Badin P., Bailly G., Revéret L., Baciu M., Segebarth C., and Savariaux C. Three-dimensional linear articulatory modeling of tongue, lips and face based on MRI and video images. J. Phonetics 30 3 (2002) 533-553
2. Bailly G., Bérar M., Elisei F., and Odisio M. Audiovisual speech synthesis. Internat. J. Speech Technol. 6 (2003) 331-346
3. Bailly, G., Bégault, A., Elisei, F., Badin, P., 2008. Speaking with Smile or Disgust: Data and Models. AVSP, Tangalooma, Australia, pp. 111-116.
4. Bett, B.J., Jorgensen, C., 2005. Small Vocabulary Recognition Using Surface Electromyography in an Acoustically Harsh Environment. NASA, Ames Research Center, Moffett Field, CA, p. 16.
5. Coleman, J., Grabe, E., Braun, B., 2002. Larynx movements and intonation in whispered speech. Summary of Research Supported by British Academy.
6. Cootes T.F., Edwards G.J., and Taylor C.J. Active appearance models. IEEE Trans. Pattern Anal. Machine Intell. 23 6 (2001) 681-685
7. Crevier-Buchman, L., Vincent, C., Hans, S., 2008. Comportements laryngés en voix chuchotée, étude en caméra ultra-rapide. In: Actes du 64ième Congrès de la Société Française de Phoniatrie et des Pathologies de la Communication, Paris, October 2008.
8. Heracleous, P., Nakajima, Y., Saruwatari, H., Shikano, K., 2005. A tissue-conductive acoustic sensor applied in speech recognition for privacy. In: Internat. Conf. on Smart Objects and Ambient Intelligence, Grenoble, France, pp. 93-98.
9. Higashikawa M., Nakai K., Sakakura A., and Takahashi H. Perceived pitch of whispered vowels - relationship with formant frequencies: a preliminary study. J. Voice 10 2 (1996) 155-158
10. Hueber, T., Aversano, G., Chollet, G., Denby, B., Dreyfus, G., Oussar, Y., Roussel, P., Stone, M., 2007a. EigenTongue feature extraction for an ultrasound-based silent speech interface. In: IEEE Internat. Conf. on Acoustics, Speech and Signal Processing, Honolulu, Hawaii, pp. 1245-1248.
11. Hueber, T., Chollet, G., Denby, B., Dreyfus, G., Stone, M., 2007b. Continuous-speech Phone Recognition from Ultrasound and Optical Images of the Tongue and Lips. InterSpeech, Antwerp, Belgium, pp. 658-661.
12. Hueber, T., Chollet, G., Denby, B., Stone, M., Zouari, L., 2007c. Ouisper: corpus-based synthesis driven by articulatory data. In: Internat. Cong. of Phonetic Sciences, Saarbrücken, Germany, pp. 2193-2196.
13. Hueber, T., Chollet, G., Denby, B., Dreyfus, G., Stone, M., 2008a. Towards a Segmental Vocoder Driven by Ultrasound and Optical Images of the Tongue and Lips. InterSpeech, Brisbane, Australia, pp. 2028-2031.
14. Hueber, T., Chollet, G., Denby, B., Dreyfus, G., Stone, M., 2008b. Phone Recognition from Ultrasound and Optical Video Sequences for a Silent Speech Interface. InterSpeech, Brisbane, Australia, pp. 2032-2035.
15. Inouye T., and Shimizu A. The electromyographic study of verbal hallucinations. J. Nerv. Mental Dis. 151 (1970) 415-422
16. Jorgensen, C., Binsted, K., 2005. Web browser control using EMG-based subvocal speech recognition. In: Proc. 38th Annual Hawaii Internat. Conf. on System Sciences (HICSS'05), Hawaii, p. 294c.
17. Jou, S.-C., Schultz, T., Walliczek, M., Kraft, F., Waibel, A., 2006. Towards Continuous Speech Recognition Using Surface Electromyography. InterSpeech, Pittsburgh, PE, pp. 573-576.
18. 0 extraction: Possible role of a repetitive structure in sounds. Speech Comm. 27 3-4 (1999) 187-207
19. Nakagiri, M., Toda, T., Kashioka, H., Shikano, K., 2006. Improving Body Transmitted Unvoiced Speech with Statistical Voice Conversion. InterSpeech, Pittsburgh, PE, pp. 2270-2273.
20. Nakajima, Y., Kashioka, H., Shikano, K., Campbell, N., 2003. Non-audible murmur recognition Input Interface using stethoscopic microphone attached to the skin. In: Internat. Conf. on Acoustics, Speech and Signal Processing, pp. 708-711.
21. Potamianos, G., Neti, C., Deligne, S., 2003. Joint Audiovisual Speech Processing for Recognition and Enhancement. Auditory-Visual Speech Processing, St Jorioz, France, pp. 95-104.
22. Revéret, L., Bailly, G., Badin, P., 2000. MOTHER: a new generation of talking heads providing a flexible articulatory control for video-realistic speech animation. In: Internat. Conf. on Speech and Language Processing, Beijing, China, pp. 755-758.
23. Sodoyer D., Girin L., Jutten C., and Schwartz J.-L. Developing an audio-visual speech source separation algorithm. Speech Comm. 44 1-4 (2004) 113-125
24. Summerfield Q. Use of visual information for phonetic perception. Phonetica 36 (1979) 314-331
25. Summerfield A., MacLeod A., McGrath M., and Brooke M. Lips, teeth, and the benefits of lipreading. In: Young A.W., and Ellis H.D. (Eds). Handbook of Research on Face Processing (1989), Elsevier Science Publishers, Amsterdam 223-233
26. Toda, T., Shikano, K., 2005. NAM-to-Speech Conversion with Gaussian Mixture Models. InterSpeech, Lisbon, Portugal, pp. 1957-1960.
27. Toda, T., Tokuda, K., 2005. Speech Parameter Generation Algorithm Considering Global Variance for HMM-based Speech Synthesis. InterSpeech, Lisbon, Portugal, pp. 2801-2804.
28. Toda, T., Nakamura, K., Sekimoto, H., Shikano, K., 2009. Voice conversion for various types of body transmitted speech. In: Proc. ICASSP. Taipei, Taiwan, pp. 3601-3604.
29. Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., Kitamura, T., 2000. Speech parameter generation algorithms for HMM-based speech synthesis. In: IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing. Istanbul, Turkey, pp. 1315-1318.
30. 0 and voicing from NAM-captured whispered speech. In: Proc. Speech Prosody. Campinas, Brazil, May.
31. Walliczek, M., Kraft, F., Jou, S.-C., Schultz, T., Waibel, A., 2006. Sub-word Unit Based Non-audible Speech Recognition Using Surface Electromyography. InterSpeech, Pittsburgh, PE, pp. 1487-1490.
32. Young S., Kershaw D., Odell J., Ollason D., Valtchev V., and Woodland P. The HTK Book (1999), Entropic Ltd., Cambridge, United Kingdom
33. Zen, H., Nose, T., Yamagishi, J., Sako, S., Masuko, T., Black, A., Tokuda, K., 2007. The HMM-based Speech Synthesis System Version 2.0. Speech Synthesis Workshop, Bonn, Germany, pp. 294-299.
34. Zeroual, C., Esling, J., Crevier-Buchman, L., 2005. Physiological Study of Whispered Speech in Moroccan Arabic. In: Proc. InterSpeech. Lisbon, pp. 1069-1072.