Multimodal HMM-based NAM-to-speech conversion

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2009, Pages 656-659

  Tran, Viet Anh ^a   Bailly, Gérard ^a   Loevenbruck, Hélène ^a   Toda, Tomoki ^b  

^a GIPSA LAB   (France)

^b NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Audiovisual voice conversion; HMM based conversion; Non audible murmur; Silent speech interface; Whispered speech

Indexed keywords

DIRECT SIGNAL; FACIAL MOVEMENTS; MULTI-MODAL; NON-AUDIBLE MURMUR; OUTPUT SIGNAL; RECOGNITION RATES; SIGNAL MAPPING; SPECTRAL DISTORTIONS; SPEECH CONVERSION; SPEECH INTERFACE; SYNTHESIS PROCEDURE; SYNTHESIS TECHNIQUES; VOICE CONVERSION; WHISPERED SPEECH;

HIDDEN MARKOV MODELS; LINGUISTICS; SPEECH COMMUNICATION; SPEECH INTELLIGIBILITY;

SPEECH RECOGNITION;

EID: 70450186861     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Toda, T. and Shikano, K., "NAM-to-Speech Conversion with Gaussian Mixture Models". InterSpeech, Lisbon - Portugal, 1957-1960, 2005.
2. Nakajima, Y., Kashioka, H., Shikano, K. and Campbell, N. (2003). "Non-audible murmur recognition Input Interface using stethoscopic microphone attached to the skin". International Conference on Acoustics, Speech and Signal Processing, 708-711.
3. Toda, T., Black A.W., Tokuda K., "Acoustic-to-Articulatory Inversion Mapping with Gaussian Mixture Model", ICSLP, 2004.
4. Hueber, T., Aversano, G., Chollet, G., Denby, B., Dreyfus, G., Oussar, Y., Roussel, P. and Stone, M., "EigenTongue feature extraction for an ultrasound-based silent speech interface". IEEE International Conference on Acoustics, Speech and Signal Processing, Honolulu, Hawaii, 1245-1248, 2007.
5. Hueber, T., Chollet, G., Denby, B., Dreyfus, G. and Stone, M., "Visual phone recognition for an ultrasound-based silent speech interface". Interspeech, Brisbane, Australia, 2008.
6. Tran, V-A., Bailly, G., Loevenbruck, H. and Toda, T., "Improvement to a NAM captured whisper-to-speech system", Interspeech, 1465-1468, 2008.
7. Heracleous, P., Beautemps, D., Tran, V.-A., Loevenbruck, H., Bailly, G., "Exploiting visual information for NAM recognition", IEICE Electronics Express, 6(2): 77-82, 2009.
8. Jorgensen, C. and Binsted, K., "Web browser control using EMG-based subvocal speech recognition". Proceedings of the 38th Annual Hawaii International Conference on System Sciences, Hawaii, 294c, 2005.
9. Jou, S.-C., Schultz, T., Walliczek, M., Kraft, F. and Waibel, A., "Towards continuous speech recognition using surface electromyography" . InterSpeech, Pittsburgh, PE, 573-576, 2006.
10. Stylianou, Y., Cappé, O. and Moulines, E., "Continuous probabilistic transform for voice conversion", IEEE Transactions on Speech and Audio Processing, 6(2), 131-142, 1998.
11. Kain, A. and Macon M.W., "Spectral voice conversion for text-to-speech synthesis", ICASSP, Seattle, 285-288, 1998.
12. Coleman, J., E. Grabe and Braun, B., "Larynx movements and intonation in whispered speech". Summary of research supported by British Academy (2002).
13. Heracleous, P., Kaino T., Saruwatari, H., Shikano, K., "Investigating the Role of the Lombard Reflex in Non-Audible Murmur (NAM) Recognition", in Proceedings of Interspeech2005 -EUROSPEECH, pp. 2649-2652, 2005.
14. Revéret, L., Bailly, G. and Badin, P., "MOTHER: a new generation of talking heads providing a flexible articulatory control for video-realistic speech animation". International Conference on Speech and Language Processing, Beijing, China, 755-758, 2000.
15. Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T. and Kitamura, T., "Speech parameter generation algorithms for HMM-based speech synthesis". ICASSP,Turkey, 1315-1318, 2000.
16. Young, S., Kershaw, D., Odell, J., Ollason, D., Valtchev, V. and Woodland, P., "The HTK Book". Cambridge, United Kingdom, Entropic Ltd, 1999.
17. Zen, H., Nose, T., Yamagishi, J., Sako, S., Masuko, T., Black, A. and Tokuda, K., "The HMM-based speech synthesis system version 2.0". Speech Synthesis Workshop, Bonn, Germany, 294-299, 2007.
18. Kawahara, H., Masuda-Katsuse, I. and Cheveigné, A. de, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds." Speech Communication 27(3-4): 187-207, 1999.
19. Toda, T. and Tokuda, K., "Speech parameter generation algorithm considering global variance for HMM-based speech synthesis". Interspeech, Lisbon, Portugal, 2801-2804, 2005.