Statistical voice conversion techniques for body-conducted unvoiced speech enhancement

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 9, 2012, Pages 2505-2517

  Toda, Tomoki ^a   Nakagiri, Mikihiro ^b   Shikano, Kiyohiro ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b PANASONIC CORPORATION   (Japan)

Author keywords

body conducted unvoiced speech; nonaudible murmur; Silent speech; voice conversion; whispered voice

Indexed keywords

ACOUSTIC FEATURES; CONVERSION MODEL; EXPERIMENTAL EVALUATION; FUNDAMENTAL FREQUENCY CONTOUR; GAUSSIAN MIXTURE MODELS; NON-AUDIBLE MURMUR; SPEECH SOUNDS; STATISTICAL APPROACH; UNVOICED SPEECH; VOICE CONVERSION; VOICE CONVERSION TECHNIQUES;

DEGRADATION; MICROPHONES; SPEECH ENHANCEMENT; SPEECH INTELLIGIBILITY;

SPEECH RECOGNITION;

EID: 84865698185     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2205241     Document Type: Article

References (32)

1. B. Denby, T. Schultz, K. Honda, T. Hueber, J. M. Gilbert, and J. S. Brumberg, "Silent speech interfaces," Speech Commun., vol. 52, no. 4, pp. 270-287, 2010.
2. S.-C. Jou, T. Schultz, and A. Waibel, "Adaptation for soft whisper recognition using a throat microphone," in Proc. INTERSPEECH, Jeju Island, Korea, Sep. 2004, pp. 1493-1496.
3. T. Schultz and M. Wand, "Modeling coarticulation in EMG-based continuous speech recognition," Speech Commun., vol. 52, no. 4, pp. 341-353, 2010.
4. T. Hueber, E.-L. Benaroya, G. Chollet, B. Denby, G. Dreyfus, and M. Stone, "Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips," Speech Commun., vol. 52, no. 4, pp. 288-300, 2010.
5. A. Subramanya, Z. Zhang, Z. Liu, and A. Acero, "Multisensory processing for speech enhancement and magnitude-normalized spectra for speech modeling," Speech Commun., vol. 50, no. 3, pp. 228-243, 2008. (Pubitemid 351172472)
6. Y. Nakajima, H. Kashioka, N. Cambell, and K. Shikano, "Non-audible murmur (NAM) recognition," IEICE Trans. Inf. Syst., vol. E89-D, no. 1, pp. 1-8, 2006.
7. T. Hirahara, M. Otani, S. Shimizu, T. Toda, K. Nakamura, Y. Nakajima, and K. Shikano, "Silent-speech enhancement using body-conducted vocal-tract resonance signals," Speech Commun., vol. 52, no. 4, pp. 301-313, 2010.
8. T. Toda, K. Nakamura, T. Nagai, T. Kaino, Y. Nakajima, and K. Shikano, "Technologies for processing body-conducted speech detected with non-audible murmur microphone," in Proc. INTERSPEECH, Brighton, U.K., Sep. 2009, pp. 632-635.
9. P. Heracleous, V.-A. Tran, T. Nagai, and K. Shikano, "Analysis and recognition of NAMspeech using HMM distances and visual information," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1528-1538, Aug. 2010.
10. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol. 6, no. 2, pp. 131-142, Mar. 1998. (Pubitemid 128720639)
11. T. Toda, A. W. Black, and K. Tokuda, "Voice conversion based on maximum likelihood estimation of spectral parameter trajectory," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
12. T. Toda and K. Shikano, "NAM-to-speech conversion with Gaussian mixture models," in Proc. INTERSPEECH, Lisbon, Portugal, Sep. 2005, pp. 1957-1960. (Pubitemid 43908472)
13. M. Nakagiri, T. Toda, H. Saruwatari, and K. Shikano, "Improving body transmitted unvoiced speech with statistical voice conversion," in Proc. INTERSPEECH, Pittsburgh, PA, Sep. 2006, pp. 2270-2273.
14. T. Toda, K. Nakamura, H. Sekimoto, and K. Shikano, "Voice conversion for various types of body transmitted speech," in Proc. ICASSP, Taipei, Taiwan, Apr. 2009, pp. 3601-3604.
15. V.-A. Tran, G. Bailly, H. Loevenbruck, and T. Toda, "Improvement to a NAM-captured whisper-to-speech system," Speech Commun., vol. 52, no. 4, pp. 314-326, 2010.
16. Y. Nakajima, H. Kashioka, K. Shikano, and N. Campbell, "Remodeling of the sensor for non-audible murmur (NAM)," in Proc. INTERSPEECH, Lisbon, Portugal, Sep. 2005, pp. 389-392. (Pubitemid 43908081)
17. A. Kain and M. W. Macon, "Spectral voice conversion for text-to-speech synthesis," in Proc. ICASSP, Seattle, WA, May 1998, pp. 285-288.
18. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis," in Proc. ICASSP, Istanbul, Turkey, Jun. 2000, pp. 1315-1318.
19. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis," Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009.
20. T. Toda, A. W. Black, and K. Tokuda, "Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model," Speech Commun., vol. 50, no. 3, pp. 215-227, 2008. (Pubitemid 351172471)
21. H. Kawahara, J. Estill, and O. Fujimura, "Aperiodicity extraction and control using mixed mode excitation and group delay manipulation for a high quality speech analysis, modification and synthesis system STRAIGHT," in Proc. MAVEBA, Firenze, Italy, Sep. 2001.
22. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Maximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation," in Proc. INTERSPEECH, Pittsburgh, PA, Sep. 2006, pp. 2266-2269.
23. Y. Sagisaka, K. Takeda, M. Abe, S. Katagiri, T. Umeda, and H. Kuwabara, "A large-scale Japanese speech database," in Proc. ICSLP90, Kobe, Japan, Nov. 1990, pp. 1089-1092.
24. JNAS: Japanese Newspaper Article Sentences, [Online]. Available: http://www.milab.is.tsukuba.ac.jp/jnas/instruct.html
25. K. Tokuda, T. Kobayashi, T. Masuko, and S. Imai, "Mel-generalized cepstral analysis -A unified approach to speech spectral estimation," in Proc. ICSLP, Yokohama, Japan, Sep. 1994, pp. 1043-1045.
26. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigné, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, no. 3-4, pp. 187-207, 1999.
27. H. Kawahara, H. Katayose, A. de Cheveigné, and R. D. Patterson, "Fixed point analysis of frequency to instantaneous frequency mapping for accurate estimation of and periodicity," in Proc. EUROSPEECH, Budapest, Hungary, Sep. 1999, pp. 2781-2784.
28. T. Fukada, K. Tokuda, T. Kobayashi, and S. Imai, "An adaptive algorithm for mel-cepstral analysis of speech," in Proc. ICASSP, San Francisco, CA, Mar. 1992, vol. 1, pp. 137-140.
29. T. Muramatsu, Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Low-delay voice conversion based on maximum likelihood estimation of spectral parameter trajectory," in Proc. INTERSPEECH, Brisbane, Australia, Sep. 2008, pp. 1076-1079.
30. D. Miyamoto, K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "Acoustic compensation methods for body transmitted speech conversion," in Proc. ICASSP, Taipei, Taiwan, Apr. 2009, pp. 3901-3904.
31. T. Toda, Y. Ohtani, and K. Shikano, "One-to-many and many-to-one voice conversion based on eigenvoices," in Proc. ICASSP, Apr. 2007, pp. 1249-1252.
32. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Many-to-many eigenvoice conversion with reference voice," in Proc. INTERSPEECH, Brighton, U.K., Sep. 2009, pp. 1623-1626.