Alaryngeal speech enhancement based on one-to-many eigenvoice conversion

IEEE Transactions on Audio, Speech and Language Processing

Volumn 22, Issue 1, 2014, Pages 172-183

  Doi, Hironori ^a   Toda, Tomoki ^a   Nakamura, Keigo ^b   Saruwatari, Hiroshi ^a   Shikano, Kiyohiro ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b RAKUTEN INC   (Japan)

Author keywords

Alaryngeal speech; Eigenvoice conversion; Laryngectomees; Speech enhancement; Voice conversion

Indexed keywords

HANDICAPPED PERSONS; SPEECH ENHANCEMENT; SPEECH PRODUCTION AIDS; SPEECH PROCESSING;

ALARYNGEAL SPEECH; CONVERSION MODEL; EIGENVOICES; ELECTROLARYNGEAL SPEECH; ESOPHAGEAL SPEECH; LARYNGECTOMEES; SPEECH QUALITY; VOICE CONVERSION;

SPEECH;

EID: 84897939966     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2013.2286917     Document Type: Article

References (29)

1. K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "Evaluation of extremely small sound source signals used in speaking-aid system with statistical voice conversion," IEICE Trans. Inf. Syst., vol. E93-D, no. 7, pp. 1909-1917, Jul. 2010.
2. Y. Nakajima, H. Kashioka, N. Campbell, and K. Shikano, "Non-Audible Murmur (NAM) recognition," IEICE Trans. Inf. Syst., vol. E89-D, no. 1, pp. 1-8, Jan. 2006.
3. K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "The use of air-pressure sensor in electrolaryngeal speech enhancement based on statistical voice conversion," in Proc. Interspeech, Sep. 2010, pp. 1628-1631.
4. A. Hisada and H. Sawada, "Real-time clarification of esophageal speech using a comb filter," in Proc. ICDVRAT, Sep. 2002, pp. 39-46.
5. K. Matsui, N. Hara, N. Kobayashi, and H. Hirose, "Enhancement of esophageal speech using formant synthesis," in Proc. ICASSP, May 1999, pp. 1831-1834.
6. H. R. Sharifzadeh, I. V. McLoughlin, and F. Ahmadi, "Reconstruction of normal sounding speech for laryngectomy patients through a modified CELP codec," IEEE Trans. Biomed. Eng., vol. 57, no. 10, pp. 2448-2458, Oct. 2010.
7. H. Liu, Q. Zhao, M. Wan, and S. Wang, "Enhancement of electrolarynx speech based on auditory masking," IEEE Trans. Biomed. Eng., vol. 53, no. 5, pp. 865-874, May 2006. (Pubitemid 43667746)
8. G. Aguilar-Torres, M. Nakano-Miyatake, and H. Perez-Meana, "Enhancement and restoration of alaryngeal speech signals," in Proc. 16th IEEE Int. Conf. Electron., Commun. Comput. (CONIELECOMP '06), Feb. 2006, p. 30.
9. H. Doi, K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "An evaluation of alaryngeal speech enhancement methods based on voice conversion techniques," in Proc. ICASSP, May 2011, pp. 5136-5139.
10. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," J. Acoust. Soc. Jpn. (E), vol. 11, no. 2, pp. 71-76, 1990.
11. Y. Stylianou, O. Cappe, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol. 6, no. 2, pp. 131-142, Mar. 1998. (Pubitemid 128720639)
12. T. Toda, Y. Ohtani, and K. Shikano, "One-to-many and many-to-one voice conversion based on eigenvoices," in Proc. ICASSP, Apr. 2007, pp. 1249-1252.
13. H. Doi, K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "Esophageal speech enhancement based on statistical voice conversion with Gaussian mixture models," IEICE Trans. Inf. Syst., vol. E93-D, no. 9, pp. 2472-2482, Sep. 2010.
14. H. Kawahara, H. Katayose, A. Cheveigne, and R. D. Patterson, "Fixed point analysis of frequency to instantaneous frequency mapping for accurate estimation of and periodicity," in Proc. EUROSPEECH, Sep. 1999, pp. 2781-2784.
15. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Maximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation,"Interspeech '06-ICSLP, pp. 2266-2269, Sep. 2006.
16. H. Kawahara, J. Estill, and O. Fujimura, "Aperiodicity extraction and control using mixed mode excitation and group delay manipulation for a high quality speech analysis, modification and system straight," in Proc. MAVEBA, Sep. 2001.
17. H. Kawahara, I. Masuda-Katsuse, and A. Cheveigne, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, no. 3-4, pp. 187-207, Apr. 1999.
18. T. Hirahara, M. Otani, S. Shimizu, T. Toda, and K. Nakamura, "Silent-speech enhancement using body-conducted vocal-tract resonance signals,"Speech Commun., vol. 52, no. 4, pp. 301-313, Apr. 2010.
19. T. Toda, A.W. Black, and K. Tokuda, "Voice conversion based on maximum likelihood estimation of spectral parameter trajectory," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
20. A. Kain and M. W. Macon, "Spectral voice conversion for text-to-speech synthesis," in Proc. ICASSP, May 1998, pp. 285-288.
21. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis,"in Proc. ICASSP, Jun. 2000, pp. 1315-1318.
22. R. Kuhn, J. Junqua, P. Nguyen, and N. Niedzielski, "Rapid speaker adaptation in eigenvoice space," IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 695-707, Nov. 2000. (Pubitemid 32025317)
23. B. Milner and X. Shao, "Prediction of fundamental frequency and voicing from mel-frequency cepstral coefficients for unconstrained speech reconstruction," IEEE Trans. Speech Audio Process., vol. 15, no. 1, pp. 24-33, Dec. 2007.
24. J. Darch, B. Milner, and S. Vaseghi, "Analysis and prediction of acoustic speech features from mel-frequency cepstral coefficients in distributed speech recognition architectures," J. Acoust. Soc. Amer., vol. 124, no. 6, pp. 3989-4000, Dec. 2008.
25. T. Toda, A. W. Black, and K. Tokuda, "Statistical mapping between articulatory movements and acoustic spectrum with a Gaussian mixture model," Speech Commun., vol. 50, no. 3, pp. 215-227, Mar. 2008. (Pubitemid 351172471)
26. T. Toda, M. Nakagiri, and K. Shikano, "Statistical voice conversion techniques for body-conducted unvoiced speech enhancement," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 9, pp. 2505-2517, Sep. 2012.
27. T. Anastasakos, J. McDonough, S. R. Schwartz, and J. Makhoul, "A compact model for speaker-adaptive training," in Proc. ICSLP, 1996, vol. 2, pp. 1137-1140.
28. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Adaptive training for voice conversion based on eigenvoices," IEICE Trans. Inf. Syst., vol. E93-D, no. 6, pp. 1589-1598, Jun. 2010.
29. K. Tokuda, T. Kobayashi, T. Masuko, and S. Imai, "Mel-generalized cepstral analysis - a unified approach to speech spectral estimation," in Proc. ICSLP, Sep. 1994, pp. 1043-1045.