Voice conversion based on weighted frequency warping

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 5, 2010, Pages 922-931

  Erro, Daniel ^a   Moreno, Asunción ^b   Bonafonte, Antonio ^b  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^b UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Gaussian mixture models (GMMs); Harmonic plus stochastic model (HSM); Speech synthesis; Voice conversion; Weighted frequency warping

Indexed keywords

FREQUENCY WARPING; GAUSSIAN MIXTURE MODELS; GAUSSIAN MIXTURE MODELS (GMMS); HARMONIC PLUS STOCHASTIC MODEL (HSM); VOICE CONVERSION;

LINEAR TRANSFORMATIONS; PIECEWISE LINEAR TECHNIQUES; SPEECH SYNTHESIS; STOCHASTIC SYSTEMS; WEAVING;

STOCHASTIC MODELS;

EID: 77953727123     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2038663     Document Type: Article

References (35)

1. E. Moulines and Y. Sagisaka, Eds., "Voice conversion: State of the art and perspectives," Special Iss. Speech Commun., vol.16(2), 1995, Elsevier.
2. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1988, pp. 655-658.
3. K. Shikano, S. Nakamura, and M. Abe, "Speaker adaptation and voice conversion by codebook mapping," in Proc. IEEE Int. Symp. Circuits Syst., 1991, vol.1, pp. 594-597.
4. H. Mizuno and M. Abe, "Voice conversion based on piecewise linear conversion rules of formant frequency and spectrum tilt," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1994, vol.1, pp. 469-472.
5. L. M. Arslan, "Speaker transformation algorithm using segmental codebooks (STASC)," Speech Commun., no.28, 1999.
6. O. Turk and L. M. Arslan, "Robust processing techniques for voice conversion," Comput. Speech Lang., vol.20, no.4, pp. 441-467, 2006.
7. H. Valbret, E. Moulines, and J. P. Tubach, "Voice transformation using PSOLA technique," Speech Commun., vol.1, pp. 145-148, 1992.
8. D. Sündermann and H. Ney, "VTLN-based voice conversion," in Proc. IEEE Symp. Signal Process. Inf. Technol., 2003, pp. 556-559.
9. D. Rentzos, S. Vaseghi, Q. Yan, and C. H. Ho, "Voice conversion through transformation of spectral and intonation features," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2004, vol.1, pp. 21-24.
10. Z. W. Shuang, R. Bakis, S. Shechtman, D. Chazan, and Y. Qin, "Frequency warping based on mapping formant parameters," in Proc. Int. Conf. Spoken Lang. Process., 2006.
11. N. Iwahashi and Y. Sagisaka, "Speech spectrum transformation by speaker interpolation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1994, vol.1, pp. 461-464.
12. M. Narendranath, H. A. Murthy, S. Rajendran, and B. Yegnanarayana, "Transformation of formants for voice conversion using artificial neural networks," Speech Commun., vol.16, no.2, pp. 207-216, 1995.
13. Y. Stylianou, "Harmonic plus noise models for speech, combined with statistical methods, for speech and speaker modification," Ph.D. dissertation, École Nationale Superieure Des Télé communications, Paris, France, 1996.
14. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1998, vol.6, pp. 131-142.
15. A. Kain, "High resolution voice transformation," Ph.D. dissertation, OGI School of Sci. and Eng., Beaverton, OR, 2001.
16. D. Sündermann, H. Höge, A. Bonafonte, and H. Duxans, "Residual prediction," in Proc. IEEE Symp. Signal Process. Inf. Technol., 2005, pp. 512-516.
17. H. Ye and S. Young, "Quality-enhanced voice morphing using maximum likelihood transformations," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.4, pp. 1301-1312, Jul. 2006.
18. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Maximum likelihood voice conversion based on GMM with straight mixed excitation," in Proc. Interspeech, 2006.
19. A. del Pozo and S. Young, "The linear transformation of LF glottal waveforms for voice conversion," in Proc. Interspeech, 2008, pp. 1457-1460.
20. T. Toda, H. Saruwatari, and K. Shikano, "Voice conversion algorithm based on gaussian mixture model with dynamic frequency warping of straight spectrum," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2001, pp. 841-844.
21. T. Toda, A. W. Black, and K. Tokuda, "Spectral conversion based on maximum likelihood estimation considering global variance of converted parameter," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2005, vol.1, pp. 9-12.
22. T. Toda, A. W. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.8, pp. 2222-2235, Nov. 2007.
23. T. Masuko, K. Tokuda, T. Kobayashi, and S. Imai, "Speech synthesis usingHMMSwith dynamic features," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1996, pp. 389-392.
24. T. Masuko, K. Tokuda, T. Kobayashi, and S. Imai, "Voice characteristics conversion for HMM-based speech synthesis system," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1997, pp. 1611-1614.
25. J. Yamagishi, T. Kobayashi, Y. Nakano, K. Ogata, and J. Isogai, "Analysis of speaker adaptation algorithms for HMM-based speech synthesis and a constrained SMAPLR adaptation algorithm," IEEE Trans. Audio, Speech, Lang. Process., vol.17, no.1, pp. 66-83, Jan. 2009.
26. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis," Speech Commun., vol.51, no.11, pp. 1039-1064, 2009.
27. H. Zen, Y. Nankaku, and K. Tokuda, "Continuous stochastic feature mapping based on trajectory HMMs," in Proc. 2nd One Day Meeting on Unified Models for Speech Recognition and Synthesis, 2009.
28. D. Erro, "Intra-lingual and cross-lingual voice conversion using harmonic plus stochastic models," Ph.D. dissertation, Univ. Politècnica de Catalunya, Barcelona, Spain, 2008.
29. D. Erro and A. Moreno, "Weighted frequency warping for voice conversion," in Proc. Interspeech, 2007, pp. 1965-1968.
30. D. Erro, A. Moreno, and A. Bonafonte, "Flexible harmonic/stochastic speech synthesis," in Proc. 6th ISCA Workshop Speech Synth., 2007.
31. H. Duxans, D. Erro, J. Pérez, F. Diego, A. Bonafonte, and A. Moreno, "Voice conversion of non-aligned data using unit selection," in Proc. TC-STAR Workshop Speech to Speech Transl., 2006.
32. A. El-Jaroudi and J. Makhoul, "Discrete all-pole modeling," IEEE Trans. Signal Process., vol.39, no.2, pp. 411-423, Feb. 1991.
33. A. Bonafonte, H. Höge, I. Kiss, A. Moreno, U. Ziegenhain, H. van Den Heuvel, H. U. Hain, X. S.Wang, and M. N. Garcia, "TC-STAR: Specifications of language resources and evaluation for speech synthesis," in Proc. Int. Conf. Lang. Resources Eval., 2006.
34. A. Bonafonte, J. Adell, P. D. Agüero, D. Erro, I. Esquerra, A. Moreno, J. Pérez, and T. Polyakova, "The UPC TTS system description for the 2007 Blizzard Challenge," in Proc. 6th ISCA Workshop Speech Synth., 2007.
35. D. Mostefa, O. Hamon, N. Moreau, and K. Choukri, Evaluation report, deliverable D30 of the EU funded project TC-STAR 2007 [Online]. Available: http://www.tc-star.org