Voice conversion using dynamic kernel partial least squares regression

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 3, 2012, Pages 806-817

  Helander, Elina ^a   Silen, Hanna ^a   Virtanen, Tuomas ^a   Gabbouj, Moncef ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Kernel methods; partial least squares regression; voice conversion

Indexed keywords

APERIODICITY; AUXILIARY INFORMATION; CONVERSION FUNCTION; GAUSSIANS; KERNEL METHODS; KERNEL PARTIAL LEAST SQUARES; NONLINEAR MODELING; PARTIAL LEAST SQUARES REGRESSION; SIMPLE AND EFFICIENT ALGORITHMS; SOURCE FEATURES; SPECTRAL FEATURE; SPEECH FEATURES; VOICE CONVERSION; VOICE CONVERSION ALGORITHM;

ALGORITHMS; DYNAMICS; LINEAR TRANSFORMATIONS; MATHEMATICAL TRANSFORMATIONS; REGRESSION ANALYSIS;

SPEECH PROCESSING;

EID: 84856141218     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2165944     Document Type: Article

References (33)

1. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, New York, Apr. 1988, pp. 565-568.
2. S. Desai, A. Black, B. Yegnanarayana, and K. Prahallad, "Spectral mapping using artificial neural networks for voice conversion," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 5, pp. 954-964, Jul. 2010.
3. H. Valbret, E. Moulines, and J. Tubach, "Voice transformation using PSOLA technique," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, Mar. 1992, vol. 1, pp. 145-148.
4. L. Arslan, "Speaker transformation algorithm using segmental codebooks (STASC)," Speech Commun., vol. 28, no. 3, pp. 211-226, Jun. 1999.
5. E. Helander, H. Silen, J. Miguez, and M. Gabbouj, "Maximum a posteriori voice conversion using sequential Monte Carlo methods," in Proc. Interspeech, Sep. 2010, pp. 1716-1719.
6. Y. Stylianou, O. Cappe, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol. 6, no. 2, pp. 131-142, Mar. 1998. (Pubitemid 128720639)
7. A. Kain and M. W. Macon, "Spectral voice conversion for text-tospeech synthesis," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Seattle, WA, May 1998, vol. 1, pp. 285-288.
8. E. Helander, T.Virtanen, J. Nurminen, and M. Gabbouj, "Voice conversion using partial least squares regression," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 5, pp. 912-921, Jul. 2010.
9. T. Toda, A. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
10. K. Tokuda, H. Zen, and A. W. Black, "An HMM-based speech synthesis system applied to English," in Proc. IEEE Workshop Speech Synth., Sep. 2002, pp. 227-230.
11. T. Toda, Y. Ohtani, and K. Shikano, "One-to-many and many-to-one voice conversion based on eigenvoices," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Apr. 2007, vol. 4, pp. IV-1249-IV-1252. (Pubitemid 47178603)
12. Y. Chen, M. Chu, E. Chang, J. Liu, and R. Liu, "Voice conversion with smoothedGMM and MAP adaptation," in Proc. Eurospeech, 2003, pp. 2413-2416.
13. D. Erro, A. Moreno, and A. Bonafonte, "Voice conversion based on weighted frequency warping," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 5, pp. 922-931, Jul. 2010.
14. M. J. Embrechts and B. Szymanski, Computationally Intelligent Hybrid Systems. New York: Wiley, 2005, ch. Introduction to Scientific Data Mining: Direct Kernel Methods & Applications, pp. 317-365.
15. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigné, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and a instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, no. 3-4, pp. 187-207, Apr. 1999.
16. J. Yamagishi, B. Usabaev, S. King, O.Watts, J. Dines, J. Tian, Y. Guan, R. Hu, K. Oura, Y.-J. Wu, K. Tokuda, R. Karhila, and M. Kurimo, "Thousands of voices for HMM-based speech synthesis-Analysis and application of TTS systems built on various ASR corpora," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 5, pp. 984-1004, Jul. 2010.
17. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Upper Saddle River, NJ: Prentice-Hall, 1993.
18. F. Camastra and A.Verri, "A novel kernel method for clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 801-804, May 2005.
19. B. Schölkopf, A. J. Smola, and K.-R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, 1998. (Pubitemid 128463674)
20. K. P. Bennett and M. J. Embrechts, Advances in Learning Theory: Methods, Models and Applications, ser. NATO Science Series. Series III: Computer and Systems Sciences. Amsterdam, The Netherlands: IOS Press, 2003, vol. 190, ch. An Optimization Perspective on Kernel Partial Least Squares Regression, pp. 227-250.
21. S. de Jong, "SIMPLS: An alternative approach to partial least squares regression," Chemometrics Intell. Lab. Syst., vol. 18, no. 3, pp. 251-263, Mar. 1993.
22. R. Rosipal and L. Trejo, "Kernel partial least squares regression in reproducing kernel Hilbert space," J. Mach. Learn. Res., vol. 2, pp. 97-123, Dec. 2001.
23. H. Zen, T. Toda, M. Nakamura, and K. Tokuda, "Details of the Nitech HMM-based speech synthesis system for the Blizzard challenge 2005," IEICE Trans. Inf. Syst., vol. E90-D, no. 1, pp. 325-333, Jan. 2007. (Pubitemid 46145336)
24. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Maximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation," in Proc. Interspeech, 2006, pp. 2266-2269.
25. K. Koishida, K. Tokuda, T. Kobayashi, and S. Imai, "CELP coding based on mel-cepstral analysis," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., May 1995, vol. 1, pp. 33-36.
26. O. Turk and L. Arslan, "Robust processing techniques for voice conversion," Comput. Speech Lang., vol. 4, no. 20, pp. 441-467, Oct. 2006. (Pubitemid 44150541)
27. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Mixed excitation for HMM-based speech synthesis," in Proc. Eurospeech, 2001, pp. 2263-2266.
28. K. Yutani, Y. Uto, Y. Nankaku, A. Lee, and K. Tokuda, "Voice conversion based on simultaneous modeling of spectrum and F0," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., May 2009, pp. 3897-3900.
29. E. Helander and J. Nurminen, "A novel method for prosody prediction in voice conversion," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Apr. 2007, vol. 4, pp. IV-509-IV-512. (Pubitemid 47178423)
30. D. Chapell and J. Hansen, "Speaker-specific pitch contour modelling and modification," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Seattle, WA, May 1998, pp. 885-888.
31. A. Kain, "CLSU: Voices," in Linguistic Data Consortium, Philadelphia, PA, 2006.
32. D. Reynolds and R. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. Speech Audio Process., vol. 3, no. 1, pp. 72-83, Jan. 1995.
33. M. Farrus, M. Wagner, D. Erro, and J. Hernando, "Automatic speaker recognition as a measurement of voice imitation and conversion," Int. J. Speech Lang. Law, vol. 17, no. 1, 2010.