Voice conversion based on feature combination with limited training data

Speech Communication

Volumn 67, Issue , 2015, Pages 113-128

  Ghorbandoost, Mostafa ^a   Sayadiyan, Abolghasem ^a   Ahangar, Mohsen ^a   Sheikhzadeh, Hamid ^a   Shahrebabaki, Abdoreza Sabzi ^a   Amini, Jamal ^a  

^a AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Dynamic kernel partial least square regression (DKPLS); Feature combination; Gaussian mixture models (GMM); Voice conversion

Indexed keywords

LEAST SQUARES APPROXIMATIONS; POLES; QUALITY CONTROL; SPEECH RECOGNITION;

ACOUSTICAL CHARACTERISTICS; ANALYSIS/SYNTHESIS; FEATURE COMBINATION; GAUSSIAN MIXTURE MODEL; KERNEL PARTIAL LEAST SQUARE REGRESSIONS; LIMITED TRAINING DATA; VOICE CONVERSION; VOICE CONVERSION ALGORITHM;

SPEECH PROCESSING;

EID: 84919915933     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2014.12.004     Document Type: Article

References (39)

1. Ahangar, M., Ghorbandoost, M., Sheikhzadeh, H., Raahemifar, K., Shahrebabaki, A.S., Amini, J., 2013. Voice conversion based on state space model and considering global variance. In: IEEE Intl. Symp. Signal Processing and Information Technology (ISSPIT), pp. 000416-000421.
2. Amini, J., Shahrebabaki, A.S., Shokouhi, N., Sheikhzadeh, H., Raahemifar, K., Eslami, M., 2013. Speech analysis/synthesis by Gaussian mixture approximation of the speech spectrum for voice conversion. In: IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 000428-000433.
3. Arslan, L.M., 1999. Speaker transformation algorithm using segmental codebooks (STASC). Speech Commun. 28 (3), 211-226.
4. de Jong, S., 1993. SIMPLS: an alternative approach to partial least squares regression. Chemometr. Intell. Lab. Syst. 18 (3), 251-263.
5. Desai, S., Black, A.W., Yegnanarayana, B., Prahallad, K., 2010. Spectral mapping using artificial neural networks for voice conversion. IEEE Trans. Audio, Speech Lang. Process. 18 (5), 954-964.
6. Erro, D., 2008. Intra-lingual and Cross-lingual Voice Conversion using Harmonic Plus Stochastic Models. Barcelona, Spain: PhD Thesis, Universitat Politechnica de Catalunya, 2008.
7. Erro, D., Moreno, A., Bonafonte, A., 2010. Voice conversion based on weighted frequency warping. IEEE Trans. Audio, Speech Lang. Process. 18 (5), 922-931.
8. Erro, D., Navas, E., Hernaez, I., 2013. Parametric voice conversion based on bilinear frequency warping plus amplitude scaling. IEEE Trans. Audio, Speech Lang. Process. 21 (3), 556-566.
9. Hastie, T., Tibshirani, R., Friedman, J., Franklin, J., 2005. The elements of statistical learning: data mining, inference and prediction. Math. Intell. 27 (2), 83-85.
10. Helander, E., Nurminen, J., Gabbouj, M., 2008. LSF mapping for voice conversion with very small training sets. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2008, pp. 4669-4672.
11. Helander, E., Virtanen, T., Nurminen, J., Gabbouj, M., 2010. Voice conversion using partial least squares regression. IEEE Trans. Audio, Speech Lang. Process. 18 (5), 912-921.
12. Helander, E., Siln, H., Virtanen, T., Gabbouj, M., 2012. Voice conversion using dynamic kernel partial least squares regression. IEEE Trans. Audio, Speech Lang. Process. 20 (3), 806-817.
13. Itakura, F., 1975. Line spectrum representation of linear predictor coefficients of speech signals. J. Acoust. Soc. Am. 57 (S1), S35-S35.
14. Kain, A., Macon, M., 1998. Spectral voice conversion for text-to-speech synthesis. In: Proc. Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP1998), pp. 285-288.
15. Kawahara, H., Masuda-Katsuse, I., de Cheveigne, A., 1999. Restructuring speech representations using a pitch-adaptive time frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds. Speech Commun. 27 (3), 187-207.
16. Kominek, J., Black, A.W., 2004. The CMU Arctic speech databases. In: Fifth ISCA Workshop on Speech Synthesis.
17. Lee, C.H., Wu, C.H., 2006. Map-based adaptation for speech conversion using adaptation data selection and non-parallel training. In: Proc. Interspeech, 2006.
18. Lim, J., Oppenheim, A.V., 1988. Advanced Topics in Signal Processing. Prentice-Hall, Englewood Cliffs, NJ.
19. Ohtani, Y., Toda, T., Saruwatari, H., Shikano, K., 2006. Maximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation. In: Proc. Interspeech 2006, pp. 2266-2269.
20. Shahrebabaki, A.S., Amini, J., Sheikhzadeh, H., Ghorbandoost, M., Faraji, N., 2013. Reduced search space frame alignment based on Kullback-Leibler divergence for voice conversion. Advances in Nonlinear Speech Processing. Springer, Berlin Heidelberg, pp. 83-88.
21. Shuang, Z., Meng, F., Qin, Y., 2008. Voice conversion by combining frequency warping with unit selection. In: Proc. Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP2008), pp. 4661-4664.
22. Sndermann, D., Hge, H., Bonafonte, A., Ney, H., Hirschberg, J., 2006. Text-independent cross-language voice conversion. In: Proc. Interspeech, 2006.
23. Stylianou, I., 1996. Harmonic Plus Noise Models for Speech, Combined with Statistical Methods, for Speech and Speaker Modification. PhD Diss., Ecole Nationale Suprieure des Tcommunications.
24. Stylianou, Y., Capp, O., Moulines, E., 1998. Continuous probabilistic transform for voice conversion. IEEE Trans. Audio, Speech Lang. Process. 6 (2), 131-142.
25. Tao, J., Zhang, M., Nurminen, J., Tian, J., Wang, X., 2010. Supervisory data alignment for text-independent voice conversion. IEEE Trans. Audio, Speech Lang. Process. 18 (5), 932-943.
26. Toda, T., Black, A.W., Tokuda, K., 2005. Spectral conversion based on maximum likelihood estimation considering global variance of converted parameter. In: IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP2005), vol. 1, pp. 9-12.
27. Toda, T., Black, A.W., Tokuda, K., 2007. Voice conversion based on maximum likelihood estimation of spectral parameter trajectory. IEEE Trans. Audio, Speech Lang. Process. 15 (8), 2222-2235.
28. Toda, T., Nakagiri, M., Shikano, K., 2012. Statistical voice conversion techniques for body-conducted unvoiced speech enhancement. IEEE Trans. Audio, Speech Lang. Process. 20 (9), 2505-2517.
29. Tokuda, K., Kobayashi, T., Masuko, T., Imai, S., 1994. Mel-generalized cepstral analysis-a unified approach to speech spectral estimation. In: ICSLP, vol. 3, pp. 1043-1046.
30. Tokuda, K., Kobayashi, T., Imai, S., 1994. Recursive calculation of melcepstrum from LP coefficients. Trans. IEICE 71, 128-131.
31. Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., Kitamura, T., 2000. Speech parameter generation algorithms for HMM-based speech synthesis. In: Proc. Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP2000), vol. 3, pp. 1315-1318.
32. Unser, M., Aldroubi, A., Eden, M., 1993. B-spline signal processing. IEEE Trans. Signal Process. 41 (2), 821-848.
33. Wu, C.H., Hsia, C.C., Liu, T.H., Wang, J.F., 2006. Voice conversion using duration-embedded bi-HMMs for expressive speech synthesis. IEEE Trans. Audio, Speech Lang. Process. 14 (4), 1109-1116.
34. Wu, Z., Chng, E.S., Li, H., 2013. Conditional restricted boltzmann machine for voice conversion. In: Signal and Information Processing (ChinaSIP), pp. 104-108.
35. Yamamoto, K., Toda, T., Saruwatari, H., Shikano, K., 2012. Statistical approach to voice quality control in esophageal speech enhancement. In: IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP2012), pp. 4497-4500.
36. Ye, H., Young, S., 2004. Voice conversion for unknown speakers. In: Proc. Interspeech, 2004.
37. Ye, H., Young, S., 2006. Quality-enhanced voice morphing using maximum likelihood transformations. IEEE Trans. Audio Speech Lang. Process. 14.4, 1301-1312.
38. Zen, H., Toda, T., Tokuda, K., 2008. The Nitech-NAIST HMM-based speech synthesis system for the Blizzard Challenge. IEICE Trans. Inform. Syst. 91.6, 1764-1773.
39. Zen, H., Nankaku, Y., Tokuda, K., 2011. Continuous stochastic feature mapping based on trajectory HMMs. IEEE Trans. Audio, Speech Lang. Process. 19 (2), 417-430.