An Automatic Voice Conversion Evaluation Strategy Based on Perceptual Background Noise Distortion and Speaker Similarity

9th ISCA Speech Synthesis Workshop, SSW 2016

Volumn , Issue , 2016, Pages 44-51

  Huang, Dong Yan ^a   Xie, Lei ^b   Lee, Yvonne Siu Wa ^a   Wu, Jie ^b   Ming, Huaiping ^a   Tian, Xiaohai ^c   Zhang, Shaofei ^b   Ding, Chuang ^b   Li, Mei ^b   Nguyen, Quy Hy ^c   Dong, Minghui ^a   Chng, Eng Siong ^c   Li, Haizhou ^a  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

objective measures; speaker similarity score; speech quality assessment; subjective listening tests; Voice conversion

Indexed keywords

ACOUSTIC NOISE; SPEECH COMMUNICATION; SPEECH ENHANCEMENT; SPEECH SYNTHESIS;

BACKGROUND NOISE; EVALUATION STRATEGIES; LANGUAGE CONTENT; NOISE DISTORTIONS; OBJECTIVE MEASURE; SIMILARITY SCORES; SPEAKER SIMILARITY SCORE; SPEECH QUALITY ASSESSMENT; SUBJECTIVE LISTENING TEST; VOICE CONVERSION;

QUALITY CONTROL;

EID: 85075288991     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. J. Nurminen, H. Silen, and V. Popa, "Voice conversion," Speech Enhancement, Modeling and Recognition-Algorithms and Applications, pp. 69-94, 2012.
2. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," in International Conference on Acoustics, Speech, and Signal Processing, 1988, Apr 1988, pp. 655-658 vol.1.
3. Y. Stylianou, O. Cappe, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Transactions on Speech and Audio Processing, vol. 6, no. 2, pp. 131-142, Mar 1998.
4. T. Toda, A.W. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 15, no. 8, pp. 2222-2235, 2007.
5. S. Takamichi, T. Toda, A. W. Black, and S. Nakamura, "Modulation spectrum-constrained trajectory training algorithm for gmmbased voice conversion," in 2015 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2015, South Brisbane, Queensland, Australia, April 19-24, 2015, 2015, pp. 4859-4863.
6. E. Helander, H. Silen, T. Virtanen, and M. Gabbouj, "Voice conversion using dynamic kernel partial least squares regression," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 3, pp. 806-817, March 2012.
7. D.-Y. Huang, M. Dong, and H. Li, "A dynamic gaussian process for voice conversion," in Multimedia and Expo Workshops (ICMEW), 2013 IEEE International Conference on, July 2013, pp. 1-4.
8. Z. Wu, T. Virtanen, E. Chng, and H. Li, "Exemplar-based sparse representation with residual compensation for voice conversion," IEEE/ACM Trans. Audio, Speech & Language Processing, vol. 22, pp. 1506-1521, 2014.
9. S. Desai, E. V. Raghavendra, B. Yegnanarayana, A.W. Black, and K. Prahallad, "Voice conversion using artificial neural networks," in 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, April 2009, pp. 3893-3896.
10. L. H. Chen, Z. H. Ling, L. J. Liu, and L. R. Dai, "Voice conversion using deep neural networks with layer-wise generative training," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 22, no. 12, pp. 1859-1872, Dec 2014.
11. L. Sun, S. Kang, K. Li, and H. Meng, "Voice conversion using deep bidirectional long short-term memory based recurrent neural networks," in 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), April 2015, pp. 4869-4873.
12. "Perceptual evaluation of speech quality (pesq), an objective method for end-to-end speech quality assessment of 3.1 khz handset telephony (narrow-band) networks and speech codecs," nternational Telecommunications Union, Geneva, Switzerland, 2001.
13. Y. Hu and P. C. Loizou, "Evaluation of objective quality measures for speech enhancement," IEEE Transactions on Audio, Speech, and Language Processing, vol. 16, no. 1, pp. 229-238, Jan 2008.
14. D.-Y. Huang, "Prediction of perceived sound quality of synthetic speech," in In: Proc. APSIPA ASC., Xi'an, China, 2011.
15. L. Xu, K. A. Lee, H. Li, and Z. Yang, "Rapid computation of i-vector," in Proc. Odyssey, 2016.
16. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 4, p. 788798, 2011.
17. S. W. Lee, Z. Wu, M. Dong, X. Tian, and H. Li, "A comparative study of spectral transformation techniques for singing voice synthesis," in Proc. Interspeech, 2014, pp. 2499-2503.
18. H. Benisty, D. Malah, and K. Crammer, "Modular global variance enhancement for voice conversion systems," in Signal Processing Conference (EUSIPCO), 2012 Proceedings of the 20th European, Aug 2012, pp. 370-374.
19. F. Zhu, Z. Fan, and X. Wu, "Voice conversion using conditional restricted boltzmann machine," in Signal and Information Processing (ChinaSIP), 2014 IEEE China Summit International Conference on, July 2014, pp. 110-114.
20. P. Song, Y. Q. Bao, L. Zhao, and C. R. Zou, "Voice conversion using support vector regression," Electronics Letters, vol. 47, no. 18, pp. 1045-1046, September 2011.
21. H. Mizuno and M. Abe, "Voice conversion based on piecewise linear conversion rules of formant frequency and spectrum tilt," in Acoustics, Speech, and Signal Processing, 1994. ICASSP-94., 1994 IEEE International Conference on, vol. i, Apr 1994, pp. I/469-I/472 vol.1.
22. D. Erro, A. Moreno, and A. Bonafonte, "Voice conversion based on weighted frequency warping," IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, no. 5, pp. 922-931, July 2010.
23. E. Godoy, O. Rosec, and T. Chonavel, "Voice conversion using dynamic frequency warping with amplitude scaling, for parallel or nonparallel corpora," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 4, pp. 1313-1323, May 2012.
24. D. T. Chappell and J. H. L. Hansen, "Speaker-specific pitch contour modeling and modification," in Acoustics, Speech and Signal Processing, 1998. Proceedings of the 1998 IEEE International Conference on, vol. 2, May 1998, pp. 885-888 vol.2.
25. Z. Inanoglu, "Transforming pitch in a voice conversion framework," 2003.
26. B. Gillett and S. King, "Transforming F0 contours," in 8th European Conference on Speech Communication and Technology, EUROSPEECH 2003 - INTERSPEECH 2003, Geneva, Switzerland, September 1-4, 2003, 2003.
27. H. Ming, D.-Y. Huang, L. Xie, S. Zhang, M. Dong, and H. Li, "Exemplar-based sparse representation of timbre and prosody for voice conversion," 2016.
28. X. Tian, Z. Wu, S. W. Lee, N. Q. Hy, M. Dong, and E. Chng, "System fusion for high-performance voice conversion," in INTERSPEECH 2015, 16th Annual Conference of the International Speech Communication Association, Dresden, Germany, September 6-10, 2015, 2015, pp. 2759-2763.
29. X. Tian, Z. Wu, S. W. Lee, N. Q. Hy, E. Chng, and M. Dong, "Sparse representation for frequency warping based voice conversion." in ICASSP. IEEE, 2015, pp. 4235-4239.
30. D.-Y. Huang, E. P. Ong, S. Rahardja, M. Dong, and H. Li, "Transformation of vocal characteristics: A review of literature," International Journal of Electrical, Computer, Energetic, Electronic and Communication Engineering, vol. 3, no. 12, pp. 77-85, 2009.
31. J. Hansen and B. Pellom, "An effective quality evaluation protocol for speech enhancement algorithms," in Proc. ICSLP, Sydney, Australia, 1998, pp. 81-84.
32. D. Klatt, "Prediction of perceived phonetic distance from criticalband spectra: A first step," in Proc. IEEE ICASSP, 1982, pp. 1278-1281.
33. N. Dehak, "Discriminative and generative approches for longand short-term speaker characteristics modeling: Application to speaker verification," Ph.D. dissertation, École de Technologie Supérieure, Montreal, 2009.
34. D. Garcia-Romero and C. Y. Espy-Wilson, "Analysis of i-vector length normalization in speaker recognition systems," in INTERSPEECH 2011, 12th Annual Conference of the International Speech Communication Association, Florence, Italy, August 27-31, 2011, 2011, pp. 249-252.