The voice conversion challenge 2016

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 08-12-September-2016, Issue , 2016, Pages 1632-1636

  Toda, Tomoki ^a   Chen, Ling Hui ^b   Saito, Daisuke ^c   Villavicencio, Fernando ^d   Wester, Mirjam ^e   Wu, Zhizheng ^e   Yamagishi, Junichi ^d,e  

^a NAGOYA UNIVERSITY   (Japan)

^b UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^c UNIVERSITY OF TOKYO   (Japan)

^d NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^e UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Evaluation challenge; Speech synthesis; Voice conversion

Indexed keywords

SPEECH COMMUNICATION; SPEECH SYNTHESIS;

CONTROLLED ENVIRONMENT; EVALUATION CHALLENGE; SPEAKER CONVERSION; TARGET SPEAKER; UNSOLVED PROBLEMS; VOICE CONVERSION; VOICE IDENTITIES;

SPEECH PROCESSING;

EID: 84994361374     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: 10.21437/Interspeech.2016-1066     Document Type: Conference Paper

References (40)

1. M. Abe, S. Nakamura, and K. Shikano, "Voice conversion through vector quantization," The Journal of the Acoustical Society of Japan (E), vol. 11, no. 2, pp. 71-76, 1990.
2. A. B. Kain, J. P. Hosom, X. Niu, J. P. H. van Santen, M. Fried-Oken, and J. Staehely, "Improving the intelligibility of dysarthric speech," Speech Communication, vol. 49, no. 9, pp. 743-759, 2007.
3. H. Doi, T. Toda, H. Saruwatari, and K. Shikano, "Alaryngeal speech enhancement based on one-to-many eigenvoice conversion," Audio, Speech, and Language Processing, IEEE/ACM Transactions on, vol. 22, no. 1, pp. 172-183, 2014.
4. Z. Inanoglu and S. Young, "Data-driven emotion conversion in spoken english," Speech Communication, vol. 51, no. 3, pp. 268-283, 2009.
5. O. Türk and M. Schröder, "Evaluation of expressive speech synthesis with voice conversion and copy resynthesis techniques," Audio, Speech, and Language Processing, IEEE/ACM Transactions on, vol. 18, no. 5, pp. 965-973, 2010.
6. F. Villavicencio and J. Bonada, "Applying voice conversion to concatenative singing-voice synthesis," in Proc. INTERSPEECH, 2010, pp. 2162-2165.
7. K. Kobayashi, T. Toda, H. Doi, T. Nakano, M. Goto, G. Neubig, S. Sakti, and S. Nakamura, "Voice timbre control based on perceived age in singing voice conversion," Information and Systems, IEICE Transactions on, vol. E97-D, no. 6, pp. 1419-1428, 2014.
8. P. Jax and P. Vary, "On artificial bandwidth extension of telephone speech," Signal Processing, vol. 83, no. 8, pp. 1707-1719, 2003.
9. T. Toda, M. Nakagiri, and K. Shikano, "Statistical voice conversion techniques for body-conducted unvoiced speech enhancement," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 9, pp. 2505-2517, 2012.
10. D. Felps, H. Bortfeld, and R. Gutierrez-Osuna, "Foreign accent conversion in computer assisted pronunciation training," Speech Communication, vol. 51, no. 10, pp. 920-932, 2009.
11. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," in Proc. ICASSP, 1988, pp. 655-658.
12. M. Abe, K. Shikano, and H. Kuwabara, "Statistical analysis of bilingual speaker's speech for cross-language voice conversion," The Journal of the Acoustical Society of America, vol. 90, no. 1, pp. 76-82, 1991.
13. H. Valbret, E. Moulines, and J. P. Tubach, "Voice transformation using psola technique," Speech Communication, vol. 11, no. 2-3, pp. 175-187, 1992.
14. A. W. Black and K. Tokuda, "The Blizzard Challenge-2005: evaluating corpus-based speech synthesis on common datasets," in Proc. INTERSPEECH, 2005, pp. 77-80.
15. Y. Stylianou, "Applying the harmonic plus noise model in concatenative speech synthesis," Speech and Audio Processing, IEEE Transactions on, vol. 9, no. 1, pp. 21-29, 2001.
16. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigné, "Restructuring speech representations using a pitch-adaptive timefrequency smoothing and an instantaneous-frequency-based f0 extraction: possible role of a repetitive structure in sounds," Speech Communication, vol. 27, no. 3-4, pp. 187-207, 1999.
17. F. Soong and B. Juang, "Optimal quantization of lsp parameters," Speech and Audio Processing, IEEE Transactions on, vol. 1, no. 1, pp. 15-24, 1993.
18. K. Tokuda, T. Kobayashi, T. Masuko, and S. Imai, "Melgeneralized cepstral analysis-a unified approach to speech spectral estimation," in Proc. ICSLP, 1994, pp. 1043-1045.
19. L.-H. Chen, Z.-H. Ling, L.-J. Liu, and L.-R. Dai, "Voice conversion using deep neural networks with layer-wise generative training," Audio, Speech, and Language Processing, IEEE/ACM Transactions on, vol. 22, no. 12, pp. 1859-1872, 2014.
20. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Maximum likelihood voice conversion based on gmm with straight mixed excitation," in Proc. INTERSPEECH, 2006, pp. 2266-2269.
21. A. Kain and M.W. Macon, "Design and evaluation of a voice conversion algorithm based on spectral envelope mapping and residual prediction," in Proc. ICASSP, 2001, pp. 813-816.
22. H. Ye and S. Young, "Quality-enhanced voice morphing using maximum likelihood transformations," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 14, no. 4, pp. 1301-1312, 2006.
23. B. Gillett and S. King, "Transforming F0 contours," in Proc. INTERSPEECH, 2003, pp. 101-104.
24. H. Kameoka, K. Yoshizato, T. Ishihara, K. Kadowaki, Y. Ohishi, and K. Kashino, "Generative modeling of voice fundamental frequency contours," Audio, Speech, and Language Processing, IEEE/ACM Transactions on, vol. 23, no. 6, pp. 1042-1053, 2015.
25. K. Yutani, Y. Uto, Y. Nankaku, T. Toda, and K. Tokuda, "Simultaneous conversion of duration and spectrum based on statistical models including time-sequence matching," in Proc. INTERSPEECH, 2008, pp. 1072-1075.
26. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion," Speech and Audio Processing, IEEE Transactions on, vol. 6, no. 2, pp. 131-142, 1998.
27. T. Toda, A.W. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 15, no. 8, pp. 2222-2235, 2007.
28. T. Nakashika, T. Takiguchi, and Y. Ariki, "Voice conversion based on speaker-dependent restricted boltzmann machines," Information and Systems, IEICE Transactions on, vol. E67-D, no. 6, pp. 1403-1410, 2014.
29. E. Helander, H. Silé, T. Virtanen, and M. M. Gabbouj, "Voice conversion using dynamic kernel partial least squares regression," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 3, pp. 806-817, 2012.
30. N. Pilkington, H. Zen, and M. Gales, "Gaussian process experts for voice conversion," in Proc. INTERSPEECH, 2011, pp. 2761-2764.
31. N. Xu, Y. Tang, J. Bao, A. Jiang, X. Liu, and Z. Yang, "Voice conversion based on gaussian processes by coherent and asymmetric training with limited training data," Speech Communication, vol. 58, pp. 124-138, 2014.
32. S. Desai, A. Black, B. Yegnanarayana, and K. Prahallad, "Spectral mapping using artificial neural networks for voice conversion," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 18, no. 5, pp. 954-964, 2010.
33. R. Takashima, T. Takiguchi, and Y. Ariki, "Exemplar-based voice conversion using sparse representation in noisy environments," Information and Systems, IEICE Transactions on, vol. E96-A, no. 10, pp. 1946-1953, 2013.
34. Z. Wu, T. Virtanen, E. Chng, and H. Li, "Exemplar-based sparse representation with residual compensation for voice conversion," Audio, Speech, and Language Processing, IEEE/ACM Transactions on, vol. 22, no. 10, pp. 1506-1521, 2014.
35. L. Sun, S. Kang, K. Li, and H. Meng, "Voice conversion using deep bidirectional long short-term memory based recurrent neural networks," in Proc. ICASSP, 2015, pp. 4869-4873.
36. S. Takamichi, T. Toda, A. Black, G. Neubig, S. Sakti, and S. Nakamura, "Post-filters to modify the modulation spectrum for statistical parametric speech synthesis," Audio, Speech, and Language Processing, IEEE/ACM Transactions on, vol. 24, no. 4, pp. 757-767, 2016.
37. D. Erro, A. Moreno, and A. Bonafonte, "Voice conversion based on weighted frequency warping," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 18, no. 5, pp. 922-931, 2010.
38. G. J. Mysore, "Can we automatically transform speech recorded on common consumer devices in real-world environments into professional production quality speech?-a dataset, insights, and challenges," IEEE Signal Processing Letters, vol. 22, no. 8, pp. 1006-1010, Aug 2015.
39. M. Wester, Z. Wu, and J. Yamagishi, "Analysis of the Voice Conversion Challenge 2016 evaluation results," in (submitted to) Interspeech, 2016.
40. Z. Wu, P. L. De Leon, C. Demiroglu, A. Khodabakhsh, S. King, Z.-H. Ling, D. Saito, B. Stewart, T. Toda, M. Wester, and J. Yamagishi, "Anti-spoofing for text-independent speaker verification: An initial database, comparison of countermeasures, and human performance," Audio, Speech and Language Processing, IEEE/ACM Transactions on, vol. 24, pp. 768-783, 2016.