Voice conversion based on speaker-dependent restricted boltzmann machines

IEICE Transactions on Information and Systems

Volumn E97-D, Issue 6, 2014, Pages 1403-1410

  Nakashika, Toru ^a   Takiguchi, Tetsuya ^a   Ariki, Yasuo ^a  

^a KOBE UNIVERSITY   (Japan)

Author keywords

Deep learning; Restricted boltzmann machine; Speaker individuality; Voice conversion

Indexed keywords

ABSTRACTING; SPEECH COMMUNICATION;

DEEP LEARNING; MODEL-BASED METHOD; NEURAL NETWORK (NN); OBJECTIVE CRITERIA; RESTRICTED BOLTZMANN MACHINE; SPEAKER INDIVIDUALITY; VOICE CONVERSION; VOICE CONVERSION TECHNIQUES;

SPEECH PROCESSING;

EID: 84901766069     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1587/transinf.E97.D.1403     Document Type: Article

References (39)

1. A. Kain and M.W. Macon, "Spectral voice conversion for text-tospeech synthesis, " Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.285-288, 1998.
2. C. Veaux and X. Robet, "Intonation conversion from neutral to expressive speech, " Proc. Interspeech, pp.2765-2768, 2011.
3. K. Nakamura, T. Toda, H. Saruwatari, and K. Shikano, "Speakingaid systems using gmm-based voice conversion for electrolaryngeal speech, " Speech Commun., vol.54, no.1, pp.134-146, 2012.
4. L. Deng, A. Acero, L. Jiang, J. Droppo, and X. Huang, "Highperformance robust speech recognition using stereo training data, " Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp.301-304, 2001.
5. A. Kunikoshi, Y. Qiao, N. Minematsu, and K. Hirose, "Speech generation from hand gestures based on space mapping, " Proc. Interspeech, pp.308-311, 2009.
6. R. Gray, "Vector quantization, " IEEE ASSP Mag., vol.1, no.2, pp.4- 29, 1984.
7. H. Valbret, E. Moulines, and J.P. Tubach, "Voice transformation using psola technique, " Speech Commun., vol.11, no.2, pp.175-187, 1992.
8. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion, " IEEE Trans. Speech Audio Process., vol.6, no.2, pp.131-142, 1998.
9. T. Toda, A.W. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory, " IEEE Trans. Audio Speech Language Process., vol.15, no.8, pp.2222-2235, 2007.
10. E. Helander, T. Virtanen, J. Nurminen, andM. Gabbouj, "Voice conversion using partial least squares regression, " IEEE Trans. Audio Speech Language Process., vol.18, no.5, pp.912-921, 2010.
11. C.H. Lee and C.H. Wu, "Map-based adaptation for speech conversion using adaptation data selection and non-parallel training, " Proc. Interspeech, pp.2254-2257, 2006.
12. T. Toda, Y. Ohtani, and K. Shikano, "Eigenvoice conversion based on gaussian mixture model, " Proc. Interspeech, pp.2446-2449, 2006.
13. D. Saito, K. Yamamoto, N. Minematsu, and K. Hirose, "One-tomany voice conversion based on tensor representation of speaker space, " Proc. Interspeech, pp.653-656, 2011.
14. D. Saito, S. Watanabe, A. Nakamura, and N. Minematsu, "Probabilistic integration of joint density model and speaker model for voice conversion, " Proc. Interspeech, pp.1728-1731, 2010.
15. Z. Jian and Z. Yang, "Voice conversion using canonical correlation analysis based on gaussian mixture model, " Proc. International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, pp.210-215, IEEE, 2007.
16. R. Takashima, T. Takiguchi, and Y. Ariki, "Exemplar-based voice conversion in noisy environment, " IEEE Spoken Language Technology Workshop (SLT), pp.313-317, 2012.
17. S. Desai, E.V. Raghavendra, B. Yegnanarayana, A.W. Black, and K. Prahallad, "Voice conversion using artificial neural networks, " Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.3893-3896, 2009.
18. Y.J. Wu, H. Kawai, J. Ni, and R.H. Wang, "Minimum segmentation error based discriminative training for speech synthesis application, " Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp.I-629, 2004.
19. E. McDermott, T.J. Hazen, J. Le Roux, A. Nakamura, and S. Katagiri, "Discriminative training for large-vocabulary speech recognition using minimum classification error, " IEEE Trans. Audio Speech Language Process., vol.15, no.1, pp.203-223, 2007.
20. T. Tomoki and K. Tokuda, "A speech parameter generation algorithm considering global variance for hmm-based speech synthesis, " IEICE Trans. Inf. & Syst., vol.E90-D, no.5, pp.816-824, May 2007.
21. Z.H. Ling and L.R. Dai, "Minimum kullback-leibler divergence parameter generation for hmm-based speech synthesis, " IEEE Trans. Audio Speech Language Process., vol.20, no.5, pp.1492-1502, 2012.
22. Z.H. Ling, Y.J.Wu, Y.P.Wang, L. Qin, and R.H.Wang, "Ustc system for blizzard challenge 2006 an improved hmm-based speech synthesis method, " Blizzard Challenge Workshop, 2006.
23. Z. Wu, T. Virtanen, T. Kinnunen, E.S. Chng, and H. Li, "Exemplarbased voice conversion using non-negative spectrogram deconvolution, " Proc. 8th ISCA Speech Synthesis Workshop, 2013.
24. P. Smolensky, "Information processing in dynamical systems: Foundations of harmony theory, " vol.1, pp.194-281, 1986.
25. G.E. Hinton, S. Osindero, and Y.W. Teh, "A fast learning algorithm for deep belief nets, " Neural computation, vol.18, no.7, pp.1527- 1554, 2006.
26. Z.H. Ling, L. Deng, and D. Yu, "Modeling spectral envelopes using restricted boltzmann machines and deep belief networks for statistical parametric speech synthesis, " IEEE Trans. Audio Speech Language Process., no.10, pp.2129-2139, 2013.
27. A.r.Mohamed, G.E. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks, " IEEE Trans. Audio Speech Language Process., vol.20, no.1, pp.14-22, 2012.
28. V. Nair and G. Hinton, "3-d object recognition with deep belief nets, " Advances in Neural Information Processing Systems, vol.22, pp.1339-1347, 2009.
29. T. Deselaers, S. Hasan, O. Bender, and H. Ney, "A deep learning approach to machine transliteration, " Proc. Fourth Workshop on Statistical Machine Translation, pp.233-241, Association for Computational Linguistics, 2009.
30. T. Nakashika, R. Takashima, T. Takiguchi, and Y. Ariki, "Voice conversion in high-order eigen space using deep belief nets, " Proc. Interspeech, pp.369-372, 2013.
31. Z.Wu, E.S. Chng, and H. Li, "Conditional restricted boltzmann machine for voice conversion, " Proc. IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), 2013.
32. C. Ling-Hui, L. Zhen-Hua, S. Yan, and D. Li-Rong, "Joint spectral distribution modeling using restricted boltzmann machines for voice conversion, " Proc. Interspeech, pp.3052-3056, 2013.
33. A. Kurematsu, K. Takeda, Y. Sagisaka, S. Katagiri, H. Kuwabara, and K. Shikano, "Atr japanese speech database as a tool of speech recognition and synthesis, " Speech Commun., no.4, pp.357-363, 1990.
34. H. Kawahara, M.Morise, T. Takahashi, R. Nisimura, T. Irino, and H. Banno, "Tandem-straight: A temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, f0, and aperiodicity estimation, " Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.3933-3936, 2008.
35. B. Milner and X. Shao, "Speech reconstruction from mel-frequency cepstral coefficients using a source-filter model., " Proc. Interspeech, 2002.
36. R. Salakhutdinov, Learning deep generative models, PhD thesis, University of Toronto, 2009.
37. G. Hinton, "A practical guide to training restricted boltzmann machines, " Tech. Rep. Department of Computer Science, University of Toronto, 2010.
38. A.R. Mohamed and G. Hinton, "Phone recognition using restricted boltzmann machines, " Proc. IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), pp.4354-4357, 2010.
39. N. Wang, J. Melchior, and L. Wiskott, "An analysis of gaussianbinary restricted boltzmann machines for natural images, " Proc. European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), pp.287-292, 2012.