Voice conversion using speaker-dependent conditional restricted Boltzmann machine

Eurasip Journal on Audio, Speech, and Music Processing

Volumn 2015, Issue 1, 2015, Pages

  Nakashika, Toru ^a   Takiguchi, Tetsuya ^a   Ariki, Yasuo ^a  

^a KOBE UNIVERSITY   (Japan)

Author keywords

Conditional restricted Boltzmann machine; Deep learning; Recurrent neural network; Speaker specific features; Voice conversion

Indexed keywords

RECURRENT NEURAL NETWORKS;

CONDITIONAL RESTRICTED BOLTZMANN MACHINES; DEEP LEARNING; NEURAL NETWORK (NN); OBJECTIVE EVALUATION; RECURRENT NEURAL NETWORK (RNN); SPEAKER INDEPENDENTS; SPEAKER-SPECIFIC FEATURES; VOICE CONVERSION;

SPEECH PROCESSING;

EID: 84924309945     PISSN: 16874714     EISSN: 16874722     Source Type: Journal    
DOI: 10.1186/s13636-014-0044-3     Document Type: Article

References (44)

1. A Kain, MW Macon, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Spectral voice conversion for text-to-speech synthesis, (1998), pp. 285–288.
2. C Veaux, X Robet, in Proceedings of Interspeech. Intonation conversion from neutral to expressive speech, (2011), pp. 2765–2768.
3. K Nakamura, T Toda, H Saruwatari, K Shikano, Speaking-aid systems using GMM-based voice conversion for electrolaryngeal speech. Speech Commun. 54(1), 134–146 (2012).
4. L Deng, A Acero, L Jiang, J Droppo, X Huang, in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). High-performance robust speech recognition using stereo training data, (2001), pp. 301–304.
5. A Kunikoshi, Y Qiao, N Minematsu, K Hirose, in Proceedings of Interspeech. Speech generation from hand gestures based on space mapping, (2009), pp. 308–311.
6. R Gray, Vector quantization. ASSP Mag. IEEE. 1(2), 4–29 (1984).
7. H Valbret, E Moulines, J-P Tubach, Voice transformation using PSOLA technique. Speech Commun. 11(2), 175–187 (1992).
8. Y Stylianou, Cappé O, E Moulines, Continuous probabilistic transform for voice conversion. IEEE Trans. Speech Audio Process. 6(2), 131–142 (1998).
9. T Toda, AW Black, K Tokuda, Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory. IEEE Trans. Audio Speech Lang. Process. 15(8), 2222–2235 (2007).
10. E Helander, T Virtanen, J Nurminen, Gabbouj, Voice conversion using partial least squares regression. IEEE Trans. Audio Speech Lang. Process. 18(5), 912–921 (2010).
11. C-H Lee, C-H Wu, in Proceedings of Interspeech. Map-based adaptation for speech conversion using adaptation data selection and non-parallel training, (2006), pp. 2254–2257.
12. T Toda, Y Ohtani, K Shikano, in Proceedings of Interspeech. Eigenvoice conversion based on gaussian mixture model, (2006), pp. 2446–2449.
13. D Saito, Yamamoto K, N Minematsu, K Hirose, in Proceedings of Interspeech. One-to-many voice conversion based on tensor representation of speaker space, (2011), pp. 653–656.
14. D Saito, S Watanabe, A Nakamura, N Minematsu, in Proceedings of Interspeech. Probabilistic integration of joint density model and speaker model for voice conversion, (2010), pp. 1728–1731.
15. Z Jian, Z Yang, in Proceedings of International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing. Voice conversion using canonical correlation analysis based on Gaussian mixture model, (2007), pp. 210–215.
16. R Takashima, T Takiguchi, Y Ariki, in IEEE Spoken Language Technology Workshop (SLT). Exemplar-based voice conversion in noisy environment, (2012), pp. 313–317.
17. M Narendranath, HA Murthy, S Rajendran, B Yegnanarayana, Transformation of formants for voice conversion using artificial neural networks. Speech Commun. 16(2), 207–216 (1995).
18. S Desai, EV Raghavendra, B Yegnanarayana, AW Black, K Prahallad, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Voice conversion using artificial neural networks, (2009), pp. 3893–3896.
19. Y-J Wu, H Kawai, J Ni, R-H Wang, in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Minimum segmentation error based discriminative training for speech synthesis application, (2004), p. 629.
20. E McDermott, TJ Hazen, J Le Roux, A Nakamura, S Katagiri, Discriminative training for large-vocabulary speech recognition using minimum classification error. IEEE Trans. Audio Speech Lang. Process. 15(1), 203–223 (2007).
21. T Tomoki, K Tokuda, A speech parameter generation algorithm considering global variance for HMM-based speech synthesis. IEICE Trans. Inform. Syst. 90(5), 816–824 (2007).
22. Z-H Ling, L-R Dai, Minimum Kullback-Leibler divergence parameter generation for HMM-based speech synthesis. IEEE Trans. Audio Speech Lang. Process. 20(5), 1492–1502 (2012).
23. Z-H Ling, Y-J Wu, Y-P Wang, L Qin, R-H Wang, in Blizzard Challenge Workshop. USTC system for blizzard challenge 2006 an improved HMM-based speech synthesis method, (2006).
24. Z Wu, T Virtanen, T Kinnunen, ES Chng, H Li, in Proceedings of the 8th ISCA Speech Synthesis Workshop. Exemplar-based voice conversion using non-negative spectrogram deconvolution, (2013), pp. 221–226.
25. T Nakashika, R Takashima, T Takiguchi, Y Ariki, in Proceedings of Interspeech. Voice conversion in high-order eigen space using deep belief nets, (2013), pp. 369–372.
26. P Smolensky, Information processing in dynamical systems: foundations of harmony theory. Parallel Distributed Process. 1, 194–281 (1986).
27. GE Hinton, S Osindero, Y-W Teh, A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006).
28. Z-H Ling, L Deng, D Yu, Modeling spectral envelopes using restricted Boltzmann machines and deep belief networks for statistical parametric speech synthesis. IEEE Trans. Audio Speech Lang. Process. 21(10), 2129–2139 (2013).
29. A-R Mohamed, GE Dahl, G Hinton, Acoustic modeling using deep belief networks. Audio Speech Lang. Process. IEEE Trans. 20(1), 14–22 (2012).
30. V Nair, G Hinton, 3-D object recognition with deep belief nets. Adv. Neural Inform. Process. Syst. 22, 1339–1347 (2009).
31. T Deselaers, S Hasan, O Bender, H Ney, in Proceedings of the Fourth Workshop on Statistical Machine Translation. A deep learning approach to machine transliteration, (2009), pp. 233–241.
32. Z Wu, ES Chng, H Li, in Proceedings of the IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP). Conditional restricted Boltzmann machine for voice conversion, (2013).
33. C Ling-Hui, L Zhen-Hua, S Yan, D Li-Rong, in Proceedings of Interspeech. Joint spectral distribution modeling using restricted Boltzmann machines for voice conversion, (2013), pp. 3052–3056.
34. DH Ackley, GE Hinton, TJ Sejnowski, A learning algorithm for Boltzmann machines. Cogn. Sci. 9(1), 147–169 (1985).
35. Y Freund, D Haussler, Unsupervised learning of distributions of binary vectors using two layer networks. Adv, Neural Inform. Process. Syst. 4, 912–919 (1991).
36. GE Hinton, RR Salakhutdinov, Reducing the dimensionality of data with neural networks. Science. 313(5786), 504–507 (2006).
37. G Hinton, in Tech. Rep. Department of Computer Science. A practical guide to training restricted Boltzmann machines (University of Toronto, 2010).
38. A Krizhevsky, G Hinton, Learning multiple layers of features from tiny images (Computer Science Department, University of Toronto, Tech. Rep, 2009).
39. K Cho, A Ilin, T Raiko, in Artificial Neural Networks and Machine Learning–ICANN 2011. Improved learning of gaussian-bernoulli restricted Boltzmann machines, (2011), pp. 10–17.
40. GW Taylor, GE Hinton, ST Roweis, in Advances in Neural Information Processing Systems. Modeling human motion using binary latent variables, (2006), pp. 1345–1352.
41. R Pascanu, T Mikolov, Y Bengio, On the difficulty of training recurrent neural networks. (2012).
42. A Kurematsu, K Takeda, Y Sagisaka, S Katagiri, H Kuwabara, K Shikano, ATR japanese speech database as a tool of speech recognition and synthesis. Speech Communication. 9(4), 357–363 (1990).
43. H Kawahara, M Morise, T Takahashi, R Nisimura, T Irino, H Banno, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Tandem-straight: a temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, f0, and aperiodicity estimation, (2008), pp. 3933–3936.
44. B Milner, X Shao, in Proceedings of Interspeech. Speech reconstruction from mel-frequency cepstral coefficients using a source-filter model, (2002), pp. 2421–2424.