Voice conversion using deep Bidirectional Long Short-Term Memory based Recurrent Neural Networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 4869-4873

  Sun, Lifa ^a   Kang, Shiyin ^a   Li, Kun ^a   Meng, Helen ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

bidirectional long short term memory; dynamic features; recurrent neural networks; voice conversion

Indexed keywords

AUDIO SIGNAL PROCESSING; BRAIN; DEEP NEURAL NETWORKS; LONG SHORT-TERM MEMORY; RECURRENT NEURAL NETWORKS; SPEECH COMMUNICATION;

CONTEXT DEPENDENCY; CONVERSION METHODS; DYNAMIC FEATURES; MEAN OPINION SCORES; SPEECH FRAMES; SPEECH OUTPUT; TEMPORAL CORRELATIONS; VOICE CONVERSION;

SPEECH PROCESSING;

EID: 84946027999     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178896     Document Type: Conference Paper

References (34)

1. J. Nurminen, H. Silen, and V. Popa, Voice Conversion, Speech Enhancement, Modeling and Recognition-Algorithms and Applications, pp. 69-94, 2012
2. Z. W. Shuang, R. Bakis, S. Shechtman, and Y. Qin, Frequency warping based on mapping formant parameters, in Interspeech, 2006
3. D. Erro and A. Moreno, Weighted frequency warping for voice conversion, in Interspeech, 2007
4. G. Hinton, S. Osindero, and Y. Teh, A fast learning algorithm for Deep Belief Nets, Neural computation, vol. 18, no. 7, pp. 1527-1554, 2006
5. A. Mohamed, G. E. Dahl, and G. Hinton, Acoustic modeling using Deep Belief Networks, Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 1, pp. 14-22, 2012
6. Y. Stylianou, O. Cappé, and E. Moulines, Continuous probabilistic transform for voice conversion, IEEE Transactions on Speech and Audio Processing, vol. 6, no. 2, pp. 131-142, 1998
7. T. Toda, A. W. Black, and K. Tokuda, Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory, IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 8, pp. 2222-2235, 2007
8. S. Desai, E. V. Raghavendra, B. Yegnanarayana, A. W. Black, and K. Prahallad, Voice conversion using Artificial Neural Networks, in ICASSP, 2009
9. L. H. Chen, Z. H. Ling, Y. Song, and L. R. Dai, Joint spectral distribution modeling using Restricted Boltzmann Machines for voice conversion, in Interspeech, 2013
10. L. H. Chen, Z. H. Ling, L. J. Liu, and L. R. Dai, Voice conversion using Deep Neural Networks with layer-wise generative training, IEEE/ACM Transactions on Audio, Speech and Language Processing, vol. 22, no. 12, pp. 1859-1872, 2014
11. T. Nakashika, R. Takashima, T. Takiguchi, and Y. Ariki, Voice conversion in high-order eigen space using Deep Belief Nets, in Interspeech, 2013
12. T. Nakashika, T. Takiguchi, and Y. Ariki, High-order sequence modeling using speaker-dependent recurrent temporal Restricted Boltzmann Machines for voice conversion, in Interspeech, 2014
13. Y. Bengio, P. Simard, and P. Frasconi, Learning longterm dependencies with gradient descent is difficult, IEEE Transactions on Neural Networks, vol. 5, no. 2, pp. 157-166, 1994
14. A. Graves and J. Schmidhuber, Framewise phoneme classification with bidirectional LSTM and other neural network architectures, Neural Networks, vol. 18, no. 5, pp. 602-610, 2005
15. S. Hochreiter and J. Schmidhuber, Long Short Term Memory, Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997
16. F. A. Gers and J. Schmidhuber, LSTM recurrent networks learn simple context-free and context-sensitive languages, IEEE Transactions on Neural Networks, vol. 12, no. 6, pp. 1333-1340, 2001
17. A. Graves, N. Jaitly, and A. R. Mohamed, Hybrid speech recognition with deep bidirectional LSTM, in ASRU, 2013
18. H. Sak, A. Senior, and F. Beaufays, Long Short-Term Memory based Recurrent Neural Network architectures for large vocabulary speech recognition, arXiv preprint arXiv: 1402.1128, 2014
19. M. Wollmer, Z. X. Zhang, F. Weninger, B. Schuller, and G. Rigoll, Feature enhancement by bidirectional LSTM networks for conversational speech recognition in highly nonstationary noise, in ICASSP, 2013
20. Y. C. Fan, Y. Qian, F. L. Xie, and F. K. Soong, TTS synthesis with bidirectional LSTM based Recurrent Neural Networks, in Interspeech, 2014
21. M. Schuster and K. K. Paliwal, Bidirectional Recurrent Neural Networks, IEEE Transactions on Signal Processing, vol. 45, no. 11, pp. 2673-2681, 1997
22. F. A. Gers, J. Schmidhuber, and F. Cummins, Learning to forget: Continual prediction with LSTM, Neural computation, vol. 12, no. 10, pp. 2451-2471, 2000
23. A. Graves, A. R. Mohamed, and G. E. Hinton, Speech recognition with deep Recurrent Neural Networks, in ICASSP, 2013, pp. 6645-6649
24. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigné, Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequencybased F0 extraction: Possible role of a repetitive structure in sounds, Speech communication, vol. 27, no. 3, pp. 187-207, 1999
25. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, Maximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation, in Proc. ICSLP, 2006
26. G. E. Hinton, Learning distributed representations of concepts, in Proceedings of the eighth annual conference of the cognitive science society, 1986
27. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, Learning representations by back-propagating errors, Cognitive modeling, 1988
28. P. J.Werbos, Backpropagation through time: what it does and how to do it, Proceedings of the IEEE, vol. 78, no. 10, pp. 1550-1560, 1990
29. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, Speech parameter generation algorithms for hmm-based speech synthesis, in ICASSP, 2000
30. J. Kominek and A. W. Black, The CMU Arctic speech databases, in Fifth ISCAWorkshop on Speech Synthesis, 2004
31. F. Weninger and J. Bergmann, Currennt: CUDA-enabled machine learning library for Recurrent Neural Networks, http://sourceforge.net/projects/currennt
32. S.Y. Kang, X.J. Qian, and H. Meng, Multi-distribution Deep Belief Network for speech synthesis, in ICASSP, 2013
33. H. Zen, A. Senior, and M. Schuster, Statistical parametric speech synthesis using Deep Neural Networks, in ICASSP, 2013
34. S.Y. Kang and H.Meng, Statistical parametric speech synthesis using weighted multi-distribution Deep Belief Network, in Interspeech, 2014