Voice conversion using generative trained deep neural networks with multiple frame spectral envelopes

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 2313-2317

  Chen, Ling Hui ^a   Ling, Zhen Hua ^a   Dai, Li Rong ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Deep neural network; Spectral envelope; Voice conversion

Indexed keywords

ASSOCIATIVE PROCESSING; COMPLEX NETWORKS; SPEECH COMMUNICATION; SPEECH PROCESSING;

BI-DIRECTIONAL ASSOCIATIVE MEMORY; CONTRASTIVE DIVERGENCE; CONVERSION METHODS; DEEP NEURAL NETWORKS; NONLINEAR MAPPINGS; RESTRICTED BOLTZMANN MACHINE; SPECTRAL ENVELOPES; VOICE CONVERSION;

PHOTOMAPPING;

EID: 84910104946     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. A. Kain and M. Macon, "Spectral voice conversion for text-tospeech synthesis, " in Proc. ICASSP, 1998, pp. 285-288.
2. Y. Chen, M. Chu, E. Chang, J. Liu, and R. Liu, "Voice conversion with smoothedGMMand MAP adaptation, " in Eurospeech, 2003, pp. 2413-2416.
3. H. Zen, Y. Nankaku, and K. Tokuda, "Continuous stochastic feature mapping based on trajectory hmms, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 19, no. 2, pp. 417- 430, 2011.
4. T. Toda, A. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 15, no. 8, pp. 2222 -2235, nov. 2007.
5. S. Desai, A. Black, B. Yegnanarayana, and K. Prahallad, "Spectral mapping using artificial neural networks for voice conversion, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 18, no. 5, pp. 954-964, 2010.
6. T. Nakashika, T. Takashima, R. Takiguchi, and Y. Ariki, "Voice conversion in high-order eigen space using deep belief nets, " in Proc. Interspeech, 2013, pp. 369-372.
7. Z. Wu, E. S. Chng, and H. Li, "Conditional restricted Boltzmann machine for voice conversion, " in Signal and Information Processing (ChinaSIP), 2013 IEEE China Summit International Conference on, 2013, pp. 104-108.
8. L.-H. Chen, Z.-H. Ling, Y. Song, and L.-R. Dai, "Joint spectral distribution modeling using restricted Boltzmann machines for voice conversion, " in Interspeech, 2013, pp. 3052-3056.
9. L.-J. Liu, L.-H. Chen, Z.-H. Ling, and L.-R. Dai, "Using bidirectional associative memories for joint spectral envelope modeling in voice conversion, " in Proc. ICASSP, 2014.
10. P. Smolensky, "Information processing in dynamical systems: foundations of harmony theory, " in Parallel distributed processing: explorations in the microstructure of cognition, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA, USA: MIT Press, 1986, vol. 1, ch. 6, pp. 194-281.
11. B. Kosko, "Bidirectional associative memories, " Systems, Man and Cybernetics, IEEE Transactions on, vol. 18, no. 1, pp. 49- 60, 1988.
12. G. Hinton, "Training products of experts by minimizing contrastive divergence, " Neural Computation, vol. 12, no. 14, pp. 1711-1800, 2002.
13. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for hmm-based speech synthesis, " in Proc. ICASSP, vol. 3, 2000, pp. 1315 -1318.
14. Z.-H. Ling, L. Deng, and D. Yu, "Modeling spectral envelopes using restricted Boltzmann machines for statistical parametric speech synthesis, " in ICASSP, 2013, pp. 7825-7829.
15. R. Salakhutdinov, "Learning deep generative models, " Ph.D. dissertation, University of Toronto, 2009.
16. Z.-H. Ling, L. Deng, and D. Yu, "Modeling spectral envelopes using restricted Boltzmann machines and deep belief networks for statistical parametric speech synthesis, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 21, no. 10, pp. 2129-2139, 2013.
17. R. Salakhutdinov and G. E. Hinton, "Deep Boltzmann machines, " in International Conference on Artificial Intelligence and Statistics, 2009, pp. 448-455.
18. A. Mohamed, G. Hinton, and G. Penn, "Understanding how deep belief networks perform acoustic modelling, " in ICASSP, March 2012, pp. 4273-4276.
19. J. Pan, C. Liu, Z. Wang, Y. Hu, and H. Jiang, "Investigation of deep neural networks (DNN) for large vocabulary continuous speech recognition: Why DNN surpasses GMMs in acoustic modeling, " in Chinese Spoken Language Processing (ISCSLP), 2012 8th International Symposium on, Dec 2012, pp. 301-305.
20. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigne, "Restructuring speech representations using a pitch-adaptive timefrequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds, " Speech Communication, vol. 27, no. 3, pp. 187-208, 1999.
21. T. Stafylakis, P. Kenny, M. Senoussaoui, and P. Dumouchel, "PLDA using Gaussian restricted Boltzmann machines with application to speaker verification." in Inter speech, 2012.
22. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov, "Improving neural networks by preventing coadaptation of feature detectors, " arXiv preprint arXiv:1207.0580, 2012.