On the training of DNN-based average voice model for speech synthesis

2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2016

Volumn , Issue , 2017, Pages

  Yang, Shan ^a   Wu, Zhizheng ^b   Xie, Lei ^a  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP NEURAL NETWORKS; LINGUISTICS; SPEECH PROCESSING;

AVERAGE VOICE MODELS; LINGUISTIC FEATURES; SPEAKER DEPENDENTS; SPEAKER NORMALISATION; SPEAKER SPECIFIC INFORMATIONS; SPEECH SYNTHESIS SYSTEM; STATISTICAL PARAMETRIC SPEECH SYNTHESIS; SYSTEMATIC ANALYSIS;

SPEECH SYNTHESIS;

EID: 85013762788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/APSIPA.2016.7820818     Document Type: Conference Paper

References (28)

1. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis," Speech Communication, vol. 51, no. 11, pp. 1039-1064, 2009.
2. K. Tokuda, Y. Nankaku, T. Toda, H. Zen, J. Yamagishi, and K. Oura, "Speech synthesis based on hidden markov models," Proceedings of the IEEE, vol. 101, no. 5, pp. 1234-1252, 2013.
3. H. Zen, A. Senior, and M. Schuster, "Statistical parametric speech synthesis using deep neural networks," in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 7962-7966.
4. O. Watts, G. E. Henter, T. Merritt, Z. Wu, and S. King, "From hmms to dnns: where do the improvements come from?" in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016.
5. Y. Qian, Y. Fan,W. Hu, and F. K. Soong, "On the training aspects of deep neural network (dnn) for parametric tts synthesis," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 3829-3833.
6. Z.-H. Ling, L. Deng, and D. Yu, "Modeling spectral envelopes using restricted boltzmann machines and deep belief networks for statistical parametric speech synthesis," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 21, no. 10, pp. 2129-2139, 2013.
7. H. Zen and A. Senior, "Deep mixture density networks for acoustic modeling in statistical parametric speech synthesis," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 3844-3848.
8. Z. Wu, C. Valentini-Botinhao, O. Watts, and S. King, "Deep neural networks employing multi-task learning and stacked bottleneck features for speech synthesis," in Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015, pp. 4460-4464.
9. K. Hashimoto, K. Oura, Y. Nankaku, and K. Tokuda, "The effect of neural networks in statistical parametric speech synthesis," in Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015, pp. 4455-4459.
10. M. Tamura, T. Masuko, K. Tokuda, and T. Kobayashi, "Speaker adaptation for hmm-based speech synthesis system using mllr," in The Third ESCA/COCOSDA Workshop (ETRW) on Speech Synthesis, 1998.
11. M. TAMURA, T. MASUKO, K. TOKUDA, and T. KOBAYASHI, "Speaker adaptation of pitch and spectrum for hmm-based speech synthesis," IEICE transactions on information and systems, vol. 85, no. 4, p. 793, 2002.
12. J. Yamagishi and T. Kobayashi, "Average-voice-based speech synthesis using hsmm-based speaker adaptation and adaptive training," IEICE TRANSACTIONS on Information and Systems, vol. 90, no. 2, pp. 533- 543, 2007.
13. J. Yamagishi, T. Kobayashi, Y. Nakano, K. Ogata, and J. Isogai, "Analysis of speaker adaptation algorithms for hmm-based speech synthesis and a constrained smaplr adaptation algorithm," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 17, no. 1, pp. 66- 83, 2009.
14. J. Yamagishi, T. Nose, H. Zen, Z.-H. Ling, T. Toda, K. Tokuda, S. King, and S. Renals, "Robust speaker-adaptive hmm-based text-to-speech synthesis," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 17, no. 6, pp. 1208-1230, 2009.
15. Y. Fan, Y. Qian, F. K. Soong, and L. He, "Multi-speaker modeling and speaker adaptation for dnn-based tts synthesis," in Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015, pp. 4475-4479.
16. -, "Speaker and language factorization in dnn-based tts synthesis," in IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2016, pp. 5540-5544.
17. Z. Wu, P. Swietojanski, C. Veaux, S. Renals, and S. King, "A study of speaker adaptation for dnn-based speech synthesis," in Proceedings interspeech, 2015.
18. O. Watts, Z. Wu, and S. King, "Sentence-level control vectors for deep neural network speech synthesis," in Interspeech, 2015.
19. D. Garcia-Romero and C. Y. Espy-Wilson, "Analysis of i-vector length normalization in speaker recognition systems." in Interspeech, 2011, pp. 249-252.
20. B. Scholkopft and K.-R. Mullert, "Fisher discriminant analysis with kernels," Neural networks for signal processing IX, vol. 1, no. 1, p. 1, 1999.
21. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 19, no. 4, pp. 788-798, 2011.
22. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Annals of eugenics, vol. 7, no. 2, pp. 179-188, 1936.
23. C. R. Rao, "The utilization of multiple measurements in problems of biological classification," Journal of the Royal Statistical Society. Series B (Methodological), vol. 10, no. 2, pp. 159-203, 1948.
24. H. Kawahara, I. Masuda-Katsuse, and A. De Cheveigne, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based f0 extraction: Possible role of a repetitive structure in sounds," Speech communication, vol. 27, no. 3, pp. 187-207, 1999.
25. A. Black, P. Taylor, R. Caley, R. Clark, K. Richmond, S. King, V. Strom, and H. Zen, "The festival speech synthesis system version 1.4.2," Software, Jun 2001. [Online]. Available: http://www.cstr.ed.ac.uk/projects/festival/
26. Z. Wu, O. Watts, and S. King, "Merlin: An open source neural network speech synthesis system," in 9th ISCA Speech Synthesis Workshop (SSW9), Sunnyvale, CA, USA, September 2016.
27. S. O. Sadjadi, M. Slaney, and L. Heck, "Msr identity toolbox v1. 0: A matlab toolbox for speaker-recognition research," Speech and Language Processing Technical Committee Newsletter, 2013.
28. L. Van der Maaten and G. Hinton, "Visualizing data using t-sne," Journal of Machine Learning Research, vol. 9, no. 2579-2605, p. 85, 2008.