On the training aspects of Deep Neural Network (DNN) for parametric TTS synthesis

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 3829-3833

  Qian, Yao ^a   Fan, Yuchen ^a   Hu, Wenping ^a   Soong, Frank K ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

DNN; HMM; Speech Synthesis; TTS

Indexed keywords

SPEECH SYNTHESIS;

ACTIVATION FUNCTIONS; DEEP NEURAL NETWORKS; DNN; GAUSSIAN PROBABILITY; HMM; KEY CHARACTERISTICS; OBJECTIVE AND SUBJECTIVE MEASURES; TTS;

SIGNAL PROCESSING;

EID: 84905251808     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854318     Document Type: Conference Paper

References (22)

1. G. E. Dahl, D. Yu, L. Deng, and A. Acero, "Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition," IEEE Trans, on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 30-2, 2012.
2. F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-depedent deep neural networks," in Proc. InterSpeech, pp. 437-40, 2011.
3. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," Signal Processing Magazine, IEEE, vol. 29, no. 6, pp. 82-97,2012.
4. K. Tokuda, T. Kobayashi, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech Parameter generation algorithms for HMM-based speech synthesis", InProc. ICASSP, pp. 1315-1318,2000.
5. H. Zen, K. Tokuda, and W. Black, Alan, "Statistical parametric speech synthesis", Speech Communication, Volume 51, Issue 11, pp. 1039-1064,2009.
6. H. Zen, A. Senior and M. Senior, "Statistical Parametric Speech Synthesis Using Deep Neural Networks", InProc. ICASSP, pp. 8012-8016,2013.
7. H. Lu, S. King, and O. Watts, "Combining a vector space representation of linguistic context with a deep neural network for text-to-speech synthesis", In 8th ISCA Workshop on Speech Synthesis, pp. 281-285,2013.
8. S. Kang, X. Qian, and H. Meng, "Multi-distribution deep belief network for speech synthesis", In Proc. ICASSP, pp. 7962-7966, 2013.
9. Z.-H. Ling, L. Deng, and D. Yu, "Modeling spectral envelopes using restricted Boltzmann machines for statistical parametric speech synthesis", InProc. ICASSP, pp. 7825-7829,2013.
10. G.E. Hinton, S. Osindero and Y. W. Teh, "A Fast Learning Algorithm for Deep Belief Nets," Neural Computation, vol. 18, no. 7, pp. 1527-1554,2006.
11. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors," Nature, vol. 323, no. 9, pp. 533-536, 1986.
12. A. Krogh and J. A. Hertz, "A Simple Weight Decay Can Improve Generalization", in Advance in Neural Information Processing Systems-4, J.E. Moody, S.J. Hanson and P.R. Lippmann, eds. Morgan Kauffmann Publishers, San Mateo CA, pp. 950-957, 1992.
13. H. Bourlard and N. Morgan, Connectionist Speech Recognition: A Hybrid Approach, Kluwer Academic Publishers, Norwell, MA, USA, 1993.
14. D. Erhan, Y. Bengio, A. Courville, P.A. Manzagol, P. Vincent, and S. Bengio, "Why does unsupervised pre-training help deep learning," JMLR, 2010.
15. D. Yu, L. Deng, and G. Dahl, "Roles of pre-training and fine-tuning in context-dependent DBN-HMMs for real-world speech recognition," in NIPS Workshop, 2010.
16. F. Seide, G. Li, X. Chen, and D. Yu, "Feature engineering in context-dependent deep neural networks for conversational speech transcription," in IEEE ASRU, 2011.
17. T.N. Sainath, B. Kingsbury, B. Ramabhadran, P. Fousek, P. Novak, and A.R. Mohamed, "Making deep belief networks effective for large vocabulary continuous speech recognition," in IEEE ASRU, 2011
18. Y. Bengio, "Learning deep architectures for AI," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127,2009.
19. Y.-J. Wu and R.H. Wang, "Minimum generation error training for HMM-based speech synthesis", In Proc. ICASSP, 2006.
20. C. Julian Chen, Ramesh A. Gopinath, Michael D. Monkowski, Michael A. Picheny, and Katherine Shen, "New methods in continuous Mandarin speech recognition.," in EUROSPEECH. 1997, ISCA.
21. Z.-H. Ling, Y.-J. Wu, Y.-P. Wang, L. Qin, and R.-H. Wang, "USTC System for Blizzard Challenge 2006 an Improved HMM-based Speech Synthesis Method," Proc. Blizzard Challenge 2006 Workshop, 2006.
22. K. Shinoda, and T. Watanable, "MDL-based Context-Dependent Sub-word Modeling for Speech Recognition", J. Acoust. Soc. Jpn(E), vol.21, no.2, pp.79-86,2000.