Statistical parametric speech synthesis using deep neural networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 7962-7966

  Ze, Heiga ^a   Senior, Andrew ^a   Schuster, Mike ^a  

^a GOOGLE INC   (United States)

Author keywords

Deep neural network; Hidden Markov model; Statistical parametric speech synthesis

Indexed keywords

CONTEXT DEPENDENCY; CONTEXT DEPENDENT; CONVENTIONAL APPROACH; DEEP NEURAL NETWORKS; HIDDEN MARKOV MODELS (HMMS); HMM-BASED SYSTEMS; PROBABILITY DENSITIES; STATISTICAL PARAMETRIC SPEECH SYNTHESIS;

DECISION TREES; HIDDEN MARKOV MODELS; PROBABILITY; SIGNAL PROCESSING; SPEECH SYNTHESIS;

NEURAL NETWORKS;

EID: 84890490547     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639215     Document Type: Conference Paper

References (40)

1. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis," in Proc. Eurospeech, 1999, pp. 2347-2350.
2. A. Hunt and A. Black, "Unit selection in a concatenative speech syn-thesis system using a large speech database," in Proc. ICASSP, 1996, pp. 373-376.
3. M. Tamura, T. Masuko, K. Tokuda, and T. Kobayashi, "Adaptation of pitch and spectrum for HMM-based speech synthesis using MLLR," in Proc. ICASSP, 2001, pp. 805-808.
4. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Speaker interpolation in HMM-based speech synthesis system," in Proc. Eurospeech, 1997, pp. 2523-2526.
5. K. Shichiri, A. Sawabe, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Eigenvoices for HMM-based speech synthesis," in Proc. ICSLP, 2002, pp. 1269-1272.
6. T. Nose, J. Yamagishi, T. Masuko, and T. Kobayashi, "A style control technique for HMM-based expressive speech synthesis," IEICE Trans. Inf. Syst., vol. E90-D, no. 9, pp. 1406-1413, 2007.
7. Y. Morioka, S. Kataoka, H. Zen, Y. Nankaku, K. Tokuda, and T. Ki-tamura, "Miniaturization of HMM-based speech synthesis," in Proc. Autumn Meeting of ASJ, 2004, pp. 325-326, (in Japanese).
8. S.-J. Kim, J.-J. Kim, and M.-S. Hahn, "HMM-based Korean speech synthesis system for hand-held devices," IEEE Trans. Consum. Elec-tron., vol. 52, no. 4, pp. 1384-1390, 2006.
9. A. Gutkin, X. Gonzalvo, S. Breuer, and P. Taylor, "Quantized HMMs for low footprint text-to-speech synthesis," in Proc. Interspeech, 2010, pp. 837-840.
10. J. Yamagishi, T. Nose, H. Zen, Z.-H. Ling, T. Toda, K. Tokuda, S. King, and S. Renals, "Robust speaker-adaptive HMM-based text-to-speech synthesis," IEEE Trans. Audio Speech Lang. Process., vol. 17, no. 6, pp. 1208-1230, 2009.
11. H. Zen, K. Tokuda, and A. Black, "Statistical parametric speech syn-thesis," Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009.
12. K. Tokuda, H. Zen, and A. Black, "An HMM-based speech synthesis system applied to English," in Proc. IEEE Speech Synthesis Workshop, 2002, CD-ROM Proceeding.
13. J. Odell, The use of context in large vocabulary speech recognition, Ph.D. thesis, Cambridge University, 1995.
14. K. Shinoda and T. Watanabe, "Acoustic modeling based on the MDL criterion for speech recognition," in Proc. Eurospeech, 1997, pp. 99-102.
15. W. Chou and W. Reichl, "Decision tree state tying based on penalized Bayesian information criterion," in Proc. ICASSP, 1999, vol. 1, pp. 345-348.
16. T. Shinozaki, "HMM state clustering based on efficient cross-validation," in Proc. ICASSP, 2006, pp. 1157-1160.
17. H. Zen and M.J.F. Gales, "Decision tree-based context clustering based on cross validation and hierarchical priors," in Proc. ICASSP, 2011, pp. 4560-4563.
18. S. Esmeir and S. Markovitch, "Anytime learning of decision trees," J. Mach. Learn. Res., vol. 8, pp. 891-933, 2007.
19. K. Yu, H. Zen, F. Mairesse, and S. Young, "Context adaptive train-ing with factorized decision trees for HMM-based statistical parametric speech synthesis," Speech Commun., vol. 53, no. 6, pp. 914-923, 2011.
20. Y. Bengio, "Learning deep architectures for AI," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127, 2009.
21. J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, Q. Le, M. Mao, M. Ranzato, A. Senior, P. Tucker, K. Yang, and A. Ng, "Large scale distributed deep networks," in Proc. NIPS, 2012.
22. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition," IEEE Signal Process. Magazine, vol. 29, no. 6, pp. 82-97, 2012.
23. B. Uria, I. Murray, S. Renals, and K. Richmond, "Deep architectures for articulatory inversion," in Proc. Interspeech, 2012.
24. O. Karaali, G. Corrigan, and I. Gerson, "Speech synthesis with neural networks," in Proc. World Congress on Neural Networks, 1996, pp. 45-50.
25. Y. Qian, H. Liang, and F. Soong, "Generating natural F0 trajectory with additive trees," in Proc. Interspeech, 2008, pp. 2126-2129.
26. Y. Nankaku, K. Nakamura, H. Zen, and K. Tokuda, "Acoustic modeling with contextual additive structure for HMM-based speech recognition," in Proc. ICASSP, 2008, pp. 4469-4472.
27. K. Saino, A clustering technique for factor analysis-based eigenvoice models, Master thesis, Nagoya Institute of Technology, 2008, (in Japanese).
28. H. Zen, M. Gales, Y. Nankaku, and K. Tokuda, "Product of experts for statistical parametric speech synthesis," IEEE Trans. Audio Speech Lang. Process., vol. 20, no. 3, pp. 794-805, 2012.
29. K. Yu, F. Mairesse, and S. Young, "Word-level emphasis modelling in HMM-based speech synthesis," in Proc. ICASSP, 2010, pp. 4238-4241.
30. D. Yu and L. Deng, "Deep learning and its applications to signal and information processing," IEEE Signal Process. Magazine, vol. 28, no. 1, pp. 145-154, 2011.
31. S. Furui, "Speaker independent isolated word recognition using dy-namic features of speech spectrum," IEEE Trans. Acoust. Speech Signal Process., vol. 34, pp. 52-59, 1986.
32. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech syn-thesis," in Proc. ICASSP, 2000, pp. 1315-1318.
33. H. Zen, T. Toda, M. Nakamura, and T. Tokuda, "Details of the Nitech HMM-based speech synthesis system for the Blizzard Challenge 2005," IEICE Trans. Inf. Syst., vol. E90-D, no. 1, pp. 325-333, 2007.
34. T. Fukada, K. Tokuda, T. Kobayashi, and S. Imai, "An adaptive algo-rithm for mel-cepstral analysis of speech," in Proc. ICASSP, 1992, pp. 137-140.
35. H. Zen, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "A hidden semi-Markov model-based speech synthesis system," IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 825-834, 2007.
36. K. Tokuda, T. Masuko, N. Miyazaki, and T. Kobayashi, "Multi-space probability distribution HMM," IEICE Trans. Inf. Syst., vol. E85-D, no. 3, pp. 455-464, 2002.
37. K. Yu and S. Young, "Continuous F0 modelling for HMM based sta-tistical parametric speech synthesis," IEEE Trans. Audio Speech Lang. Process., vol. 19, no. 5, pp. 1071-1079, 2011.
38. T. Toda and K. Tokuda, "A speech parameter generation algorithm considering global variance for HMM-based speech synthesis," IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 816-824, 2007.
39. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Incorporation of mixed excitation model and postfilter into HMM-based text-to-speech synthesis," IEICE Trans. Inf. Syst., vol. J87-D-II, no. 8, pp. 1563-1571, 2004.
40. T. Toda, A. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 8, pp. 2222-2235, 2007