Deep neural networks employing Multi-Task Learning and stacked bottleneck features for speech synthesis

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 4460-4464

  Wu, Zhizheng ^a   Valentini Botinhao, Cassia ^a   Watts, Oliver ^a   King, Simon ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

acoustic model; bottleneck feature; deep neural network; multi task learning; Speech synthesis

Indexed keywords

AUDIO SIGNAL PROCESSING; COMPLEX NETWORKS; LINGUISTICS; MAPPING; SPEECH COMMUNICATION; SPEECH SYNTHESIS;

ACOUSTIC MODEL; BOTTLENECK FEATURES; LINGUISTIC FEATURES; LISTENING TESTS; MULTITASK LEARNING; PARAMETRIC SYSTEMS; SPEECH ACOUSTICS; SYNTHETIC SPEECH;

DEEP NEURAL NETWORKS;

EID: 84946033275     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178814     Document Type: Conference Paper

References (25)

1. Heiga Zen, Keiichi Tokuda, and Alan W Black, Statistical parametric speech synthesis, Speech Communication, vol. 51, no. 11, pp. 1039-1064, 2009
2. Simon King, Measuring a decade of progress in text-tospeech, Loquens, vol. 1, no. 1, 2014
3. Andrew J Hunt and Alan W Black, Unit selection in a concatenative speech synthesis system using a large speech database, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 1996
4. Yi-Jian Wu and Ren-Hua Wang, Minimum generation error training for HMM-based speech synthesis, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2006
5. Toda Tomoki and Keiichi Tokuda, A speech parameter generation algorithm considering global variance for HMM-based speech synthesis, IEICE Transactions on Information and Systems, vol. 90, no. 5, pp. 816-824, 2007
6. Heiga Zen, Keiichi Tokuda, and Tadashi Kitamura, Reformulating the HMM as a trajectory model by imposing explicit relationships between static and dynamic feature vector sequences, Computer Speech &Language, vol. 21, no. 1, pp. 153-173, 2007
7. Heiga Zen, Andrew Senior, and Mike Schuster, Statistical parametric speech synthesis using deep neural networks, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2013
8. Shiyin Kang, Xiaojun Qian, and Helen Meng, Multidistribution deep belief network for speech synthesis, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2013
9. Zhen-Hua Ling, Li Deng, and Dong Yu, Modeling spectral envelopes using Restricted Boltzmann Machines and Deep Belief Networks for statistical parametric speech synthesis, IEEE Transactions on Audio, Speech, and Language Processing, vol. 21, no. 10, pp. 2129-2139, 2013
10. Heng Lu, Simon King, and Oliver Watts, Combining a vector space representation of linguistic context with a deep neural network for text-to-speech synthesis, Proc. the 8th ISCA Speech Synthesis Workshop (SSW), 2013
11. Yao Qian, Yuchen Fan, Wenping Hu, and Frank K Soong, On the training aspects of deep neural network (DNN) for parametric TTS synthesis, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2014
12. G. Hinton, Li Deng, Dong Yu, G.E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T.N. Sainath, and B. Kingsbury, Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012
13. Rich Caruana, Multitask learning, Springer, 1998
14. Yuchen Fan, Yao Qian, Fenglong Xie, and Frank K. Soong, TTS synthesis with bidirectional LSTM based recurrent neural networks, in Proc. Interspeech, 2014
15. Michael L Seltzer and Jasha Droppo, Multi-task learning in deep neural networks for improved phoneme recognition, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2013
16. Ronan Collobert and Jason Weston, A unified architecture for natural language processing: Deep neural networks with multitask learning, in Proc. IEEE Int. Conf. on Machine Learning (ICML), 2008
17. Keiichi Tokuda, Takayoshi Yoshimura, Takashi Masuko, Takao Kobayashi, and Tadashi Kitamura, Speech parameter generation algorithms for HMM-based speech synthesis, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2000
18. Dong Yu and Michael L Seltzer, Improved bottleneck features using pretrained deep neural networks, in Proc. Interspeech, 2011
19. Tara N Sainath, Brian Kingsbury, and Bhuvana Ramabhadran, Auto-encoder bottleneck features using deep belief networks, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2012
20. Jonas Gehring, Yajie Miao, Florian Metze, and Alex Waibel, Extracting deep bottleneck features using stacked autoencoders, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2013
21. Hideki Kawahara, Ikuyo Masuda-Katsuse, and Alain Cheveigné, Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds, Speech communication, vol. 27, no. 3, pp. 187-207, 1999
22. D. P.W. Ellis, Gammatone-like spectrograms, web resource: http://www.ee.columbia.edu/ dpwe/resources/matlab/gammatonegram/, 2009
23. Martin Cooke, Glimpsing speech, Journal of Phonetics, vol. 31, pp. 579-584, 2003
24. James Bergstra, Olivier Breuleux, Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio, Theano: a CPU and GPU math expression compiler, in Proceedings of the Python for Scientific Computing Conference (SciPy), June 2010
25. Heiga Zen and Andrew Senior, Deep mixture density networks for acoustic modeling in statistical parametric speech synthesis, in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2014