Deep neural network-guided unit selection synthesis

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5145-5149

  Merritt, Thomas ^a   Clark, Robert A J ^a,c   Wu, Zhizheng ^a   Yamagishi, Junichi ^a,b   King, Simon ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^c GOOGLE INC   (United States)

Author keywords

deep neural networks; embedding; hybrid synthesis; speech synthesis; unit selection

Indexed keywords

EID: 84973402504     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472658     Document Type: Conference Paper

References (36)

1. Simon King and Vasilis Karaiskos, "The Blizzard Challenge 2011, " in Proc. Blizzard Challenge, 2011.
2. Simon King and Vasilis Karaiskos, "The Blizzard Challenge 2012, " in Proc. Blizzard Challenge, 2012.
3. Simon King and Vasilis Karaiskos, "The Blizzard Challenge 2013, " in Proc. Blizzard Challenge, 2013.
4. Simon King, "Measuring a decade of progress in text-to-speech, " Loquens, vol. 1, no. 1, 2014.
5. Thomas Merritt and Simon King, "Investigating the shortcomings of HMM synthesis, " in Proc. 8th ISCA Speech Synthesis Workshop, 2013, pp. 165-170.
6. Thomas Merritt, Tuomo Raitio, and Simon King, "Investigating source and filter contributions, and their interaction, to statistical parametric speech synthesis, " in Proc. Interspeech, 2014, pp. 1509-1513.
7. Gustav Eje Henter, Thomas Merritt, Matt Shannon, Catherine Mayo, and Simon King, "Measuring the perceptual effects of modelling assumptions in speech synthesis using stimuli constructed from repeated natural speech, " in Proc. Interspeech, 2014, pp. 1504-1508.
8. Thomas Merritt, Javier Latorre, and Simon King, "Attributing modelling errors in HMM synthesis by stepping gradually from natural to modelled speech, " in Proc. ICASSP, 2015.
9. Thomas Merritt, Junichi Yamagishi, Zhizheng Wu, Oliver Watts, and Simon King, "Deep neural network context embeddings for model selection in rich-context HMM synthesis, " in Proc. Interspeech, 2015.
10. Andrew J Hunt and Alan W Black, "Unit selection in a concatenative speech synthesis system using a large speech database, " in Proc. ICASSP, 1996, pp. 373-376.
11. Alan W Black and Paul A Taylor, "Automatically clustering similar units for unit selection in speech synthesis., " in Proc. Eurospeech, 1997.
12. Paul Taylor, Alan W Black, and Richard Caley, "The architecture of the festival speech synthesis system, " in The Third ESCA/COCOSDA Workshop on Speech Synthesis, 1998.
13. Paul Taylor, "The target cost formulation in unit selection speech synthesis., " in Proc. Interspeech, 2006, pp. 2038-2041.
14. Yao Qian, Frank K Soong, and Zhi-Jie Yan, "A unified trajectory tiling approach to high quality speech rendering, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 21, no. 2, pp. 280-290, 2013.
15. Zhen-Hua Ling, Heng Lu, Guo-Ping Hu, Li-Rong Dai, and Ren-Hua Wang, "The USTC system for Blizzard Challenge 2008, " in Proc. Blizzard Challenge, 2008.
16. Zhi-Jie Yan, Yao Qian, and Frank K Soong, "Rich-context unit selection (RUS) approach to high quality TTS, " in Proc. ICASSP, 2010, pp. 4798-4801.
17. Vincent Pollet and Andrew Breen, "Synthesis by generation and concatenation of multiform segments., " in Proc. Interspeech, 2008, pp. 1825-1828.
18. Alexander Sorin, Slava Shechtman, and Vincent Pollet, "Uniform Speech Parameterization for Multi-form Segment Synthesis, " in Proc. Interspeech, 2011, pp. 337-340.
19. Alexander Sorin, Slava Shechtman, and Vincent Pollet, "Psychoacoustic Segment Scoring for Multi-Form Speech Synthesis., " in Proc. Interspeech, 2012, pp. 2214-2217.
20. Alexander Sorin, Slava Shechtman, and Vincent Pollet, "Refined Intersegment Joining in Multi-Form Speech Synthesis, " in Proc. Interspeech, 2014, pp. 790-794.
21. Raul Fernandez, Asaf Rendel, Bhuvana Ramabhadran, and Ron Hoory, "Using Deep Bidirectional Recurrent Neural Networks for Prosodic-Target Prediction in a Unit-Selection Text-to-Speech System, " in Proc. Interspeech, 2015.
22. Zhizheng Wu, Cassia Valentini-Botinhao, Oliver Watts, and Simon King, "Deep neural networks employing multi-task learning and stacked bottleneck features for speech synthesis, " in Proc. ICASSP, 2015.
23. Zhen-Hua Ling, Shi-Yin Kang, Heiga Zen, Andrew Senior, Mike Schuster, Xiao-Jun Qian, Helen M Meng, and Li Deng, "Deep learning for acoustic modeling in parametric speech generation: A systematic review of existing techniques and future trends, " IEEE Signal Processing Magazine, vol. 32, no. 3, pp. 35-52, 2015.
24. Heiga Zen, "Acoustic Modeling in Statistical Parametric Speech Synthesis-From HMM to LSTM-RNN, " in Proc. MLSLP, 2015.
25. Sin-Horng Chen, Shaw-Hwa Hwang, and Yih-Ru Wang, "An RNNbased prosodic information synthesizer for Mandarin text-to-speech, " IEEE Transactions on Speech and Audio Processing, vol. 6, no. 3, pp. 226-239, 1998.
26. Zhi-Jie Yan, Yao Qian, and Frank K Soong, "Rich context modeling for high quality HMM-based TTS, " in Proc. Interspeech, 2009, pp. 1755-1758.
27. Robert AJ Clark, Korin Richmond, and Simon King, "Festival 2-build your own general purpose unit selection speech synthesiser, " in Proc. SSW5, 2004.
28. Robert AJ Clark, Korin Richmond, and Simon King, "Multisyn: Opendomain unit selection for the festival speech synthesis system, " Speech Communication, vol. 49, no. 4, pp. 317-330, 2007.
29. John R. Hershey and Peder A. Olsen, "Approximating the Kullback-Leibler divergence between Gaussian mixture models, " in Proc. ICASSP, 2007.
30. Heiga Zen, Takashi Nose, Junichi Yamagishi, Shinji Sako, Takashi Masuko, Alan W. Black, and Keiichi Tokuda, "The HMM-based speech synthesis system (HTS) version 2. 0, " in Proc. SSW6, 2007, pp. 294-299.
31. Zhizheng Wu and Simon King, "Minimum trajectory error training for deep neural networks, combined with stacked bottleneck features, " in Proc. Interspeech, 2015.
32. Martin Cooke, Catherine Mayo, and Cassia Valentini-Botinhao, "Hurricane natural speech corpus, [sound], " LISTA Consortium, doi: 10. 7488/ds/140, 2013.
33. International Telecommunication Union, Telecommunication Standardization Sector, Geneva, Switzerland, Objective measurement of active speech level, March 2011.
34. International Telecommunication Union Radiocommunication Assembly, Geneva, Switzerland, Method for the subjective assessment of intermediate quality level of coding systems, March 2003.
35. Thomas Merritt, Robert A. J. Clark, Zhizheng Wu, Junichi Yamagishi, and Simon King, "Listening test materials for "Deep neural network-guided unit selection synthesis", 2016 [dataset], " University of Edinburgh, The Centre for Speech Technology Research (CSTR), doi: 10. 7488/ds/1313.
36. Alistair D. Conkie and Stephen Isard, "Optimal coupling of diphones, " in Progress in speech synthesis, pp. 293-304. Springer, 1997.