Generative adversarial network-based glottal waveform model for statistical parametric speech synthesis

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2017-August, Issue , 2017, Pages 3394-3398

  Bollepalli, Bajibabu ^a   Juvela, Lauri ^a   Alku, Paavo ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

DNN; GAN; Glottal souce modelling; TTS

Indexed keywords

ADDITIVE NOISE; DEEP NEURAL NETWORKS; SPEECH; SPEECH SYNTHESIS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS; VOCODERS;

ADVERSARIAL NETWORKS; CONDITIONAL AVERAGE; DATA DISTRIBUTION; EXCITATION MODELS; STATISTICAL PARAMETRIC SPEECH SYNTHESIS; STOCHASTIC COMPONENT; STOCHASTIC VARIATION; WAVEFORM MODELING;

SPEECH COMMUNICATION;

EID: 85039171110     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: 10.21437/Interspeech.2017-1288     Document Type: Conference Paper

References (38)

1. K. Tokuda, Y. Nankaku, T. Toda, H. Zen, J. Yamagishi, and K. Oura, "Speech synthesis based on hidden Markov models, " Proceedings of the IEEE, vol. 101, no. 5, pp. 1234-1252, May 2013.
2. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis, " Speech Communication, vol. 51, no. 11, pp. 1039-1064, 2009.
3. H. Zen, A. Senior, and M. Schuster, "Statistical parametric speech synthesis using deep neural networks, " in Proc. of ICASSP, May 2013, pp. 7962-7966.
4. Y. Fan, Y. Qian, F.-L. Xie, and F. K. Soong, "TTS synthesis with bidirectional LSTM based recurrent neural networks." in Interspeech, 2014, pp. 1964-1968.
5. H. Zen and H. Sak, "Unidirectional long short-term memory recurrent neural network with recurrent output layer for low-latency speech synthesis, " in Proc. of ICASSP. IEEE, 2015, pp. 4470-4474.
6. Z. Wu and S. King, "Improving trajectory modelling for DNNbased speech synthesis by using stacked bottleneck features and minimum generation error training, " IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 24, no. 7, pp. 1255-1265, 2016.
7. X. Wang, S. Takaki, and J. Yamagishi, "An autoregressive recurrent mixture density network for parametric speech synthesis, " in Proc. of ICASSP. IEEE, 2017, pp. 4895-4899.
8. H. Kawahara, I. Masuda-Katsuse, and A. De Cheveigne, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds, " Speech communication, vol. 27, no. 3, pp. 187-207, 1999.
9. H. Kawahara, J. Estill, and O. Fujimura, "Aperiodicity extraction and control using mixed mode excitation and group delay manipulation for a high quality speech analysis, modification and synthesis system straight, " in MAVEBA, 2001.
10. T. Raitio, A. Suni, J. Yamagishi, H. Pulakka, J. Nurminen, M. Vainio, and P. Alku, "HMM-based speech synthesis utilizing glottal inverse filtering, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 1, pp. 153-165, January 2011.
11. M. Airaksinen, B. Bollepalli, L. Juvela, Z. Wu, S. King, and P. Alku, "GlottDNN-a full-band glottal vocoder for statistical parametric speech synthesis, " in Proc. of Interspeech, 2016.
12. Y. Stylianou, "Applying the harmonic plus noise model in concatenative speech synthesis, " IEEE Transactions on Speech and Audio Processing, vol. 9, no. 1, pp. 21-29, 2001.
13. D. Erro, I. Sainz, E. Navas, and I. Hernaez, "Harmonics plus noise model based vocoder for statistical parametric speech synthesis, " IEEE Journal of Selected Topics in Signal Processing, vol. 8, no. 2, pp. 184-194, April 2014.
14. P. Alku, "Glottal wave analysis with pitch synchronous iterative adaptive inverse filtering, " Speech Communication, vol. 11, no. 2-3, pp. 109-118, 1992, Eurospeech '91.
15. L. Juvela, B. Bollepalli, M. Airaksinen, and P. Alku, "Highpitched excitation generation for glottal vocoding in statistical parametric speech synthesis using a deep neural network, " in "Proc. of ICASSP", Mar. 2016, pp. 5120-5124.
16. M. Airaksinen, B. Bollepalli, J. Pohjalainen, and P. Alku, "Glottal vocoding with frequency-warped time-weighted linear prediction, " IEEE Signal Processing Letters, vol. 24, no. 4, pp. 446-450, April 2017.
17. T. Raitio, A. Suni, L. Juvela, M. Vainio, and P. Alku, "Deep neural network based trainable voice source model for synthesis of speech with varying vocal effort, " in Proc. of Interspeech, Singapore, September 2014, pp. 1969-1973.
18. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets, " in Advances in neural information processing systems, 2014, pp. 2672-2680.
19. A. van den Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, and K. Kavukcuoglu, "WaveNet: A generative model for raw audio, " Pre-print, 2016, https://arxiv.org/pdf/1609.03499.pdf.
20. S. O. Arik, M. Chrzanowski, A. Coates, G. Diamos, A. Gibiansky, Y. Kang, X. Li, J. Miller, A. Ng, J. Raiman, S. Sengupta, and M. Shoeybi, "Deep voice: Real-time neural text-to-speech, " in ICML 2017 (submission), 2017, https://arxiv.org/pdf/1702.07825.pdf.
21. H. Zen, "Generative model-based text-to-speech synthesis, " 2017, invited talk given at CBMM workshop on speech representation, perception and recognition.
22. T. Drugman, P. Alku, A. Alwan, and B. Yegnanarayana, "Glottal source processing: From analysis to applications, " Computer Speech & Language, vol. 28, no. 5, pp. 1117-1138, 2014.
23. P. Alku, "Glottal inverse filtering analysis of human voice production-a review of estimation and parameterization methods of the glottal excitation and their applications. (invited article), " Sadhana-Academy Proceedings in Engineering Sciences, vol. 36, no. 5, pp. 623-650, 2011.
24. T. Kaneko, H. Kameoka, N. Hojo, Y. Ijima, K. Hiramatsu, and K. Kashino, "Generative adversarial network-based postfilter for statistical parametric speech synthesis, " in Proc. of ICASSP, March 2017, pp. 4910-4914.
25. Y. Saito, S. Takamichi, and H. Saruwatari, "Training algorithm to deceive anti-spoofing verification for dnn-based speech synthesis, " in ICASSP, New Orleans, USA, 2017, pp. 4900-4904.
26. A. Radford, L. Metz, and S. Chintala, "Unsupervised representation learning with deep convolutional generative adversarial networks, " arXiv preprint arXiv:1511.06434, 2015.
27. M. Mirza and S. Osindero, "Conditional generative adversarial nets, " arXiv preprint arXiv:1411.1784, 2014.
28. S.-W. Fu, Y. Tsao, X. Lu, and H. Kawai, "Raw waveform-based speech enhancement by fully convolutional networks, " arXiv preprint arXiv:1703.02205, 2017.
29. X. Mao, Q. Li, H. Xie, R. Y. Lau, and Z. Wang, "Least squares generative adversarial networks, " arXiv preprint arXiv:1611.04076v2, 2017.
30. A.W. Black and K. A. Lenzo, "Flite: a small fast run-time synthesis engine, " in 4th ISCA Tutorial and Research Workshop (ITRW) on Speech Synthesis, 2001.
31. K. Richmond, R. A. Clark, and S. Fitt, "Robust LTS rules with the Combilex speech technology lexicon, " in Proc. of Interspeech, Brighton, September 2009, pp. 1295-1298.
32. H. Zen, K. Tokuda, and T. Kitamura, "An introduction of trajectory model into HMM-based speech synthesis, " in Fifth ISCA Workshop on Speech Synthesis, 2004.
33. L. Juvela, B. Bollepalli, J. Yamagishi, and P. Alku, "Reducing mismatch in training of DNN-based glottal excitation models in a statistical parametric text-to-speech system, " in "Submitted to Interspeech", 2017.
34. S. Ioffe and C. Szegedy, "Batch normalization: Accelerating deep network training by reducing internal covariate shift, " arXiv preprint arXiv:1502.03167, 2015.
35. E. Moulines and J. Laroche, "Non-parametric techniques for pitch-scale and time-scale modification of speech, " Speech communication, vol. 16, no. 2, pp. 175-205, 1995.
36. Recommendation ITUTP, "800, methods for subjective determination of transmission quality, " International Telecommunication Union, 1996.
37. CrowdFlower Inc. (2017) Crowd-sourcing platform. [Online]. Available: https://www.crowdflower.com/
38. (2017) EF English Proficiency Index. [Online]. Available: http://www.ef.com/epi/