Voice source modelling using deep neural networks for statistical parametric speech synthesis

European Signal Processing Conference

Volumn , Issue , 2014, Pages 2290-2294

  Raitio, Tuomo ^a   Lu, Heng ^b   Kane, John ^c   Suni, Antti ^d   Vainio, Martti ^d   King, Simon ^b   Alku, Paavo ^a  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c TRINITY COLLEGE DUBLIN   (Ireland)

^d UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Deep neural network; DNN; glottal flow; statistical parametric speech synthesis; voice source modelling

Indexed keywords

DEEP NEURAL NETWORKS; SIGNAL PROCESSING; SPEECH SYNTHESIS; TIME DOMAIN ANALYSIS;

ACOUSTIC FEATURES; GLOTTAL FLOW; MODELLING METHOD; PITCH SYNCHRONOUS; SPEECH DATABASE; STATISTICAL PARAMETRIC SPEECH SYNTHESIS; SUBJECTIVE LISTENING TEST; VOICE SOURCES;

NEURAL NETWORKS;

EID: 84911869827     PISSN: 22195491     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. T. Yoshimura, K. Tokuda, T.Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis," in Proc. Eurospeech, 1999, pp. 2374-2350.
2. Heiga Zen, Keiichi Tokuda, and Alan W. Black, "Statistical parametric speech synthesis," Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009.
3. A. Hunt and A. Black, "Unit selection in a concatenative speech synthesis system using a large speech database," in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., 1996, pp. 373-376.
4. J. Makhoul, "Linear prediction: A tutorial review," Proceedings of the IEEE, vol. 63, no. 4, pp. 561-580, 1975.
5. T. Yoshimura, K. Tokuda, T.Masuko, T. Kobayashi, and T. Kitamura, "Speaker interpolation in HMM-based speech synthesis system," in Proc. Eurospeech, 1997, pp. 2523-2526.
6. S.-J. Kim and M. Hahn, "Two-band excitation for HMMbased speech synthesis," IEICE Trans. Inf. Syst., vol. E90-D, 2007.
7. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigné, "Restructuring speech representations using a pitch-adaptive timefrequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds," Speech Commun., vol. 27, no. 3-4, pp. 187-207, 1999.
8. H. Kawahara, Jo Estill, and O. Fujimura, "Aperiodicity extraction and control using mixed mode excitation and group delay manipulation for a high quality speech analysis, modification and synthesis system STRAIGHT," in 2nd International Workshop on Models and Analysis of Vocal Emissions for Biomedical Applications (MAVEBA), 2001.
9. R. Maia, T. Toda, H. Zen, Y. Nankaku, and K. Tokuda, "An excitation model for HMM-based speech synthesis based on residual modeling," in 6th ISCA Workshop on Speech Synthesis, 2007.
10. R. Maia, H. Zen, and M. J. F. Gales, "Statistical parametric speech synthesis with joint estimation of acoustic and excitation model parameters," in 7th ISCA Speech Synthesis Workshop, 2010, pp. 88-93.
11. J. Cabral, S. Renalds, K. Richmond, and J. Yamagishi, "Towards an improved modeling of the glottal source in statistical parametric speech synthesis," in 6th ISCA Workshop on Speech Synthesis, 2007, pp. 113-118.
12. J. Cabral, S. Renalds, K. Richmond, and J. Yamagishi, "Glottal spectral separation for parametric speech synthesis," in Proc. Interspeech, 2008, pp. 1829-1832.
13. J. Holmes, "The influence of glottal waveform on the naturalness of speech from a parallel formant synthesizer," IEEE Trans. Audio and Electroac., vol. 21, no. 3, pp. 298-305, 1973.
14. K. Matsui, S. D. Pearson, K. Hata, and T. Kamai, "Improving naturalness in text-to-speech synthesis using natural glottal source," in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., 1991, vol. 2, pp. 769-772.
15. G. Fries, "Hybrid time-and frequency-domain speech synthesis with extended glottal source generation," in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., 1994, vol. 1, pp. 581-584.
16. T. Raitio, A. Suni, H. Pulakka, M. Vainio, and P. Alku, "HMM-based Finnish text-to-speech system utilizing glottal inverse filtering," in Proc. Interspeech, 2008, pp. 1881-1884.
17. T. Raitio, A. Suni, J. Yamagishi, H. Pulakka, J. Nurminen, M. Vainio, and P. Alku, "HMM-based speech synthesis utilizing glottal inverse filtering," IEEE Trans. Audio Speech Lang. Proc., vol. 19, no. 1, pp. 153-165, 2011.
18. T. Drugman, G. Wilfart, and T. Dutoit, "A deterministic plus stochastic model of the residual signal for improved parametric speech synthesis," in Proc. Interspeech, 2009, pp. 1779-1782.
19. J. Sung, D. Hong, K. Oh, and N. Kim, "Excitation modeling based on waveform interpolation for HMM-based speech synthesis," in Proc. Interspeech, 2010, pp. 813-816.
20. T. Drugman and T. Dutoit, "The deterministic plus stochastic model of the residual signal and its applications," IEEE Trans. Audio Speech Lang. Proc., vol. 20, no. 3, pp. 968-981, 2012.
21. T. Raitio, A. Suni, M. Vainio, and P. Alku, "Comparing glottal-flow-excited statistical parametric speech synthesis methods," in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., 2013, pp. 7830-7834.
22. T. Drugman, G. Wilfart, A. Moinet, and T. Dutoit, "Using a pitch-synchronous residual codebook for hybrid HMM/frame selection speech synthesis," in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., 2009, pp. 3793-3796.
23. T. Raitio, A. Suni, H. Pulakka,M. Vainio, and P. Alku, "Utilizing glottal source pulse library for generating improved excitation signal for HMM-based speech synthesis," in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., 2011, pp. 4564-4567.
24. G. Hinton, L. Deng, D. Yu, G. Dahl, A.-R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition," IEEE Sig. Proc. Mag., vol. 29, no. 6, pp. 82-97, 2012.
25. H. Zen, A. Senior, and M. Schuster, "Statistical parametric speech synthesis using deep neural networks," in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., 2013, pp. 7962-7966.
26. P. Alku, "Glottal wave analysis with pitch synchronous iterative adaptive inverse filtering," Speech Commun., vol. 11, no. 2-3, pp. 109-118, 1992.
27. H. Zen, T. Nose, J. Yamagishi, S. Sako, T. Masuko, A. Black, and K. Tokuda, "The HMM-based speech synthesis system (HTS) version 2.0," in 6th ISCA Workshop on Speech Synthesis, 2007, pp. 294-299.