Deep neural network based trainable voice source model for synthesis of speech with varying vocal effort

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 1969-1973

  Raitio, Tuomo ^a   Suni, Antti ^b   Juvela, Lauri ^a   Vainio, Martti ^b   Alku, Paavo ^a  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Deep neural network; DNN; Glottal flow; Speech synthesis; Vocal effort; Voice source modelling

Indexed keywords

SPEECH SYNTHESIS; TIME DOMAIN ANALYSIS;

DEEP NEURAL NETWORKS; DNN; GLOTTAL FLOW; VOCAL EFFORTS; VOICE SOURCES;

SPEECH COMMUNICATION;

EID: 84910068090     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis, " in Proc. Euro speech, 1999, pp. 2374-2350.
2. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis, " Speech Commun., vol. 51, no. 11, pp. 1039- 1064, 2009.
3. A. Hunt and A. Black, "Unit selection in a concatenative speech synthesis system using a large speech database, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), 1996, pp. 373-376.
4. M. Tamura, T. Masuko, K. Tokuda, and T. Kobayashi, "Adaptation of pitch and spectrum for HMM-based speech synthesis using MLLR, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), 2001, pp. 805-808.
5. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Speaker interpolation in HMM-based speech synthesis system, " in Proc. Euro speech, 1997, pp. 2523-2526.
6. K. Shichiri, A. Sawabe, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Eigenvoices for HMM-based speech synthesis, " in Proc. ICSLP, 2002, pp. 1269-1272.
7. T. Nose, J. Yamagishi, T. Masuko, and T. Kobayashi, "A style control technique for HMM-based expressive speech synthesis, " IEICE Trans. Inf. Syst., vol. E90-D, no. 9, pp. 1406-1413, 2007.
8. J. Yamagishi, T. Kobayashi, Y. Nakano, K. Ogata, and J. Isogai, "Analysis of speaker adaptation algorithms for HMM-based speech synthesis and a constrained SMAPLR adaptation algorithm, " IEEE Trans. Audio, Speech and Lang. Proc., vol. 17, no. 1, pp. 66-83, 2009.
9. S.-J. Kim, J.-J. Kim, and M.-S. Hahn, "HMM-based Korean speech synthesis system for hand-held devices, " IEEE Trans. Consum. Electron., vol. 52, no. 4, pp. 1384-1390, 2006.
10. A. Gutkin, X. Gonzalvo, S. Breuer, and P. Taylor, "Quantized HMMs for low footprint text-to-speech synthesis, " in Proc. Inter speech, 2010, pp. 837-840.
11. J. Yamagishi, T. Nose, H. Zen, Z.-H. Ling, T. Toda, K. Tokuda, S. King, and S. Renals, "Robust speaker-adaptive HMM-based text-to-speech synthesis, " IEEE Trans. Audio, Speech and Lang. Proc., vol. 17, no. 6, pp. 1208-1230, 2009.
12. J. Makhoul, "Linear prediction: A tutorial review, " Proceedings of the IEEE, vol. 63, no. 4, pp. 561-580, 1975.
13. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Mixed excitation for HMM-based speech synthesis, " in Proc. Euro speech, 2001, pp. 2259-2262.
14. S. J. Kim and M. Hahn, "Two-band excitation for HMM-based speech synthesis, " IEICE Trans. Inf. & Syst., vol. E90-D, 2007.
15. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigńe, "Restructuring speech representations using a pitch-adaptive time frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds, " Speech Commun., vol. 27, no. 3-4, pp. 187-207, 1999.
16. H. Kawahara, J. Estill, and O. Fujimura, "Aperiodicity extraction and control using mixed mode excitation and group delay manipulation for a high quality speech analysis, modification and synthesis system STRAIGHT, " in 2nd International Workshop on Models and Analysis of Vocal Emissions for Biomedical Applications (MAVEBA), 2001.
17. R. Maia, T. Toda, H. Zen, Y. Nankaku, and K. Tokuda, "An excitation model for HMM-based speech synthesis based on residual modeling, " in 6th ISCA Speech Synthesis Workshop, 2007.
18. R. Maia, H. Zen, and M. J. F. Gales, "Statistical parametric speech synthesis with joint estimation of acoustic and excitation model parameters, " in 7th ISCA Speech Synthesis Workshop, 2010, pp. 88-93.
19. J. Cabral, S. Renalds, K. Richmond, and J. Yamagishi, "Towards an improved modeling of the glottal source in statistical parametric speech synthesis, " in Sixth ISCA Workshop on Speech Synthesis, 2007, pp. 113-118.
20. J. Cabral, S. Renalds, K. Richmond, and J. Yamagishi, "Glottal spectral separation for parametric speech synthesis, " in Proc. Inter speech, 2008, pp. 1829-1832.
21. J. Holmes, "The influence of glottal waveform on the naturalness of speech from a parallel formant synthesizer, " IEEE Trans. Audio and Electro acoustics, vol. 21, no. 3, pp. 298-305, 1973.
22. K. Matsui, S. D. Pearson, K. Hata, and T. Kamai, "Improving naturalness in text-to-speech synthesis using natural glottal source, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), vol. 2, 1991, pp. 769-772.
23. G. Fries, "Hybrid time- And frequency-domain speech synthesis with extended glottal source generation, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), vol. 1, 1994, pp. 581-584.
24. T. Raitio, A. Suni, H. Pulakka, M. Vainio, and P. Alku, "HMM based Finnish text-to-speech system utilizing glottal inverse filtering, " in Proc. Inter speech, 2008, pp. 1881-1884.
25. T. Raitio, A. Suni, J. Yamagishi, H. Pulakka, J. Nurminen, M. Vainio, and P. Alku, "HMM-based speech synthesis utilizing glottal inverse filtering, " IEEE Trans. Audio, Speech and Lang. Proc., vol. 19, no. 1, pp. 153-165, 2011.
26. T. Drugman, G.Wilfart, A. Moinet, and T. Dutoit, "Using a pitchsynchronous residual codebook for hybrid HMM/frame selection speech synthesis, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), 2009, pp. 3793-3796.
27. J. Sung, D. Hong, K. Oh, and N. Kim, "Excitation modeling based on waveform interpolation for HMM-based speech synthesis, " in Proc. Inter speech, 2010, pp. 813-816.
28. T. Drugman and T. Dutoit, "The deterministic plus stochastic model of the residual signal and its applications, " IEEE Trans. Audio, Speech and Lang. Proc., vol. 20, no. 3, pp. 968-981, 2012.
29. T. Raitio, A. Suni, M. Vainio, and P. Alku, "Comparing glottalflow- excited statistical parametric speech synthesis methods, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), 2013, pp. 7830-7834.
30. T. Drugman, G. Wilfart, and T. Dutoit, "A deterministic plus stochastic model of the residual signal for improved parametric speech synthesis, " in Proc. Inter speech, 2009, pp. 1779-1782.
31. T. Raitio, A. Suni, H. Pulakka, M. Vainio, and P. Alku, "Utilizing glottal source pulse library for generating improved excitation signal for HMM-based speech synthesis, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), 2011, pp. 4564-4567.
32. B. Picart, T. Drugman, and T. Dutoit, "Analysis and HMM-based synthesis of hypo and hyperarticulated speech, " Computer Speech & Language, vol. 28, no. 2, pp. 687-707, 2014.
33. T. Raitio, A. Suni, M. Vainio, and P. Alku, "Synthesis and perception of breathy, normal, and lombard speech in the presence of noise, " Computer Speech & Language, vol. 28, no. 2, pp. 648- 664, 2014.
34. T. Raitio, J. Kane, T. Drugman, and C. Gobl, "HMM-based synthesis of creaky voice, " in Proc. Inter speech, 2013, pp. 2316- 2320.
35. T. Raitio, H. Lu, J. Kane, A. Suni, M. Vainio, S. King, and P. Alku, "Voice source modelling using deep neural networks for statistical parametric speech synthesis, " in 22nd European Signal Processing Conference (EUSIPCO), 2014, accepted.
36. P. Alku, "Glottal wave analysis with pitch synchronous iterative adaptive inverse filtering, " Speech Commun., vol. 11, no. 2-3, pp. 109-118, 1992.
37. G. Hinton, L. Deng, D. Yu, G. Dahl, A.-R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition, " IEEE Sig. Proc. Mag., vol. 29, no. 6, pp. 82-97, 2012.
38. H. Zen, A. Senior, and M. Schuster, "Statistical parametric speech synthesis using deep neural networks, " in Proc. IEEE Int. Conf. on Acoust. Speech and Signal Proc. (ICASSP), 2013, pp. 7962-7966.
39. H. Zen, T. Nose, J. Yamagishi, S. Sako, T. Masuko, A. Black, and K. Tokuda, "The HMM-based speech synthesis system (HTS) version 2.0, " in Sixth ISCA Workshop on Speech Synthesis, 2007, pp. 294-299.
40. I. R. Titze, "Nonlinear source-filter coupling in phonation: Theory, " J. Acoust. Soc. Am., vol. 123, no. 5, pp. 2733-2749, 2008.