Continuous F0 Modeling for HMM Based Statistical Parametric Speech Synthesis

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 5, 2011, Pages 1071-1079

  Yu, Kai ^a   Young, Steve ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

F0 modeling; hidden Markov model (HMM) based synthesis; statistical parametric speech synthesis; voicing classification

Indexed keywords

EID: 85008023596     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2010.2076805     Document Type: Article

References (27)

1. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, “Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis,” in Proc. Eurospeech, 1999, pp. 2347–2350.
2. H. Kawahara, I. M. Katsuse, and A. D. Cheveigne “Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds,” Speech Commun., vol. 27, no. 3–4, pp. 187–207, 1999.
3. H. Kawahara, J. Estill, and O. Fujimura, “Aperiodicity extraction and control using mixed mode excitation and group delay manipulation for a high quality speech analysis, modification and synthesis system straight,” in Proc. MAVEBA, 2001.
4. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, “Speech parameter generation algorithms for HMM-based speech synthesis,” in Proc. ICASSP, 2000, pp. 1315–1318.
5. S. Imai, “Cepstral analysis synthesis on the mel frequency scale,” in Proc. ICASSP, 1983, pp. 93–96.
6. H. Kawahara, H. Katayose, A. D. Cheveigne, and R. D. Patterson, “Fixed point analysis of frequency to instantaneous frequency mapping for accurate estimation of F0 and periodicity,” in Proc. Eurospeech, 1999, pp. 2781–2784.
7. X. Huang, A. Acero, and H. Hon, Spoken Language Process. Upper Saddle River, NJ: Prentice-Hall, 2001.
8. D. Talkin, “A robust algorithm for pitch tracking (RAPT),” in Speech Coding Synth., Amsterdam, The Netherlands: Elsevier, 1995, pp. 497–516.
9. K. Tokuda, T. Mausko, N. Miyazaki, and T. Kobayashi “Multi-space probability distribution HMM,” IEICE Trans. Inf. Syst., vol. E85-D, no. 3, pp. 455–464, 2002.
10. T. Yoshimura, “Simultaneous modelling of phonetic and prosodic parameters, and characteristic conversion for HMM based text-to-speech systems,” Ph.D. dissertation, Nagoya Inst. of Technol., Nagoya, Japan, 2002.
11. T. Masuko, K. Tokuda, N. Miyazaki, and T. Kobayashi “Pitch pattern generation using multi-space probability distribution HMM,” IEICE Trans., vol. J83-D-II, no. 7, pp. 1600–1609, 2000.
12. G. J. Freij and F. Fallside, “Lexical stress recognition using hidden Markov modeld,” in Proc. ICASSP, 1988, pp. 135–138.
13. U. Jensen, R. K. Moore, P. Dalsgaard, and B. Lindberg “Modelling intonation contours at the phrase level using continuous density hidden Markov models,” Comput. Speech Lang., vol. 8, pp. 247–260, 1994.
14. K. N. Ross and M. Ostendorf, “A dynamical system model for generating fundamental frequency for speech synthesis,” IEEE Trans. Speech Audio Process., vol. 7, no. 3, pp. 295–309, May 1999.
15. K. Yu, T. Toda, M. Gasic, S. Keizer, F. Mairesse, B. Thomson, and S. Young, “Probablistic modeling of F0 in unvoiced regions in HMM based speech synthesis,” in Proc. ICASSP, 2009.
16. A. Papoulis, Probability, Random Rariables, and Stochastic Processes. New York: McGraw-Hill, 1984.
17. H. Zen, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, “A pitch pattern modeling technique using dynamic features on the border of voiced and unvoiced segments,” Tech. Rep. IEICE, vol. 101, no. 325, pp. 53–58, 2001.
18. K. Tokuda, T. Kobayashi, and S. Imai, “Speech parameter generation from HMM using dynamic features,” in Proc. ICASSP, 1995, pp. 660–663.
19. K. Shinoda and T. Watanabe, “Acoustic modeling based on the MDL principle for speech recognition,” in Proc. Eurospeech, 1997, pp. 99–102.
20. N. Miyazaki, K. Tokuda, T. Masuko, and T. Kobayashi, “A study on pitch pattern generation using HMMs based on multi-space probability distributions,” Tech. Rep. IEICE, vol. SP98–12, 1998.
21. T. Lyche and L. L. Schumaker, “On the convergence of cubic interpolating splines,” in Spline Functions and Approximation Theory. New York: Birkhauser, 1973, pp. 169–189.
22. J. Kominek and A. Black, CMU ARCTIC Databases for Speech Synthesis Lang. Technol. Inst., School of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, 2003, Tech. Rep. CMU-LTI-03-177.
23. HMM-Based Speech Synthesis System (HTS). [Online]. Available: http://hts.sp.nitech.ac.jp
24. H. Zen, T. Toda, M. Nakamura, and K. Tokuda “Details of the Nitech HMM-based speech synthesis system for the Blizzard Challenge 2005,” IEICE Trans. Inf. Syst., vol. E90-D, no. 1, pp. 325–333, 2007.
25. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, “Duration modeling in HMM-based speech synthesis system,” in Proc. ICSLP, 1998, pp. 29–32.
26. H. Zen, K. Tokuda, T. Masuko, T. Yoshimura, T. Kobayashi, and T. Kitamura “State duration modeling for HMM-based speech synthesis,” IEICE Trans. Inf. Syst., vol. E90-D, no. 3, pp. 692–693, 2007.
27. T. Toda and K. Tokuda “A speech parameter generation algorithm considering global variance for HMM-based speech synthesis,” IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 816–824, 2007.