Parameter generation methods with rich context models for high-quality and flexible text-to-speech Synthesis

IEEE Journal on Selected Topics in Signal Processing

Volumn 8, Issue 2, 2014, Pages 239-250

  Takamichi, Shinnosuke ^a   Toda, Tomoki ^a   Shiga, Yoshinori ^b   Sakti, Sakriani ^a   Neubig, Graham ^a   Nakamura, Satoshi ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

GMM; HMM based speech synthesis; over smoothing; parameter generation; rich context model

Indexed keywords

CONTEXT MODELING; GMM; HMM-BASED SPEECH SYNTHESIS; OVER-SMOOTHING; PARAMETER GENERATION;

ALGORITHMS; COMMUNICATION CHANNELS (INFORMATION THEORY); HIDDEN MARKOV MODELS; PROBABILITY DISTRIBUTIONS; SPEECH SYNTHESIS;

ITERATIVE METHODS;

EID: 84897862522     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2013.2288599     Document Type: Article

References (28)

1. Y. Sagisaka, "Speech synthesis by rule using an optimal selection of non-uniform synthesis units," in Proc. ICASSP, New York, NY, USA, Apr. 1988, pp. 679-682 (Pubitemid 18666106)
2. N. Iwahashi, N. Kaiki, and Y. Sagisaka, "Speech segment selection for concatenative synthesis based on spectral distortion minimization," IEICE Trans., Fundamentals, vol. E76-A, no. 11, pp. 1942-1948, 1993
3. A. J.Hunt and A. Black, "Unit selection in a concatenative speech synthesis system using a large speech database," in Proc. ICASSP, Atlanta, GA, USA, May 1996, pp. 373-376
4. A. K. Syrdal, C.W.Wightman, A. Conkie, Y. Stylianou, M. Beutnagel, J. Schroeter, V. Strom, K.-S. Lee, and M. Makashay, "Corpus-based techniques in the AT&T NextGen synthesis system," in Proc. ICSLP, Beijing, China, Oct. 2000, pp. 410-415
5. H. Zen, K. Tokuda, and A. Black, "Statistical parametric speech synthesis," Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009
6. T. Yoshimura, T. Masuko, K. Tokuda, T. Kobayashi, and T. Kitamura, "Speaker interpolation for HMM-based speech synthesis system," J. Acoust. Soc. Jpn. (E), vol. 21, no. 4, pp. 199-206, 2000
7. J. Yamagishi and T. Kobayashi, "Average-voice-based speech synthesis using HSMM-based speaker adaptation and adaptive training," IEICE Trans., Inf. Syst., vol. E90-D, no. 2, pp. 533-543, 2007 (Pubitemid 46279829)
8. T. Nose, J. Yamagishi, T. Masuko, and T. Kobayashi, "A style control technique forHMM-based expressive speech synthesis," IEICE Trans., Inf. Syst., vol. E90-D, no. 9, pp. 1406-1413, 2007
9. T. Toda and K. Tokuda, "A speech parameter generation algorithm considering global variance for HMM-based speech synthesis," IEICE Trans., vol. E90-D, no. 5, pp. 816-824, 2007
10. S. King and V. Karaiskos, "The blizzard challenge 2011," in Proc. Blizzard Challenge Workshop, Turin, Italy, Sep. 2011
11. Z. Ling, L. Qin, H. Lu, Y. Gao, L. Dai, R. Wang, Y. Jiang, Z. Zhao, J. Yang, J. Chen, and G. Hu, "The USTC and iflytek speech synthesis systems for blizzard challenge 2007," in Proc. Blizzard Challenge Workshop, Bonn, Germany, Aug. 2007
12. Z. Yan, Q. Yao, and S. K. Frank, "Rich context modeling for high quality HMM-based TTS," in Proc. INTERSPEECH, Brighton, U.K., Sep. 2009, pp. 1755-1758
13. Y. Qian, Z. Yan, Y. Wu, and F. K. Soong, "An HMM trajectory tiling (HTT) approach to high quality TTS," in Proc. INTERSPEECH, Chiba, Japan, Sept. 2010, pp. 422-425
14. T. Toda, H. Kawai, and M. Tsuzaki, "Optimizing sub-cost functions for segment selection based on perceptual evaluations in concatenative speech synthesis," in Proc. ICASSP,Montreal,QC, Canada, May 2004, pp. 657-660
15. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMMbased speech synthesis," in Proc. EUROSPEECH, Budapest, Hungary, Apr. 1999, pp. 2347-2350
16. K. Shinoda and T.Watanabe, "MDL-based context-dependent subword modeling for speech recognition," J. Acoust. Soc. Jpn.(E), vol. 21, no. 2, pp. 79-86, 2000 (Pubitemid 30594111)
17. K. Tokuda, T. Masuko, B. Miyazaki, and T. Kobayashi, "Multi-space probability distribution HMM," IEICE Trans., Inf. Syst., vol. E85-D, no. 3, pp. 455-464, 2002 (Pubitemid 35353984)
18. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis," in Proc. ICASSP, Istanbul, Turkey, Jun. 2000, pp. 1315-1318
19. S. Kataoka, N. Mizutani, K. Tokuda, and T. Kitamura, "Decision tree backing-off in HMM-based speech synthesis," in Proc. INTERSPEECH, Jeju, Korea, Oct. 2004, vol. 2, pp. 1205-1208
20. Z. Ling and R. Wang, "HMM-based unit selection using frame sized speech segments," in Proc. INTERSPEECH, Pittsburgh, PA, USA, Sep. 2013
21. T.Mizutani and T. Kagoshima, "Concatenative speech synthesis based on the plural unit selection and fusion method," IEICE Trans. Inf. Syst., vol. E88-D, no. 11, pp. 2565-2572, 2005 (Pubitemid 41816802)
22. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol. 9, pp. 171-185, 1995
23. T. Shinozaki and M. Ostendorf, "Cross-validation and aggregated EM training for robust parameter estimation," Comput. Speech Lang., vol. 22, pp. 185-195, 2008 (Pubitemid 350016715)
24. H. Zen, K. Tokuda, T. K. T. Masuko, and T. Kitamura, "Hidden semimarkovmodel based speech synthesis system," IEICE Trans., Inf. Syst., vol. E90-D, no. 5, pp. 825-834, 2007
25. Y. Sagisaka, K. Takeda, M. Abe, S. Katagiri, T. Umeda, and H. Kuawhara, "A large-scale Japanese speech database," in Proc. ICSLP'90, Kobe, Japan, Nov. 1990, pp. 1089-1092
26. H. Kawahara, J. Estill, and O. Fujimura, "Aperiodicity extraction and control using mixed mode excitation and group delay manipulation for a high quality speech analysis, modification and synthesis system STRAIGHT"," in Proc. MAVEBA ' 01, Florence, Italy, Sep. 2001, pp. 1-6
27. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Maximum likelihood voice conversion based on GMM with STRAIGHT mixed excitation," in Proc. INTERSPEECH, Pittsburgh, PA, USA, Sep. 2006, pp. 2266-2269
28. H. Kawahara, I. Masuda-Katsuse, and A. D. Cheveigne, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, no. 3-4, pp. 187-207, 1999.