Autoregressive models for statistical parametric speech synthesis

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 3, 2013, Pages 587-597

  Shannon, Matt ^a   Zen, Heiga ^b,c   Byrne, William ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b TOSHIBA CORPORATION   (Japan)

^c GOOGLE   (United Kingdom)

Author keywords

Acoustic modeling; autoregressive hidden Markov model; autoregressive processes; hidden Markov models (HMMs); speech; statistical parametric speech synthesis

Indexed keywords

ACOUSTIC MODELING; AUTO REGRESSIVE MODELS; AUTO REGRESSIVE PROCESS; AUTO-REGRESSIVE; EXPECTATION MAXIMIZATION; GENERATION ALGORITHM; HIDDEN MARKOV MODELS (HMMS); HIGH QUALITY; LOW LATENCY; NUMBER OF STATE; OBJECTIVE EVALUATION; SYNTHESIS ALGORITHMS;

ALGORITHMS; HIDDEN MARKOV MODELS; SPEECH; SPEECH SYNTHESIS; TRAJECTORIES;

PARAMETER ESTIMATION;

EID: 84872190545     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2227740     Document Type: Article

References (40)

1. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis," Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009.
2. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis," in Proc. ICASSP '00, 2000, pp. 1315-1318.
3. H. Zen, K. Tokuda, and T. Kitamura, "Reformulating the HMM as a trajectory model by imposing explicit relationships between static and dynamic feature vector sequences," Comput. Speech Lang., vol. 21, no. 1, pp. 153-173, 2007. (Pubitemid 44537647)
4. C. Wellekens, "Explicit time correlation in hidden Markov models for speech recognition," in Proc. ICASSP '87, 1987, vol. 12, pp. 384-386. (Pubitemid 17596360)
5. P. Kenny, M. Lennig, and P. Mermelstein, "A linear predictive HMM for vector-valued observations with applications to speech recognition," IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 2, pp. 220-225, Feb. 1990. (Pubitemid 20666463)
6. P. C. Woodland, "Hidden Markov models using vector linear prediction and discriminative output distributions," in Proc. ICASSP '92, 1992, pp. 509-512.
7. J. Bilmes, "Graphical models and automatic speech recognition," in Mathematical Foundations of Speech and Language Processing, M. Johnson, S. P. Khudanpur, M. Ostendorf, and R. Rosenfeld, Eds. New York: Springer-Verlag, 2004.
8. K. K. Chin and P. C. Woodland, "Maximum mutual information training of hidden Markov models with vector linear predictors," in Proc. Interspeech '02, 2002, pp. 997-1000.
9. A. Poritz, "Linear predictive hidden Markov models and the speech signal," in Proc. ICASSP '82, 1982, vol. 7, pp. 1291-1294.
10. B. H. Juang and L. Rabiner, "Mixture autoregressive hidden Markov models for speech signals," IEEE Trans. Acoust., Speech, Signal Process., vol. 33, no. 6, pp. 1404-1413, Dec. 1985.
11. M. Shannon and W. Byrne, "Autoregressive HMMs for speech synthesis," in Proc. Interspeech '09, 2009, pp. 400-403.
12. M. Shannon and W. Byrne, "Autoregressive clustering for HMM speech synthesis," in Proc. Interspeech '10, 2010, pp. 829-832.
13. M. Shannon, H. Zen, and W. Byrne, "The effect of using normalized models in statistical speech synthesis," in Proc. Interspeech '11, 2011, pp. 121-124.
14. C. Quillen, "AutoregressiveHMM speech synthesis," in Proc. ICASSP '12, 2012, pp. 4021-4024.
15. EMIME consortium, Tools [Online]. Available: http://www.emime. org/participate/tools, accessed 21 March, 2012
16. HTS working group, HMM-Based Speech Synthesis System (HTS) [Online]. Available: http://hts.sp.nitech.ac.jp/accessed 21March, 2012
17. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Duration modeling for HMM-based speech synthesis," in Proc. ICSLP '98, 1998.
18. H. Zen, K. Tokuda, T. Masuko, T. Kobayasih, and T. Kitamura, "A hidden semi-Markov model-based speech synthesis system," IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 825-834, 2007.
19. S. Z. Yu and H. Kobayashi, "An efficient forward-backward algorithm for an explicit-duration hidden Markov model," IEEE Signal Process. Lett., vol. 10, no. 1, pp. 11-14, Jan. 2003.
20. H. Zen, "Implementing an HSMM-based speech synthesis system using an efficient forward-backward algorithm," Nagoya Inst. of Technol., Tech. Rep. TR-SP-0001, 2007.
21. M. Shannon andW. Byrne, A formulation of the autoregressive HMM for speech synthesis Dept. of Eng., Univ. of Cambridge, Cambridge, U.K., Tech. Rep. CUED/F-INFENG/TR.629, 2009 [Online]. Available: http://mi.eng.cam.ac.uk/sms46/ papers/shannon2009fah.pdf
22. S. Young, J. Odell, and P. Woodland, "Tree-based state tying for high accuracy acoustic modelling," in Proc. ARPA Human Lang. Technol. Workshop, 1994, pp. 307-312.
23. K. Shinoda and T.Watanabe, "MDL-based context-dependent subword modeling for speech recognition," J. Acoust. Soc. Jpn. (E), vol. 21, no. 2, pp. 79-86, 2000. (Pubitemid 30594111)
24. T. Toda and K. Tokuda, "A speech parameter generation algorithm considering global variance for HMM-based speech synthesis," IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 816-824, 2007.
25. K. Koishida, K. Tokuda, T. Masuko, and T. Kobayashi, "Vector quantization of speech spectral parameters using statistics of static and dynamic features," IEICE Trans. Inf. Syst., vol. E84-D, no. 10, pp. 1427-1434, 2001. (Pubitemid 33099747)
26. T. Muramatsu, Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Low-delay voice conversion based on maximum likelihood estimation of spectral parameter trajectory," in Proc. Interspeech '08, 2008, pp. 1076-1079.
27. W. Han, L. Wang, F. Soong, and B. Yuan, "Improved minimum converted trajectory error training for real-time speech-to-lips conversion," in Proc. ICASSP '12, 2012, pp. 4513-4516.
28. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Incorporation of mixed excitation model and postfilter into HMMbased text-to-speech synthesis," IEICE Trans. Inf. Syst. (Jpn. Ed.), vol. J87-D-II, no. 8, pp. 1565-1571, 2004.
29. Z.-H. Ling, Y.-J. Wu, Y.-P. Wang, L. Qin, and R.-H. Wang, "USTC system for Blizzard Challenge 2006 an improved HMM-based speech synthesis method," in Proc. Blizzard Challenge Workshop '06, 2006.
30. A. V. Oppenheim and R. W. Schafer, Digital Signal Processing, 1st ed. Englewood Cliffs: Prentice-Hall, 1975, p. 15.
31. M. Shannon and W. Byrne, "Viewing the trajectory HMM as a generalized autoregressive HMM," Dept. of Eng., Univ. of Cambridge, U.K., Tech. Rep. CUED/F-INFENG/TR.677, 2012 [Online]. Available: http://mi.eng.cam.ac. uk/sms46/papers/shannon2012viewing.pdf
32. A. W. Black and K. Tokuda, "The Blizzard Challenge 2005: Evaluating corpus-based speech synthesis on common datasets," in Proc. Interspeech '05, 2005, pp. 77-80. (Pubitemid 43908005)
33. R. Kubichek, "Mel-cepstral distance measure for objective speech quality assessment," in Proc. IEEE Pacific Rim Conf. Commun., Comput., Signal Process., 1993, pp. 125-128. (Pubitemid 23713438)
34. J. Kominek and A. W. Black, "The CMU ARCTIC databases for speech synthesis," Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-LTI-03-177, 2003.
35. T. Fukada, K. Tokuda, T. Kobayashi, and S. Imai, "An adaptive algorithm for mel-cepstral analysis of speech," Proc. ICASSP '92, pp. 137-140, 1992.
36. H. Zen, T. Toda, M. Nakamura, and K. Tokuda, "Details of the Nitech HMM-based speech synthesis system for the Blizzard Challenge '05," IEICE Trans. Inf. Syst., vol. E90-D, no. 1, pp. 325-333, 2007. (Pubitemid 46145336)
37. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigné, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, pp. 187-207, 1999.
38. K. Tokuda, T. Masuko, N. Miyazaki, and T. Kobayashi, "Multi-space probability distribution HMM," IEICE Trans. Inf. Syst., vol. E85-D, no. 3, pp. 455-464, 2002. (Pubitemid 35353984)
39. K. Yu, "Continuous F0 modeling for HMMbased statistical parametric speech synthesis," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 5, pp. 1071-1079, Jul. 2011.
40. R. A. J. Clark, M. Podsiadlo, M. Fraser, C. Mayo, and S. King, "Statistical analysis of the Blizzard Challenge 2007 listening test results," in Proc. Blizzard Challenge Workshop '07, 2007.