Statistical parametric speech synthesis based on speaker and language factorization

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 6, 2012, Pages 1713-1724

  Zen, Heiga ^a   Braunschweiler, Norbert ^b   Buchholz, Sabine ^c   Gales, Mark J F ^b   Knill, Kate ^b   Krstulović, Sacha ^d   Latorre, Javier ^b  

^a GOOGLE   (United Kingdom)

^b TOSHIBA CORPORATION   (Japan)

^c SynapseWork   (United Kingdom)

^d NUANCE COMMUNICATIONS   (United States)

Author keywords

Hidden Markov models (HMMs); Speaker and language factorization; Statistical parametric speech synthesis

Indexed keywords

HIDDEN MARKOV MODELS (HMMS); IN-BUILDINGS; LANGUAGE FACTORIZATION; MULTIPLE LANGUAGES; RECOGNITION SYSTEMS; SPEAKER CHARACTERISTICS;

DECISION TREES; FACTORIZATION; HIDDEN MARKOV MODELS;

SPEECH SYNTHESIS;

EID: 84859765673     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2187195     Document Type: Article

References (42)

1. International Phonetic Association,, Handbook of the International Phonetic Association, Cambridge Univ. Press, 1999.
2. T. Anastasakos, J. McDonough, R. Schwartz, and J. Makhoul, "A compact model for speaker adaptive training," in Proc. ICSLP, 1996, pp. 1137-1140.
3. S. Buchholz and J. Latorre, "Crowdsourcing preference tests, and how to detect cheating," in Proc. Interspeech, 2011, pp. 3053-3056.
4. M. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition," Comput. Speech Lang., vol. 12, no. 2, pp. 75-98, 1998. (Pubitemid 128383747)
5. M. Gales, "Cluster adaptive training of hidden Markov models," IEEE Trans. Speech Audio Process., vol. 8, no. 4, pp. 417-428, Jul. 2000.
6. M. Gales, "Acoustic factorisation," in Proc. ASRU, 2001, pp. 77-80.
7. R. Kuhn, J. Junqua, P. Nguyen, and N. Niedzielski, "Rapid speaker adaptation in eigenvoice space," IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 695-707, Nov. 2000. (Pubitemid 32025317)
8. J. Latorre, K. Iwano, and S. Furui, "New approach to the polyglot speech generation by means of an HMM-based speaker adaptable synthesizer," Speech Commun., vol. 48, no. 10, pp. 1227-1242, 2006. (Pubitemid 44353817)
9. H. Liang and J. Dines, "An analysis of language mismatch in HMM state mapping-based cross-lingual speaker adaptation," in Proc. Interspeech, 2010, pp. 622-625.
10. Y. Nankaku, K. Nakamura, H. Zen, and K. Tokuda, "Acoustic modeling with contextual additive structure for HMM-based speech recognition," in Proc. ICASSP, 2008, pp. 4469-4472.
11. J. Odell, "The use of context in large vocabulary speech recognition," Ph.D. dissertation, Cambridge Univ., Cambridge, U.K., 1995.
12. X. Peng, K. Oura, Y. Nankaku, and K. Tokuda, "Cross-lingual speaker adaptation for HMM-based speech synthesis considering differences between language-dependent average voices," in Proc. ICSP, 2010, pp. 605-608.
13. Y. Qian, H. Liang, and F. Soong, "A cross-language state sharing and mapping approach to bilingual (Mandarin-English) TTS," IEEE Trans. Audio Speech Lang. Process., vol. 17, no. 6, pp. 1231-1239, Aug. 2009.
14. K. Saino, "A clustering technique for factor analyzed voice models," (in Japanese) M.S. thesis, Nagoya Inst. of Technol., Nagoya, Japan, 2008.
15. O. Schenk and K. Gärtner, "Solving unsymmetric sparse systems of linear equations with PARDISO," J. Future Gen. Comput. Syst., vol. 20, no. 3, pp. 475-487, 2004.
16. T. Schultz, "Globalphone: A multilingual speech and text database developed at Karlsruhe University," in Proc. ICSLP, 2002, pp. 345-348.
17. M. Seltzer and A. Acero, "Separating speaker and environmental variability using factored transforms," in Proc. Interspeech, 2011, pp. 1097-1100.
18. K. Shichiri, A. Sawabe, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Eigenvoices for HMM-based speech synthesis," in Proc. ICSLP, 2002, pp. 1269-1272.
19. K. Shinoda and T. Watanabe, "Acoustic modeling based on the MDL criterion for speech recognition," in Proc. Eurospeech, 1997, pp. 99-102.
20. T. Shinozaki, "HMM state clustering based on efficient cross-validation," in Proc. ICASSP, 2006, pp. 1157-1160.
21. K. Sim and M. Gales, "Adaptation of precision matrix models on large vocabulary continuous speech recognition," in Proc. ICASSP, 2005, pp. 97-100.
22. R. Sproat, Multilingual Text-to-Speech Synthesis: The Bell Labs Approach. New York: Springer, 1998.
23. T. Toda and K. Tokuda, "A speech parameter generation algorithm considering global variance for HMM-based speech synthesis," IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 816-824, 2007.
24. K. Tokuda, T. Masuko, N. Miyazaki, and T. Kobayashi, "Multi-space probability distribution HMM," IEICE Trans. Inf. Syst., vol. E85-D, no. 3, pp. 455-464, 2002. (Pubitemid 35353984)
25. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis," in Proc. ICASSP, 2000, pp. 1315-1318.
26. K. Tokuda, H. Zen, and A. Black, "An HMM-based speech synthesis system applied to English," in Proc. IEEE Speech Synth. Workshop, 2002, CD-ROM Proceeding.
27. C. Traber, K. Huber, K. Nedir, B. Pfister, E. Keller, and B. Zellner, "From multilingual to polyglot speech synthesis," in Proc. Eurospeech, 1999, pp. 835-838.
28. Y.Wang and M. Gales, "Speaker and noise factorisation on AURORA4 task," in Proc. ICASSP, 2011, pp. 4584-4587.
29. M. Wester, "The EMIME Bilingual Database," Univ. of Edinburgh, 2010, Tech. Rep. EDI-INF-RR-1388.
30. Y.Wu, Y. Nankaku, and K. Tokuda, "State mapping based method for cross-lingual speaker adaptation in HMM-based speech synthesis," in Proc. Interspeech, 2009, pp. 528-531.
31. J. Yamagishi, "Average-voice-based speech synthesis," Ph.D. dissertation, Tokyo Inst. of Technol., Yokohama, Japan, 2006.
32. J. Yamagishi and S. King, "Simple methods for improving speakersimilarity of HMM-based speech synthesis," in Proc. ICASSP, 2010, pp. 4610-4613.
33. J. Yamagishi, M. Tachibana, T. Masuko, and T. Kobayashi, "Speaking style adaptation using context clustering decision tree for HMM-based speech synthesis," in Proc. ICASSP, 2004, pp. 5-8.
34. J. Yamagishi and O.Watts, "The CSTR/EMIME HTS system for Blizzard Challenge," in Proc. Blizzard Challenge Workshop, 2010.
35. J. Yamagishi, H. Zen, Y.Wu, T. Toda, and K. Tokuda, "The HTS2007' system: Yet another evaluation of the speaker-adaptive HMM-based speech synthesis system in the 2008 Blizzard Challenge," in Proc. Blizzard Challenge Workshop, 2008.
36. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMMbased speech synthesis," in Proc. Eurospeech, 1999, pp. 2347-2350.
37. K. Yu and M. Gales, "Adaptive training using structured transforms," in Proc. ICASSP, 2004, pp. 317-320.
38. K. Yu, H. Zen, F. Mairesse, and S. Young, "Context adaptive training with factorized decision trees for HMM-based statistical parametric speech synthesis," Speech Commun., vol. 53, no. 6, pp. 914-923, 2011.
39. H. Zen, "Speaker and language adaptive training for HMM-based polyglot speech synthesis," in Proc. Interspeech, 2010, pp. 410-413.
40. o model for HMM-based speech synthesis," in Proc. Interspeech, 2009, pp. 2091-2094.
41. H. Zen, N. Braunschweiler, S. Buchholz, K. Knill, S. Krstulovic', and J. Latorre, "HMM-based polyglot speech synthesis by speaker and language adaptive training," in Proc. ISCA SSW7, 2010, pp. 186-191.
42. H. Zen, K. Tokuda, and A. Black, "Statistical parametric speech synthesis," Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009.