Unsupervised intralingual and cross-lingual speaker adaptation for HMM-Based speech synthesis using two-pass decision tree construction

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 4, 2011, Pages 895-904

  Gibson, Matthew ^a   Byrne, William ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Cross lingual; hidden Markov model (HMM) based speech synthesis; unsupervised speaker adaptation

Indexed keywords

ACOUSTIC MODEL; AUTOMATIC SPEECH RECOGNITION; CROSS-LINGUAL; DECISION TREE CONSTRUCTION; HMM-BASED SPEECH SYNTHESIS; LINGUISTIC ANALYSIS; SPEAKER ADAPTATION; SPEECH SYNTHESIS SYSTEM; SYNTHESIS MODELS; TRAINING DATASET; UNSUPERVISED ADAPTATION; UNSUPERVISED SPEAKER ADAPTATION;

DECISION TREES; HIDDEN MARKOV MODELS; SPEECH SYNTHESIS; TRANSCRIPTION;

SPEECH RECOGNITION;

EID: 79953289255     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2066968     Document Type: Article

References (27)

1. V. Karaiskos, S. King, R. Clark, and C. Mayo, "The blizzard challenge 2008," in Proc. Blizzard, 2008, 2008.
2. T. Yoshimura, T. Masuko, K. Tokuda, T. Kobayashi, and T. Kitamura, "Speaker interpolation for HMM-based speech synthesis system," J. Acoust. Soc. Japan, vol. 21, no. 4, pp. 119-206, 2000.
3. J.Yamagishi, K. Onishi, T. Masuko, and T.Kobayashi, "Acoustic modeling of speaking styles and emotional expressions in HMM-based speech synthesis," IEICE Trans. Inf. Syst., vol. E88-D, no. 3, pp. 503-509, 2005.
4. J. Yamagishi, T. Kobayashi, Y. Nakano, K. Ogata, and J. Isogai, "Analysis of speaker adaptation algorithms for HMM-based speech synthesis and a constrained SMAPLR adaptation algorithm," IEEE Audio, Speech, Lang. Process., vol. 17, no. 1, pp. 66-83, Jan. 2009.
5. S. King, K. Tokuda, H. Zen, and J. Yamagishi, "Unsupervised adaptation for HMM-based speech synthesis," in Proc. Interspeech, 2008, pp. 1869-1872.
6. B. Wheatley, K. Kondo, W. Anderson, and Y. Muthusamy, "An evaluation of cross-language adaptation for rapid HMM development in a new language," in Proc. ICASSP, 1994, vol. 1, pp. 237-240.
7. P. Fung, C. Y. Ma, and W. K. Liu, "MAP-based crosslanguage adaptation augmented by linguistic knowledge: From English to Chinese," in Proc. Eurospeech, 1999, pp. 871-874.
8. Y. Wu, S. King, and K. Tokuda, "Cross-lingual speaker adaptation for HMM-based speech synthesis," in Proc. ISCSLP, 2008, pp. 1-4.
9. Y.Wu, Y. Nankaku, and K. Tokuda, "State mapping based method for cross-lingual speaker adaptation in HMM-based speech synthesis," in Proc. Interspeech, 2009, pp. 528-531.
10. J. Yamagishi, H. Zen, Y.-J. Wu, T. Toda, and T. Tokuda, "The HTS- 2008 system: Yet another evaluation of the speaker-adaptive HMMbased speech synthesis system in the 2008 blizzard challenge," in Proc. Blizzard, 2008, p.
11. M. Gibson, "Efficient maximum likelihood linear regression," M.Phil. dissertation, Cambridge Univ., Cambridge, U.K., 2004.
12. J. Dines, L. Saheer, and H. Liang, "Speech recognition with speech synthesis models by marginalising over decision tree leaves," in Proc. Interspeech, 2009, pp. 1395-1398.
13. M. Gibson, "Two-pass decision tree construction for unsupervised adaptation of HMM-based synthesis models," in Proc. Interspeech, 2009, pp. 1791-1794.
14. H. Zen, T. Toda, M. Nakamura, and K. Tokuda, "Details of nitech HMM-based speech synthesis system for the blizzard challenge 2005," IEICE Trans. Inf. Syst., vol. E90-D, no. 1, pp. 325-333, 2007. (Pubitemid 46145336)
15. M. Gibson, T. Hirsimaki, R. Karhila, M. Kurimo, and W. Byrne, "Unsupervised cross-lingual speaker adaptation for HMM-based speech synthesis using two-pass decision tree construction," in Proc. ICASSP, 2010, pp. 4642-4645.
16. T. Anastasakos, J. McDonough, R. Schwartz, and J. Makhoul, "A compact model for speaker adaptive training," in Proc. ICSLP, Philadelphia, 1996, pp. 1137-1140.
17. J. Yamagishi, "Average-voice-based speech synthesis," Ph.D. dissertation, Tokyo Inst. of Technol., Tokyo, Japan, 2006.
18. H. Kawahara, I. Masuda-Katsuse, and A. Cheveigne, "Restructuring speech representations using a pitch adaptive time-frequency smoothing and an instantaneous frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, pp. 187-207, 1999.
19. K. Tokuda, T. Masuko, N. Miyazaki, and T. Kobayashi, "Multi-space probability distribution HMM," IEICE Trans. Inf. Syst., vol. E85-D, no. 3, pp. 455-464, 2002. (Pubitemid 35353984)
20. H. Zen, K. Tokuda, T. Masuko, K. Kobayashi, and T. Kitamura, "Hidden semi-Markov model based speech synthesis system," IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 825-834, 2007.
21. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis," in Proc. ICASSP, 2000, pp. 1315-1318.
22. T. Toda and K. Tokuda, "A speech parameter generation algorithm considering global variance for HMM-based speech synthesis," IEICE Trans., vol. E90-D, no. 5, pp. 816-824, 2007.
23. J. Yamagishi, B. Usabaev, S. King, O.Watts, J. Dines, J. Tian, R. Hu, Y. Guan, K. Oura, K. Tokuda, R. Karhila, and M. Kurimo, "Thousands of voices for HMM-based speech synthesis," in Proc. Interspeech, 2009, pp. 420-423.
24. V. Digalakis, D. Rtischev, and L. Neumeyer, "Speaker adaptation using constrained estimation of Gaussian mixtures," IEEE Trans. Speech Audio Process., vol. 3, no. 5, pp. 357-366, Sep. 1995.
25. R. Likert, "A technique for the measurement of attitudes," Arch. Psychol., vol. 140, pp. 1-55, 1932.
26. R. Clark, M. Podsiadlo, M. Fraser, C. Mayo, and S. King, "Statistical analysis of the Blizzard Challenge 2007 listening test results," in Proc. Blizzard, 2007.
27. P. Koehn, "Europarl: A parallel corpus for statistical machine translation," in Proc. MT Summit, 2005.