A Cross-Language State Sharing and Mapping Approach to Bilingual (Mandarin-English) TTS

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 6, 2009, Pages 1231-1239

  Qian, Yao ^a   Soong, Frank K ^a   Liang, Hui ^a,b  

^a MICROSOFT RESEARCH ASIA   (China)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Bilingual hidden Markov model (HMM) based speech synthesis; Kullback Leibler divergence (KLD); new language synthesis

Indexed keywords

EID: 85008020260     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2009.2015708     Document Type: Article

References (18)

1. C. Traber et al., “From multilingual to polyglot speech synthesis,” in Proc. Eurospeech, 1999, pp. 835–838.
2. N. Campbell, “Foreign-language speech synthesis,” in Proc. ESCA/COCOSDA Workshop Speech Synth., 1998, pp. 177–180.
3. L. Badino, C. Barolo, and S. Quazza, “Language independent phoneme mapping for foreign TTS,” in Proc. 5th ISCA Speech Synth. Workshop, 2004, pp. 217–218.
4. J. Latorre, K. Iwano, and S. Furui, “Polyglot synthesis using a mixture of monolingual corpora,” in Proc. ICASSP, 2005, vol. 1, pp. 1–4.
5. M. Chu, H. Peng, Y. Zhao, Z. Y. Niu, and E. Chang, “Microsoft Mulan—A bilingual TTS system,” in Proc. ICASSP, 2003, vol. 1, pp. 264–267.
6. K. Tokuda, T. Kobayashi, T. Masuko, T. Kobayashi, and T. Kitamura, “Speech parameter generation algorithms for HMM-based speech synthesis,” in Proc. ICASSP, 2000, vol. 3, pp. 1315–1318.
7. T. A. Myrvoll and F. K. Soong, “Optimal clustering of multivariate normal distributions using divergence and its application to HMM adaptation,” in Proc. ICASSP, 2003, vol. 1, pp. 552–555.
8. Y. Zhao, C. Zhang, F. K. Soong, M. Chu, and X. Xiao, “Measuring attribute dissimilarity with HMM KL-divergence for speech synthesis,” in Proc. 6th ISCA Speech Synth. Workshop, 2007, pp. 206–210.
9. H. Liang, Y. Qian, and F. K. Soong, “An HMM-based bilingual (Mandarin-English) TTS,” in Proc. 6th ISCA Speech Synth. Workshop, 2007, pp. 137–142.
10. H. Liang, Y. Qian, F. K. Soong, and G. Liu, “A cross-language state mapping approach to bilingual (Mandarin-English) TTS,” in Proc. ICASSP, 2008, pp. 4641–4644.
11. C. Huang, Y. Shi, J.-L. Zhou, M. Chu, T. Wang, and E. Chang, “Seg-mental tonal modeling for phone set design in Mandarin LVCSR,” in Proc. ICASSP, 2004, vol. 1, pp. 901–904.
12. F. K. Soong and B.-H. Juang, “Line Spectrum Pair (LSP) and speech data compression,” in Proc. ICASSP, 1984, pp. 1.10.1–1.10.4.
13. M. Tamura, T. Masuko, K. Tokuda, and T. Kobayashi, “Speaker adaptation for HMM-based speech synthesis system using MLLR,” in Proc. 3rd ESCA/COCOSDA Workshop Speech Synth., 1998, pp. 273–276.
14. M. Mashimo, T. Toda, K. Shikano, and N. Campbell, “Evaluation of cross-language voice conversion based on GMM and STRAIGHT,” in Proc. Eurospeech, 2001, pp. 361–364.
15. K. Tokuda, T. Mausko, N. Miyazaki, and T. Kobayashi, “Multi-space probability distribution HMM,” IEICE Trans. Inf. Syst., vol. E85-D, no. 3, pp. 455–464, 2002.
16. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigne “Restructuring speech representations using pitch-adaptive time-frequency smoothing and instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds,” Speech Commun., vol. 27, pp. 187–207, 1999.
17. K. Shinoda and T. Watanable, “MDL-based context-dependent subword modeling for speech recognition,” J. Acoust. Soc. Jpn.(E), vol. 21, no. 2, pp. 79–86, 2000.
18. Methods for Subjective Determination of Transmission Quality, Rec. p. 800, ITU-T Std., 1996.