Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 1, 2013, Pages 207-219

  Ling, Zhen Hua ^a   Richmond, Korin ^b   Yamagishi, Junichi ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Articulatory features; Gaussian mixture model; multiple regression hidden Markov model; speech synthesis

Indexed keywords

ACOUSTICS; GAUSSIAN DISTRIBUTION; LINGUISTICS; MATHEMATICAL TRANSFORMATIONS; REGRESSION ANALYSIS; SPEECH SYNTHESIS; TRELLIS CODES;

ARTICULATORY FEATURES; ARTICULATORY SPACE; ELECTROMAGNETIC ARTICULOGRAPHY; EXPLANATORY VARIABLES; GAUSSIAN MIXTURE MODEL; MULTIPLE REGRESSIONS; REGRESSION MATRICES; SPEECH SYNTHESIZER;

HIDDEN MARKOV MODELS;

EID: 84869440340     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2215600     Document Type: Article

References (34)

1. T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in HMMbased speech synthesis," in Proc. Eurospeech, 1999, pp. 2347-2350.
2. K. Tokuda, H. Zen, and A.W. Black, "HMM-based approach to multilingual speech synthesis," in Text to Speech Synthesis: New Paradigms and Advances, S.Narayanan and A.Alwan, Eds. Upper Saddle River, NJ: Prentice-Hall, 2004.
3. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis," in Proc. ICASSP, 2000, vol. 3, pp. 1315-1318.
4. H. Zen, T. Toda, M. Nakamura, and K. Tokuda, "Details of Nitech HMM-based speech synthesis system for the Blizzard Challenge 2005," IEICE Trans. Inf. Syst., vol. E90-D, no. 1, pp. 325-333, 2007. (Pubitemid 46145336)
5. Z.-H. Ling, Y.-J. Wu, Y.-P. Wang, L. Qin, and R.-H. Wang, "USTC system for Blizzard Challenge 2006: An improvedHMM-based speech synthesis method," in Blizzard Challenge Workshop, 2006.
6. J. Yamagishi and T. Kobayashi, "Average-voice-based speech synthesis using HSMM-based speaker adaptation and adaptive training," IEICE Trans. Inf. Syst., vol. E90-D, no. 2, pp. 533-543, 2007. (Pubitemid 46279829)
7. K. Shichiri, A. Sawabe, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Eigenvoices for HMM-based speech synthesis," in Proc. ICSLP, 2002, pp. 1269-1272.
8. J. Yamagishi, K. Onishi, T. Masuko, and T. Kobayashi, "Acoustic modeling of speaking styles and emotional expressions in HMM-based speech synthesis," IEICE Trans. Inf. Syst., vol. E88-D, no. 3, pp. 503-509, 2005.
9. M. Tachibana, J. Yamagishi, T. Masuko, and T. Kobayashi, "Speech synthesis with various emotional expressions and speaking styles by style interpolation and morphing," IEICE Trans. Inf. Syst., vol. E88-D, no. 11, pp. 2484-2491, 2005. (Pubitemid 41816793)
10. T. Nose, J. Yamagishi, T. Masuko, and T. Kobayashi, "A style control technique for HMM-based expressive speech synthesis," IEICE Trans. Inf. Syst., vol. E90-D, no. 9, pp. 1406-1413, 2007.
11. Z.-H. Ling, K. Richmond, J.Yamagishi, and R.-H.Wang, "Articulatory control of HMM-based parametric speech synthesis driven by phonetic knowledge," in Proc. Interspeech '08, 2008, pp. 573-576.
12. Z.-H. Ling, K. Richmond, J. Yamagishi, and R.-H. Wang, "Integrating articulatory features into HMM-based parametric speech synthesis," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 6, pp. 1171-1185, Aug. 2009.
13. K. Kirchhoff, G. Fink, and G. Sagerer, "Conversational speech recognition using acoustic and articulatory input," in Proc. ICASSP, 2000, pp. 1435-1438.
14. A. Black, T. Bunnell, Y. Dou, P. Muthukumar, F. Metze, D. Perry, T. Polzehl, K. Prahallad, S. Steidl, and C. Vaughn, "Articulatory features for expressive speech synthesis," in Proc. ICASSP, 2012, pp. 4005-4008.
15. P. W. Schönle, K. Gräbe, P. Wenig, J. Höhne, J. Schrader, and B. Conrad, "Electromagnetic articulography: Use of alternating magnetic fields for tracking movements of multiple points inside and outside the vocal tract," Brain Lang., vol. 31, pp. 26-35, 1987.
16. T. Baer, J. C. Gore, S. Boyce, and P. W. Nye, "Application of MRI to the analysis of speech production," Magn. Resonance Imag., vol. 5, pp. 1-7, 1987. (Pubitemid 17059052)
17. Y. Akgul, C. Kambhamettu, and M. Stone, "Extraction and tracking of the tongue surface from ultrasound image sequences," IEEE Comp. Vis. Pattern Recogn., vol. 124, pp. 298-303, 1998.
18. K. Fujinaga, M. Nakai, H. Shimodaira, and S. Sagayama, "Multiple-regression hidden Markov model," in Proc. ICASSP, 2001, pp. 513-516. (Pubitemid 32839299)
19. Y. Ijima,M. Tachibana, T. Nose, and T. Kobayashi, "Emotional speech recognition based on style estimation and adaptation with multipleregression HMM," in Proc. ICASSP, 2009, pp. 4157-4160.
20. T. Nozaki, T. Suzuki, S. Okuma, K. Itabashi, and F. Fujiwara, "Quantitative evaluation for skill controller based on comparison with human demonstration," IEEE Trans. Control Syst. Technol., vol. 12, no. 4, pp. 609-619, Jul. 2004.
21. L. Deng, D. Yu, and A. Acero, "A quantitative model for formant dynamics and contextually assimilated reduction in fluent speech," in Proc. Interspeech, 2004, pp. 719-722.
22. P. Birkholz, B. Kroger, and C. Neuschaefer-Rube, "Model-based reproduction of articulatory trajectories for consonant-vowel sequences," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 5, pp. 1422-1433, Jul. 2011.
23. S. Hiroya and M. Honda, "Estimation of articulatory movements from speech acoustics using an HMM-based speech production model," IEEE Trans. Speech Audio Process., vol. 12, no. 2, pp. 175-185, Mar. 2004.
24. Q. Cetin and M. Ostendorf, "Cross-stream observation dependencies for multi-stream speech recognition," in Proc. Eurospeech, 2003, pp. 2517-2520.
25. M. Gales, "Cluster adaptive training of hidden Markov model," IEEE Trans. Audio, Speech, Lang. Process., vol. 8, no. 4, pp. 417-428, Jul. 2000.
26. K. Tokuda, T. Masuko, N. Miyazaki, and T. Kobayashi, "Multi-space probability distribution HMM(invited paper)," IEICE Trans. Inf. Syst., vol. E85-D, no. 3, pp. 455-464, 2002. (Pubitemid 35353984)
27. K. Shinoda and T.Watanabe, "MDL-based context-dependent subword modeling for speech recognition," J. Acoust. Soc. Japan (E), vol. 21, no. 2, pp. 79-86, 2000. (Pubitemid 30594111)
28. D. Povey, L. Burget, M. Agarwal, P. Akyazi, F. Kai, A. Ghoshal, O. Glembek, N. Goel, M. Karafiát, A. Rastrow, R. C. Rose, P. Schwarz, and S. Thomas, "The subspace Gaussian mixture model-a structured model for speech recognition," Comput. Speech Lang., vol. 25, no. 2, pp. 404-439, Apr. 2011.
29. T. Toda,W. A. Black, and K. Tokuda, "Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model," Speech Commun., vol. 50, pp. 215-227, 2008. (Pubitemid 351172471)
30. K. Richmond, P. Hoole, and S. King, "Announcing the electromagnetic articulography (day 1) subset of the mngu0 articulatory corpus," in Proc. Interspeech, 2011, pp. 1505-1508.
31. H. Kawahara, I.Masuda-Katsuse, and A. deCheveigne, "Restructuring speech representations using pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, pp. 187-207, 1999.
32. Z.-H. Ling, K. Richmond, and J. Yamagishi, "An analysis of HMMbased prediction of articulatory movements," Speech Commun., vol. 52, no. 10, pp. 834-846, 2010.
33. M.-Q. Cai, Z.-H. Ling, and L.-R. Dai, "Target-filtering model based articulatory movement prediction for articulatory control of HMM-based speech synthesis," in Proc. 11th Int. Conf. Signal Process., 2012, accepted for publication.
34. Z.-H. Ling, K. Richmond, and J. Yamagishi, "Feature-space transform tying in unified acoustic-articulatory modelling for articulatory control of HMM-based speech synthesis," in Proc. Interspeech, 2011, pp. 117-120.