Hmm-based style control for expressive speech synthesis with arbitrary speaker's voice using model adaptation

IEICE Transactions on Information and Systems

Volumn E92-D, Issue 3, 2009, Pages 489-497

  Nose, Takashi ^a   Tachibana, Makoto ^a   Kobayashi, Takao ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Average voice model; Expressive speech; HMM based speech synthesis; Model adaptation; Multiple regression HSMM (MRHSMM); Style control

Indexed keywords

MARKOV PROCESSES; SPEECH PROCESSING; SPEECH RECOGNITION; SPEECH SYNTHESIS;

AVERAGE VOICE MODELS; EXPRESSIVE SPEECH; HMM-BASED SPEECH SYNTHESIS; MODEL ADAPTATION; MULTIPLE REGRESSIONS;

SPEECH;

EID: 67650793657     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1587/transinf.E92.D.489     Document Type: Article

References (22)

1. M. Schröder, "Emotional speech synthesis: A review, " Proc. EU-ROSPEECH 2001, pp. 561-564, Sept. 2001.
2. D. Erickson, "Expressive speech: Production, perception and application to speech synthesis, " Acoustical Science and Technology, vol. 26, no. 4, pp. 317-325, July 2005.
3. A. Iida, N. Campbell, F. Higuchi, and M. Yasumura, "A corpusbased speech synthesis system with emotion, " Speech Commun., vol. 40, no. 1-2, pp. 161-187, 2003.
4. J. Yamagishi, K. Onishi, T. Masuko, and T. Kobayashi, "Acoustic modeling of speaking styles and emotional expressions in HMM-based speech synthesis, " IEICE Trans. Inf. & Syst., vol. E88-D, no. 3, pp. 503-509, March 2005.
5. R. Cowie and R. R. Cornelius, "Describing the emotional states that are expressed in speech, " Speech Commun., vol. 40, no. 1-2, pp. 5-32, April 2003.
6. K. Hirose, N. Minematsu, and H. Kawanami, "Analytical and perceptual study on the role of acoustic features in realizing emotional speech, " Proc. ICSLP 2000, pp. 369-372, Oct. 2000.
7. T. Nose, J. Yamagishi, T. Masuko, and T. Kobayashi, "A style control technique for HMM-based expressive speech synthesis, " IEICE Trans. Inf. & Syst., vol. E90-D, no. 9, pp. 1406-1413, Sept. 2007.
8. D. Jiang, W. Zhang, L. Shen, and L. Cai, "Prosody analysis and modeling for emotional speech synthesis, " Proc. ICASSP 2005, pp. 281-284, March 2005.
9. C. Gobl and A. N. Chasaide, "The role of voice quality in communicating emotion, mood and attitude, " Speech Commun., vol. 40, no. 1-2, pp. 189-212, 2003.
10. C. H. Wu, C. C. Hsia, T. H. Liu, and J. F. Wang, "Voice conversion using duration-embedded bi-HMMs for expressive speech synthesis, " IEEE Trans. Audio, Speech, and Language Process., vol. 14, no. 4, pp. 1109-1116, July 2006.
11. M. Tachibana, J. Yamagishi, T. Masuko, and T. Kobayashi, "A style adaptation technique for speech synthesis using HSMM and suprasegmental features, " IEICE Trans. Inf. & Syst., vol. E89-D, no. 3, pp. 1092-1099, March 2006.
12. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models, " Comput. Speech Lang., vol. 9, no. 2, pp. 171-185, 1995.
13. J. Yamagishi and T. Kobayashi, "Average-voice-based speech synthesis using HSMM-based speaker adaptation and adaptive training, " IEICE Trans. Inf. & Syst., vol. E90-D, no. 2, pp. 533-543, Feb. 2007.
14. H. Zen, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "A hidden semi-Markov model-based speech synthesis system, " IEICE Trans. Inf. & Syst., vol. E90-D, no. 5, pp. 825-834, May 2007.
15. N. Niwase, J. Yamagishi, and T. Kobayashi, "Human walking motion synthesis with desired pace and stride length based on HSMM, " IEICE Trans. Inf. & Syst., vol. E88-D, no. 11, pp. 2492-2499, Nov. 2005.
16. J. Yamagishi, M. Tamura, T. Masuko, K. Tokuda, and T. Kobayashi, "A training method of average voice model for HMM-based speech synthesis, " IEICE Trans. Fundamentals, vol. E86-A, no. 8, pp. 1956-1963, Aug. 2003.
17. J. Yamagishi, T. Masuko, and T. Kobayashi, "MLLR adaptation for hidden semi-Markov model based speech synthesis, " Proc. INTER-SPEECH 2004-ICSLP, pp. 1213-1216, Oct. 2004.
18. Y. Nakano, M. Tachibana, J. Yamagishi, and T. Kobayashi, "Constrained structural maximum a posteriori linear regression for average-voice-based speech synthesis, " Proc. INTERSPEECH 2006-ICSLP, pp. 2286-2289, Sept. 2006.
19. K. Shinoda and C. Lee, "A structural Bayes approach to speaker adaptation, " IEEE Trans. Speech Audio Process., vol. 9, no. 3, pp. 276-287, 2001.
20. O. Shiohan, Y. Myrvoll, and C. Lee, "Structural maximum a posteriori linear regression for fast HMM adaptation, " Comput. Speech Lang., vol. 16, no. 3, pp. 5-24, 2002.
21. V. Digalakis and L. Neumeyer, "Speaker adaptation using combined transformation and Bayesian methods, " IEEE Trans. Speech Audio Process., vol. 4, no. 4, pp. 294-300, July 1996.
22. K. Ogata, M. Tachibana, J. Yamagishi, and T. Kobayashi, "Acoustic model training based on linear transformation and MAP modification for HSMM-based speech synthesis, " Proc. INTERSPEECH 2006-ICSLP, pp. 1328-1331, Sept. 2006.