Prosody conversion from neutral speech to emotional speech

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1145-1153

  Tao, Jianhua ^a,b   Kang, Yongguo ^b   Li, Aijun ^c  

^a IEEE   (China)

^b INSTITUTE OF AUTOMATION   (China)

^c CHINESE ACADEMY OF SOCIAL SCIENCES   (China)

Author keywords

Emotional speech; Prosody analysis; Speech synthesis

Indexed keywords

EMOTIONAL SPEECH; GAUSSIAN MIXTURE MODELS (GMM); LINEAR MODIFICATION MODELS (LMM); PROSODY ANALYSIS;

CLASSIFICATION (OF INFORMATION); COMPUTER SIMULATION; INFORMATION ANALYSIS; MATHEMATICAL MODELS; OPTIMIZATION; REGRESSION ANALYSIS; SEMANTICS;

SPEECH SYNTHESIS;

EID: 34047263010     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.876113     Document Type: Article

References (37)

1. N. Campbell, "Perception of affect in speech - Toward an automatic processing of paralinguistic information in spoken conversation," in Proc. ICSLP, Jeju, Korea, Oct. 2004, pp. 881-884.
2. A. Ortony, G. L. Clore, and A. Collins, The Cognitive Structure of Emotions. Cambridge, U.K.: Cambridge Univ. Press, 1988.
3. J. P. H. van Santen, R. W. Sproat, J. P. Olive, and J. Hirschberg, Eds., Progress in Speech Synthesis. New York: Springer, 1997.
4. J. Tao, "Emotion control of Chinese speech synthesis in natural environment," in Proc. Eurospeech, 2003, pp. 2349-2352.
5. Y. Xu and Q. E. Wang, "Pitch targets and their realization: Evidence from mandarin Chinese," Speech Commun., vol. 33, pp. 319-337, 2001.
6. H. Fujisaki and K. Hirose, "Analysis of voice fundamental frequency contours for declarative sentence of Japanese," J. Acoust. Soc. Jpn. (E), vol. 5, no. 4, pp. 233-242, 1984.
7. S. J. L. Mozziconacci and D. J. Hermes, "Expression of emotion and attitude through temporal speech variations," in Proc. ICSLP, Beijing, China, 2000, pp. 373-378.
8. J. E. Cahn, "The generation of affect in synthesized speech," J. Amer. Voice I/O Soc., vol. 8, pp. 1-19, Jul. 1990.
9. Synthesis units for conversational speech - Using phrasal segments, N. Campbell. [Online]. Available: http://feast.atr.jp/nick/rcfs.html
10. M. Schröder and S. Breuer, "XML representation languages as a way of interconnecting TTS modules," in Proc. ICSLP, Jeju, Korea, 2004, pp. 1889-1892.
11. E. Eide, A. Aaron, R. Bakis, W. Hamza, M. Picheny, and J. Pitrelli, "A corpus-based approach to < ahem expressive speech synthesis," in Proc. IEEE Speech Synthesis Workshop, Santa Monica, CA, 2002, pp. 79-84.
12. Z.-J. Chuang and C.-H. Wu, "Emotion recognition from textual input using an emotional semantic network," in Proc. Int. Conf. Spoken Language Processing, ICSLP 2002, Denver, CO, 2002, pp. 2033-2036.
13. E. Rank and H. Pirker, "Generating emotional speech with a concatenative synthesizer," in Proc. ICSLP, 1998, pp. 671-674.
14. A. Li, "Chinese prosody and prosodic labeling of spontaneous speech," in Proc. Speech Prosody, 2002, pp. 39-46.
15. H. Kawahra and R. Akahane-Yamada, "Perceptual effects of spectral envelope and F0 manipulations using STRAIGHT method," J. Acoust. Soc. Amer., pt. 2, vol. 103, no. 5, p. 2776, 1998. 1aSC27.
16. A. B. Kain, "High-resolution voice transformation," Ph.D. dissertation, Oregon Health and Sci. Univ., Portland, Oct. 2001.
17. G. P. Kochanski and C. Shih, "STEM-ML: Language independent prosody description," in Proc. ICSLP, Beijing, China, 2000, pp. 239-242.
18. I. Murray and J. L. Arnott, "Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion," J. Acoust. Soc. Amer., pp. 1097-1108, 1993.
19. R. M. Stibbard, "Vocal expression of emotions in non-laboratory speech: An investigation of the reading/leeds emotion in speech project annotation data," Ph.D. dissertation, Univ. Reading, Reading, U.K., 2001.
20. X. Sun, "The determination, analysis, and synthesis of fundamental frequency," Ph.D. dissertation. Northwestern Univ., Evanston, IL, 2002.
21. E. Moulines and Y. Sagisaka, "Voice conversion: State of the art and perspectives," Speech Commun., vol. 16, no. 2, pp. 125-126, Feb. 1995.
22. S. McGilloway, R. Cowie, E. Doulas-Cowie, S. Gielen, M. Westerdijk, and S. Stroeve, "Approaching automatic recognition of emotion from voice: A rough benchmark," in Proc. ISCA workshop Speech Emotion, 2000, pp. 207-212.
23. N. Amir, "Classifying emotions in speech: A comparison of methods," in Proc. Eurospeech. Holon, Isreal, 2001, pp. 127-130.
24. G. McLachlan and T. Krishnan, "The EM algorithm and extensions," in Wiley Series in Probability and Statistics, New York: Wiley, 1997.
25. C. Gobl and A. N'1Chasaide, "The role of voice quality in communicating emotion, mood and attitude," Speech Commun., vol. 40, pp. 189-212, 2003.
26. R. Tato, R. Santos, R. Kompe, and J. M. Pardo, "Emotional space improves emotion recognition," in Proc. ICSLP, Denver, CO, Sep. 2002, pp. 2029-2032.
27. V. A. Petrushin, "Emotion recognition in speech signal: Experimental study, development and application," in Proc. ICSLP, Beijing, China, 2000, pp. 222-225.
28. B. Hayes, Metrical Stress Theory: Principles and Case Studies. Chicago, IL: Univ. Chicago Press, 1995.
29. Z.-W. Shuang, Z.-X. Wang, Z.-H. Ling, and R.-H. Wang, "A novel voice conversion system based on codebook mapping with phoneme-lied weighting," in Proc. ICSLP, Jeju, Korea, Oct. 2004, pp. 1197-1200.
30. L. M. Arslan and D. Talkin, "Voice conversion by codebook mapping of line spectral frequencies and excitation spectrum," in Proc. Eurospeech, Rhodes, Greece, 1997, pp. 1347-1350.
31. T. Watanabe et al., "Transformation of spectral envelope for voice conversion based on radial basis function networks," in Proc. ICSLP, Denver, CO, 2002, pp. 285-288.
32. A. Li and H. Wang, "Friendly speech analysis and perception in standard Chinese," in Proc. ICSLP, Jeju, Korea, 2004, pp. 897-900.
33. T. Toda, A. W. Black, and K. Tokuda, "Spectral conversion based on maximum likelihood estimation considering global variance of converted parameter," in Proc. ICASSP, 2005, pp. 9-12.
34. Y. Chen et al., "Voice conversion with smoothed GMM and map adaptation," in Proc. Eurospeech, Geneva, Switzerland, 2003, pp. 2413-2416.
35. Y. Stylianou et al., "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol. 6, no. 2, pp. 131-142, 1998.
36. H Mizuno, H Mizuno, and M Abe, "Voice conversion based on piecewise linear conversions rules of formant frequency and spectrum tilt," Speech Commun. 16, pp. 153-164.
37. Y. Kang, Z. Shuang, J. Tao, W. Zhang, and B. Xu, "A hybrid gmm and codebook mapping method for spectral conversion," in Proc. 1st Int. Conf. Affective Comput. Intell. Interaction, 2005, pp. 303-310.