A corpus-based speech synthesis system with emotion

Speech Communication

Volumn 40, Issue 1-2, 2003, Pages 161-187

  Iida, Akemi ^a,b   Campbell, Nick ^b,c   Higuchi, Fumito ^a   Yasumura, Michiaki ^a  

^a KEIO UNIVERSITY   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^c ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

Concatenative speech synthesis; Corpus; Emotion; Natural speech; Source database

Indexed keywords

CORRELATION METHODS; DATABASE SYSTEMS; SPEECH;

EMOTIONAL SPEECH;

SPEECH SYNTHESIS;

EID: 0037380318     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-6393(02)00081-X     Document Type: Article

References (41)

1. Abe, M., Sagisaka, Y., Umeda, T., Kuwabara, H., 1990. ATR Technical Report TR-I-0166 Speech Database User's Manual. ATR Interpreting Telephony Research Lab.
2. Banse R., Scherer K.R. Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology. 70(3):1996;614-636.
3. 0 contours from ToBI labels using linear regression. In: Proceedings of ICSLP 96, Philadelphia, USA, Vol. 3, pp. 1385-1388.
4. Bunnell, H.T., Hoskins, S.R., 1998. Prosodic vs segmental contributions to naturalness in a diphone synthesizer. In: Proceedings of ICSLP 98, Sydney, Australia, Vol. 5, pp. 1723-1726.
5. Cahn, J.E., 1989. Generation of affect in synthesized speech. In: Proceedings of the 1989 Conference of the American Voice I/O Society, pp. 251-256.
6. Campbell, W.N., 1996. Autolabelling Japanese TOBI. In: Proceedings of ICSLP 96, Philadelphia, USA, pp. 2399-2402.
7. Campbell, W.N., 1997a. Processing a speech corpus for CHATR synthesis. In: Proceedings of International Conference on Speech Processing (ICSP '97), Seoul, Korea, pp. 183-186.
8. Campbell W.N. Synthesizing spontaneous speech. Sagisaka Y., Campbell N., Higuchi N. Computing Prosody. 1997b;165-186 Springer, NY.
9. Campbell W.N., Black A. Prosody and the selection of source units for concatenative synthesis. van Santen J., Sproat R., Olive J., Hirschberg J. Progress in Speech Synthesis. 1997;279-292 Springer Verlag, NY.
10. Carlson, R., Granstrom, G., Nord, L., 1992. Experiments with emotive speech, acted utterances and synthesized replicas. In: Proceedings of ICSLP 92, Banff, Canada. Vol. 2, pp. 671-674.
11. Cowie R., Douglas-Cowie E., Tsapatsoulis N., Votsis G., Kollias S., Fellenz W., Taylor J.G. Emotion recognition in human-computer interaction. IEEE Signal Processing Magazine. 18(1):2001;32-80.
12. Entropic Research Laboratory, Inc., 1996. ESPS Programs A-L.
13. Davitz J.R. A review of research concerned with facial and vocal expressions of emotion. Davitz J.R. The Communication of Emotional Meaning. 1964a;13-29 McGraw-Hill, NY.
14. Davitz J.R. Auditory correlates of vocal expressions of emotional meanings. Davitz J.R. The Communication of Emotional Meaning. 1964b;101-112 McGraw-Hill, NY.
15. Fairbanks G., Pronovost W. An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monographs. 6:1939;87-104.
16. Guerrero L.K., Andersen P.A., Trost M.R. Communication and emotion: basic concepts and approaches. Andersen P.A., Guerrero L.K. Handbook of Communication and Emotion: Research, Theory, Applications and Contexts. 1998;3-27 Academic Press, San Diego.
17. Ichikawa, A., Nakayama, T., Nakata, K., 1967. Experimental consideration on the naturalness of the synthesized speech. In: Proceedings of Acoustic Society of Japan Fall Meeting, pp. 95-96 (in Japanese).
18. Iida, A., Iga, S., Higuchi, F., Campbell, N., Yasumura, M., 1998. Acoustic nature and perceptual testing of a corpus of emotional speech. In: Proceedings of ICSLP 98, Sydney, Australia, Vol. 4, pp. 1559-1592.
19. Iida, A., Iga, S., Higuchi, F., Campbell, N., Yasumura, M., 2000. A speech synthesis system with emotion for assisting communication. In: Proceedings of ISCA Workshop on Speech and Emotion, Belfast, UK, pp. 167-172.
20. Ito K. A basic study on voice sound involving emotion (III). Ergonomics. 22(4):1986;211-217. (in Japanese).
21. JEIDA, 2000. The guideline of speech synthesis system performance evaluation methods. Japan Electronic Industry Development Association.
22. Kamimura, K., 1990. Ashitawo tsukuru - Sekizui sonshoushano seikatsuno kiroku. Miwashoten, Tokyo (in Japanese).
23. Katae, N., Kimura, S., 2000. An effect of voice quality and prosody control in emotional speech synthesis. In: Proceedings of Acoustic Society of Japan Fall Meeting, pp. 187-188 (in Japanese).
24. Keating P.A., Huffman M.K. Vowel variation in Japanese. Phonetica. 41:1984;191-207.
25. Kitahara Y., Tohkura Y. Prosodic control to express emotions for man-machine speech interaction. Institute of Electronics, Information, and Communication Engineers (IEICE) Transactions of Fundamentals of Electronics. E75-A(2):1992;155-163.
26. Kitahara Y., Takeda S., Ichikawa A., Tohkura Y. Role of prosody in cognitive process of spoken language. Journal of Interaction, Institute of Electronics, Information, and Communication Engineers (IEICE) D. J70-D(11):1987;2095-2101. (in Japanese).
27. Makino T., Arai S., Ozawa S. A method of vowel recognition in connected speech using the mutual relation of vowels. Institute of Electronics Information and Communication Engineers (IEICE) D-II. J72-DII(6):1989;837-845. (in Japanese).
28. Mokhtari, P., Iida, A., Campbell, N., 2001. Some articulatory correlates of emotion variability in speech: a preliminary study on spoken Japanese vowels. In: Proceedings of the International Conference on Speech Processing (ICSP'01), Taejon, Korea, pp. 431-436.
29. Mozziconacci, S.J.L., 1998. Speech variability and emotion: production and perception. Ph.D. thesis, Technical University Eindhoven.
30. Murray I.R., Arnott J.L. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of Acoustic Society of America. 93(2):1993;1097-1108.
31. Murray I.R., Arnott J.L. Implementation and testing of a system for producing emotion-by-rule in synthesized speech. Speech Communication. 16:1995;369-390.
32. Murray, I.R., Arnott, J.L., Alm, N., Newell, A.F., 1991. A communication system for the disabled with emotional synthesized speech produced by rule. In: Proceedings of Eurospeech '91, Genova, Italy, pp. 311-314.
33. Murray, I.R., Edgington, M.D., Campion, D., Lynn, J., 2000. Rule-based emotion synthesis using concatenated speech. In: Proceedings of ISCA Workshop on Speech and Emotion, Belfast, UK, pp. 173-177.
34. Nagae, Y., 1998. Onsei ni fukumareru washa no kanjo no bunseki to ninshiki ni kansuru kenkyuu. Bachelor's thesis submitted to Utsuyomiya University (in Japanese).
35. Ohira, Y., 1995. Watashirashiku, ningenrashiku, Autobiography (in Japanese).
36. Russell, J.A., 1989. Measures of emotion. In: Plutchik, R., Kellerman, (Eds.), Emotion Theory, Research, and Experience, Academic Press, NY, Vol. 4, pp. 83-111.
37. Scherer K.R. Vocal affect expression: a review and a model for future research. Psychological Bulletin. 99(2):1986;143-165.
38. Scherer K.R., Banse R., Wallbott H.G., Goldbeck T. Vocal cues in emotion encoding and decoding. Motivation and Emotion. 15(2):1991;123-148.
39. Shaver P., Schwartz J., Kirson D., O'Connor C. Emotion knowledge: Further exploration of a prototype approach. Journal of Personality and Social Psychology. 52(6):1987;1061-1086.
40. Takeda, S., Ishizuka, F., Hiramatsu, M., 2000. Power features of "anger" expressions in pseudo-conversational speech. In: Proceedings of Acoustic Society of Japan Fall Meeting, pp. 191-192 (in Japanese).
41. Todoroki, T., 1993. Kousai - Kagayaki tuzukeru tameni - KB mausude nyuuryokushita Kinzisutorofii seinenno kiroku (Self-published in Japanese).