Applying an analysis of acted vocal emotions to improve the simulation of synthetic speech

Computer Speech and Language

Volumn 22, Issue 2, 2008, Pages 107-129

  Murray, Iain R ^a   Arnott, John L ^a  

^a UNIVERSITY OF DUNDEE   (United Kingdom)

Author keywords

Affect; Emotion; Speech analysis; Speech perception; Synthesis by rule; System evaluation

Indexed keywords

COMPUTER SIMULATION; SOFTWARE PROTOTYPING; SPEECH ANALYSIS; SPEECH PRODUCTION AIDS;

AFFECT; EMOTION; SPEECH PERCEPTION; SYNTHESIS-BY RULE; SYSTEM EVALUATION;

SPEECH SYNTHESIS;

EID: 35548963442     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2007.06.001     Document Type: Article

References (39)

1. Ax A.F. Physiological differentiation of emotional states. Psychosomatic Medicine 15 (1953) 433-442
2. Allen J., Hunnicutt M.S., Klatt D., Armstrong R.C., and Pisoni D. From Text to Speech: The MITalk System (1987), Cambridge University Press, Cambridge, UK
3. Anderson S. Emotion Rules for the Festival Speech Synthesiser, Project Report, Applied Computing (2003), University of Dundee
4. Banse R., and Scherer K.R. Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology 70 3 (1996) 614-636
5. Bulut, M., Narayanan, S.S., Syrdal, A.K., 2002. Expressive speech synthesis using a concatenative synthesiser. In: Proceedings of ICSLP '02, Denver, CO, USA.
6. Burkhardt, F., Sendlmeier, W.F., 2000. Verification of acoustical correlates of emotional speech using formant synthesis. In: Proceedings of the ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, 5-7 September, pp. 151-156.
7. Cahn, J.E. (1990) Generating Expression in Synthesised Speech. MIT Media Laboratory Technical Report.
8. Davitz J.R. The Communication Of Emotional Meaning (1964), MacGraw-Hill, New York
9. Dawes R.M., and Kramer E. A proximity analysis of vocally expressed emotions. Perceptual And Motor Skills 22 (1966) 571-574
10. Douglas-Cowie E., Campbell N., Cowie R., and Roach P. Emotional speech: towards a new generation of databases. Speech Communication 40 (2003) 33-60
11. Eskénazi, M. (1993) Trends in speaking styles research. In: Proceedings of Eurospeech'93, Berlin, Germany, pp. 501-509.
12. Fairbanks G., and Pronovost W. An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monographs 6 (1939) 87-104
13. Fónagy I. Emotions, voice and music. In: Sundberg J. (Ed). Research Aspects On Singing: Proceedings From A Seminar Organised By The Committee For The Acoustics Of Music vol. 33 (1981), Royal Swedish Academy of Music 51-79
14. Fonix, 2007. About Fonix Speech. Retrieved Jan 8, 2007 from http://www.fonixspeech.com/pages/index.php.
15. Gobl C., and Ní Chasaide A. The role of voice quality in communicating emotion, mood and attitude. Speech Communication 40 (2003) 189-212
16. Hofer, G.O., Richmond, K., Clark, R.A.J., 2005. Informed blending of databases for emotional speech synthesis. In: Proceedings of Interspeech 2005, Lisbon, Portugal (Paper #1836).
17. Johnstone T., and Scherer K.R. The effects of emotions on voice quality. Geneva Studies in Emotion and Communication 13 3 (1999). http://www.unige.ch/fapse/emotion/publications/geneva_studies.html Retrieved Jan 8, 2007 from
18. Kitahara, Y., & Tohkura, Y., 1992. Prosodic control to express emotions for man-machine speech interaction. In: IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences (Japan), 0E75-A(2), February, pp. 155-163.
19. Leinonen L., Hiltunen T., Linnankoski I., and Laakso M. Expression of emotional-motivational connotations with a one-word utterance. Journal of the Acoustical Society of America 102 3 (1997) 1853-1863
20. Montero, J.M., Gutiérrez-Arriola, J., Colás, J., Macías-Guarasa, J., Enríquez, E., & Pardo, J.M., 1999. Development of an emotional speech synthesiser in Spanish. In: Proceedings of Eurospeech '99, Budapest, Hungary, September.
21. Morton K. PALM: psychoacoustic language modelling. Proceedings of the Institute of Acoustics 14 6 (1992) 189-197
22. Murray, I.R., 1989. Simulating Emotion In Synthetic Speech, PhD Thesis, University of Dundee.
23. Murray, I.R., 2000. Rule-based emotion synthesis using concatenated speech. In: Proceedings of the ISCA workshop on speech and emotion, Newcastle, Northern Ireland, 5-7 September, pp. 173-177.
24. Murray I.R., and Arnott J.L. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of the Acoustical Society of America 93 2 (1993) 1097-1108
25. Murray I.R., and Arnott J.L. Implementation and testing of a system for producing emotion-by-rule in synthetic speech. Speech Communication 16 (1995) 369-390
26. Murray I.R., and Edgington M.D. Emotion in the BT Laureate speech synthesis system. Proceedings of the Institute of Acoustics 20 6 (1998) 263-270
27. Ortony A., and Turner T.J. What's basic about basic emotions?. Psychological Review 97 3 (1990) 315-331
28. O'Sullivan M., Ekman P., Friesen W., and Scherer K. What you say and how you say it: the contribution of speech content and voice quality to judgements of others. Journal of Personality and Social Psychology 48 (1985) 54-62
29. Picard R.W. Affective Computing (2000), MIT Press
30. Raymond, N., 1993. Emotional Speech In Men And Women, BSc dissertation, University of Leeds.
31. Roach P. Introducing Phonetics (1992), Penguin
32. Roach, P., 2000. Techniques for the phonetic description of emotional speech. In: Proceedings of the ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, September, pp. 53-59.
33. Schachter S., and Singer J.E. Cognitive, social and physiological determinants of emotional state. Psychological Review 69 5 (1962) 379-399
34. Schröder, M., 2001. Emotional speech synthesis: a review. In: Proceedings of Eurospeech 2001, Aalborg, Denmark.
35. Schröder, M., Trouvain, J., 2001. The German text-to-speech system MARY: A tool for research, development and testing. In: Proceedings of the 4th ISCA workshop on speech synthesis, Blair Atholl, UK.
36. Sprent P. Applied Nonparametric Statistical Methods (1989), Chapman and Hall, London
37. Tolkmitt F.J., and Scherer K.R. Effect of experimentally induced stress on vocal parameters. Journal of Experimental Psychology: Human Perception and Performance 12 3 (1986) 302-313
38. Vroomen, J., Collier, R., Mozziconacci, S., 1993. Duration and intonation in emotional speech. In: Proceedings of Eurospeech '93, Berlin, Germany, pp. 577-580.
39. Williams C.E., and Stevens K.N. Emotions and speech: some acoustic correlates. Journal Of The Acoustical Society Of America 52 4(2) (1972) 1238-1250