Primitives-based evaluation and estimation of emotions in speech

Speech Communication

Volumn 49, Issue 10-11, 2007, Pages 787-800

  Grimm, Michael ^a   Kroschel, Kristian ^a   Mower, Emily ^b   Narayanan, Shrikanth ^b  

^a UNIVERSITY OF KARLSRUHE   (Germany)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Emotion estimation; Emotion expression variations; Emotion recognition; Emotion space concept; Fuzzy logic; Man machine interaction; Natural speech understanding; Speech analysis

Indexed keywords

DATABASE SYSTEMS; ESTIMATION; FUZZY LOGIC; HUMAN COMPUTER INTERACTION; IMAGE ANALYSIS; SPEECH INTELLIGIBILITY;

EMOTION ESTIMATION; EMOTION EXPRESSION VARIATIONS; EMOTION RECOGNITION; EMOTION SPACE CONCEPTS; NATURAL SPEECH UNDERSTANDING;

SPEECH ANALYSIS;

EID: 34547940048     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2007.01.010     Document Type: Article

References (42)

1. Banse R., and Scherer K. Acoustic profiles in vocal emotion expression. J. Personality Social Psychol. 70 3 (1996) 614-636
2. Batliner, A., Fischer, K., Huber, R., Spilker, J., Nöth, E., 2000. Desperately seeking emotions or: Actors, wizards, and human beings. In: Proc. ICASSP, pp. 195-200.
3. Bulut, M., Narayanan, S., Syrdal, A., 2002. Expressive speech synthesis using a concatenative synthesizer. In: Proc. ICSLP, Denver, CO.
4. Carletta J. Assessing agreement on classification tasks: the kappa statistic. Comput. Linguist. 22 2 (1996) 249-254
5. Cowie R., and Cornelius R. Describing the emotional states that are expressed in speech. Speech Communication 40 (2003) 5-32
6. Cowie, R., Douglas-Cowie, E., Savvidou, S, McMahon, E., Sawey, M., Schröder, M., 2000. 'FEELTRACE': an instrument for recording perceived emotion in real time. In: Douglas-Cowie, E., Cowie, R., Schröder, M. (Eds.), Proc. ISCA Workshop on Speech and Emotion: A Conceptual Framework for Research, Textflow, Belfast, pp. 19-24.
7. Cowie R., Douglas-Cowie E., Tsapatsoulis N., Votsis G., Kollias S., Fellenz W., and Taylor J. Emotion recognition in human-computer interaction. IEEE Signal Process. Mag. 18 1 (2001) 32-80
8. Dellaert, F., Polzin, T., Waibel, A., 1996. Recognizing emotion in speech. In: Proc. ICSLP, Vol. 3, Philadelphia, PA, USA, pp. 1970-1973.
9. Douglas-Cowie, E., Cowie, R., Schröder, M., 2003. The description of naturally occurring emotional speech. In: Proc. 15th Internat. Conf. on Phonetic Sciences, Barcelona, Spain, pp. 2877-2880.
10. Fischer L., Brauns D., and Belschak F. Zur Messung von Emotionen in der angewandten Forschung (2002), Pabst Science Publishers, Lengerich
11. Fragopanagos N.F., and Taylor J.G. Emotion recognition in human-computer interaction. Neural Networks 18 4 (2005) 389-405
12. Grimm, M., Kroschel, K., 2005a. Rule-based emotion classification using acoustic features. In: Proc. 3rd Internat. Conf. on Telemedicine and Multimedia Communication, Kajetany, Poland.
13. Grimm, M., Kroschel, K., 2005b. Evaluierung von natürlichen Emotionen in Sprachsignalen. In: Proceedings 31. Deutsche Jahrestagung für Akustik, DAGA'05, München, Germany, pp. 731-732.
14. Grimm, M., Kroschel, K., 2005c. Evaluation of natural emotions using self assessment manikins. In: Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), San Juan, Puerto Rico, pp. 381-385.
15. Grimm, M., Mower, E., Narayanan, S., Kroschel, K., 2006a. Combining categorical and primitives-based emotion recognition. In: Proc. 14th European Signal Processing Conference (EUSIPCO), Florence, Italy.
16. Grimm, M., Kroschel, K., Narayanan, S., 2006b. Modeling emotion expression and perception behavior in auditive emotion evaluation. In: Proc. ISCA 3rd Internat. Conf. on Speech Prosody, Dresden, Germany, pp. 9-12.
17. Hammal, Z., Bozkurt, B., Couvreur, L., Unay, D., Caplier, A., Dutoit, T., 2005. Passive versus active: Vocal classification system. In: Proc. Eusipco, Antalya, Turkey.
18. Hernandez, C., 2005. Einsatz von Fuzzy Logic zur Erkennung von Emotionen in der Sprache, Studienarbeit, Universität Karlsruhe (TH), Germany.
19. Huang, C.-F, Akagi, M., 2005. A multi-layer fuzzy logical model for emotional speech perception. In: Proc. Eurospeech, Lisbon, Portugal, pp. 417-420.
20. Kehrein, R., 2002. The prosody of authentic emotions. In: Proc. Speech Prosody Conference, pp. 423-426.
21. Kroschel K. Statistische Informationstheorie: Signal- und Mustererkennung, Parameter- und Signalschätzung. fourth ed. (2004), Springer, Berlin
22. Lang P. Behavioral treatment and bio-behavioral assessment. In: Sidowski J.B., et al. (Ed). Technology in Mental Health Care Delivery Systems (1980), Ablex Publishing, Norwood, NJ 119-137
23. Lee, C., Narayanan, S., 2003. Emotion recognition using a data-driven fuzzy inference system. In: Proc. Eurospeech, Geneva, pp. 157-160.
24. Lee C.M., and Narayanan S.S. Toward detecting emotions in spoken dialogs. IEEE Trans. Speech Audio Process. 13 2 (2005) 293-303
25. Lee, C., Narayanan, S., Pieraccini, R., 2001. Recognition of negative emotions from the speech signal. In: Proc. IEEE ASRU, Trento, Italy, pp. 240-243.
26. Lee, S., Yildirim, S., Kazemzadeh, A., Narayanan, S, 2005. An articulatory study of emotional speech production. In: Proc. Eurospeech, pp. 497-500.
27. Murray I., and Arnott J. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. J. Acoust. Soc. Amer. 93 2 (1993) 1097-1108
28. Nagel, A., 2005. Robuste Pitch-Extraktion für die Erkennung von Emotionen in der Sprache. Diploma Thesis, Universität Karlsruhe (TH), Germany.
29. Nwe T.L., Foo S.W., and De Silva L.C. Speech emotion recognition using hidden markov models. Speech Communication 41 4 (2003) 603-623
30. Oudeyer P.-Y. The production and recognition of emotions in speech: features and algorithms. Int. J. Hum. Comput. Stud. 59 1-2 (2003) 157-183
31. Russell J., and Mehrabian A. Evidence for a three-factor theory of emotions. J. Res. Personality 11 (1977) 273-294
32. Scherer K.R. What are emotions? And how can they be measured?. Social Sci. Inf. 44 4 (2005) 693-727
33. Schölkopf B., and Smola A.J. Learning with Kernels (2002), The MIT Press
34. Schröder, M., Cowie, R., Douglas-Cowie, E., Westerdijk, M., Gielen, S., 2001. Acoustic correlates of emotion dimensions in view of speech synthesis. In: Proc. Eurospeech, Vol. 1, Aalborg, pp. 87-90.
35. Schuller, B., Lang, M., Rigoll, G., 2005. Speaker independent emotion recognition by early fusion of acoustic and linguistic features within ensembles. In: Proc. Interspeech, Lisbon, Portugal, pp. 805-808.
36. Schuller, B., Lang, M., Rigoll, G., 2006. Recognition of spontaneous emotions by speech within automotive environment. In: Proc. 32. Deutsche Jahrestagung für Akustik, DAGA'06, Braunschweig, Germany, pp. 57-58.
37. Ververidis, D., Kotropoulos, C., Pitas, I., 2004. Automatic emotional speech classification. In: Proc. ICASSP, Montreal, Canada, pp. 593-596.
38. Vidrascu, L., Devillers, L., 2005. Real-life emotion representation and detection in call centers data. In: Proc. First Internat. Conf. on Affective Computing and Intelligent Interaction (ACII), Beijing, China, pp. 739-746.
39. Vidrascu, L., Devillers, L., 2005. Detection of real-life emotions in call centers. In: Proc. Eurospeech, pp. 1841-1844.
40. Wundt W. Grundriss der Psychologie (1896), W. Engelmann, Leipzig
41. Yu, Y., Chang, E., Li, C., 2002. Computer recognition of emotion in speech. In: Proc. Intel Internat. Science and Engineering Fair.
42. Yu, C., Aoki, P.M., Woodruff, A., 2004. Detecting user engagement in everyday conversations. In: Proc. 8th Internat. Conf. on Spoken Language Processing (ICSLP), Vol. 2, Jeju Island, Korea, pp. 1329-1332.