Toward detecting emotions in spoken dialogs

IEEE Transactions on Speech and Audio Processing

Volumn 13, Issue 2, 2005, Pages 293-303

  Lee, Chul Min ^a   Narayanan, Shrikanth S ^a  

^a University of Southern California ^*  (United States)

Author keywords

Acoustic correlates; Dialog systems; Emotion recognition; Emotional salience; Feature selection; Information fusion; Principal component analysis; Spoken language processing

Indexed keywords

ALGORITHMS; AUTOMATION; DECISION MAKING; HUMAN COMPUTER INTERACTION; INFORMATION ANALYSIS; LINGUISTICS; MATHEMATICAL MODELS; OPTIMIZATION; PRINCIPAL COMPONENT ANALYSIS; SIGNAL PROCESSING;

ACOUSTIC CORRELATES; DIALOG SYSTEMS; EMOTION RECOGNITION; EMOTIONAL SCIENCE; FEATURE SELECTION; INFORMATION FUSION; SPOKEN LANGUAGE PROCESSING;

SPEECH RECOGNITION;

EID: 14644439843     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2004.838534     Document Type: Article

References (28)

1. A. Damasio, Descartes' Error: Emotion, Reason, and the Hitman Brain. London, U.K.: Putman, 1994.
2. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Process. Mag., vol. 18, no. 1, pp. 32-80, Jan. 2001.
3. A. Ortony, G. Clore, and A. Collins, The Cognitive Structure of Emotions. Cambridge, U.K.: Cambridge Univ. Press, 1988.
4. J. Averill, "In the eyes of the beholder," The Nature of Emotion: Fundamental Questions, pp. 7-14, 1994.
5. K. Scherer, "Toward a concept of 'modal emotions'," The Nature of Emotion: Fundamental Questions, pp. 25-31, 1994.
6. R. Plutchik, The Psychology and Biology of Emotion. New York: HarperCollins College, 1994.
7. K. Scherer, "A cross-cultural inverstigation of emotion inferences from voice and speech: Implications for speech technology," in Proc. ICSLP, Beijing, China, Oct. 2000, pp. 379-382.
8. C. Lee, S. Narayanan, and R. Pieraccini, "Recognition of negative emotions from the speech signal," in Proc. Automatic Speech Recognition Understanding, Dec. 2001.
9. V. Petrushin, "Emotion in speech: Recognition and application to call centers," Artif. Neu. Net. Engr. (ANNIE), 1999.
10. F. Dellaert, T. Polzin, and A. Waibel, "Recognizing emotion in speech," in Proc. ICSLP, Philadelphia, PA, 1996, pp. 1970-1973.
11. D. Roy and A. Pentland, "Automatic spoken affect analysis and classification," in Proc. Int. Conf. Automatic Face Gesture Recognition, Killington, VT, 1996, pp. 363-367.
12. R. Banse and K. Scherer, "Acoustic profiles in vocal emotion expression," J. Personality Social Psych., vol. 70, no. 3, pp. 614-636, 1996.
13. I. Murray and J. Arnott, "Toward a simulation of emotion in synthetic speech: A review of the literature on human vocal emotion," Acoust. Soc. Ante., vol. 93, no. 2, pp. 1097-1108, 1993.
14. S. McGilloway, R. Cowie, E. Douglas-Cowie, S. Gielen, M. Westerdijk, and S. Stroeve, "Approaching automatic recognition of emotion from voice: A rough benchmark," in Proc. ISCA Workshop Speech Emotion, 2000, pp. 207-212.
15. A. Batliner, K. Fischer, R. Huber, J. Spiker, and E. Noth, "Desperately seeking emotions: Actors, wizards, and human beings," in Proc. ISCA Workshop Speech Emotion, 2000, pp. 195-200.
16. S. Arunachalam, D. Gould, E. Anderson, D. Byrd, and S. Narayanan, "Politeness and frustration language in child-machine interactions," in Proc. Eurospeech, Aalborg, Denmark, 2001, pp. 2675-2678.
17. J. Ang, R. Dhillon, A. Krupski, E. Shriberg, and A. Stolcke, "Prosodybased automatic detection of annoyance and frustration in human-computer dialog," in Proc, ICSLP, Denver, CO, Sep. 2002, pp. 2037-2040.
18. A. Gorin, "On automated language acquisition," J. Acoust. Soc., Amer., vol. 97, no. 6, pp. 3441-3461, 1995.
19. S. Siegel and J. N. J. Castellan, Nonparametric Statistics for The Behavioral Sciences. New York: McGraw-Hill, 1988.
20. J. Carletta, "Assessing agreement on classification tasks: The kappa statistic," Comput. Linguistics, vol. 22, no. 2, pp. 249-254, 1996.
21. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
22. T. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1991.
23. A. Gorin, A. Gertner, and E. Goldman, "Adaptive acquisition of language," in Neural Networks, Theory, and Applications, R. Mammone and Y Zeevi, Eds. San Diego, CA: Academic, 1991, pp. 125-167.
24. D. Tax, M. van Breukelen, R. Duin, and J. Kittler, "Combining multiple classifiers by averaging or by multiplying," Pattern Recognit., vol. 33, pp. 1475-1485, 2001.
25. L. Kuncheva, J. Bezdek, and R. Duin, "Decision templates for multiple classifier fusion: An experimental comparison," Pattern Recognit., vol. 34, no. 2, pp. 299-314, 2001.
26. Z. Chair and P. K. Varshney, "Optimal data fusion in multiple sensor detection systems," IEEE Trans. Aerosp. Electron. Syst., vol. AES-22, pp. 98-101, 1986.
27. L. Kuncheva and C. Whitaker, "Measure of diversity in classifier ensembles," Mach. Learn., vol. 51, pp. 181-207, 2003.
28. C. Lee and S. Narayanan, "Emotion recognition using a data-driven fuzzy inference system," in Proc. Eurospeech, 2003, pp. 157-160.