Anger recognition in speech using acoustic and linguistic cues

Speech Communication

Volumn 53, Issue 9-10, 2011, Pages 1198-1209

  Polzehl, Tim ^a,b   Schmitt, Alexander ^c   Metze, Florian ^d   Wagner, Michael ^e  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b DEUTSCHE TELEKOM LABORATORIES   (Germany)

^c UNIVERSITY OF ULM   (Germany)

^d Carnegie Mellon University   (United States)

^e UNIVERSITY OF CANBERRA   (Australia)

Author keywords

Anger classification; Decision fusion; Emotion detection; IGR ranking; IVR speech; Linguistic and prosodic acoustic modeling

Indexed keywords

ANGER CLASSIFICATION; DECISION FUSION; EMOTION DETECTION; IGR RANKING; IVR SPEECH;

AUDIO ACOUSTICS; CLASSIFICATION (OF INFORMATION); DATABASE SYSTEMS; FEATURE EXTRACTION; LINGUISTICS; TEXT PROCESSING; VECTOR SPACES;

SPEECH RECOGNITION;

EID: 79960836821     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2011.05.002     Document Type: Article

References (38)

1. Batliner, A.; Fischer, K.; Huber, R.; Spilker, J.; Nöth, E.; 2000. Desperately Seeking Emotions: Actors, Wizards, and Human Beings. In: ISCA Workshop on Speech and Emotion.
2. D. Bitouk, R. Verma, and A. Nenkova Class-level spectral features for emotion recognition Speech Comm. 52 2010 613 625
3. Boersma, P.; Weenink, D.; 2009. Praat: Doing Phonetics by Computer.
4. Burkhardt, F.; van Ballegooy, M.; Huber, R.; 2005a. An emotion-aware voice portal. In: Proc. Electronic Speech Signal Processing ESSP.
5. Burkhardt, F.; Rolfes, M.; Sendlmeier, W.; Weiss, B.; 2005b. A database of german emotional speech. In: Proc. Annual Conf. of the International Speech Communication Association (Interspeech 2005), ISCA.
6. F. Burkhardt, T. Polzehl, J. Stegmann, F. Metze, and R. Huber Detecting real life anger Proc. Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP 2009) 2009 IEEE Taipei, Taiwan 4761 4764
7. Davies, M.; Fleiss, J.; 1982. Measuring Agreement for Multinomial Data.
8. L. Devillers, L. Vidrascu, and L. Lamel Challenges in real life emotion annotation and machine learning based detection J. Neural Networks 18 2005 407 422 (Pubitemid 40922648)
9. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2000 John Wiley & Sons
10. Dumouchel, P.; Dehak, N.; Attabi, Y.; Dehak, R.; Boufaden, N.; 2009. Cepstral and long-term features for emotion recognition. In: Proc. Annual Conf. of the International Speech Communication Association (Interspeech 2009).
11. Enberg, I.S.; Hansen, A.V.; 1996. Documentation of the Danish Emotional Speech Database. Technical Report. Aalborg University, Denmark.
12. H. Fastl, and E. Zwicker Psychoacoustics: Facts and Models third ed. 2005 Springer Berlin
13. V. Hozjan, and Z. Kacic Context-independent multilingual emotion recognition from speech signals Internat. J. Speech Technol. 6 2003 11 320
14. X. Huang, A. Acero, and H.W. Hon Spoken Language Processing 2001 Prentice Hall
15. C.M. Lee, and S.S. Narayanan Toward detecting emotions in spoken dialogs IEEE Trans. Speech Audio Process. 13 2005 293 303 (Pubitemid 40320247)
16. Lee, F.M.; Li, L.H.; Huang, R.Y.; 2008. Recognizing low/high anger in speech for call centers. In: Internat. Conf. on Signal Processing, Robotics and Automation, World Scientific and Engineering Academy and Society (WSEAS), pp. 171-176.
17. F. Metze, R. Englert, U. Bub, F. Burkhardt, and J. Stegmann Getting closer: tailored humancomputer speech dialog Universal Access Inform. Soc. 2008
18. F. Metze, T. Polzehl, and M. Wagner Fusion of acoustic and linguistic speech features for emotion detection Proc. Internat. Conf. on Semantic Computing (ICSC 2009) 2009 IEEE Berleley, CA, USA
19. F. Metze, A. Batliner, F. Eyben, T. Polzehl, B. Schuller, and S. Steidl Emotion recognition using imperfect speech recognition Proc. Annual Conf. of the International Speech Communication Association (Interspeech 2009) 2010 IEEE Makuhari, Japan 1 6
20. Polzehl, T.; Schmitt, a.; Metze, F.; 2009a. Comparing features for acoustic anger classification in german and english ivr systems. In: Proc. of International Workshop of Spoken Dialogue Systems (IWSDS 2009), University of Ulm, Ulm, Germany.
21. T. Polzehl, S. Sundaram, H. Ketabdar, M. Wagner, and F. Metze Emotion classification in children's speech using fusion of acoustic and linguistic features Proc. Annual Conf. of the International Speech Communication Association (Interspeech 2009) 2009 ISCA Brighton, England 340 343
22. T. Polzehl, A. Schmitt, and F. Metze Salient features for anger recognition in german and english ivr portals Spoken Dialogue Systems Technology and Design 2010 Springer Berlin, Germany 81 110
23. Schmitt, A.; Tschaffon, U.; Heinroth, T.; Minker, W.; 2010. Inter-labeler agreement for anger detection in interactive voice response systems. In: 6th Internat. Conf. on Intelligent Environments (IE'10).
24. Schuller, B.; 2006. Automatische Emotionserkennung aus Sprachlicher und manueller Interaktion. Dissertation. Technische Universität München, München.
25. Schuller, B.; Rigoll, G.; Lang, M.; 2004. Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine - belief network architecture. In: IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP).
26. B. Schuller, F. Metze, S. Steidl, A. Batliner, F. Eyben, and T. Polzehl Late fusion of individual engines for imrpoved recognition of negative emotion in speech - learning vs. democratic vote Internat. Conf. on Acoustics Speech and Signal Processing (ICASSP) 2009 IEEE
27. Schuller, B.; Steidl, S.; Batliner, A.; 2009b. The interspeech 2009 emotion challenge. iIn: Proc. Annual Conf. of the International Speech Communication Association (Interspeech 2009).
28. Shafran, I.; Mohri, M.; 2005. A comparison of classifiers for detecting emotion from speech. In: IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP).
29. Shafran, I.; Riley, M.; Mohri, M.; 2003. Voice signatures. In: IEEE Workshop on Automatic Speech Recognition and Understanding, 2003. ASRU '03, pp. 31-36.
30. Steidl, S.; 2009. Automatic classification of emotion-related user states in spontaneous children's speech. Ph.D. thesis.
31. Steidl, S.; Levit, M.; Batliner, A.; Nöth, E.; Niemann, H.; 2005. Of all things the measure is man - classification of emotions and inter-labeler consistency. In: IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), pp. 317-320.
32. V. Vapnik, and C. Cortes Support vector networks Machine Learn. 20 1995 273 297
33. Vidrascu, L.; Devillers, L.; 2007. Five emotion classes detection in real-world call centre data: the use of various types of paralinguistic features. In: Paraling.
34. Vlasenko, B.; Wendemuth, A.; 2009. Processing affected speech within human machine interaction. In: Proc. Annual Conf. of the International Speech Communication Association (Interspeech 2009).
35. Vlasenko, B.; Schuller, B.; Wendemuth, A.; Rigoll, G.; 2007. Combining frame and turn-level information for robust recognition of emotions within speech. In: Proc. Annual Conf. of the International Speech Communication Association (Interspeech 2007), pp. 2225-2228.
36. Vlasenko, B.; Schuller, B.; Mengistu, K.; Rigoll, G.; Wendemuth, A.; 2008. Balancing spoken content adaptation and unit length in the recognition of emotion and interest. In: Proc. 9th INTERSPEECH 2008 Incorp. 12th Australasian Internat. Conf. on Speech Science and Technology (SST 2008), pp. 805-808.
37. Wang, Y.; Li, B.; Meng, Q.; Li, P.; 2009. Emotional feature analysis and recognition in multilingual speech signal. In: Electronic Measurement and Instruments (ICEMI), Beijing.
38. Yacoub, S.; Simske, S.; Lin, X.; Burns, J.; 2003. Recognition of emotions in interactive voice response systems. In: Eurospeech, Geneva, pp. 1-4.