Spoken emotion recognition using hierarchical classifiers

Computer Speech and Language

Volumn 25, Issue 3, 2011, Pages 556-570

  Albornoz, Enrique M ^a,b   Milone, Diego H ^a,b   Rufiner, Hugo L ^a,b,c  

^a UNIVERSIDAD NACIONAL DEL LITORAL   (Argentina)

^b Facultad de Ciencias Naturales e Instituto M Lillo   (Argentina)

^c UNIVERSIDAD NACIONAL DE ENTRE RÍOS   (Argentina)

Author keywords

Emotion recognition; Hidden Markov Model; Hierarchical classifiers; Multilayer Perceptron; Spectral information

Indexed keywords

EMOTION CLASSIFICATION; EMOTION RECOGNITION; EMOTIONAL STATE; GAUSSIAN MIXTURE MODEL; GAUSSIAN MIXTURES; HIERARCHICAL CLASSIFIERS; HIERARCHICAL METHOD; HUMAN MACHINE INTERACTION; INPUT FEATURES; MULTI-DISCIPLINARY RESEARCH; MULTILAYER PERCEPTRON; MULTIPLE FEATURES; PROSODIC FEATURES; SPECTRAL CHARACTERISTICS; SPECTRAL INFORMATION; SPECTRUM CHARACTERISTIC; SPEECH SIGNALS;

MULTILAYERS; NEURAL NETWORKS; OBJECT RECOGNITION; STANDARDS;

HIDDEN MARKOV MODELS;

EID: 79952619486     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2010.10.001     Document Type: Article

References (43)

1. J. Adell Mercado, A. Bonafonte Cávez, and D. Escudero Mancebo Analysis of prosodic features: towards modelling of emotional and pragmatic attributes of speech XXI Congreso de la Sociedad Española. Procesamiento del Lenguaje Natural - SEPLN 2005, no. 35 Granada, España 2005 277 284
2. E.M. Albornoz, M.B. Crolla, and D.H. Milone Recognition of emotions in speech Proceedings of XXXIV Congreso Latinoamericano de Informática - CLEI Santa Fe, Argentina 2008 1120 1129
3. A. Batliner, S. Steidl, B. Schuller, D. Seppi, T. Vogt, J. Wagner, L. Devillers, L. Vidrascu, V. Aharonson, L. Kessous, and N. Amir Whodunnit - searching for the most important feature types signalling emotion-related user states in speech Computer Speech & Language 25 1 2011 4 28
4. C.M. Bishop Pattern Recognition and Machine Learning 1st edition 2006 Springer
5. M. Borchert, and A. Dusterhoft Emotions in speech - experiments with prosody and quality features in speech for use in categorical and dimensional emotion recognition environments Proceedings of IEEE International Conference on Natural Language Processing and Knowledge Engineering. IEEE NLP-KE 2005 2005 147 151
6. F. Burkhardt, A. Paeschke, M. Rolfes, W. Sendlmeier, and B. Weiss A database of German emotional speech 9th European Conference on Speech Communication and Technology - Interspeech'2005 2005 1517 1520 (Pubitemid 43908362)
7. C. Clavel, I. Vasilescu, L. Devillers, G. Richard, and T. Ehrette Fear-type emotion recognition for future audio-based surveillance systems Speech Communication 50 6 2008 487 503
8. R. Cowie, and R. Cornelius Describing the emotional states that are expressed in speech Speech Communication 40 1-2 2003 5 32
9. F. Dellaert, T. Polzin, and A. Waibel Recognizing emotions in speech Proceedings of International Conference on Spoken Language Processing - ICSLP'96, vol. 3 Philadelphia, PA 1996 1970 1973
10. J.R. Deller, J.G. Proakis, and J.H. Hansen Jr. Discrete-time Processing of Speech Signals 1993 Prentice Hall PTR Upper Saddle River, NJ, USA
11. L. Devillers, and L. Vidrascu Speaker Classification II: Selected Projects, vol. 4441/2007 of Lecture Notes in Computer Science 2007 Springer-Verlag Berlin/Heidelberg Chapter: Real-life emotion recognition in speech, pp. 34-42
12. M. El Ayadi, M. Kamel, and F. Karray Speech emotion recognition using Gaussian mixture vector autoregressive models IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP 2007, vol. 4 2007 IV-957 IV-960
13. P. Ekman, E.R. Sorenson, and W.V. Friesen Pan-cultural elements in facial displays of emotions Science 164 3875 1969 86 88
14. L. Fu, X. Mao, and L. Chen Speaker independent emotion recognition based on SVM/HMMs fusion system International Conf. on Audio, Language and Image Processing. ICALIP 2008 2008 61 65
15. S. Haykin Neural Networks: A Comprehensive Foundation 2nd edition 1998 Prentice Hall
16. A.I. Iliev, M.S. Scordilis, J.P. Papa, and A.X. Falcao Spoken emotion recognition through optimum-path forest classification using glottal features Computer Speech & Language 24 3 2010 445 460
17. J. Kim Robust Speech Recognition and Understanding 2007 I-Tech Education and Publishing Vienna, Austria Chapter: Bimodal emotion recognition using speech and physiological changes, pp. 265-280
18. J. Kim, and E. André Emotion recognition based on physiological changes in music listening IEEE Transactions on Pattern Analysis and Machine Intelligence 30 12 2008 2067 2083
19. T. Kohonen The Self-Organizing Map 1995 Springer-Verlag
20. R. Lazarus Appraisal Processes in Emotion: Theory, Methods, Research (Series in Affective Science) 2001 Oxford University Press USA Chapter: Relational meaning and discrete emotions, pp. 37-67
21. C. Lee, E. Mower, C. Busso, S. Lee, and S. Narayanan Emotion recognition using a hierarchical binary decision tree approach Interspeech 2009 Brighton, UK 2009 320 323
22. Y.-L. Lin, and G. Wei Speech emotion recognition based on HMM and SVM Proceedings of International Conference on Machine Learning and Cybernetics, vol. 8 2005 4898 4901 (Pubitemid 41734780)
23. I. Luengo Gil, E. Navas Cordón, I.C. Hernáez Rioja, and J. Sánchez de la Fuente Reconocimiento automático de emociones utilizando parámetros prosódicos Procesamiento del lenguaje natural 35 2005 13 20
24. D. Michie, D. Spiegelhalter, and C. Taylor Machine Learning, Neural and Statistical Classification 1994 Ellis Horwood University College, London
25. D. Morrison, R. Wang, and L.C.D. Silva Ensemble methods for spoken emotion recognition in call-centres Speech Communication 49 2 2007 98 112
26. I.R. Murray, and J.L. Arnott Applying an analysis of acted vocal emotions to improve the simulation of synthetic speech Computer Speech & Language 22 2 2008 107 129 (Pubitemid 350016711)
27. A. Noguerias, A. Moreno, A. Bonafonte, and J. Mariño Speech emotion recognition using hidden Markov models European Conference on Speech Communication and Technology - Eurospeech 2001 Aalborg, Denmark 2001 2679 2682
28. J.J. Prinz Which emotions are basic? D. Evans, P. Cruse, Emotion, Evolution, and Rationality 2004 Oxford University Press
29. L. Rabiner, and B.-H. Juang Fundamentals of Speech Recognition 1993 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
30. J. Rong, Y.-P.P. Chen, M. Chowdhury, and G. Li Acoustic features extraction for emotion recognition 6th IEEE/ACIS International Conference on Computer and Information Science - ICIS 2007 2007 419 424
31. K.R. Scherer What are emotions? And how can they be measured? Social Science Information 44 4 2005 695 729 (Pubitemid 41666684)
32. K. Schindler, L. Van Gool, and B. de Gelder Recognizing emotions expressed by body pose: a biologically inspired neural model Neural Networks 21 9 2008 1238 1246
33. B. Schuller, G. Rigoll, and M. Lang Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing - ICASSP'04 2004 I-577 I-580
34. B. Schuller, B. Vlasenko, D. Arsic, G. Rigoll, and A. Wendemuth Combining speech recognition and acoustic word emotion models for robust text-independent emotion recognition IEEE International Conference on Multimedia and Expo'08 2008 1333 1336
35. D. Tacconi, O. Mayora, P. Lukowicz, B. Arnrich, C. Setz, G. Tröster, and C. Haring Activity and emotion recognition to support early diagnosis of psychiatric diseases Proceedings of 2nd International Conference on Pervasive Computing Technologies for Healthcare'08 Tampere, Finland 2008 100 102
36. K.P. Truong, and D.A. van Leeuwen Automatic discrimination between laughter and speech Speech Communication 49 2 2007 144 158 (Pubitemid 46241514)
37. V. Vinhas, L.P. Reis, and E. Oliveira Dynamic multimedia content delivery based on real-time user emotions. Multichannel online biosignals towards adaptative GUI and content delivery International Conference on Bio-inspired Systems and Signal Processing - Biosignals 2009 Porto, Portugal 2009 299 304
38. J. Wagner, T. Vogt, and E. André A systematic comparison of different HMM designs for emotion recognition from acted and spontaneous speech Proceedings of the 2nd International Conference on Affective Computing and Intelligent Interaction - ACII'07 2007 Springer-Verlag Berlin/Heidelberg 114 125
39. Z. Xiao, E. Dellandréa, W. Dou, and L. Chen Recognition of emotions in speech by a hierarchical approach International Conference on Affective Computing and Intelligent Interaction (ACII) 2009 312 319
40. B. Yang, and M. Lugger Emotion recognition from speech signals using new harmony features Signal Processing 90 5 2010 1415 1423 (special Section on Statistical Signal & Array Processing)
41. S. Yildirim, S. Narayanan, and A. Potamianos Detecting emotional state of a child in a conversational computer game Computer Speech & Language 25 1 2011 29 44
42. S. Young, G. Evermann, D. Kershaw, G. Moore, J. Odell, D. Ollason, V. Valtchev, and P. Woodland The HTK Book (for HTK Version 3.1) 2001 Cambridge University Engineering Department England
43. Zell, A.; Mamier, G.; Vogt, M.; Mache, N.; Hubner, R.; Doring, S.; Herrmann, K.-U.; Soyez, T.; Schmalzl, M.; Sommer, T.; Hatzigeorgiou, A.; Posselt, D.; Schreiner, T.; Kett, B.; Clemente, G.; 1998. SNNS (Stuttgart Neural Network Simulator) - user manual Version 4.2, 70565 Stuttgart, Fed. Rep. of Germany, sNNS User Manual Version 4.0.