Prosodic, Spectral and Voice Quality Feature Selection Using a Long-Term Stopping Criterion for Audio-Based Emotion Recognition

Proceedings - International Conference on Pattern Recognition

Volumn , Issue , 2014, Pages 803-808

  Kachele, Markus ^a   Zharkov, Dimitrij ^a   Meudt, Sascha ^a   Schwenker, Friedhelm ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

FEATURE EXTRACTION;

EMOTION RECOGNITION; EMOTION RECOGNITION FROM SPEECH; HUMAN MACHINE INTERFACE; STATE-OF-THE-ART PERFORMANCE; STOPPING CRITERIA; SUPRASEGMENTAL FEATURES; TERMINATION CRITERIA; VOICE QUALITY FEATURES;

SPEECH RECOGNITION;

EID: 84918807880     PISSN: 10514651     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPR.2014.148     Document Type: Conference Paper

References (43)

1. D. Zharkov, M. Kä chele, S. Meudt, and F. Schwenker, "A long-term stopping criterion for the forward-backward feature selection algorithm for the classification of emotions in speech, " in Joint Proceedings of the T2CT and CCGL Workshops. Otto von Guericke University Magdeburg, 2013, pp. 27-35.
2. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction, " IEEE Signal Processing Magazine, vol. 18, no. 1, pp. 32-80, Jan 2001.
3. L. Devillers, L. Vidrascu, and L. Lamel, "Challenges in real-life emotion annotation and machine learning based detection, " Neural Networks, vol. 18, pp. 407-422, 2005.
4. P.-Y. Oudeyer, "The production and recognition of emotions in speech: features and algorithms, " International Journal of Human Computer Interaction, vol. 59(1-2), pp. 157-183, 2003.
5. S. Scherer, F. Schwenker, and G. Palm, "Classifier fusion for emotion recognition from speech, " in Advanced Intelligent Environments, W. Minker, M. Weber, H. Hagras, V. Callagan, and A. D. Kameas, Eds. Springer, 2009, pp. 95-117.
6. M. Kä chele, M. Glodek, D. Zharkov, S. Meudt, and F. Schwenker, "Fusion of audio-visual features using hierarchical classifier systems for the recognition of affective states and the state of depression, " in Proceedings of the International Conference on Pattern Recognition Applications and Methods (ICPRAM), M. De Marsico, A. Tabbone, and A. Fred, Eds. SciTePress, 2014, pp. 671-678.
7. N. Fragopanagos and J. Taylor, "Emotion recognition in humancomputer interaction, " Neural Networks, vol. 18, pp. 389-405, 2005.
8. K. R. Scherer, T. Johnstone, and G. Klasmeyer, Handbook of Affective Sciences-Vocal expression of emotion, ser. Affective Science. Oxford University Press, 2003, ch. 23, pp. 433-456.
9. S. Scherer, M. Oubbati, F. Schwenker, and G. Palm, "Real-time emotion recognition from speech using echo state networks, " in Artificial Neural Networks in Pattern Recognition. Springer Berlin Heidelberg, 2008, pp. 205-216.
10. S. Scherer, F. Schwenker, and G. Palm, "Emotion recognition from speech using multi-classifier systems and rbf-ensembles, " in Speech, Audio, Image and Biomedical Signal Processing using Neural Networks. Springer Berlin Heidelberg, 2008, pp. 49-70.
11. J. Nicholson, K. Takahashi, and R. Nakatsu, "Emotion recognition in speech using neural networks, " Neural Computing and Applications, vol. 9, pp. 290-296, 2000.
12. F. Burkhardt, A. Paeschke, M. Rolfes, W. Sendlmeier, and B. Weiss, "A database of german emotional speech, " in Proceedings of Interspeech 2005, 2005.
13. G. Palm and F. Schwenker, "Sensor-fusion in neural networks, " in Harbour Protection Through Data Fusion Technologies, E. Shahbazian, G. Rogova, and M. J. DeWeert, Eds. Springer, 2009, pp. 299-306.
14. F. Schwenker, S. Scherer, M. Schmidt, M. Schels, and M. Glodek, "Multiple classifier systems for the recognition of human emotions, " in Proceedings of the 9th International Workshop on Multiple Classifier Systems (MCS'10), ser. LNCS 5997, N. E. Gayar, J. Kittler, and F. Roli, Eds. Springer, 2010, pp. 315-324.
15. C. M. Lee, S. Yildirim, M. Bulut, A. Kazemzadeh, C. Busso, Z. Deng, S. Lee, and S. S. Narayanan, "Emotion recognition based on phoneme classes, " in Proceedings of ICSLP 04, 2004.
16. S. Meudt and F. Schwenker, "On instance selection in audio based emotion recognition, " in Proceedings of the 5th IAPR TC3 Workshop on Artificial Neural Networks for Pattern Recognition (ANNPR'12). Springer, 2012, pp. 186-192.
17. T. L. Nwe, S. W. Foo, and L. C. De Silva, "Speech emotion recognition using hidden markov models, " Speech communication, vol. 41, no. 4, pp. 603-623, 2003.
18. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Comput., vol. 18, no. 7, pp. 1527-1554, Jul. 2006.
19. H. Lee, Y. Largman, P. Pham, and A. Y. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks, " in Advances in Neural Information Processing Systems 22, 2009, pp. 1096-1104.
20. A. Stuhlsatz, C. Meyer, F. Eyben, T. ZieIke, G. Meier, and B. Schuller, "Deep neural networks for acoustic emotion recognition: raising the benchmarks, " in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on. IEEE, 2011, pp. 5688-5691.
21. M. Lugger and B. Yang, "Classification of different speaking groups by means of voice quality parameters, " ITG-Fachbericht-Sprachkommunikation 2006, 2006.
22. I. Luengo, E. Navas, and I. Herná ez, "Feature analysis and evaluation for automatic emotion identification in speech, " Multimedia, IEEE Transactions on, vol. 12, no. 6, pp. 490-501, 2010.
23. S. Scherer, J. Kane, C. Gobl, and F. Schwenker, "Investigating fuzzyinput fuzzy-output support vector machines for robust voice quality classification, " Computer Speech and Language, vol. 27, no. 1, pp. 263-287, Jan. 2012.
24. B. Schuller, A. Batliner, S. Steidl, and D. Seppi, "Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge, " Speech Communication, vol. 53, no. 9-10, pp. 1062-1087, 2011, sensing Emotion and Affect-Facing Realism in Speech Processing.
25. F. Eyben, M. Wollmer, and B. Schuller, "Openear-introducing the munich open-source emotion and affect recognition toolkit, " in Affective Computing and Intelligent Interaction and Workshops, 2009. ACII 2009. 3rd International Conference on, 2009, pp. 1-6.
26. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection, " J. Mach. Learn. Res., vol. 3, pp. 1157-1182, Mar. 2003.
27. R. Kohavi and G. H. John, "Wrappers for feature subset selection, " Artif. Intell., vol. 97, no. 1-2, pp. 273-324, Dec. 1997.
28. M. Lugger and B. Yang, "The relevance of voice quality features in speaker independent emotion recognition, " in Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on, vol. 4. IEEE, 2007, pp. IV-17.
29. J. Kane and C. Gobl, "Identifying regions of non-modal phonation using features of the wavelet transform." in INTERSPEECH, 2011, pp. 177-180.
30. T. Drugman, B. Bozkurt, and T. Dutoit, "Causal-anticausal decomposition of speech using complex cepstrum for glottal source estimation, " Speech Communication, vol. 53, no. 6, pp. 855-866, 2011.
31. G. Fant, J. Liljencrants, and Q.-g. Lin, "A four-parameter model of glottal flow, " STL-QPSR, vol. 4, no. 1985, pp. 1-13, 1985.
32. P. Alku, T. Bä ckströ m, and E. Vilkman, "Normalized amplitude quotient for parametrization of the glottal flow, " the Journal of the Acoustical Society of America, vol. 112, p. 701, 2002.
33. M. Airas and P. Alku, "Comparison of multiple voice source parameters in different phonation types." in INTERSPEECH, 2007, pp. 1410-1413.
34. J. Kane and C. Gobl, "Wavelet maxima dispersion for breathy to tense voice discrimination, " 2013.
35. J. Sohn, N. S. Kim, and W. Sung, "A statistical model-based voice activity detection, " Signal Processing Letters, IEEE, vol. 6, no. 1, pp. 1-3, 1999.
36. J. Esparza, S. Scherer, A. Brechmann, and F. Schwenker, "Automatic emotion classification vs. human perception: Comparing machine performance to the human benchmark, " in Proceedings of the 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA'12). IEEE, 2012, pp. 1286-1291.
37. L. Kahsay, F. Schwenker, and G. Palm, "Comparison of multiclass svm decomposition schemes for visual object recognition, " in Pattern Recognition. Springer Berlin Heidelberg, 2005, pp. 334-341.
38. C.-W. Hsu and C.-J. Lin, "A comparison of methods for multiclass support vector machines, " Neural Networks, IEEE Transactions on, vol. 13, no. 2, pp. 415-425, 2002.
39. A. Paeschke, Prosodische Analyse emotionaler Sprechweise. Logos-Verlag, 2003.
40. J. A. Russell and A. Mehrabian, "Evidence for a three-factor theory of emotions, " Journal of Research in Personality, vol. 11, no. 3, pp. 273-294, 1977.
41. M. Schels, M. Kä chele, M. Glodek, D. Hrabal, S. Walter, and F. Schwenker, "Using unlabeled data to improve classification of emotional states in human computer interaction, " Journal on Multimodal User Interfaces (JMUI), 2013.
42. M. Kä chele and F. Schwenker, "Semi-supervised dictionary learning of sparse representations for emotion recognition, " in Partially Supervised Learning, ser. Lecture Notes in Computer Science, Z.-H. Zhou and F. Schwenker, Eds. Springer Berlin Heidelberg, 2013, pp. 21-35.
43. M. Glodek, M. Schels, F. Schwenker, and G. Palm, "Combination of sequential class distributions from multiple channels using markov fusion networks, " Journal on Multimodal User Interfaces, pp. 1-16, 2014