Combining semantic and acoustic features for valence and arousal recognition in speech

2012 3rd International Workshop on Cognitive Information Processing, CIP 2012

Volumn , Issue , 2012, Pages

  Karadoǧan, Seliz Gulsen ^a   Larsen, Jan ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC FEATURES; ACOUSTIC INFORMATION; AFFECT RECOGNITION; BASIC EMOTIONS; EMOTIONAL STATE; ENGLISH WORD; HUMAN SUBJECTS; LATENT SEMANTICS; SEMANTIC FEATURES; SUPPORT VECTOR REGRESSION (SVR);

DATA PROCESSING; SEMANTICS;

SPEECH RECOGNITION;

EID: 84864691668     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIP.2012.6232924     Document Type: Conference Paper

References (31)

1. R. Picard, E. Vyzas, and J. Healey, "Toward machine emotional intelligence: Analysis of affective physiological state," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 10, pp. 1175-1191, 2001.
2. M. El Ayadi, M. Kamel, and F. Karray, "Survey on speech emotion recognition: Features, classification schemes, and databases," Pattern Recognition, vol. 44, no. 3, pp. 572-587, 2011.
3. T. Nwe, S. Foo, and L. De Silva, "Speech emotion recognition using hidden markov models," Speech communication, vol. 41, no. 4, pp. 603-623, 2003.
4. D. Ververidis and C. Kotropoulos, "Emotional speech classification using gaussian mixture models and the sequential floating forward selection algorithm," in IEEE International Conference on Multimedia and Expo, 2005. ICME 2005. IEEE, 2005, pp. 1500-1503.
5. Ververidis, D. and Kotropoulos, C., "Emotional speech recognition, resources, features, and methods," Speech communication, vol. 48, no. 9, pp. 1162-1181, 2006.
6. B. Schuller, S. Reiter, R. Muller, M. Al-Hames, M. Lang, and G. Rigoll, "Speaker independent speech emotion recognition by ensemble classification," in IEEE International Conference on Multimedia and Expo, 2005. ICME 2005. IEEE, 2005, pp. 864-867.
7. B. Schuller, G. Rigoll, and M. Lang, "Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture," in IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004. Proceedings.(ICASSP'04), vol. 1. IEEE, 2004, pp. I-577.
8. Z. Chuang and C. Wu, "Multi-modal emotion recognition from speech and text," International Journal of Computational Linguistics and Chinese Language Processing, vol. 9, no. 2, pp. 45-62, 2004.
9. A. Batliner, S. Steidl, B. Schuller, D. Seppi, T. Vogt, J. Wagner, L. Devillers, L. Vidrascu, V. Aharonson, L. Kessous et al., "Whodunnit- searching for the most important feature types signalling emotion-related user states in speech," Computer Speech & Language, vol. 25, no. 1, pp. 4-28, 2011.
10. A. Batliner, S. Steidl, B. Schuller, D. Seppi, K. Laskowski, T. Vogt, L. Devillers, L. Vidrascu, N. Amir, L. Kessous et al., "Combining efforts for improving automatic classification of emotional user states," Proc. IS-LTC, pp. 240-245, 2006.
11. C. Wu, Z. Chuang, and Y. Lin, "Emotion recognition from text using semantic labels and separable mixture models," ACM Transactions on Asian Language Information Processing (TALIP), vol. 5, no. 2, pp. 165-183, 2006.
12. A. Gill, R. French, D. Gergle, and J. Oberlander, "The language of emotion in short blog texts," in Proceedings of the 2008 ACM conference on Computer supported cooperative work. ACM, 2008, pp. 299-302.
13. C. Strapparava and R. Mihalcea, "Learning to identify emotions in text," in Proceedings of the 2008 ACM symposium on Applied computing. ACM, 2008, pp. 1556-1560.
14. M. Petersen and L. Hansen, "Modeling lyrics as emotional semantics," Proceedings of YoungCT, KAIST Korea Advanced Institute of Science and Technology, 2010.
15. D. Grandjean, D. Sander, and K. Scherer, "Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization," Consciousness and cognition, vol. 17, no. 2, pp. 484-495, 2008.
16. H. Gunes and M. Pantic, "Automatic, dimensional and continuous emotion recognition," International Journal of Synthetic Emotions, vol. 1, no. 1, pp. 68-99, 2010.
17. R. Fernandez, "A computational model for the automatic recognition of affect in speech," Ph.D. dissertation, Massachusetts Institute of Technology, 2004.
18. S. Zhang, Q. Tian, S. Jiang, Q. Huang, and W. Gao, "Affective mtv analysis based on arousal and valence features," in 2008 IEEE International Conference on Multimedia and Expo. IEEE, 2008, pp. 1369-1372.
19. M. Bradley and P. Lang, "Affective norms for english words (anew): Instruction manual and affective ratings," University of Florida: The Center for Research in Psychophysiology, 1999.
20. Bradley, M.M. and Lang, P.J., "Measuring emotion: the self-assessment manikin and the semantic differential," Journal of behavior therapy and experimental psychiatry, vol. 25, no. 1, pp. 49-59, 1994.
21. Y. Lin and G. Wei, "Speech emotion recognition based on hmm and svm," in Proceedings of International Conference on Machine Learning and Cybernetics, vol. 8. IEEE, 2005, pp. 4898-4901.
22. F. Eyben, M. Wollmer, and B. Schuller, "Openear introducing the munich open-source emotion and affect recognition toolkit," in Affective Computing and Intelligent Interaction and Workshops, 2009. ACII 2009. 3rd International Conference on. IEEE, 2009, pp. 1-6.
23. M. Hall, "Correlation-based feature selection for machine learning," Ph.D. dissertation, The University of Waikato, 1999.
24. J. Russell and J. Carroll, "On the bipolarity of positive and negative affect." Psychological Bulletin, vol. 125, no. 1, pp. 3-30, 1999.
25. D. Robinson, "Replay gain," 2001, http://www.replaygain.org/.
26. S. G. Karadogan, "Emotional movie database (emov) creation," 2011, http://www.student.dtu.dk/~seka/.
27. Karadogan, S. G., "Emotional speech database design details and the java applet code written for the design," 2012, http://www2.imm.dtu.dk/ pubdb/views/publication-details.php?id=6231.
28. A. Smola and B. Schölkopf, "A tutorial on support vector regression," Statistics and computing, vol. 14, no. 3, pp. 199-222, 2004.
29. S. Ross, "Peirce's criterion for the elimination of suspect experimental data," Journal of Engineering Technology, vol. 20, no. 2, pp. 38-41, 2003.
30. DTU, "Latent semantic analysis software application written in java including hawik and lywik corpora," 2010, http://dl.dropbox.com/u/5442905/ lsa.zip.
31. A. Haag, S. Goronzy, P. Schaich, and J. Williams, "Emotion recognition using bio-sensors: First steps towards an automatic system," Affective Dialogue Systems, pp. 36-48, 2004.