A novel approach for emotion classification based on fusion of text and speech

2012 19th International Conference on Telecommunications, ICT 2012

Volumn , Issue , 2012, Pages

  Houjeij, Ali ^a   Hamieh, Layla ^a   Mehdi, Nader ^a   Hajj, Hazem ^a  

^a AMERICAN UNIVERSITY OF BEIRUT   (Lebanon)

Author keywords

Algorithms; emotional classification; fusion; speech mining; text mining

Indexed keywords

AUDIO FEATURES; BENCHMARK DATA; DATA SETS; EMOTION CLASSIFICATION; EMOTIONAL CLASSIFICATION; HUMAN DIALOGUES; SPEECH CONTEXTS; SPEECH FEATURES; TEXT MINING;

ALGORITHMS; BENCHMARKING; CLASSIFICATION (OF INFORMATION); DATA MINING; FUSION REACTIONS; INFORMATION TECHNOLOGY; STATISTICAL TESTS;

TEXT PROCESSING;

EID: 84864255360     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICTEL.2012.6221211     Document Type: Conference Paper

References (22)

1. T. Vogt, E. Andre, and J. Wagner, "Automatic Recognition of Emotions from Speech: A Review of the Literature and Recommendations for Practical Realisation," Affect and Emotion in Human-Computer Interaction, pp.75-91,2008.
2. R. del Hoyo, I. Hupont, F. Lacueva, and D. Abadía, "Hybrid Text Affect Sensing System for Emotional Language Analysis," in Proceedings of the ACM International Workshop on Affective-Aware Virtual Agents and Social Robots2009, pp. 1-4.
3. E. Vayrynen, J. Toivanen, and T. Seppanen, "Classification of Emotion in Spoken Finnish Using Vowel Length Segments: Increasing Reliability with a Fusion Technique," Speech Communication, 2010 vol. 53, no.3, pp. 269-282.
4. X. Hu and J. Downie, "Improving Mood Classification in Music Digital Libraries by Combining Lyrics and Audio," in Proceedings of the ACM 10th annual joint conference on Digital libraries. 2010, pp. 159-168.
5. C. Laurier, J. Grivolla, and P. Herrera, "Multimodal Music Mood Classification Using Audio and Lyrics," Seventh International Conference on Machine Learning and Applications (ICMLA'08) 2008, pp. 688-693.
6. T. Kucukyilmaz, B. Cambazoglu, C. Aykanat, and F. Can, "Chat Mining: Predicting User and Message Attributes in Computer-Mediated Communication," Information Processing & Management, vol. 44, no. 4, pp. 1448-1466, 2008.
7. H. Binali, V. Potdar, and C. Wu, "A State of the Art Opinion Mining and its Application Domains," in Industrial Technology, 2009. ICIT 2009. IEEE International Conference. 2009, pp. 1-6.
8. N. Li and D. Wu, "Using Text Mining and Sentiment Analysis for Online Forums Hotspot Detection and Forecast," Decision Support Systems, vol. 48, no. 2, pp. 354-368, 2010.
9. G. Mishne, "Experiments with Mood Classification in Blog Posts," in Proceedings of ACM SIGIR 2005 Workshop on Stylistic Analysis of Text for Information Access. 2005.
10. D. Ververidis and C. Kotropoulos, "Emotional Speech Recognition: Resources, Features, and Methods," Speech Communication, vol. 48, no. 9, pp. 1162-1181, 2006.
11. M. Grimm, K. Kroschel, E. Mower, and S. Narayanan, "Primitives-based evaluation and estimation of emotions in speech," Speech Communication, vol. 49, no. 10-11, pp. 787-800, 2007.
12. A. Iliev, M. Scordilis, J. Papa, and A. Falcao, "Spoken Emotion Recognition Through Optimum-Path Forest Classification Using Glottal Features," Computer Speech & Language, vol. 24, no. 3, pp. 445-460, 2010.
13. J.P. Papa, A.X. Falcao, and C.T.N. Suzuki. "Supervised Pattern Classification Based on Optimum-Path Forest". International Journal of Imaging Systems and Technology, vol.19 no.2pp.120-131, 2009.
14. R. Neumayer and A. Rauber, "Integration of Text and Audio Features for Genre Classification in Music Information Retrieval," Advances in Information Retrieval, pp. 724-727, 2007.
15. Y. Yang, Y. Lin, H. Cheng, I. Liao, Y. Ho, and H. Chen, "Toward Multi-Modal Music Emotion Classification," Advances in Multimedia Information Processing-PCM2008,pp.70-79,2008.
16. X. Hu, J. Downie, and A. Ehmann, "Lyric Text Mining in Music Mood Classification," American music, vol. 183, no. 5,049, pp. 2-209, 2009.
17. Wave Planet, Online Audio Database http://www.wavplanet.com Retrieved on Feb, 2011.
18. WebConfs. Stop words. http://www.webconfs.com/stop-words.php,2006.
19. Kristina Toutanova and Christopher D. Manning. 2000. Enriching the Knowledge Sources Used in a Maximum Entropy Part-of-Speech Tagger. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP/VLC-2000), pp. 63-70.
20. C. Strapparava and A. Valitutti, "WordNet-Affect: An Affective Extension of WordNet," in Proceedings of LREC, vol. 4. Citeseer, 2004, pp. 1083-1086.
21. A. Norrell and D. Walsh, "Method and Apparatus for Adaptively Equalizing a Signal Received from a Remote Transmitter," Mar. 7 2000, US Patent 6,034,993.
22. H. Gunes and M. Piccardi, "Affect Recognition from Face and Body: Early Fusion vs. Late Fusion," 2005 IEEE International Conference in Systems, Man and Cybernetics, vol. 4. 2006, pp. 3437-3443.