Sentic blending: Scalable multimodal fusion for the continuous interpretation of semantics and sentics

Proceedings of the 2013 IEEE Symposium on Computational Intelligence for Human-Like Intelligence, CIHLI 2013 - 2013 IEEE Symposium Series on Computational Intelligence, SSCI 2013

Volumn , Issue , 2013, Pages 108-117

  Cambria, Erik ^a   Howard, Newton ^b   Hsu, Jane ^c   Hussain, Amir ^d  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^d UNIVERSITY OF STIRLING   (United Kingdom)

Author keywords

Affective common sense; Emotion recognition; Facial expression analysis; Multimodal fusion; SenticNet

Indexed keywords

AFFECTIVE COMMON-SENSE; EMOTION RECOGNITION; FACIAL EXPRESSION ANALYSIS; MULTI-MODAL FUSION; SENTICNET;

ARTIFICIAL INTELLIGENCE; BLENDING; KNOWLEDGE BASED SYSTEMS; SIGNAL PROCESSING;

SEMANTICS;

EID: 84886665707     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIHLI.2013.6613272     Document Type: Conference Paper

References (36)

1. R. Plutchik, "The nature of emotions," American Scientist, vol. 89, no. 4, pp. 344-350, 2001.
2. N. Frijda, "The laws of emotions," American Psychologist, vol. 43, no. 5, 1988.
3. U. Neisser, Cognitive Psychology. Appleton Century Crofts, 1967.
4. Z. Zeng, M. Pantic, and T. Huang, "Emotion recognition based on multimodal information," Affective Information Processing, vol. 4, pp. 241-265, 2009.
5. A. Kapoor, W. Burleson, and R. Picard, "Automatic prediction of frustration," International Journal of Human-Computer Studies, vol. 65, pp. 724-736, 2007.
6. S. Gilroy, M. Cavazza, M. Niiranen, E. Andre, T. Vogt, J. Urbain, M. Benayoun, H. Seichter, and M. Billinghurst, "Pad-based multimodal affective fusion," in ACII, Amsterdam, 2009, pp. 1-8.
7. H. Gunes, M. Piccardi, and M. Pantic, "From the lab to the real world: Affect recognition using multiple cues and modalities," Affective Computing: Focus on Emotion Expression, Synthesis, and Recognition, pp. 185-218, 2008.
8. C. Shan, S. Gong, and P. McOwan, "Beyond facial expressions: Learning human emotion from body gestures," in BMVC, Warwick, 2007.
9. T. Pun, T. Alecu, G. Chanel, J. Kronegg, and S. Voloshynovskiy, "Brain-computer interaction research at the computer vision and multimedia laboratory," IEEE Trans. on Neural Systems and Rehabilitation Engineering, vol. 14, no. 2, pp. 210-213, 2006.
10. L. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms. Wiley & Sons, 2004.
11. Z. Zeng, J. Tu, M. Liu, T. Huang, B. Pianfetti, D. Roth, and S. Levinson, "Audio-visual affect recognition," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 424-428, 2007.
12. H. Gunes and M. Piccardi, "Bi-modal emotion recognition from expressive face and body gestures," Network and Computer Applications, vol. 30, no. 4, pp. 1334-1345, 2007.
13. P. Pal, A. Iyer, and R. Yantorno, "Emotion detection from infant facial expressions and cries," in International Conference on Acoustics, Speech and Signal Processing, Dallas, 2006.
14. P. Ekman, T. Dalgleish, and M. Power, Handbook of Cognition and Emotion. Chichester: Wiley, 1999.
15. C. Whissell, "The dictionary of affect in language," Emotion: Theory, Research, and Experience, vol. 4, pp. 113-131, 1989.
16. K. Karpouzis, G. Caridakis, L. Kessous, N. Amir, A. Raouzaiou, L. Malatesta, and S. Kollias, "Modeling naturalistic affective states via facial, vocal and bodily expressions recognition," in Lecture Notes in Artificial Intelligence. Springer, 2007, vol. 4451, pp. 92-116.
17. G. Caridakis, K. Karpouzis, and S. Kollias, "User and context adaptive neural networks for emotion recognition," Neurocomputing, vol. 71, pp. 2553-2562, 2008.
18. E. Douglas-Cowie, R. Cowie, I. Sneddon, C. Cox, O. Lowry, and M. McRorie, "The HUMAINE database: Addressing the needs of the affective computing community," in nduced Emotional Data Affective Computing and Intelligent Interaction, ser. Lecture Notes in Computer Science. Berlin Heidelberg: Springer, 2007, vol. 4738, pp. 488-500.
19. M. Grimm, K. Kroschel, and S. Narayanan, "The vera am mittag german audio-visual emotional speech database," in IEEE International Conference on Multimedia and Expo, 2008, pp. 865-868.
20. F. Fragopanagos and J. Taylor, "Emotion recognition in humancomputer interaction," Neural Networks, vol. 18, pp. 389-405, 2005.
21. E. Cambria and A. Hussain, Sentic Computing: Techniques, Tools, and Applications. Dordrecht, Netherlands: Springer, 2012.
22. G. Fauconnier and M. Turner, The Way We Think: Conceptual Blending and the Mind's Hidden Complexities. Basic Books, 2003.
23. E. Cambria, I. Hupont, A. Hussain, E. Cerezo, and S. Baldassarri, "Sentic avatar: Multimodal affective conversational agent with common sense," in Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues, ser. Lecture Notes in Computer Science, A. Esposito, A. Hussain, M. Faundez-Zanuy, R. Martone, and N. Melone, Eds. Berlin Heidelberg: Springer-Verlag, 2011, vol. 6456, pp. 82-96.
24. K. Isbister, Better game characters by design: A psychological approach. Morgan Kaufmann, 2006.
25. N. Yee, J. Bailenson, M. Urbanek, F. Chang, and D. Merget, "The unbearable likeness of being digital: The persistence of nonverbal social norms in online virtual environments," CyberPsychology & Behavior, vol. 10, no. 1, pp. 115-121, 2007.
26. M. Ochs, C. Pelachaud, and D. Sadek, "An empathic virtual dialog agent to improve human-machine interaction," in International Joint Conference on Autonomous Agents and Multiagent Systems, 2008, pp. 89-96.
27. E. Cambria, C. Havasi, and A. Hussain, "SenticNet 2: A semantic and affective resource for opinion mining and sentiment analysis," in FLAIRS, Marco Island, 2012, pp. 202-207.
28. I. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques. San Francisco: Morgan Kaufmann, 2005.
29. F. Wallhoff, "Facial expressions and emotion database," Technische Universitat Munchen, Tech. Rep., 2006.
30. M. Pantic, M. Valstar, R. Rademaker, and L. Maat, "Web-based database for facial expression analysis," in ICME, Singapore, 2005.
31. S. Siegel and N. Castellan, Nonparametric Statistics for the Social Siences. New York: McGraw-Hill, 1988.
32. E. Cambria, D. Rajagopal, D. Olsher, and D. Das, "Big social data analysis," in Big Data Computing, R. Akerkar, Ed. Chapman and Hall/CRC, 2013, ch. 13.
33. E. Cambria, Y. Song, H. Wang, and N. Howard, "Semantic multidimensional scaling for open-domain sentiment analysis," IEEE Intelligent Systems, doi: 10. 1109/MIS. 2012. 118, 2013.
34. E. Lapponi, J. Read, and L. Ovrelid, "Representing and resolving negation for sentiment analysis," in ICDM SENTIRE, Brussels, 2012, pp. 687-692.
35. E. Cambria, T. Benson, C. Eckl, and A. Hussain, "Sentic PROMs: Application of sentic computing to the development of a novel unified framework for measuring health-care quality," Expert Systems with Applications, vol. 39, no. 12, pp. 10 533-10 543, 2012.
36. E. Cambria, A. Livingstone, and A. Hussain, "The hourglass of emotions," in Cognitive Behavioral Systems, ser. Lecture Notes in Computer Science, A. Esposito, A. Vinciarelli, R. Hoffmann, and V. Muller, Eds. Berlin Heidelberg: Springer, 2012, vol. 7403, pp. 144-157.