Multimodal sentiment intensity analysis in videos: Facial gestures and verbal messages

IEEE Intelligent Systems

Volumn 31, Issue 6, 2016, Pages 82-88

  Zadeh, Amir ^a   Zellers, Rowan ^b   Pincus, Eli ^c   Morency, Louis Philippe ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

affective computing; computational linguistics; intelligent systems; machine learning; natural language processing; sentiment analysis

Indexed keywords

COMPUTATIONAL LINGUISTICS; INTELLIGENT SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

AFFECTIVE COMPUTING; INTENSITY PREDICTION; MULTIMODAL ANALYSIS; NATURAL LANGUAGE PROCESSING; NEGATIVE INTERACTION; ONLINE VIDEO SHARING; SENTIMENT ANALYSIS; SPEAKER INDEPENDENTS;

MODAL ANALYSIS;

EID: 85012037104     PISSN: 15411672     EISSN: None     Source Type: Journal    
DOI: 10.1109/MIS.2016.94     Document Type: Article

References (17)

1. B. Pang and L. Lee, "A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts,"Proc. 42nd Ann. Conf. Assoc. Computational Linguistics, 2004, article 271.
2. E. Cambria et al., "Af fectiveSpace 2: Enabling Af fective Intuition for Concept-Level Sentiment Analysis,"Proc. 29th AAAI Conf. Artificial Intelligence, 2015, pp. 508-514.
3. M. Taboada et al., "Lexicon-Based Methods for Sentiment Analysis,"Computational Linguistics, vol. 37, no. 2, 2011, pp. 267-307.
4. B. Yang, and C. Cardie, "Extracting Opinion Expressions with Semi-Markov Conditional Random Fields,"Proc. Jt. Conf. Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 2012, pp. 1335-1345.
5. T. Nakagawa, K. Inui, and S. Kurohashi, "Dependency Tree-Based Sentiment Classification Using CRFs with Hidden Variables," Proc. Ann. Conf. North Am. Chapter of the Assoc. Computational Linguistics Human Language Technologies, 2010, pp. 786-794.
6. R. Socher et al., "Recursive Deep Models for Semantic Compositionality over a Sentiment Treebank,"Proc. Conf. Empirical Methods in Natural Language Processing, 2013, pp. 1631-1642.
7. E. Cambria, "Affective Computing and Sentiment Analysis," IEEE Intelligent Systems, vol. 31, no. 2, 2016, pp. 102-107.
8. L.P. Morency, R. Mihalcea, and P. Doshi, "Towards Multimodal Sentiment Analysis: Harvesting Opinions from the Web,"Proc. 13th Intl Conf. Multimodal Interfaces, 2011, pp. 169-176.
9. V.P. Rosas, R. Mihalcea, and L.P. Morency, "Multimodal Sentiment Analysis of Spanish Online Videos,"IEEE Intelligent Systems, vol. 28, no. 3, 2013, pp. 38-45.
10. S. Poria, E. Cambria, and A. Gelbukh, "Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-Level Multimodal Sentiment Analysis," Proc. Conf. Empirical Methods in Natural Language Processing, 2015, pp. 2539-2544.
11. S. Poria et al., "Fusing Audio, Visual and Textual Clues for Sentiment Analysis from Multimodal Content,"Neurocomputing, vol. 174, 2016, pp. 50-59.
12. D. McNeill, Language and Gesture, vol. 2, Cambridge Univ. Press, 2000.
13. J. Yuan, and M. Liberman, "Speaker Identifi cation on the SCOTUS Corpus," J. Acoustical Soc. Am., vol. 123, no. 5, 2008, pp. 3878.
14. P. Boersma, "Praat, A System for Doing Phonetics by Computer,"GLOT Intl, vol. 5, no. 9/10, 2002, pp. 341-345.
15. J. Wiebe, T. Wilson, and C. Cardie, "Annotating Expressions of Opinions and Emotions in Language,"Language Resources and Evaluation, vol. 39, nos. 2-3, 2013, pp. 165-210.
16. R. Socher et al., "Recursive Deep Models for Semantic Compositionality over a Sentiment Treebank,"Proc. Conf. Empirical Methods in Natural Language Processing, 2013, pp. 1631-1642.
17. A.J. Smola, and B. Scholkopf, "A Tutorial on Support Vector Regression," Statistics and Computing, vol. 14, no. 3, 2004, pp. 199-222.