Computational analysis of persuasiveness in social multimedia: A novel dataset and multimodal prediction approach

ICMI 2014 - Proceedings of the 2014 International Conference on Multimodal Interaction

Volumn , Issue , 2014, Pages 50-57

  Park, Sunghyun ^a   Shim, Han Suk ^a   Chatterjee, Moitreya ^a   Sagae, Kenji ^a   Morency, Louis Philippe ^a  

^a University of Southern California   (United States)

Author keywords

Multimodal; Persuasion; Persuasive opinion multimedia corpus; Persuasiveness; POM corpus; Prediction; Social multimedia

Indexed keywords

INTERACTIVE COMPUTER SYSTEMS; WEBSITES;

MULTI-MODAL; PERSUASION; PERSUASIVE OPINION MULTIMEDIA CORPUS; PERSUASIVENESS; POM CORPUS; SOCIAL MULTIMEDIA;

FORECASTING;

EID: 84947269137     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2663204.2663260     Document Type: Conference Paper

References (44)

1. Ambady, N. and Rosenthal, R. 1992. Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin 111, 2 (Mar 1992), 256-274.
2. Biel, J., Teijeiro-Mosquera, L., and Gatica-Perez, D. 2012. FaceTube: Predicting personality from facial expression of emotion in online conversational video. In Proc. of the 14th ACM Int'l Conf. on Multimodal Interaction. ICMI '12, 53-56.
3. Burgoon, J., Birk, T., and Pfau, M. 1990. Nonverbal behaviors, persuasion, and credibility. Human Communication Research 17, 1 (Sept. 1990), 140-169.
4. Busso, C., Lee, S. and Narayanan, S. 2009. Analysis of emotionally salient aspects of fundamental frequency for emotion detection. IEEE Transactions on Audio, Speech, and Language Processing, 17, 4 (May 2009), 582-596.
5. Chaiken, S. and Eagly, A. 1983. Communication modality as a determinant of message persuasiveness and message comprehensibility. Journal of Personality and Social Psychology 34, 4 (Oct. 1976), 605-614.
6. Chaiken, S., Liberman, A., and Eagly, A. Heuristic and systematic information processing within and beyond the persuasion context. In J. Uleman and J. Bargh (Eds.), Unintended Thought: Limits of Awareness, Intention, and Control (pp. 212-252). New York: Guildford Press.
7. Chang, C.-C. and Lin, C.-J. 2011. LIBSVM: A library for support vector machine. ACM Transactions on Intelligent Systems and Technology 2, 3 (Apr. 2011), 27:1-27:25.
8. Crano, W. and Prislin, R. 2006. Attitudes and persuasion. Annual Review of Psychology 57 (Jan. 2006), 345-374.
9. Curhan, J. and Pentland, A. 2007. Thin slices of negotiation: Predicting outcomes from conversational dynamics within the first 5 minutes. Journal of Applied Psychology 92, 3 (May 2007), 802-811.
10. Degottex, G., Kane, J., Drugman, T., Raitio, T., and Scherer, S. 2014. COVAREP - A collaborative voice analysis repository for speech technologies. In Proc. of the 39th Int'l Conf. on Acoustics, Speech, and Signal Processing. ICASSP '14.
11. Ekman, P. and Rosenberg, E. 1997. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), Oxford University Press, New York, NY.
12. FaceFX. http://www.facefx.com/.
13. FACET. http://www.emotient.com/cert.
14. Gobl, C. and Chasaide, A. 2003. The role of voice quality in communication emotion, mood and attitude. Speech Communication 40, 1-2 (Apr. 2003), 189-212.
15. Hosman, L. 2002. Language and persuasion. In J. Dillard and M. Pfau (Eds.), The Persuasion Handbook: Developments in Theory and Practice (pp. 371-390). New York: Sage.
16. Kane, J., Scherer, S., Aylett, M., Morency, L.-P., and Gobl, C. 2013. Speaker and language independent voice quality classification applied to unlabeled corpora of expressive speech. In Proc. of the 38th Int'l Conf. on Acoustics, Speech, and Signal Processing. ICASSP '13, 7982-7986.
17. Kane, J., Scherer, S., Morency, L.-P., and Gobl, C. 2013. A comparative study of glottal open quotient estimation techniques. In Proc. of the 14th Annual Conf. of the Int'l Speech Communication Association. Interspeech '13, 1658-1662.
18. Krippendorff, K. 2004. Content Analysis: An Introduction to Its Methodology. Sage, Beverly Hills, CA.
19. LaCrosse, M. 1975. Nonverbal behavior and perceived counselor attractiveness and persuasiveness. Journal of Counseling Psychology 22, 6 (Nov. 1975), 563-566.
20. Mahl, G. 1956. Disturbances and silences in the patient's speech in psychotherapy. The Journal of Abnormal and Social Psychology 53, 1 (Jul. 1956), 1-15.
21. Mason, W. and Suri, S. Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods 44, 1 (Mar. 2012), 1-23.
22. Mehrabian, A. 1971. Silent messages. Wadsworth Publishing Company, Inc., Belmont, CA.
23. Mehrabian, A. and Williams, M. 1969. Nonverbal concomitants of perceived and intended persuasiveness. Journal of Personality and Social Psychology 13, 1 (Sept. 1969), 37-58.
24. Meyers-Levy, J. and Malaviya, P. 1999. Consumers' processing of persuasive advertisements: An integrative framework of persuasion theories. Journal of marketing 63, 4 (Oct. 1999), 45-60.
25. Miller, N., Maruyama, G., Beaber, R., and Valone, K. 1976. Speed of speech and persuasion. Journal of Personality and Social Psychology 34, 4 (Oct. 1976), 615-624.
26. Morency, L.-P., Whitehill, J., and Movellan, J. 2008. Generalized adaptive view-based appearance model: Integrated framework for monocular head pose estimation. In Proc. of the 8th Int'l Conf. on Automatic Face and Gesture Recognition. FG '08, 1-8.
27. OKAO Vision. http://www.omron.com/r-d/coretech/vision/okao.html.
28. O'Keefe. 2002. Persuasion: Theory and Research. Sage, Thousand Oaks, CA.
29. O'Keefe, D. and Jensen, J. 2007. The relative persuasiveness of gain-framed loss-framed messages for encouraging disease prevention behaviors: A meta-analytic review. Journal of Health Communication 12, 7 (Oct. 2007), 623-644.
30. Pearce, W. and Brommel, B. 1972. Vocalic communication in persuasion. Quarterly Journal of Speech 58, 3 (1972), 298-306.
31. Perloff, R. 2010. The Dynamics of Persuasion: Communication and Attitudes in the Twenty-First Century. Routledge, New York, NY.
32. Petty, R. and Cacioppo, J. 1986. Communication and Persuasion: Central and Peripheral Routes to Attitude Change. New York: Springer-Verlag.
33. Pittam, J. 1990. The relationship between perceived persuasiveness of nasality and source characteristics for Australian and American listeners. The Journal of Social Psychology 130, 1 (1990), 81-87.
34. Pornpitakpan, C. 2004. The persuasiveness of source credibility: A critical review of five decades' evidence. Journal of Applied Social Psychology 34, 2 (Feb. 2004), 243-281.
35. Rammstedt, B. and John, O. Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 1 (Feb. 2007), 203-212.
36. Rosenfeld, H. 1966. Approval-seeking and approval-inducing functions of verbal and nonverbal responses in the dyad. Journal of Personality and Social Psychology 4, 6 (Dec. 1966), 597-605.
37. Scherer, S., Kane, J., Gobl, C., and Schwenker, F. Investigating fuzzy-input fuzzy-output support vector machines for robust voice quality classification. Computer Speech and Language 27, 1 (Jan. 2013), 263-287.
38. Scherer, S., London, H., and Wolf, J. 1973. The voice of confidence: Paralinguistic cues and audience evaluation. Journal of Research in Personality 7, 1 (June 1973), 31-44.
39. Schuller, B., Steidl, S., Batliner, A., Schiel, F., and Krajewski, J. 2011. The Interspeech 2011 speaker state challenge. In Proc. of the 12th Annual Conf. of the Int'l Speech Communication Association. Interspeech '11, 3201-3204.
40. Stern, S., Mullennix, J., and Wilson, S. 2002. Effects of perceived disability on persuasiveness of computer-synthesized speech. Journal of Applied Psychology 87, 2 (Apr. 2002), 411-417.
41. Voss, J. 2005. The science of persuasion: An exploration of advocacy and the science behind the art of persuasion in the courtroom, Law and Psychology Review 29 (2005), 301-327.
42. Worchel, S., Andreoli, V., and Eason, J. 1975. Is the medium the message? A study of the effects of media, communicator, and message characteristics on attitude change. Journal of Applied Social Psychology 5, 2 (June 1975), 157-172.
43. Yang, Y. and Pedersen, J. 1997. A comparative study on feature selection in text categorization. In Proc. of the 14th Int'l Conf. on Machine Learning. ICML '97, 412-420.
44. Young, J., Martell, C., Anand, P., Ortiz, P., and Gilbert, H. 2011. A microtext corpus for persuasion detection in dialog. In Proc. of the AAAI-11 Workshop on Analyzing Microtext, 80-85.