Mining crowdsourced first impressions in online social video

IEEE Transactions on Multimedia

Volumn 16, Issue 7, 2014, Pages 2062-2074

  Biel, Joan Isaac ^a   Gatica Perez, Daniel ^a  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Attractiveness; automatic prediction; crowdsourcing; mood; nonverbal behavior; personality; topic models; verbal content; vlogs

Indexed keywords

ATTRACTIVENESS; AUTOMATIC PREDICTION; CROWDSOURCING; MOOD; NONVERBAL BEHAVIOR; PERSONALITY; TOPIC MODEL; VERBAL CONTENT; VLOGS;

EID: 84908120671     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2346471     Document Type: Article

References (50)

1. N. Ambady, M. Hallahan, and R. Rosenthal, "On judging and being judged accurately in zero-acquaintance situations," J. Pers. Social Psychol., vol. 69, no. 3, pp. 518-528, 1995.
2. N. Ambady and R. Rosenthal, "Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis," Psychol. Bull., vol. 111, no. 2, pp. 256-274, 1992.
3. K. Balog and M. de Rijke, "Decomposing bloggers' moods," in Proc. Int. Conf. World Wide Web (WWW), 2006.
4. T. S. Behrend, D. J. Sharek,A.W.Meade, and E.N. Wiebe, "The viability of crowdsourcing for survey research," Behavior Res. Methods, vol. 43, no. 3, pp. 800-813, 2011.
5. A. J. Berinsky, G. A. Huber, and G. S. Lenz, "Using mechanical turk as a subject recruitment tool for experimental research," Polit. Anal. 2, 2012.
6. J.-I. Biel and D. Gatica-Perez, "The good, the bad, and the angry: Analyzing crowdsourced impressions of vloggers," in Proc. AAAI Int. Conf. Weblogs Social Media (ICWSM), 2012.
7. J.-I. Biel, V. Vtsminaki, J. Dines, and D. Gatica-Perez, "Hi youtube! personality impressions and verbal content in social video," in Proc. Int. Conf. Multimodal Interfaces (ICMI-MIMI), 2013, pp. 119-126.
8. J.-I. Biel and D. Gatica-Perez, "The YouTube lens: Crowdsourced personality impressions and audiovisual analysis of vlogs," IEEE Trans. Multimedia, vol. 15, no. 1, pp. 41-55, Jan. 2013.
9. J.-I. Biel, L. Teijeiro-Mosquera, and D. Gatica-Perez, "FaceTube: Predicting personality from facial expressions of emotion in online conversational video," in Proc. Int. Conf. Multimodal Interfaces (ICMIMLMI), 2012, pp. 55-36.
10. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
11. P. Borkenau and A. Liebler, "Trait inferences: Sources of validity at zero acquaintance," J. Pers. Social Psychol., no. 62, pp. 645-657, 1992.
12. A. Brew, D. Greene, and P. Cunningham, "Using crowdsourcing and active learning to track sentiment in online media," in Proc. Eur. Conf. Artificial Intell. (ECAI), 2010, pp. 145-150.
13. M. Buhrmester, T. Kwang, and S. D. Gosling, "Amazon's mechanical turk," Perspect. Psychol. Sci., vol. 6, no. 1, p. 3, 2011.
14. J. Chang, S. Gerrish, C. Wang, J. L. Boyd-graber, and D. M. Blei, "Reading tea leaves: How humans interpret topicmodels," Adv. Neural Inf. Process. Syst., pp. 288-296, 2009.
15. N. A. Diakopoulos and D. A. Shamma, "Characterizing debate performance via aggregated twitter sentiment," in Proc. ACM SIG Int. Conf. Human Factors Comput. Syst. (CHI), 2010, pp. 1195-1198.
16. K. K. Dion, A. W. Pak, and K. L. Dion, "Stereotyping physical attractiveness: A sociocultural perspective," J. Cross-Cultural Psychol., vol. 21, no. 2, pp. 158-179, 1990.
17. D. C. Evans, S. D. Gosling, and A. Carroll, "What elements of an online social networking profile predict target-rater agreement in personality impressions?," in Proc. AAAI Int. Conf. Weblogs Social Media (ICWSM), 2008.
18. K. Filippova and K. B. Hall, "Improved video categorization from text metadata and user comments," in Proc. ACM SIGIR Int. Conf. Res. Develop. Inf. Retriev., 2011, pp. 835-842.
19. A. Fiore, L. Taylor, G. Mendelsohn, and M. Hearst, "Assessing attractiveness in online dating profiles," in Proc. ACM SIG Int. Conf. Human Factors Comput. Syst. (CHI), 2008.
20. S. D. Gosling, S. Gaddis, and S. Vazire, "Personality impressions based on Facebook profiles," in Proc. AAAI Int. Conf. Weblogs Social Media (ICWSM), 2007.
21. S. D. Gosling, P. J. Rentfrow, andW. B. Swann, "A very brief measure of the big five personality domains," J. Res. Pers., vol. 37, pp. 504-528, 2003.
22. S. Gosling, S. Ko, and T. Mannarelli, "A room with a cue: Personality judgments based on offices and bedrooms," J. Res. Pers., vol. 82, pp. 379-98, 2002.
23. G. Hitsch, A. Hortacsu, and D. Ariely, "What makes you click: An empirical analysis of online dating," Soc. Econ. Dynam. vol. 207, 2005.
24. T. Iwata, T. Yamada, and N. Ueda, "Modeling social annotation data with content relevance using a topicmodel," NIPS, vol. 9, pp. 835-843, 2009.
25. K. M. Kniffin and D. S.Wilson, "The effect of nonphysical traits on the perception of physical attractiveness: Three naturalistic studies," Evol. Human Behavior, vol. 25, no. 2, pp. 88-101, 2004.
26. A. Kramer, "An unobtrusive behavioral model of gross national happiness," in Proc. ACM SIG Int. Conf. Human Factors Comput. Syst. (CHI), 2010, pp. 287-290.
27. R. Krestel, P. Fankhauser, and W. Nejdl, "Latent dirichlet allocation for tag recommendation," in Proc. 3rd ACMConf. Recommender Syst., 2009, pp. 61-68.
28. B. Lepri, N. Mana, A. Cappelletti, F. Pianesi, andM. Zancanaro, "Modeling the personality of participants during group interactions," in Proc. Int. Conf. User Model., Adapt., Pers., 2009, pp. 114-125.
29. J. Li and M. Chignell, "Birds of a feather: How personality influences blog writing and reading," Int. J. Human-Comput. Studies, vol. 68, no. 9, pp. 586-602, 2010.
30. F. Mairesse, M. A. Walker, M. R. Mehl, and R. K. Moore, "Using linguistic cues for the automatic recognition of personality in conversation and text," J. Artif. Intell. Res., vol. 30, pp. 457-501, 2007.
31. R. R. McCrae andO. P. John., "An introduction to the five-factor model and its applications," J. Psychol., vol. 60, pp. 175-215, 1992.
32. M. Mehl, S. Gosling, and J. Pennebaker, "Personality in its natural habitat: Manifestations and implicit folk theories of personality in daily life," J. Pers. Social Psychol., vol. 90, no. 5, p. 862, 2006.
33. R. Mihalcea and H. Liu, "A corpus-based approach to finding happiness," in Proc. Spring Symp. Computational Approaches Analyzing Weblogs (CAAW), 2006, p. 19.
34. G. Mishne, "Experiments with mood classification in blog posts," in Proc. ACM SIGIR 2005 Stylistic Analy. Text Inform. Access (SATIA), 2005.
35. G. Mohammadi, A. Vinciarelli, and M. Mortillaro, "The voice of personality: Mapping nonverbal vocal behavior into trait attributions," in Proc. ACM Multimedia Workshop Social Signal Process. (SSP), 2010, pp. 17-20.
36. T. Nguyen, D. Phung, B. Adams, T. Tran, and S. Venkatesh, "Classification and pattern discovery ofmood in weblogs," Adv. Knowl. Discov. Data Mining, pp. 283-290, 2010.
37. S. Nowson and J. Oberlander, "Identifying more bloggers: Towards large scale personality classification of personal weblogs," in Proc. AAAI Int. Conf. Weblogs Social Media (ICWSM), 2007.
38. J. Pennebaker and L. King, "Linguistic styles: Language use as an individual difference," J. Pers. Social Psychol., vol. 77, no. 6, pp. 1296-1312, 1999.
39. A. S. Pentland, Honest Signals: How They Shape Our World. Cambridge, MA, USA: MIT Press, 2008, vol. 1.
40. P. Shrout and J. Fleiss, "Intraclass correlations: Uses in assessing rater reliability," Psychol. Bull., vol. 86, no. 2, pp. 420-428, 1979.
41. J. Snel, A. Tarasov, C. Cullen, and S. J. Delany, "A crowdsourcing approach to labelling a mood induced speech corpus," in Proc. 4th Int. Workshop Corpora Res. Emotion Sentiment Social Signals, 2012.
42. M. Soleymani and M. Larson, "Crowdsourcing for affective annotation of video: Development of a viewer-reported boredom corpus," in Proc. SIGIR Workshop Crowdsourcing Search Eval., 2010, pp. 4-8.
43. K. Stecher and S. Counts, "Spontaneous inference of personality traits and effects on memory for online profiles," in Proc. AAAI Int. Conf. Weblogs and Social Media (ICWSM), 2008.
44. F. Steele, Jr, D. C. Evans, and R. K. Green, "Is your profile picture worth 1000 words? Photo characteristics associated with personality impression agreement," in Proc. AAAI Int. Conf. Weblogs and Social Media (ICWSM), 2009.
45. D. J. Stillwell and M. Kosinski, "mypersonality project: Example of successful utilization of online social networks for large-scale social research," Amer. Psychol., vol. 59, no. 2, pp. 93-104, 2004.
46. S. Vazire and S. D. Gosling, "e-Perceptions: Personality impressions based on personal websites," J. Res. Pers., vol. 87, pp. 123-132, 2004.
47. J. B. Walther, B. Van Der Heide, S.-Y. Kim, D. Westerman, and S. T. Tong, "The role of friends' appearance and behavior on evaluations of individuals on Facebook: Are we known by the company we keep?," Human Commun. Res., vol. 34, no. 1, pp. 28-49, 2008.
48. S. S.Wang, S.Moon, K. H. Kwon, C. A. Evans, and M. A. Stefanone, "Face off: Implications of visual cues on initiating friendship on Facebook," Comput. Human Behavior, vol. 26, no. 2, pp. 226-234, 2010.
49. L.Wu, L. Yang, N. Yu, and X.-S. Hua, "Learning to tag," in Proc. 18th ACM Int. Conf. World Wide Web, 2009, pp. 361-370.
50. T. Yarkoni, "Personality in 100,000 words: A large-scale analysis of personality and word use among bloggers," J. Res. Pers., vol. 44, pp. 363-373, 2010