The Pictures We Like Are Our Image: Continuous Mapping of Favorite Pictures into Self-Assessed and Attributed Personality Traits

IEEE Transactions on Affective Computing

Volumn 8, Issue 2, 2017, Pages 268-285

  Segalin, Crisitina ^a   Perina, Alessandro ^b   Cristani, Marco ^a   Vinciarelli, Alessandro ^c  

^a UNIVERSITY OF VERONA   (Italy)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^c UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

automatic personality perception; automatic personality recognition; big five personality traits; Computational aesthetics; personality computing

Indexed keywords

COMPUTER PROGRAMMING;

AUTOMATIC PERSONALITY PERCEPTIONS; COMPUTATIONAL AESTHETICS; PERSONALITY COMPUTING; PERSONALITY RECOGNITION; PERSONALITY TRAITS;

COMPUTER SCIENCE;

EID: 85028362284     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAFFC.2016.2516994     Document Type: Article

References (70)

1. M. Duggan and L. Rainie, "Cell phone activities 2012, " Pew Res. Center, Washington, DC, USA, Tech. Rep., 2012.
2. L. Rainie, J. Brenner, and K. Purcell, "Photos and videos as social currency online, " Pew Res. Center, Washington, DC, USA, Tech. Rep., 2012.
3. N. Van House, "Flickr and public image-sharing: Distant closeness and photo exhibition, " in Proc. Extended Abstracts Human Factors Comput. Syst., 2007, pp. 2717-2722.
4. N. van House, "Personal photography, digital technologies and the uses of the visual, " Vis. Stud., vol. 26, no. 2, pp. 125-134, 2011.
5. J. Suler, "Image, word, action: Interpersonal dynamics in a photosharing community, " CyberPsychol. Behav., vol. 11, no. 5, pp. 555-560, 2008.
6. M. Lipczak, M. Trevisiol, and A. Jaimes, "Analyzing favorite behavior in Flickr, " in Proc. Int. Conf. Multimedia Model., 2013, pp. 535-545.
7. M. Kosinski, D. Stillwell, and T. Graepel, "Private traits and attributes are predictable from digital records of human behavior, " Proc. Nat. Acad. Sci., vol. 110, no. 15, pp. 5802-5805, 2013.
8. H. Liu, "Social network profiles as taste performances, " J. Comput.-Mediated Commun., vol. 13, no. 1, pp. 252-275, 2007.
9. S. Ray and D. Page, "Multiple instance regression, " in Proc. Int. Conf. Mach. Learn., 2001, pp. 425-432.
10. B. Babenko, "Multiple instance learning: Algorithms and applications, " 2009.
11. P. Lovato, M. Bicego, C. Segalin, A. Perina, N. Sebe, and M. Cristani, "Faved! biometrics: Tell me which image you like and i'll tell you who you are, " IEEE Trans. Inf. Forensics Security, vol. 9, no. 3, pp. 364-374, Mar. 2014.
12. A. Vinciarelli and G. Mohammadi, "A survey of personality computing, " IEEE Trans. Affective Comput., vol. 5, no. 3, pp. 273-291, Jul.-Sep. 2014.
13. A. Wright, "Current directions in personality science and the potential for advances through computing, " IEEE Trans. Affective Comput., vol. 5, no. 3, pp. 292-296, Jul.-Sep. 2014.
14. J. Uleman, S. Adil Saribay, and C. Gonzalez, "Spontaneous inferences, implicit impressions, and implicit theories, " Annu. Rev. Psychol., vol. 59, pp. 329-360, 2008.
15. R. Jenkins, Social Identity. London, U. K.: Routledge, 2014.
16. P. Galanter, "Computational aesthetic evaluation: Past and future, " in Computers and Creativity, J. McCormack and M. d'Inverno, Eds. New York, NY, USA: Springer, 2012, pp. 255-293.
17. F. Hoenig, "Defining computational aesthetics, " in Proc. Eurograph. Conf. Comput. Aesthetics Graphics, Vis. Imaging, 2005, pp. 13-18.
18. A. Salah, H. Hung, O. Aran, H. Gunes, and M. Turk, "Behavior understanding for arts and entertainment, " ACM Trans. Interactive Intell. Syst., vol. 5, no. 3, pp. 12: 1-12: 10, 2015.
19. R. Datta, D. Joshi, J. Li, and J. Wang, "Studying aesthetics in photographic images using a computational approach, " in Proc. Eur. Conf. Comput. Vis., 2006, vol. 3953, pp. 288-301.
20. Y. Luo and X. Tang, "Photo and video quality evaluation: Focusing on the subject, " in Proc. Eur. Conf. Comput. Vis., 2008, pp. 386-399.
21. C. Li and T. Chen, "Aesthetic visual quality assessment of paintings, " IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 236-252, Apr. 2009.
22. L. Wong andK. Low, "Saliency-enhanced image aesthetics class prediction, " in Proc. IEEE Int. Conf. Image Process., 2009, pp. 997-1000.
23. L. Marchesotti, F. Perronnin, D. Larlus, and G. Csurka, "Assessing the aesthetic quality of photographs using generic image descriptors, " in Proc. Int. Conf. Comput. Vis., 2011, pp. 1784-1791.
24. M. Pantic and A. Vinciarelli, "Implicit human-centered tagging, " IEEE Signal Process. Mag., vol. 26, no. 6, pp. 173-180, Nov. 2009.
25. J. Golbeck, C. Robles, and K. Turner, "Predicting personality with social media, " in Proc. Extended Abstracts Human Factors Comput. Syst., 2011, pp. 253-262.
26. S. Bai, T. Zhu, and L. Cheng, "Big-five personality prediction based on user behaviors at social network sites, " Cornell Univ., Ithaca, NY, USA, Tech. Rep., 2012.
27. F. Celli, "Unsupervised personality recognition for social network sites, " in Proc. Int. Conf. Digital Soc., 2012, pp. 59-62.
28. T. Nguyen, D. Phung, B. Adams, and S. Venkatesh, "Towards discovery of influence and personality traits through social link prediction, " in Proc. Int. AAAI Conf. Weblogs Social Media, 2011, pp. 566-569.
29. M. Cristani, A. Vinciarelli, C. Segalin, and A. Perina, "Unveiling the multimedia unconscious: Implicit cognitive processes and multimedia content analysis, " in Proc. ACM Int. Conf. Multimedia, 2013, pp. 213-222.
30. S. Fitzgerald, D. Evans, and R. Green, "Is your profile picture worth 1000 words? photo characteristics associated with personality impression agreement, " in Proc. AAAI Int. Conf. Weblogs Social Media, 2009.
31. D. Evans, S. D. Gosling, and A. Carroll, "What elements of an online social networking profile predict target-rater agreement in personality impressions, " in Proc. Int. Conf. Weblogs Social Media, 2008, pp. 45-50.
32. F. Celli, F. Pianesi, D. Stillwell, and M. Kosinski, "Workshop on computational personality recognition (shared task), " in Proc. Workshop Comput. Personality Recognit., 2013.
33. C. Judd, L. James-Hawkins, V. Yzerbyt, and Y. Kashima, "Fundamental dimensions of social judgment: Understanding the relations between judgments of competence and warmth, " J. Pers. Soc. Psychol., vol. 89, no. 6, pp. 899-913, 2005.
34. D. Funder, "Personality, " Annu. Rev. Psychol., vol. 52, pp. 197-221, 2001.
35. G. Saucier and L. Goldberg, "The language of personality: Lexical perspectives on the five-factor model, " in The Five-Factor Model of Personality, J. Wiggins, Ed. New York City, NY, USA: Guilford Press, 1996.
36. B. Rammstedt and O. John, "Measuring personality in one minute or less: A 10-item short version of the big five inventory in English and German, " J. Res. Pers., vol. 41, no. 1, pp. 203-212, 2007.
37. G. Boyle and E. Helmes, "Methods of personality assessment, " in The Cambridge Handbook of Personality Psychology, P. Corr and G. Matthews, Eds. Cambridge, U. K.: Cambridge Univ. Press, 2009, pp. 110-126.
38. D. Kenny, L. Albright, T. Malloy, and D. Kashy, "Consensus in interpersonal perception: Acquaintance and the big five, " Psychol. Bull., vol. 116, no. 2, pp. 245-258, 1994.
39. D. Kenny, "PERSON: A general model of interpersonal perception, " Pers. Soc. Psychol. Rev., vol. 8, no. 3, pp. 265-280, 2004.
40. D. Howell, Statistical Methods for Psychology. Boston, MA, USA: Cengage Learning, 2012.
41. J. Machajdik and A. Hanbury, "Affective image classification using features inspired by psychology and art theory, " in Proc. ACM Int. Conf. Multimedia, 2010, pp. 83-92.
42. K. Mardia and P. Jupp, Directional Statistics. New York, NY, USA: Wiley, 2009.
43. P. Valdez and A. Mehrabian, "Effects of color on emotions, " J. Experimental Psychol.: General, vol. 123, no. 4, p. 394, 1994.
44. P. Lovato, A. Perina, N. Sebe, O. Zandona, A. Montagnini, M. Bicego, and M. Cristani, "Tell me what you like and I'll tell you what you are: Discriminating visual preferences on Flickr data, " in Proc. Asian Conf. Comput. Vis., 2012, pp. 45-56.
45. C. Georgescu, "Synergism in low level vision, " in Proc. Int. Conf. Pattern Recognit., 2002, pp. 150-155.
46. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
47. W. Chu, Y. Chen, and K. Chen, "Size does matter: How image size affects aesthetic perception?" in Proc. ACM Int. Conf. Multimedia, 2013, pp. 53-62.
48. H. Tamura, S. Mori, and T. Yamawaki, "Texture features corresponding to visual perception, " IEEE Trans. Syst., Man, Cybern., vol. 8, no. 6, pp. 460-473, Jun. 1978.
49. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope, " Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
50. M. Johnson, "Subcortical face processing, " Nat. Rev. Neurosci., vol. 6, no. 10, pp. 766-774, 2005.
51. B. Berlin, Basic Color Terms: Their Universality and Evolution. Berkeley, CA, USA: Univ. California Press, 1991.
52. J. van de Weijer, C. Schmid, and J. Verbeek, "Learning color names from real-world images, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
53. R. Haralick and L. Shapiro, Computer and Robot Vision. Reading, MA, USA: Addison-Wesley, 1992.
54. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2001, vol. 1, pp. 511-518.
55. P. Costa, R. MacCrae, and I. Psychological Assessment Resources, Revised NEO Personality Inventory (NEO PI-R) and NEO Five-Factor Inventory (NEO FFI): Professional Manual., PAR, 1992.
56. S. Ray, "Learning from data with complex interactions and ambiguous labels, " Ph. D. dissertation, Univ. Wisconsin-Madison, Madison, WI, USA, 2005.
57. D. R. Dooly, Q. Zhang, S. A. Goldman, and R. A. Amar, "Multiple instance learning of real valued data, " J. Mach. Learn. Res., vol. 3, pp. 651-678, 2003.
58. J. Wang and J.-D. Zucker, "Solving the multiple-instance problem: A lazy learning approach, " in Proc. 17th Int. Conf. Mach. Learn., 2000, pp. 1119-1125.
59. K. L. Wagstaff, T. Lane, and A. Roper, "Multiple-instance regression with structured data, " in Proc. Workshops Int. Conf. Data Mining, 2008, pp. 291-300.
60. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation, " J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
61. A. Perina and N. Jojic, "Image analysis by counting on a grid, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1985-1992.
62. R. Tibshirani, "Regression shrinkage and selection via the LASSO, " J. Roy. Statist. Soc., vol. 58, pp. 267-288, 1994.
63. S. Cloninger, "Conceptual issues in personality theory, " in The Cambridge Handbook of Personality Psychology, P. Corr and G. Matthews, Eds. Cambridge, U. K.: Cambridge Univ. Press, 2009, pp. 3-26.
64. A. Eagly, R. Ashmore, M. Makhijani, and L. Longo, "What is beautiful is good, but.: A meta-analytic review of research on the physical attractiveness stereotype, " Psychol. Bull., vol. 110, no. 1, p. 109, 1991.
65. J. Biesanz and S. West, "Personality coherence: Moderating self-other profile agreement and profile consensus, " J. Pers. Soc. Psychol., vol. 79, no. 3, pp. 425-437, 2000.
66. S. Vazire and S. Gosling, "e-Perceptions: Personality impressions based on personal websites, " J. Pers. Soc. Psychol., vol. 87, no. 1, p. 123, 2004.
67. D. Coutu, "We googled you, " Harvard Bus. Rev., vol. 85, no. 6, pp. 1-8, 2007.
68. V. Yanulevskaya, J. Uijlings, E. Bruni, A. Sartori, E. Zamboni, F. Bacci, D. Melcher, and N. Sebe, "In the eye of the beholder: Employing statistical analysis and eye tracking for analyzing abstract paintings, " in Proc. ACM Int. Conf. Multimedia, 2012, pp. 349-358.
69. I. Poggi and F. D'Errico, "Social signals: A framework in terms of goals and beliefs, " Cogn. Process., vol. 13, no. 2, pp. 427-445, 2012.
70. A. Vinciarelli and A. Pentland, "New social signals in a new interaction world: The next frontier for social signal processing, " IEEE Syst., Man, Cybern. Mag., vol. 1, no. 2, pp. 10-17, Apr. 2015.