Predicting Ad Liking and Purchase Intent: Large-Scale Analysis of Facial Responses to Ads

IEEE Transactions on Affective Computing

Volumn 6, Issue 3, 2015, Pages 223-235

  McDuff, Daniel ^a   Kaliouby, Rana El ^b   Cohn, Jeffrey F ^c   Picard, Rosalind W ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b Affectiva Inc ^*  (United States)

^c UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

emotion; Facial expressions; market research

Indexed keywords

COMMERCE; SALES; STATISTICS;

EMOTION; FACIAL EXPRESSIONS; LARGE-SCALE ANALYSIS; MARKET RESEARCHES; ONLINE VIDEO; PRODUCT CATEGORIES; PURCHASE INTENTS; VIDEO CONTENTS;

FORECASTING;

EID: 84940991370     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAFFC.2014.2384198     Document Type: Article

References (34)

1. P. D. Bolls, A. Lang, and R. F. Potter, "The effects of message valence and listener arousal on attention, memory, and facial muscular responses to radio advertisements," J. Commun. Res., vol. 28, no. 5, pp. 627-651, 2001
2. P. Ekman and W. V. Friesen, Facial Action Coding System. Palo Alto, CA, USA: Consulting Psychologists Press, 1977
3. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, Jan. 2009
4. D. McDuff, R. el Kaliouby, and R. W. Picard, "Crowdsourcing facial responses to online videos," IEEE Trans. Affective Comput., vol. 3, no. 4, p. 456-468, Fourth Quarter 2012
5. J. Hernandez, M. E. Hoque, W. Drevo, and R. W. Picard, "Mood meter: Counting smiles in the wild," in Proc. ACM Conf. Ubiquitous Comput., 2012, pp. 301-310
6. J. P. Johnson, "Targeted advertising and advertising avoidance," RAND J. Economics, vol. 44, no. 1, pp. 128-144, 2013
7. D. McDuff, R. el Kaliouby, E. Kodra, and R. W. Picard, "Measuring voter's candidate preference based on affective responses to election debates," in Proc. Humaine Assoc. Conf. Affective Comput. Intell. Interaction, 2013, pp. 369-374
8. R. I. Haley, "The ARF copy research validity project: Final report," presented at the 7th Annu. ARF Copy Res. Workshop, New York, NY, USA, 1990
9. E. G. Smit, L. Van Meurs, and P. C. Neijens, "Effects of advertising likeability: A 10-year perspective," J. Advertising Res., vol. 46, no. 1, pp. 73-83, 2006
10. D. McDuff, R. el Kaliouby, T. Senechal, D. Demirdjian, and R. W. Picard, "Automatic measurement of ad preferences from facial responses gathered over the internet," J. Image Vis. Comput., vol. 32, no. 1, pp. 630-640, 2014
11. R. L. Hazlett and S. Y. Hazlett, "Emotional response to television commercials: Facial EMG vs. self-report," J. Advertising Res., vol. 39, pp. 7-24, 1999
12. T. Teixeira, M. Wedel, and R. Pieters, "Emotion-induced engagement in Internet Video Ads," J. Marketing Res., vol. 49, no. 2, pp. 144-159, 2012
13. T. Teixeira, R. W. Picard, and R. el Kaliouby, "Why, when and how much to entertain consumers in advertisements? A webbased facial tracking field study," J. Marketing Sci., vol. 33, no. 6, pp. 809-827, 2014
14. M. Pantic, "Machine analysis of facial behaviour: Naturalistic and dynamic behaviour," Philosophical Trans. Royal Soc. B: Biol. Sci., vol. 364, no. 1535, pp. 3505-3513, 2009
15. J. Whitehill, G. Littlewort, I. Fasel, M. Bartlett, and J. Movellan, "Toward practical smile detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 2106-2111, Nov. 2009
16. T. Senechal, J. Turcot, and R. el Kaliouby, "Smile or smirk automatic detection of spontaneous asymmetric smiles to understand viewer experience," in Proc. 10th IEEE Int. Conf. Autom. Face Gesture Recognit., 2013, pp. 1-8
17. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001
18. D. Cristinacce and T. F. Cootes, "Feature detection and tracking with constrained local models," in Proc. Brit. Mach. Vision Conf., 2006, pp. 929-938
19. H. Gunes and M. Pantic, "Automatic, dimensional and continuous emotion recognition," Int. J. Synthetic Emotions, vol. 1, no. 1, pp. 68-99, 2010
20. K. S. Kassam, "Assessment of emotional experience through facial expression," Ph. D. dissertation, Harvard Univ., Cambridge, MA, USA, 2010
21. D. McDuff, R. el Kaliouby, K. Kassam, and R. W. Picard, "Affect valence inference from facial action unit spectrograms," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, 2010, pp. 17-24
22. E. Kodra, T. Senechal, D. McDuff, and R. el Kaliouby, "From dials to facial coding: Automated detection of spontaneous facial expressions for media research," in Proc. IEEE Int. Conf. Autom, Face Gesture Recognit. Workshops, 2013, pp. 1-6
23. H. Joho, J. Staiano, N. Sebe, and J. M. Jose, "Looking at the viewer: Analysing facial activity to detect personal highlights of multimedia contents," J. Multimedia Tools Appl., vol. 51, pp. 505-523, 2011
24. S. Zhao, H. Yao, and X. Sun, "Video classification and recommendation based on affective analysis of viewers," J. Neurocomputing, vol. 119, pp. 101-110, 2013
25. B. L. Fredrickson and D. Kahneman, "Duration neglect in retrospective evaluations of affective episodes," J. Personality Soc. Psychol., vol. 65, no. 1, pp. 45-55, 1993
26. A. Micu and J. T. Plummer, "Measurable emotions: How television ads really work," J. Advertising Res., vol. 50, no. 2, pp. 137-153, 2010
27. J. Berger and K. Milkman, "What makes online content viral" Univ. Pennsylvania, Philadelphia, PA, USA, unpublished manuscript, 2011
28. A. Mehta and S. C. Purvis, "Reconsidering recall and emotion in advertising," J. Advertising Res., vol. 46, no. 1, pp. 49-56, 2006
29. T. Ambler and T. Burne, "The impact of affect on memory of advertising," J. Advertising Res., vol. 39, pp. 25-34, 1999
30. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 886-893
31. C. Chang and C. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, p. 27, 2011
32. C. Varey and D. Kahneman, "Experiences extended across time: Evaluation of moments and episodes," J. Behav. Decision Making, vol. 5, no. 3, pp. 169-185, 1992
33. D. McDuff, R. el Kaliouby, E. Kodra, and L. Larguinet, "Do emotions in advertising drive sales? Use of facial coding to understand the relationship between ads and sales effectiveness," in Proc. Eur. Soc. Opin. Marketing Res. Congr., 2013, pp. 1-13
34. J. Fleureau, P. Guillotel, and I. Orlac, "Affective benchmarking of movies based on the physiological responses of a real audience," in Proc. Humaine Assoc. Conf. Affective Comput. Intell. Interaction, 2013, pp. 73-78.