Crowdsourced data collection of facial responses

ICMI'11 - Proceedings of the 2011 ACM International Conference on Multimodal Interaction

Volumn , Issue , 2011, Pages 11-18

  McDuff, Daniel ^a   El Kaliouby, Rana ^a,b   Picard, Rosalind ^a,b  

^a MIT MEDIA LAB   (United States)

^b Affectiva Inc   (United States)

Author keywords

crowdsourcing; facial responses; non verbal communication

Indexed keywords

AFFECT RECOGNITION; CROWDSOURCING; DATA COLLECTION; DATA SETS; FACIAL EXPRESSIONS; FACIAL FEATURE POINTS; FACIAL REGIONS; FACIAL RESPONSES; NON-VERBAL COMMUNICATIONS; RESEARCH COMMUNITIES;

FACE RECOGNITION; INTERACTIVE COMPUTER SYSTEMS;

DATA ACQUISITION;

EID: 83455198348     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2070481.2070486     Document Type: Conference Paper

References (27)

1. S. Baron-Cohen. Mind reading: the interactive guide to emotions. Jessica Kingsley Publishers, 2003.
2. M. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan. Automatic recognition of facial actions in spontaneous expressions. Journal of Multimedia, 1(6):22-35, 2006.
3. M. S. Bartlett, G. Littlewort, I. Fasel, and J. R. Movellan. Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. Computer Vision and Pattern Recognition Workshop, 5:53, 2003.
4. J. Bouguet. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Technical report, Intel Corporation, 2001.
5. I. Cohen, N. Sebe, A. Garg, L. Chen, and T. Huang. Facial expression recognition from video sequences: temporal and static modeling. Computer Vision and Image Understanding, 91(1-2):160-187, 2003.
6. J. Cohn, L. Reed, Z. Ambadar, J. Xiao, and T. Moriyama. Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior. In Systems, Man and Cybernetics, 2004 IEEE International Conference on, volume 1, pages 610-616. IEEE, 2004.
7. E. Douglas-Cowie, R. Cowie, I. Sneddon, C. Cox, O. Lowry, M. Mcrorie, J. Martin, L. Devillers, S. Abrilian, A. Batliner, et al. The humaine database: Addressing the collection and annotation of naturalistic and induced emotional data. Affective computing and intelligent interaction, pages 488-500, 2007.
8. J. Hall, J. Carter, and T. Horgan. 5. Gender differences in nonverbal communication of emotion. Gender and emotion: Social psychological perspectives, page 97, 2000.
9. H. Joho, J. Staiano, N. Sebe, and J. Jose. Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents. Multimedia Tools and Applications, pages 1-19, 2011.
10. G. Littlewort, M. Bartlett, I. Fasel, J. Chenu, and J. Movellan. Analysis of machine learning methods for real-time recognition of facial expressions from video. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2004.
11. P. Lucey, J. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews. The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, pages 94-101. IEEE, 2010.
12. D. Matsumoto. Cultural similarities and differences in display rules. Motivation and Emotion, 14(3):195-214, 1990.
13. D. McDuff, R. El Kaliouby, K. Kassam, and R. Picard. Affect valence inference from facial action unit spectrograms. In Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE Computer Society Conference on, pages 17-24. IEEE, 2010.
14. G. Mckeown, M. Valstar, R. Cowie, and M. Pantic. The semaine corpus of emotionally coloured character interactions. In Proceedings of IEEE Int'l Conf. Multimedia, Expo, pages 1079-1084, July 2010.
15. P. Michel and R. El Kaliouby. Real time facial expression recognition in video using support vector machines. In Proceedings of the 5th international conference on Multimodal interfaces, pages 258-264. ACM, 2003.
16. M. Pantic, M. Valstar, R. Rademaker, and L. Maat. Web-based database for facial expression analysis. In 2005 IEEE International Conference on Multimedia and Expo, page 5. IEEE, 2005.
17. A. Quinn and B. Bederson. Human computation: a survey and taxonomy of a growing field. In Proceedings of the 2011 annual conference on Human factors in computing systems, pages 1403-1412. ACM, 2011.
18. P. Rozin and A. Cohen. High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of naturally occurring facial expressions of Americans. Emotion, 3(1):68, 2003.
19. K. Schmidt, Z. Ambadar, J. Cohn, and L. Reed. Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling. Journal of Nonverbal Behavior, 30(1):37-52, 2006. (Pubitemid 44219987)
20. D. Svantesson. Geo-location technologies and other means of placing borders on the 'borderless' internet. J. Marshall J. Computer & Info. L., 23:101-845, 2004.
21. G. Taylor, I. Spiro, C. Bregler, and R. Fergus. Learning Invariance through Imitation. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2011.
22. M. Valstar and M. Pantic. Induced disgust, happiness and surprise: an addition to the mmi facial expression database. In Language Resources and Evaluation (LREC), Conference on, 2010.
23. C. Vondrick, D. Ramanan, and D. Patterson. Efficiently scaling up video annotation with crowdsourced marketplaces. Computer Vision-ECCV 2010, pages 610-623, 2010.
24. P. Welinder and P. Perona. Online crowdsourcing: Rating annotators and obtaining cost-effective labels. In Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE Computer Society Conference on, pages 25-32. IEEE, 2010.
25. Z. Zeng, M. Pantic, G. Roisman, and T. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 31(1):39-58, 2009.
26. F. Zhou, F. De la Torre, and J. Cohn. Unsupervised discovery of facial events. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2010.
27. M. Zuckerman, J. Hall, R. DeFrank, and R. Rosenthal. Encoding and decoding of spontaneous and posed facial expressions. Journal of Personality and Social Psychology, 34(5):966, 1976.