OpenFace: An open source facial behavior analysis toolkit

2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016

Volumn , Issue , 2016, Pages

  Baltrusaitis, Tadas ^a   Robinson, Peter ^a   Morency, Louis Philippe ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BEHAVIORAL RESEARCH; FACE RECOGNITION; IMAGE RECOGNITION; LEARNING SYSTEMS; OPEN SYSTEMS;

AFFECTIVE COMPUTING; BEHAVIOR ANALYSIS; COMPUTER VISION ALGORITHMS; FACIAL ACTION UNIT RECOGNITION; FACIAL LANDMARK DETECTION; HEAD POSE ESTIMATION; INTERACTIVE APPLICATIONS; REAL TIME PERFORMANCE;

COMPUTER VISION;

EID: 84977660584     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WACV.2016.7477553     Document Type: Conference Paper

References (72)

1. A. Adams, M. Mahmoud, T. Baltrusaitis, and P. Robinson. Decoupling facial expressions and head motions in complex emotions. In Affective Computing and Intelligent Interaction, 2015.
2. S. Afzal and P. Robinson. Natural Affect Data-Collection & Annotation in a Learning Context. Design, 2009.
3. J. Alabort-i medina, E. Antonakos, J. Booth, and P. Snape. Menpo : A Comprehensive Platform for Parametric Image Alignment and Visual Deformable Models Categories and Subject Descriptors. pages 3-6, 2014.
4. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic. Robust discriminative response map fitting with constrained local models. In CVPR, 2013.
5. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic. Incremental Face Alignment in the Wild. In CVPR, 2014.
6. T. Baltrusaitis, N. Banda, and P. Robinson. Dimensional affect recognition using continuous conditional random fields. In FG, 2013.
7. T. Baltrusaitis, M. Mahmoud, and P. Robinson. Cross-dataset learning and person-specic normalisation for automatic Action Unit detection. In Facial Expression Recognition and Analysis Challenge, in conjunction with FG, 2015.
8. T. Baltrusaitis, L.-P. Morency, and P. Robinson. Constrained local neural fields for robust facial landmark detection in the wild. In ICCVW, 2013.
9. T. Baltrusaitis, P. Robinson, and L.-P. Morency. 3D Constrained Local Model for Rigid and Non-Rigid Facial Tracking. In CVPR, 2012.
10. M. S. Bartlett, G. Littlewort, I. Fasel, and J. R. Movellan. Real time face detection and facial expression recognition: Development and applications to human computer interaction. In CVPR Workshops, 2003.
11. P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar. Localizing parts of faces using a consensus of exemplars. In CVPR, 2011.
12. H. Brugman and A. Russel. Annotating multi-media / multimodal resources with ELAN. Proceedings of the 4th International Conference on Language Resources and Language Evaluation (LREC 2004), pages 2065-2068, 2004.
13. X. P. Burgos-Artizzu, P. Perona, and P. Dollar. Robust face landmark estimation under occlusion. In International Conference on Computer Vision, 2013.
14. C. Busso and J. J. Jain. Advances in Multimodal Tracking of Driver Distraction. In Digital Signal Processing for in-Vehicle Systems and Safety, pages 253-270. 2012.
15. M. L. Cascia, S. Sclaroff, and V. Athitsos. Fast, Reliable Head Tracking under Varying Illumination : An Approach Based on Registration of Texture-Mapped 3D Models. TPAMI, 22 (4), 2000.
16. D. Cristinacce and T. Cootes. Feature detection and tracking with constrained local models. In BMVC, 2006.
17. B. Czupryski and A. Strupczewski. High accuracy head pose tracking survey. In D. lzak, G. Schaefer, S. Vuong, and Y.-S. Kim, editors, Active Media Technology, volume 8610 of Lecture Notes in Computer Science, pages 407-420. Springer International Publishing, 2014.
18. F. De la Torre and J. F. Cohn. Facial Expression Analysis. In Guide to Visual Analysis of Humans: Looking at People. 2011.
19. P. Ekman and W. V. Friesen. Manual for the Facial Action Coding System. Palo Alto: Consulting Psychologists Press, 1977.
20. P. Ekman, W. V. Friesen, M. O'Sullivan, and K. R. Scherer. Relative importance of face, body, and speech in judgments of personality and affect. Journal of Personality and Social Psychology, 38: 270-277, 1980.
21. G. Fanelli, J. Gall, and L. V. Gool. Real time head pose estimation with random regression forests. In CVPR, pages 617-624, 2011.
22. G. Fanelli, T. Weise, J. Gall, and L. van Gool. Real time head pose estimation from consumer depth cameras. In DAGM, 2011.
23. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. Object Detection with Discriminative Trained Part Based Models. IEEE TPAMI, 32, 2010.
24. O. Ferhat and F. Vilariño. A Cheap Portable Eye-tracker Solution for Common Setups. 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction, 2013.
25. J. M. Girard, J. F. Cohn, M. H. Mahoor, S. Mavadati, and D. P. Rosenwald. Social risk and depression: Evidence from manual and automatic facial expression analysis. In FG, 2013.
26. A. Graesser and A. Witherspoon. Detection of Emotions during Learning with AutoTutor. Annual Meetings of the Cognitive Science Society, pages 285-290, 2005.
27. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker. Multi-PIE. IVC, 2010.
28. A. Gudi, H. E. Tasli, T. M. D. Uyl, and A. Maroulis. Deep Learning based FACS Action Unit Occurrence and Intensity Estimation. In Facial Expression Recognition and Analysis Challenge, in conjunction with FG, 2015.
29. Z. Hammal, J. F. Cohn, C. Heike, and M. L. Speltz. What Can Head and Facial Movements Convey about Positive and Negative AffectIn Affective Computing and Intelligent Interaction, 2015.
30. D. W. Hansen and Q. Ji. In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010.
31. B. Jiang, M. F. Valstar, and M. Pantic. Action unit detection using sparse appearance descriptors in space-time video volumes. 20FG, 2011.
32. V. Kazemi and J. Sullivan. One Millisecond Face Alignment with an Ensemble of Regression Trees. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1867-1874, 2014.
33. D. E. King. Dlib-ml: A machine learning toolkit. JMLR, 2009.
34. D. E. King. Max-margin object detection. CoRR, 2015.
35. C. L. Kleinke. Gaze and eye contact: A research review. Psychological bulletin, 100 (1): 78-100, 1986.
36. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang. Interactive facial feature localization. In ECCV, 2012.
37. M. Lidegaard, D. W. Hansen, and N. Krüger. Head mounted device for point-of-gaze estimation in three dimensions. Proceedings of the Symposium on Eye Tracking Research and Applications-ETRA '14, 2014.
38. P. Lucey, J. F. Cohn, T. Kanade, J. M. Saragih, Z. Ambadar, and I. Matthews. The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotionspecified expression. In CVPR Workshops, 2010.
39. B. Martinez and M. Valstar. Advances, challenges, and opportunities in automatic facial expression recognition. In B. S. M. Kawulok, E. Celebi, editor, Advances in Face Detection and Facial Image Analysis. Springer, 2015. In press.
40. B. Martinez, M. F. Valstar, X. Binefa, and M. Pantic. Local evidence aggregation for regression based facial point detection. TPAMI, 35, 2013.
41. S. M. Mavadati, M. H. Mahoor, K. Bartlett, P. Trinh, and J. F. Cohn. Disfa : A spontaneous facial action intensity database. IEEE T-AFFC, 2013.
42. B. McDaniel, S. D'Mello, B. King, P. Chipman, K. Tapp, and A. Graesser. Facial Features for Affective State Detection in Learning Environments. 29th Annual meeting of the cognitive science society, pages 467-472, 2007.
43. D. McDuff, R. el Kaliouby, D. Demirdjian, and R. Picard. Predicting online media effectiveness based on smile responses gathered over the internet. In FG, 2013.
44. G. McKeown, M. F. Valstar, R. Cowie, and M. Pantic. The SEMAINE corpus of emotionally coloured character interactions. In IEEE International Conference on Multimedia and Expo, 2010.
45. L.-P. Morency, J. Whitehill, and J. R. Movellan. Generalized Adaptive View-based Appearance Model: Integrated Framework for Monocular Head Pose Estimation. In FG, 2008.
46. E. Murphy-Chutorian and M. M. Trivedi. Head Pose Estimation in Computer Vision: A Survey. TPAMI, 31: 607-626, 2009.
47. Paris Mavromoustakos Blom, S. Bakkes, C. T. Tan, S. Whiteson, D. Roijers, R. Valenti, and T. Gevers. Towards Personalised Gaming via Facial Expression Recognition. Proceedings of Tenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, (AIIDE): 30-36, 2014.
48. P. Robinson and R. el Kaliouby. Computation of emotions in man and machines. Philosophical Transactions B, pages 3441-3447, 2009.
49. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-the-wild challenge: The first facial landmark localization challenge. In ICCV, 2013.
50. J. Saragih, S. Lucey, and J. Cohn. Deformable Model Fitting by Regularized Landmark Mean-Shift. IJCV, 2011.
51. E. Sariyanidi, H. Gunes, and A. Cavallaro. Automatic analysis of facial affect: A survey of registration, representation and recognition. IEEE TPAMI, 2014.
52. B. Schuller, M. F. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic. AVEC 2011 The First International Audio / Visual Emotion Challenge. In ACII, 2011.
53. G. Stratou, S. Scherer, J. Gratch, and L.-P. Morency. Automatic nonverbal behavior indicators of depression and ptsd: Exploring gender differences. In ACII, 2013.
54. L. Swirski, A. Bulling, and N. A. Dodgson. Robust real-time pupil tracking in highly off-axis images. In Proceedings of ETRA, 2012.
55. P. Thomas, T. Baltrusaitis, P. Robinson, and A. Vivian. Measuring head posture in 3 dimensions with the Cambridge Face Tracker: Accurate, inexpensive, easy to use. In World Congress of Pediatric Ophthalmology and Strabismus, 2015.
56. J. L. Tracy and D. Matsumoto. The spontaneous expression of pride and shame: Evidence for biologically innate nonverbal displays. Proceedings of the National Academy of Sciences, 105 (33): 11655-11660, 2008.
57. G. Tzimiropoulos. Project-Out Cascaded Regression with an application to Face Alignment. Cvpr, 2015.
58. G. Tzimiropoulos andM. Pantic. Gauss-Newton Deformable Part Models for Face Alignment In-the-Wild. Computer Vision and Pattern Recognition, (c): 1851-1858, 2014.
59. M. Valstar, J. Girard, T. Almaev, G. McKeown, M. Mehu, L. Yin, M. Pantic, and J. Cohn. FERA 2015-Second Facial Expression Recognition and Analysis Challenge. In IEEE FG, 2015.
60. M. F. Valstar, B. Jiang, M. Mehu, M. Pantic, and K. R. Scherer. The First Facial Expression Recognition and Analysis Challenge. In IEEE FG, 2011.
61. N. Wang, X. Gao, D. Tao, and X. Li. Facial feature point detection: A comprehensive survey. CoRR, abs/1410. 1037, 2014.
62. E. Wood, T. Baltrusaitis, X. Zhang, Y. Sugano, P. Robinson, and A. Bulling. Rendering of eyes for eye-shape registration and gaze estimation. In ICCV, 2015.
63. E. Wood and A. Bulling. Eyetab: Model-based gaze estimation on unmodified tablet computers. In Proceedings of ETRA, Mar. 2014.
64. X. Xiong and F. De la Torre. Supervised descent method and its applications to face alignment. In CVPR, 2013.
65. H. Yang and I. Patras. Sieving Regression Forest Votes for Facial Feature Detection in the Wild. In ICCV, 2013.
66. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. TPAMI, 31 (1): 39-58, 2009.
67. J. Zhang, S. Shan, M. Kan, and X. Chen. Coarse-to-Fine Auto-encoder Networks ( CFAN) for Real-time Face Alignment. In ECCV, pages 1-16, 2014.
68. X. Zhang, Y. Sugano, M. Fritz, and A. Bulling. Appearancebased gaze estimation in the wild. June 2015.
69. X. Zhang, L. Yin, J. F. Cohn, S. Canavan, M. Reale, A. Horowitz, P. Liu, and J. M. Girard. BP4D-Spontaneous: A high-resolution spontaneous 3D dynamic facial expression database. IVC, 2014.
70. Z. Zhang, P. Luo, C.-C. Loy, and X. Tang. Facial Landmark Detection by Deep Multi-task Learning. Eccv, 2014.
71. X. Zhu and D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In CVPR, 2012.
72. P. Zielínski. Opengazer: open-source gaze tracker for ordinary webcams, 2007.