BP4D-Spontaneous: A high-resolution spontaneous 3D dynamic facial expression database

Image and Vision Computing

Volumn 32, Issue 10, 2014, Pages 692-706

  Zhang, Xing ^a   Yin, Lijun ^a   Cohn, Jeffrey F ^b   Canavan, Shaun ^a   Reale, Michael ^a   Horowitz, Andy ^a   Liu, Peng ^a   Girard, Jeffrey M ^b  

^a BINGHAMTON UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

3D facial expression; Dynamic facial expression database; FACS; Spontaneous expression

Indexed keywords

COMPUTER KEYBOARDS; DATABASE SYSTEMS; GESTURE RECOGNITION;

3-D FACIAL EXPRESSIONS; DYNAMIC FACIAL EXPRESSION; EMOTION INDUCTIONS; FACIAL ACTION CODING SYSTEM; FACS; NATURALLY OCCURRING; SPATIO TEMPORAL FEATURES; SPONTANEOUS EXPRESSION;

FACE RECOGNITION;

EID: 84906782817     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2014.06.002     Document Type: Article

References (63)

1. Man machine interaction group http://www.mmifacedb.com/ 2005
2. T. Kanade, J.F. Cohn, and Y. Tian Comprehensive Database for Facial Expression Analysis IEEE International Conference on Automatic Face and Gesture Recognition (FG), France 2000
3. M. Pantic, and L. Rothkrantz Automatic analysis of facial expressions: the state of the art IEEE Trans. Pattern Anal. Mach. Intell. 22 12 2000
4. M. Pantic, and L. Rothkrantz Toward an affect-sensitive multimodal human-computer interaction Proc. IEEE 91 9 2003
5. Y. Zhang, and Q. Ji Active and dynamic information fusion for facial expression understanding from image sequences IEEE Trans. Pattern Anal. Mach. Intell. 27 5 May 2005 699 714 (Pubitemid 40608403)
6. H. Wallbott, and K. Scherer Cues and channels in emotion recognition J. Pers. Soc. Psychol. 51 4 1996 690 699
7. E. Douglas-Cowie, and R. Cowie et al. The Humaine Database: Addressing the Collection and Annotation of Naturalistic and Induced Emotional Data ACII 2007 488 500
8. T. Anziger, and K. Scherer Using Actor Portrayals to Systematically Study Multimodal Emotion Expression: The GEMEP Corpus ACII 2007
9. A. Savran, and N. Alyuz et al. Bosphorus Database for 3D Face Analysis BIOID 2008 47 56
10. J. Gross, and R. Levenson Emotion elicitation using films Cogn. Emot. 9 no. 1 1995 87 108
11. R. Cowie, and R. Cornelius Describing the emotional states that are expressed in speech Speech Comm. 40 1-2 2003 5 32
12. Di3D Inc. http://www.di3d.com
13. Z. Zeng, M. Pantic, G. Roisman, and T. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Trans. Pattern Anal. Mach. Intell. 31 1 2009 39 58
14. L. Yin, X. Wei, Y. Sun,and M. Rosato A 3D Facial Expression Database for Facial Behavior Research IEEE Inter. Conf. on Automatic Face and Gesture Recognition, Southampton, UK, 2006 2006
15. L. Yin, X. Chen, Y. Sun, T. Worm, and M. Reale A High-resolution 3D Dynamic Facial Expression Database IEEE Inter. Conf. on Automatic Face and Gesture Recognition, Amsterdam, the Netherlands, Sept. 2008 Sept. 2008
16. P. Lucey, J.F. Cohn, J. Saragih, I. Matthews, and Z. Ambadar The Extended Cohn-Kanade Database: A Complete Facial Expression Database for Both Facial Action Units and Emotion Detection IEEE CVPR4HB 2010
17. J.F. Cohn, Z. Ambadar, and P. Ekman Observer-based Measurement of Facial Expression With the Facial Action Coding System J.A. Coan, J.J.B. Allen, The handbook of emotion elicitation and assessment Oxford University Press Series in Affective Science 2007 Oxford University New York, NY 203 221
18. J.F. Cohn, and P. Ekman Measuring Facial Action by Manual Coding, Facial EMG, and Automatic Facial Image Analysis J.A. Harrigan, R. Rosenthal, K. Scherer, Handbook of nonverbal behavior research methods in the affective sciences 2005 Oxford University Press NY 9 64
19. J. Jang, and T. Kanade Robust 3D Head Tracking by Online Feature Registration Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, the Netherlands 2008
20. I. Matthews, J. Xiao, and S. Baker 2D vs. 3D deformable face models: representational power, construction, and real-time fitting Int. J. Comput. Vis. 75 1 2007 93 113 (Pubitemid 47120247)
21. L. Noldus, R. Trienes, A. Henriksen, H. Jansen, and R. Jansen The observer video-pro: new software for the collection, management, and presentation of time-structured data from videotapes and digital media files Behav. Res. Methods Instrum. Comput. 32 2000 197 206
22. Z. Zeng, M. Pantic, G. Roisman, and T. Huang A Survey of Affect Recognition Methods: Audio, Visual and Spontaneous Expressions ACM International Conference on Multimodal Interfaces 2007
23. RU-FACS http://mplab.ucsd.edu/wordpress/?page-id=36 2013
24. G. Stratou, A. Ghosh, P. Debevec, and L. Morency Exploring the Effect of Illumination on Automatic Expression Recognition Using the ICT-3DRFE Database IEEE International Conference on Automatic Face and Gesture Recognition (FG) 2011
25. G. Fanelli, J. Gall, H. Romsdorfer, T. Weise, and L. Van Gool A 3D audio-visual corpus of affective communication IEEE Trans. Multimedia 12 6 Oct. 2012 591 598
26. S. Wang, Z. Liu, S. Lu, and X. Wang et al. A natural visible and infrared facial expression database for expression recognition and emotion inference IEEE Trans. Multimedia 12 7 Nov. 2010 682 691
27. S.M. Mavadati, M.H. Mahoor, K. Bartlett, P. Trinh, and J.F. Cohn DISFA: a spontaneous facial action intensity database IEEE Trans. Affect. Comput. 1 2013
28. M. Mahoor, S. Cadavid, D. Messinger, and J.F. Cohn A Framework for Automated Measurement of the Intensity of Non-Posed Facial Action Units 2nd IEEE Workshop on CVPR for Human communicative Behavior analysis (CVPR4HB), Miami Beach June 25, 2009
29. J. Wang, L. Yin, X. Wei, and Y. Sun 3D Facial Expression Recognition Based on Primitive Surface Feature Distribution IEEE CVPR 2006
30. T. Cootes, G. Edwards, and C. Taylor Active appearance models IEEE Trans. Pattern Anal. Mach. Intell. 23 2001 681 685 (Pubitemid 32585279)
31. M. Lyons et al. Automatic classification of single facial images IEEE Trans. Pattern Anal. Mach. Intell. 21 1999 1357 1362 (Pubitemid 30568926)
32. K. Schmidt, Z. Ambadar, J.F. Cohn, and L. Reed Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling J. Nonverbal Behav. 30 2006 37 52 (Pubitemid 44219987)
33. E. Goeleven, R. De Raedt, L. Leyman, and B. Verschuere The Karolinska directed emotional faces: a validation study Cogn. Emot. 22 6 2008 1094 1118
34. R. Gross, I. Matthews, J.F. Cohn, T. Kanade, and S. Baker Multi-PIE Image Vis. Comput. 28 5 2010 807 813
35. D. Cosker, E. Krumhuber, and A. Hilton A FACS Valid 3D Dynamic Action Unit Database With Applications to 3D Dynamic Morphable Facial Modeling IEEE Inter. Conf. on Computer Vision (ICCV) 2011
36. P. Ekman, W. Friesen, and J. Hager Facial action coding system: Research Nexus, Network Research Information, Salt Lake City 2002
37. J. Fleiss Statistical Methods for Rates and Proportions 1981 Wiley NY
38. J.M. Saragih, S. Lucey, and J.F. Cohn Deformable Model Fitting with a Mixture of Local Experts IEEE Inter. Conf. on Computer Vision 2009
39. J.M. Saragih, S. Lucey, and J.F. Cohn Deformable model fitting by regularized landmark mean-shift Int. J. Comput. Vis. 91 2 2011 200 215
40. S. Canavan, X. Zhang, and L. Yin Fitting and Tracking 3D/4D Facial Data Using a Temporal Deformable Shape Model IEEE International Conference on Multimedia &Expo (ICME13), San Jose, 2013 2013
41. M. Reale, X. Zhang, and L. Yin Nebula Feature: A Space-time Feature for Posed and Spontaneous 4D Facial Behavior Analysis IEEE Inter. Conf. on Automatic Face and Gesture Recognition (FG) 2013
42. Y. Sun, and L. Yin Facial Expression Recognition Based on 3D Dynamic Range Model Sequences The 10th European Conference on Computer Vision (ECCV08), Oct. 2008, Marseille, France Oct. 2008
43. J. Coan, and J. Allen Oxford handbook on emotion elicitation and assessment 2007 Oxford University Press NY
44. C. Von Baeyer, T. Piira, C. Chambers, M. Trapannotto, and L. Zeltzer Guidelines for the cold pressor task as an experimental pain stimulus for use with children J. Pain 6 4 2005 218 227 (Pubitemid 40488799)
45. G. Sandbach, S. Zafeiriou, M. Pantic, and L. Yin Static and dynamic 3D facial expression recognition: a comprehensive survey Image Vis. Comput. 30 10 Oct. 2012 683 697
46. D. Clark On the induction of depressed mood in the laboratory: evaluation and comparison of the Velten and musical procedures Adv. Behav. Res. Ther. 5 1 1983 27 49
47. G. Zhao, and M. Pietikainen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Trans. Pattern Anal. Mach. Intell. 29 6 Jun. 2007 915 928 (Pubitemid 46667407)
48. Dacher Keltner Evidence for the distinctness of embarrassment, shame, and guilt: a study of recalled antecedents and facial expressions of emotion Cogn. Emot. 10.2 1996 155 172
49. Kenneth M. Prkachin The consistency of facial expressions of pain: a comparison across modalities Pain 51 3 1992 297 306 (Pubitemid 23005866)
50. Paul Ekman, and Wallace V. Friesen et al. Is the startle reaction an emotion? J. Pers. Soc. Psychol. 1985 1416
51. Zara Ambadar, Jeffrey F. Cohn, and Lawarence Ian Reed All smiles are not created equal: morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous J. Nonverbal Behav. 33 1 2009 17 34
52. Charles Darwin The Expression of the Emotions in Man and Animals 3rd edition 1872/1998 Oxford University New York
53. Richard J. Davidson, Paul Ekman, C.D. Saron, J.A. Senulis, and Wallace V. Friesen Approach-withdrawal and cerebral asymmetry: emotional expression and brain physiology I J. Pers. Soc. Psychol. 58 2 1990 330 341
54. Paul Ekman, and Wallace V. Friesen EMFACS: Coder's Instructions 1982 Human Interaction Laboratory, University of California San Francisco San Francisco
55. Paul Ekman, Erika Rosenberg, and Joseph C. Hager Facial Action Coding System Aect Interpretive Database (FACSAID) from http://nirc.com/Expression/ FACSAID/facsaid.html 1998
56. Jeffrey M. Girard, Jeffrey F. Cohn, Mohammad H. Mahoor, Seyed M. Mavadati, Zakia Hammal, and Dean Rosenwald Social risk and depression: evidence from nonverbal behavior analysis J. Image Vision Comput. 2014 (in press)
57. Eddie Harmon-Jones, David M. Amodio, and Leah R. Zinner Social Psychological Methods of Emotion Elicitation Handbook of emotion elicitation and assessment 2007 Oxford University Press NY
58. Mohammad E. Hoque, Daniel J. McDuff, and Rosalind W. Picard Exploring temporal patterns in classifying frustrated and delighted smiles Affective Computing, IEEE Transactions on 3.3 2012 323 334
59. Patrick Lucey, Jeffrey F. Cohn, Kenneth M. Prkachin, Patricia Solomon, and Iain Matthews Painful data: The UNBC-McMaster shoulder pain expression archive database J. Image Vision Comput. 30 2012 197 205
60. David K. Markus The perception of "live" embarrassment: a social relations analysis of class presentations Cogn. Emot. 13 1 1999 105 117
61. Jonathan Rottenberg, Rebecca D. Ray, and James J. Gross Emotion Elicitation Using Film J.A. Coan, J.J.B. Allen, Handbook of emotion elicitation and assessment 2007 Oxford University Press NY 9 28
62. Paul Rozin, Jonathan Haidt, and Clark R. McCauley Disgust M. Lewis, J.M. Haviland-Jones, L.F. Barrett, Handbook of emotions 3rd ed. 2008 Guilford Press NY 757 776
63. J. Richard Landis, and Gary G. Koch The measurement of observer agreement for categorical data Biometrics 1977 159 174 (Pubitemid 8054849)