Facial expression recognition based on anatomy

Computer Vision and Image Understanding

Volumn 119, Issue , 2014, Pages 1-14

  Taner Eskil, M ^a   Benli, Kristin S ^a  

^a ISIK UNIVERSITY   (Turkey)

Author keywords

Facial action coding system; Facial anatomy; Features; Muscle force

Indexed keywords

ANATOMICAL STRUCTURES; FACIAL ACTION CODING SYSTEM; FACIAL ANATOMY; FACIAL EXPRESSION RECOGNITION; FEATURES; LEAST SQUARES ALGORITHM; MUSCLE FORCE; RELATIVE DISPLACEMENT;

ADAPTIVE BOOSTING; GESTURE RECOGNITION; MUSCLE;

FACE RECOGNITION;

EID: 84890404701     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.11.002     Document Type: Article

References (68)

1. A. Mehrabian Communication without words Psychol. Today 2 9 1968 52 55
2. A. Mehrabian Silent Messages: Implicit Communication of Emotions and Attitudes 1981 Wadsworth Pub. Co.
3. H. Mcgurck, and J.W. Macdonald Hearing lips and seeing voices Nature 264 1976 746 748
4. W.L. Johnson, J.W. Rickel, and J.C. Lester Animated pedagogical agents: face-to-face interaction in interactive learning environments IJAIED 11 2000 47 78
5. A. Vinciarelli, M. Pantic, and H. Bourlard Social signal processing: survey of an emerging domain Image Vision Comput. 27 12 2009 1743 1759
6. D. Gatica-Perez Automatic nonverbal analysis of social interaction in small groups: a review Image Vision Comput. 27 12 2009 1775 1787
7. T. Dingus The 100-Car Naturalistic Driving Study: Results of the 100-Car Field Experiment 2006 National Highway Traffic Safety Administration
8. Q. Ji, P. Lan, and C. Looney A probabilistic framework for modeling and real-time monitoring human fatigue IEEE Syst. Man. Cybern. Part A 36 5 2006 862 875
9. E. Vural, M. Çetin, A. Erçil, G. Littlewort, M. Bartlett, and J. Movellan Machine learning systems for detecting driver drowsiness K. Takeda, H. Erdogan, J. Hansen, H. Abut, In-vehicle Corpus and Signal Processing for Driver Behavior 2009 Springer 97 110
10. P. Ekman, and W.V. Friesen Pictures of Facial Affect 1976 Consulting Psychologists Press
11. Z. Zhang, M.J. Lyons, M. Schuster, and S. Akamatsu Comparison between geometry based and gabor wavelets based facial expression recognition using multi-layer perceptron Proceedings of the 3rd International Conference on Face and Gesture Recognition 1998 IEEE Computer Society Washington, DC, USA 454 461
12. P. Aleksic, and A. Katsaggelos Automatic facial expression recognition using facial animation parameters and multistream HMMs IEEE Trans. Inf. Foren. Sec. 1 1 2006 3 11
13. G. Littlewort, M.S. Bartlett, I. Fasel, J. Susskind, and J. Movellan Dynamics of facial expression extracted automatically from video Image Vision Comput. 24 6 2006 615 625
14. P. Ekman, and W. Friesen Facial Action Coding System: A Technique for the Measurement of Facial Movement 1978 Consulting Psychologists Press Palo Alto
15. I. Kotsia, I. Buciu, and I. Pitas An analysis of facial expression recognition under partial facial image occlusion Image Vision Comput. 26 7 2008 1052 1067
16. P. Lucey, J. Cohn, T. Kanade, J. Saragih, Z. Ambadar, I. Matthews, The extended cohn-kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, June 2010, pp. 94-101.
17. N. Sebe, M.S. Lew, Y. Sun, I. Cohen, T. Gevers, and T.S. Huang Authentic facial expression analysis Image Vision Comput. 25 12 2007 1856 1863
18. J.N. Bassili Facial motion in the perception of faces and of emotional expression J. Exp. Psychol. Human 4 3 1978 373 379
19. H. Schneiderman, and T. Kanade A statistical method for 3D object detection applied to faces and cars IEEE Conference on Computer Vision and Pattern Recognition 2000 IEEE 1 6
20. H.A. Rowley, S. Member, S. Baluja, and T. Kanade Neural network-based face detection IEEE Trans. Pattern Anal. Mach. Intell. 20 1998 23 38
21. P. Viola, and M.J. Jones Robust real-time face detection Int. J. Comput. Vision 57 2 2004 137 154
22. T. Kozakaya, T. Shibata, M. Yuasa, and O. Yamaguchi Facial feature localization using weighted vector concentration approach Image Vision Comput. 28 5 2010 772 780
23. O. Çeliktutan, H. Akakin, B. Sankur, Multi-attribute robust facial feature localization, in: 8th IEEE International Conference on Automatic Face Gesture Recognition, 2008 (FG '08), 2008, pp. 1-6.
24. M. Bartlett, Unsupervised learning and redundancy reduction, Ph.D. dissertation, University of California, San Diego, 1998.
25. W.A. Fellenz, J.G. Taylor, N. Tsapatsoulis, S. Kollias, Comparing template-based, feature-based and supervised classification of facial expressions from static images, in: Proceedings of Circuits, Systems, Communications and Computers (CSCC'99), 1999, pp. 5331-5336.
26. L. Wiskott, J.-M. Fellous, N. Krüger, and C. von der Malsburg Face recognition by elastic bunch graph matching IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 775 779
27. D. Cristinacce, T. Cootes, Facial feature detection using Adaboost with shape constraints, in: Proceedings of British Machine Vision Conference, vol. 1, 2003, pp. 231-240.
28. A. Ali Salah, H. Çinar, L. Akarun, and B. Sankur Robust facial landmarking for registration Ann. Telecommun. 62 2007 83 108
29. H. Wu, X. Liu, G. Doretto, Face alignment via boosted ranking model, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR, 2008, pp. 1-8.
30. S. Asteriadis, N. Nikolaidis, and I. Pitas Facial feature detection using distance vector fields Pattern Recogn. 42 7 2009 1388 1398
31. H.C. Akakin, and B. Sankur Robust classification of face and head gestures in video Image Vision Comput. 29 7 2011 470 483
32. B.D. Lucas, and T. Kanade An iterative image registration technique with an application to stereo vision Proceedings of the 7th International Joint Conference on Artificial Intelligence 1981 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA 674 679
33. J. Shi, C. Tomasi, Good features to track, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1994, pp. 593-600.
34. D. Cristinacce, T. Cootes, Facial feature detection and tracking with automatic template selection, in: 7th International Conference on Automatic Face and Gesture Recognition, 2006, pp. 429-434.
35. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer-Verlag New York, Inc. New York, NY, USA
36. V.N. Vapnik Statistical Learning Theory 1998 Wiley New York, NY, USA
37. P. Michel, and R. El Kaliouby Real time facial expression recognition in video using support vector machines Proceedings of the 5th International Conference on Multimodal Interfaces 2003 ACM New York, NY, USA 258 264
38. T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham Active shape models-their training and application Comput. Vis. Image Underst. 61 1 1995 38 59
39. T.F. Cootes, G.J. Edwards, and C.J. Taylor Active appearance models H. Burkhardt, B. Neumann, Computer Vision - ECCV 98, 5th European Conference on Computer Vision, Freiburg, Germany, June 2-6, 1998, Proceedings, Volume II Lecture Notes in Computer Science vol. 1407 1998 Springer 484 498
40. T.F. Cootes, G.J. Edwards, and C.J. Taylor Active appearance models IEEE Trans. Pattern Anal. Mach. Intell. 23 6 2001 681 685
41. O. Hamsici, A. Martinez, Active appearance models with rotation invariant kernels, in: 2009 IEEE 12th International Conference on Computer Vision, 2009, pp. 1003-1009.
42. I. Matthews, and S. Baker Active appearance models revisited Int. J. Comput. Vision 60 2 2004 135 164
43. X. Liu Video-based face model fitting using adaptive active appearance model Image Vision Comput. 28 7 2010 1162 1172
44. A. Lanitis, C.J. Taylor, and T.F. Cootes Automatic interpretation and coding of face images using flexible models IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 743 756
45. J. Ahlberg An active model for facial feature tracking EURASIP J. Appl. Sig. P. 2002 1 2002 566 571
46. F. Dornaika, and F. Davoine Online appearance-based face and facial feature tracking 17th International Conference on Proceedings of the Pattern Recognition 2004 IEEE Computer Society Washington, DC, USA 814 817
47. J. Sung, T. Kanade, and D. Kim Pose robust face tracking by combining active appearance models and cylinder head models Int. J. Comput. Vision 80 2 2008 260 274
48. C. Huang, X. Ding, and C. Fang Pose robust face tracking by combining view-based AAMs and temporal filters Comput. Vis. Image Underst. 116 7 2012 777 792 http://dx.doi.org/10.1016/j.cviu.2012.02.007
49. Y. Cheon, and D. Kim Natural facial expression recognition using differential-aam and manifold learning Pattern Recogn. 42 7 2009 1340 1350
50. M. Pantic, and L.J. Rothkrantz Facial action recognition for facial expression analysis from static face images Trans. Syst. Man Cyber. Part B 34 3 2004 1449 1461
51. Y. Zhang, and Q. Ji Active and dynamic information fusion for facial expression understanding from image sequences IEEE Trans. Pattern Anal. Mach. Intell. 27 5 2005 699 714
52. Y. Tong, W. Liao, and Q. Ji Facial action unit recognition by exploiting their dynamic and semantic relationships IEEE Trans. Pattern Anal. Mach. Intell. 29 10 2007 1683 1699
53. T.-H. Wang, and J.-J. James Lien Facial expression recognition system based on rigid and non-rigid motion separation and 3D pose estimation Pattern Recogn. 42 5 2009 962 977
54. F. Tsalakanidou, and S. Malassiotis Real-time 2D+3D facial action and expression recognition Pattern Recogn. 43 5 2010 1763 1775
55. T. Kanade, Y. Tian, and J.F. Cohn Comprehensive database for facial expression analysis Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000 IEEE Computer Society Washington, DC, USA 46 53
56. I. Kotsia, S. Zafeiriou, and I. Pitas Texture and shape information fusion for facial expression and facial action unit recognition Pattern Recogn. 41 3 2008 833 851
57. B. Braathen, G. Littlewort, and E. Smith An approach to automatic recognition of spontaneous facial actions Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition 2002 IEEE Computer Society Washington, DC, USA 360 365
58. K.R. Scherer, and P. Ekman Handbook of Methods in Nonverbal Behavior Research 1982 Cambridge University Press Cambridge and New York
59. Y. Tian, T. Kanade, J. Cohn, Recognizing lower face action units for facial expression analysis, in: Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000, pp. 484-490.
60. M. Rydfalk, Candide, a parameterized face, Linkping University, Dept. of Electrical Engineering, Sweden, Tech. Rep. LiTH-ISY-I-866, 1987.
61. J. Ahlberg, Candide-3, an updated parameterized face, Linkping University, Dept. of Electrical Engineering, Sweden, Tech. Rep. LiTH-ISY-R-2326, 2001.
62. D. Terzopoulos, and K. Waters Physically-based facial modelling, analysis, and animation J. Visual. Comp. Animat. 1 2 1990 73 80
63. E. Sifakis, I. Neverov, and R. Fedkiw Automatic determination of facial muscle activations from sparse motion capture marker data ACM Trans. Graph. 24 3 2005 417 425
64. H.P. Abeysundera, K.S. Benli, and M.T. Eskil Nearest neighbor weighted average customization for modeling faces Mach. Vision Appl. 24 7 2013 1525 1537
65. K. Waters A muscle model for animating three-dimensional facial expression Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques 1987 ACM New York, NY, USA 17 24
66. Y. Luximon, R. Ball, and L. Justice The 3D chinese head and face modeling Comput. Aided Des. 44 1 2012 40 47
67. F. Dornaika, and J. Ahlberg Fitting 3D face models for tracking and active appearance model training Image Vision Comput. 24 9 2006 1010 1024
68. E. Goeleven, R. De Raedt, L. Leyman, and B. Verschuere The karolinska directed emotional faces: a validation study Cognition Emotion 22 6 2008 1094 1118