Local binary patterns for multi-view facial expression recognition

Computer Vision and Image Understanding

Volumn 115, Issue 4, 2011, Pages 541-558

  Moore, S ^a   Bowden, R ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Facial expression recognition; Head pose estimation; Local binary patterns; Local gabor binary patterns; Multi view facial expression recognition

Indexed keywords

FACIAL EXPRESSION RECOGNITION; HEAD POSE ESTIMATION; LOCAL BINARY PATTERNS; LOCAL GABOR BINARY PATTERNS; MULTI-VIEWS;

CLASSIFIERS; FEATURE EXTRACTION; GESTURE RECOGNITION; MOTION ESTIMATION;

FACE RECOGNITION;

EID: 79851512378     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.12.001     Document Type: Article

References (32)

1. J.C. McCall, M.M. Trivedi, Pose invariant affect analysis using thin-plate splines, in: ICPR '04: Proceedings of the Pattern Recognition, IEEE Computer Society, Washington, DC, USA, 2004, pp. 958-964.
2. C. Chan, J. Kittler, K. Messer, Multi-scale local binary pattern histograms for face recognition, in: The 2nd International Conference on Biometrics, ICIP 2010, pp. 809-818.
3. P. Ekman, and W.V. Friesen Pictures of Facial Affect 1976 Consulting Psychologists Press
4. S. Gong, P.W. McOwan, C. Shan, Dynamic facial expression recognition using a bayesian temporal manifold model, in: BMVC, vol. 1, 2006, pp. 297-306.
5. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker Multi-pie Image and Vision Computing 28 2010 807 813 (Best of Automatic Face and Gesture Recognition 2008)
6. Y. Hu, Z. Zeng, L. Yin, X. Wei, J. Tu, T. Huang, Multi-view facial expression recognition, FG2008, in: 8th International Conference on Automatic Face and Gesture Recognition 2008, ICPR 2008, 2008.
7. Y. Hu, Z. Zeng, L. Yin, X. Wei, J. Tu, T. Huang, A study of non-frontal-view facial expressions recognition, in: 19th International Conference on Pattern Recognition 2008, ICPR 2008, 2008, pp. 1-4.
8. T. Kanade, Y. Tian, and J.F. Cohn Comprehensive database for facial expression analysis FG '00: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000 Washington, DC, USA 2000 IEEE Computer Society 46
9. S. Liao, W. Fan, A.C.S. Chung, D.Y. Yeung, Facial expression recognition using advanced local binary patterns, tsallis entropies and global appearance features, in: ICIP, 2006, pp. 665-668.
10. S. Liao, X. Zhu, Z. Lei, L. Zhang, S. Li, Learning multi-scale block local binary patterns for face recognition, in: International Conference on Biometrics, ICB07, 2007, pp. 828-837.
11. G. Littlewort, M.S. Bartlett, I. Fasel, J. Susskind, J. Movellan, Dynamics of facial expression extracted automatically from video, Journal of Image and Vision Computing, 2004, pp. 615-625.
12. X. Liu, J. Rittscher, and T. Chen Optimal pose for face recognition CVPR '06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2006 IEEE Computer Society Washington, DC, USA 1439 1446 (Pubitemid 44931489)
13. M.J. Lyons, J. Budynek, and S. Akamatsu Automatic classification of single facial images IEEE Transactions on Pattern Analysis and Machine Intelligence 21 1999 1357 1362 (Pubitemid 30568926)
14. M.J. Lyons, R. Campbell, A. Plante, M. Coleman, M. Kamachi, and S. Akamatsu The noh mask effect vertical viewpoint dependence of facial expression perception Proceedings of the Royal Society, Biological Sciences 267 2000 2239 2245
15. A. Mehrabian Silent Messages 1971 Wadsworth Publishing Company, Inc. Belmont, CA
16. A. Mignault, and A. Chaudhuri The many faces of a neutral face: head tilt and perception of dominance and emotion Journal of Nonverbal Behavior 27 2003 111 132
17. S. Minut, S. Mahadevan, J.M. Henderson, F.C. Dyer, Face recognition using foveal vision, in: IEEE International Workshop on Biologically Motivated Computer Vision, 2000, pp. 424-433.
18. M.E.R. Nicholls, B.J. Wolfgang, D. Clode, and A.K. Lindell The effect of left and right poses on the expression of facial emotion Neuropsychologia 40 2002 1662 1665 (Pubitemid 34462874)
19. T. Ojala, M. Pietikainen, and D. Harwood A comparative study of texture measures with classification based on feature distributions Pattern Recognition 29 1996 51 59
20. T. Ojala, M. Pietikainen, and T. Maenpaa Multiresolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Transactions on Pattern Analysis and Machine Intelligence 24 2002 971 987 (Pubitemid 34835471)
21. OpenCV, < http://sourceforge.net/projects/opencvlibrary/ >.
22. M. Pantic, and I. Patras Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences IEEE Transactions on Systems, Man, and Cybernetics, Part B 36 2006 433 449
23. Y. Sato, E. Maeda, J. Yamato, K. Otsuka, S. Kumano, Pose-invariant facial expression recognition using variable-intensity templates, in: Asian Conference on Computer Vision 2007, ACCV07, pp. I: 324-334.
24. C. Shan, T. Gritti, Learning discriminative lbp-histogram bins for facial expression recognition, in: Proceedings of the British Machine Vision Conference 2008.
25. Y. li Tian, L. Brown, A. Hampapur, S. Pankanti, A. Senior, R. Bolle, Real world real-time automatic recognition of facial expressions, in: In Proceedings of IEEE workshop on Performance Evaluation of Tracking and Surveillance, 2003.
26. P. Viola, M. Jones, Robust real-time object detection, International Journal of Computer Vision 57 (2004).
27. J. Wang, L. Yin, X. Wei, and Y. Sun 3D facial expression recognition based on primitive surface feature distribution CVPR '06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Washington, DC, USA 2006 IEEE Computer Society 1399 1406 (Pubitemid 44931484)
28. X. Wang, T. Han, S. Yan, An hog-lbp human detector with partial occlusion handling, in: International Conference on Computer Vision 2009, ICCV09, pp. 32-39.
29. L. Yin, X. Wei, Y. Sun, J. Wang, M. Rosato, A 3d facial expression database for facial behavior research, in: 7th International Conference on Automatic Face and Gesture Recognition 2006, FGR 2006, 2006, pp. 211-216. (Pubitemid 44711352)
30. Y. Tian, T. Kanade, J. Cohn, Facial expression analysis, in: Handbook of Face Recognition, Springer, 2005 (Chapter 11).
31. W. Zhang, S. Shan, W. Gao, X. Chen, H. Zhang, Local gabor binary pattern histogram sequence (lgbphs): a non-statistical model for face representation and recognition, in: Tenth IEEE International Conference on Computer Vision, ICCV 1, vol. 1, 2005, pp. 786-791. (Pubitemid 44055035)
32. W. Zheng, H. Tang, Z. Lin, T. Huang, A novel approach to expression recognition from non-frontal face images, Twelth IEEE International Conference on Computer Vision, ICCV, 2009.