Framework for reliable, real-time facial expression recognition for low resolution images

Pattern Recognition Letters

Volumn 34, Issue 10, 2013, Pages 1159-1168

  Khan, Rizwan Ahmed ^a,b   Meyer, Alexandre ^a,b   Konik, Hubert ^a,c   Bouakaz, Saïda ^a,b  

^a UNIVERSITÉ DE LYON   (France)

^b UNIVERSITÉ LYON 1   (France)

^c UNIVERSITÉ JEAN MONNET   (France)

Author keywords

Facial expression recognition; Image pyramid Salient facial regions; Local binary pattern; Low resolution images

Indexed keywords

AUTOMATIC RECOGNITION; BEHAVIOR MONITORING; EXPRESSION RECOGNITION; FACIAL EXPRESSION RECOGNITION; FACIAL REGIONS; LOCAL BINARY PATTERNS; LOW RESOLUTION IMAGES; STATE-OF-THE-ART METHODS;

DATABASE SYSTEMS; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION;

FACE RECOGNITION;

EID: 84876747423     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2013.03.022     Document Type: Article

References (43)

1. D. Aha, and R.L. Bankert Feature selection for case-based classification of cloud types: an empirical comparison Association for the Advancement of Artificial Intelligence (AAAI) Workshop on Case-Based Reasoning 1994 AAAI Press 106 112
2. Bai, Y.; Guo, L.; Jin, L.; Huang, Q.; 2009. A novel feature extraction method using pyramid histogram of orientation gradients for smile recognition. In: International Conference on Image Processing.
3. Bartlett, M.S.; Littlewort, G.; Braathen, B.; Sejnowski, T.J.; Movellan, J.R.; 2002. A prototype for automatic recognition of spontaneous facial actions. In: Advances in Neural Information Processing Systems.
4. Bartlett, M.S.; Littlewort, G.; Fasel, I.; Movellan, J.R.; 2003. Real time face detection and facial expression recognition: development and applications to human computer interaction. In: Conference on Computer Vision and Pattern Recognition Workshop, 2003.
5. J.N. Bassili Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face Journal of Personality and Social Psychology 37 1979 2049 2058
6. G. Donato, M.S. Bartlett, J.C. Hager, P. Ekman, and T.J. Sejnowski Classifying facial actions IEEE Transaction on Pattern Analysis and Machine Intelligence 21 1999 974 989 (Pubitemid 129304131)
7. F. Dornaika, E. Lazkano, and B. Sierra Improving dynamic facial expression recognition with feature subset selection Pattern Recognition Letters 32 2011 740 748
8. P. Ekman Universals and cultural differences in facial expressions of emotion Nebraska Symposium on Motivation 1971 Lincoln University of Nebraska Press 207 283
9. P. Ekman Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage third ed. 2001 W.W. Norton & Company New York
10. Ekman, P.; Friesen, W.; 1978. The facial action coding system: a technique for the measurement of facial movements. Consulting Psychologist.
11. G. Guo, and C.R. Dyer Simultaneous feature selection and classifier training via linear programming: a case study for face expression recognition IEEE Conference on Computer Vision and Pattern Recognition 2003 IEEE Computer Society Washington, DC, USA 346 352
12. Guo, Z.; Zhang, L.; Zhang, D.; Mou, X.; 2010. Hierarchical multiscale lbp for face and palmprint recognition. In: IEEE International Conference on Image Processing, pp. 4521-4524.
13. E. Hadjidemetriou, M. Grossberg, and S. Nayar Multiresolution histograms and their use for recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 26 2004 831 847
14. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 20 1998 1254 1259 (Pubitemid 128742001)
15. A. Jain, and D. Zongker Feature selection: evaluation, application, and small sample performance IEEE Transactions on Pattern Analysis and Machine Intelligence 19 1997 153 158 (Pubitemid 127828334)
16. Khan, R.A.; Meyer, A.; Konik, H.; Bouakaz, S.; 2012a. Exploring human visual system: study to aid the development of automatic facial expression recognition framework. In: Computer Vision and Pattern Recognition Workshop.
17. Khan, R.A.; Meyer, A.; Konik, H.; Bouakaz, S.; 2012b. Human vision inspired framework for facial expressions recognition. In: IEEE (Ed.), IEEE International Conference on Image Processing.
18. Kolsch, M.; Turk, M.; 2004. Analysis of rotational robustness of hand detection with a viola-jones detector. In: 17th International Conference on Pattern Recognition, vol. 3, pp. 107 - 110.
19. I. Kotsia, S. Zafeiriou, and I. Pitas Texture and shape information fusion for facial expression and facial action unit recognition Pattern Recognition 41 2008 833 851 (Pubitemid 47632661)
20. G. Littlewort, M.S. Bartlett, I. Fasel, J. Susskind, and J. Movellan Dynamics of facial expression extracted automatically from video Image and Vision Computing 24 2006 615 625 (Pubitemid 43867835)
21. Lucey, P.; Cohn, J.F.; Kanade, T.; Saragih, J.; Ambadar, Z.; Matthews, I.; 2010. The extended Cohn-Kanade dataset (CK+): a complete facial expression dataset for action unit and emotion-specified expression. In: IEEE Conference on Computer Vision and Pattern Recognition Workshop.
22. S. Moore, and R. Bowden Local binary patterns for multi-view facial expression recognition Computer Vision and Image Understanding 115 2011 541 558
23. T. Ojala, and M. Pietikäinen Unsupervised texture segmentation using feature distributions Pattern Recognition 32 1999 477 486
24. T. Ojala, M. Pietikäinen, and D. Harwood A comparative study of texture measures with classification based on featured distribution Pattern Recognition 29 1996 51 59
25. T. Ojala, M. Pietikäinen, and T. Mäenpää Multiresolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Transaction on Pattern Analysis and Machine Intelligence 24 2002 971 987 (Pubitemid 34835471)
26. Ojansivu, V.; Heikkilä, J.; 2008. Blur insensitive texture classification using local phase quantization. In: International conference on Image and Signal Processing.
27. M. Pantic, and I. Patras Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences IEEE Transactions on Systems, Man, and Cybernetics 36 2006 433 449
28. Park, S.; Kim, D.; 2008. Spontaneous facial expression classification with facial motion vector. In: IEEE Conference on Automatic Face and Gesture Recognition.
29. P. Pudil, J. Novovičová, and J. Kittler Floating search methods in feature selection Pattern Recognition Letters 15 1994 1119 1125
30. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann
31. C. Shan, S. Gong, and P.W. McOwan Facial expression recognition based on local binary patterns: a comprehensive study Image and Vision Computing 27 2009 803 816
32. Tian, Y.; 2004. Evaluation of face resolution for expression analysis. In: Computer Vision and Pattern Recognition Workshop.
33. Vailaya, A.; 2000. Semantic classification in image database. Ph.D. thesis. Michigan State University.
34. Valstar, M.; Pantic, M.; 2010. Induced disgust, happiness and surprise: an addition to the MMI facial expression database. In: International Language Resources and Evaluation Conference.
35. Valstar, M.; Patras, I.; Pantic, M.; 2005. Facial action unit detection using probabilistic actively learned support vector machines on tracked facial point data. In: IEEE Conference on Computer Vision and Pattern Recognition Workshop, pp. 76-84.
36. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer-Verlag New York
37. Viola, P.; Jones, M.; 2001. Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition.
38. Wallhoff, F.; 2006. Facial expressions and emotion database. www.mmk.ei.tum.de/∼waf/fgnet/feedtum.html.
39. Wang, W.; Chen, W.; Xu, D.; 2011. Pyramid-based multi-scale lbp features for face recognition. In: International Conference on Multimedia and Signal Processing (CMSP), pp. 151-155.
40. Yang, P.; Liu, Q.; Metaxas, D.N.; 2010. Exploring facial expressions with compositional features. In: IEEE Conference on Computer Vision and Pattern Recognition.
41. Y. Zhang, and Q. Ji Active and dynamic information fusion for facial expression understanding from image sequences IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 699 714 (Pubitemid 40608403)
42. G. Zhao, and M. Pietikäinen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Transaction on Pattern Analysis and Machine Intelligence 29 2007 915 928 (Pubitemid 46667407)
43. L. Zhaoping Theoretical understanding of the early visual processes by data compression and data selection Network: Computation in Neural Systems 17 2006 301 334