An analysis of facial expression recognition under partial facial image occlusion

Image and Vision Computing

Volumn 26, Issue 7, 2008, Pages 1052-1067

  Kotsia, Irene ^a   Buciu, Ioan ^a   Pitas, Ioannis ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Discriminant Non negative Matrix Factorization; Facial expression recognition; Gabor filters; Partial occlusion; Support Vector Machines

Indexed keywords

FEATURE EXTRACTION; IMAGE CLASSIFICATION; IMAGE RECONSTRUCTION; MATRIX ALGEBRA; SUPPORT VECTOR MACHINES; WAVELET TRANSFORMS;

DISCRIMINANT NON-NEGATIVE MATRIX FACTORIZATION; FACIAL EXPRESSION RECOGNITION; GABOR FILTERS; PARTIAL OCCLUSION;

FACE RECOGNITION;

EID: 42249104358     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2007.11.004     Document Type: Article

References (40)

1. Pentland A., and Choudhury T. Face recognition for smart environments. IEEE Computer 33 2 (2000) 50-55
2. Pantic M., and Rothkrantz L. Toward an affect-sensitive multimodal human-computer interaction. Proceedings of the IEEE 91 9 (2003) 1370-1390
3. Ekman P., and Friesen W. Emotion in the Human Face (1975), Prentice Hall, New Jersey
4. Ekman P. Unmasking the Face (1982), Cambridge University Press, Cambridge
5. T. Kanade, J. Cohn, Y. Tian, Comprehensive database for facial expression analysis, in: Proceedings of IEEE International Conference on Face and Gesture Recognition, 2000, pp. 46-53.
6. Pantic M., and Rothkrantz L. Automatic analysis of facial expressions: the state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 12 (2000) 1424-1445
7. F. Bourel, C. Chibelushi, A. Low, Recognition of facial expressions in the presence of occlusion, in: Proceedings of the Twelfth British Machine Vision Conference, vol. 1, Manchester, UK, 2001, pp. 213-222.
8. Lyons M.J., Budynek J., and Akamatsu S. Automatic classification of single facial images. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 12 (1999) 1357-1362
9. Duc B., Fischer S., and Bigün J. Face authentication with Gabor information on deformable graphs. IEEE Transactions on Image Processing 8 4 (1999) 504-516
10. Chengjun L. Gabor-based kernel PCA with fractional power polynomial models for face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 5 (2004) 572-581
11. W. Fellenz, J. Taylor, N. Tsapatsoulis, S. Kollias, Comparing template-based, feature-based and supervised classification of facial expressions from static images, Computational Intelligence and Applications, World Scientific and Engineering Society Press, 1999.
12. M.S. Bartlett, G. Littlewort, I. Fasel, J.R. Movellan, Real time face detection and facial expression recognition: development and applications to human computer interaction, in: Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, 2003, pp. 1295-1302.
13. Z. Zhang, M. Lyons, M. Schuster, S. Akamatsu, Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron, in: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara Japan, 1998, pp. 454-459.
14. M.J. Lyons, S. Akamatsu, M. Kamachi, J. Gyoba, Coding facial expressions with Gabor wavelets, in: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, 1998, pp. 200-205.
15. Donato G., Bartlett M.S., Hager J.C., Ekman P., and Sejnowski T.J. Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 10 (1999) 974-989
16. Zafeiriou S., Tefas A., Buciu I., and Pitas I. Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification. IEEE Transactions on Neural Networks 17 3 (2006) 683-695
17. I. Buciu, I. Pitas, A new sparse image representation algorithm applied to facial expression recognition, in: MLSP, Sao Lufs, Brazil, 2004.
18. Buciu I., Pitas I., and NMF. LNMF and DNMF modeling of neural receptive fields involved in human facial expression perception. Journal of Visual Communication and Image Representation 17 5 (2006) 958-969
19. S.Z. Li, X.W. Hou, H.J. Zhang, Learning spatially localized, parts-based representation, in: CVPR, Kauai, HI, USA, 2001, pp. 207-212.
20. S. Krinidis, I. Pitas, Statistical analysis of facial expressions for facial expression synthesis, IEEE Transactions on Multimedia, submitted for publication.
21. P. Michel, R. Kaliouby, Real time facial expression recognition in video using support vector machines, in: Proceedings of Fifth International Conference on Multimodal Interfaces, Vancouver, British Columbia, Canada, 2003, pp. 258-264.
22. Kotsia I., and Pitas I. Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Transactions on Image Processing 16 1 (2007) 172-187
23. I. Buciu, I. Kotsia, I. Pitas, Facial expression analysis under partial occlusion, in: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2005, Philadelphia, 2005.
24. Wiskott L., Fellous J.-M., Kruger N., and von der Malsburg C. Face recognition by elastic bunch graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 (1997) 775-779
25. Collins M., Schapire R.E., and Singer Y. Logistic regression, adaboost and bregman distances. Computational Learning Theory (2000) 158-169
26. D.D. Lee, H.S. Seung, Algorithms for non-negative matrix factorization, in: NIPS, 2000, pp. 556-562.
27. Lee D., and Seung H. Learning the parts of objects by non-negative matrix factorization. Nature 401 (1999) 788-791
28. D. Donoho, V. Stodden, When does non-negative matrix factorization give a correct decomposition into parts? Advances in Neural Information Processing Systems, 17 (2004).
29. Kotsia I., Zafeiriou S., and Pitas I. A novel discriminant non-negative matrix factorization algorithm with applications to facial image characterization problems. IEEE Transaction on Forensics and Security. Part 2 2 3 (2007) 588-595
30. Kotsia I., Zafeiriou S., and Pitas I. Texture and shape information fusion for facial expression and facial action unit recognition. Pattern Recognition 41 3 (2008) 833-851
31. Vapnik V. Statistical Learning Theory (1998), Wiley, New York
32. Hsu C.W., and Lin C.J. A comparison of methods for multiclass Support Vector Machines. IEEE Transactions on Neural Networks 13 2 (2002) 415-425
33. J. Weston, C. Watkins, Multi-class Support Vector Machines, in: Proceedings of ESANN99, Brussels, Belgium, 1999.
34. Burges C.J.C. A tutorial on Support Vector Machines for pattern recognition. Data Mining and Knowledge Discovery 2 2 (1998) 121-167
35. Pantic M., and Rothkrantz L.J.M. Expert system for automatic analysis of facial expressions. Image and Vision Computing 18 11 (2000) 881-905
36. M. Pantic, M.F. Valstar, R. Rademaker, L. Maat, Web-based database for facial expression analysis, in: IEEE International Conference on Multimedia and Expo, ICME 2005, Amsterdam, The Netherlands, 2005.
37. S. Asteriadis, N. Nikolaidis, A. Hajdu, I. Pitas, An eye detection algorithm using pixel to edge information, in: Proceedings of Second IEEE-EURASIP International Symposium on Control, Communications, and Signal Processing (ISCCSP 2006), Marrakech, Morocco, 2006.
38. Cohen I., Sebe N., Garg S., Chen L.S., and Huanga T.S. Facial expression recognition from video sequences: temporal and static modelling. Computer Vision and Image Understanding 91 (2003) 160-187
39. Cover T.M. Learning in Pattern Recognition (1969), Academic Press
40. J.Y. Bouguet, Pyramidal implementation of the Lucas-Kanade feature tracker, Technical Report, Intel Corporation, Microprocessor Research Labs, 1999.