Random Gabor based templates for facial expression recognition in images with facial occlusion

Neurocomputing

Volumn 145, Issue , 2014, Pages 451-464

  Zhang, Ligang ^a,b   Tjondronegoro, Dian ^b   Chandran, Vinod ^b  

^a XI'AN UNIVERSITY OF TECHNOLOGY   (China)

^b QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Facial expression recognition; Facial occlusion; Gabor; Support vector machine; Template

Indexed keywords

ALGORITHMS; FACE RECOGNITION; FEATURE EXTRACTION; GESTURE RECOGNITION; SUPPORT VECTOR MACHINES;

FACIAL EXPRESSION RECOGNITION; FACIAL OCCLUSIONS; GABOR; LOCAL FACIAL REGIONS; MONTE CARLO ALGORITHMS; PARAMETER SENSITIVITIES; PERFORMANCE COMPARISON; TEMPLATE;

IMAGE MATCHING;

ANALYTIC METHOD; ARTICLE; AUTOMATED PATTERN RECOGNITION; AUTOMATION; COMPUTER SIMULATION; DATA BASE; FACE TEMPLATE; FACIAL EXPRESSION; FILTER; IMAGE QUALITY; MONTE CARLO METHOD; OCCLUSION HANDLING METHOD; PRIORITY JOURNAL; SENSITIVITY ANALYSIS; SUPPORT VECTOR MACHINE; SYSTEM ANALYSIS; TEMPLATE MATCHING;

EID: 84906816764     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.05.008     Document Type: Article

References (29)

1. Zeng Z., Pantic M., Roisman G.I., Huang T.S. A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31:39-58.
2. Towner H., Slater M. Reconstruction and recognition of occluded facial expressions using PCA. Affect. Comput. Intell. Interact. 2007, 36-47.
3. F. Bourel, Chibelushi, C.C., Low, A.A., Recognition of facial expressions in the presence of occlusion, in: Proceedings of the 12th British Machine Vision Conference, 2001, pp. 213-222.
4. F. Bourel, C.C. Chibelushi, A.A. Low, Robust facial expression recognition using a state-based model of spatially-localised facial dynamics, in: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, 2002, pp. 106-111.
5. N. Tan Dat, S. Ranganath, Tracking facial features under occlusions and recognizing facial expressions in sign language, in: Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG '08, 2008, pp. 1-7.
6. Hammal Z., Arguin M., Gosselin F. Comparing a novel model based on the transferable belief model with humans during the recognition of partially occluded facial expressions. J. Vis. 2009, 9:1-19.
7. M. Xia, X. YuLi, L. Zheng, H. Kang, L. ShanWei, Robust facial expression recognition based on RPCA and AdaBoost, in: Proceedings of the 10th Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS '09, 2009, pp. 113-116.
8. Jiang B., Jia K.-b. Research of Robust Facial Expression Recognition under Facial Occlusion Condition, Active Media Technology 2011, 92-100. Springer Berlin, Heidelberg.
9. I. Buciu, I. Kotsia, I. Pitas, Facial expression analysis under partial occlusion, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, (ICASSP '05), vol. 455, 2005, pp. 453-456.
10. Kotsia I., Buciu I., Pitas I. An analysis of facial expression recognition under partial facial image occlusion. Image Vis. Comput. 2008, 26:1052-1067.
11. Bassili J.N. Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. J. Pers. Soc. Psychol. 1979, 37:2049-2058.
12. Nusseck M., Cunningham D.W., Wallraven C., Bülthoff H.H. The contribution of different facial regions to the recognition of conversational expressions. J. Vis. 2008, 8(8):1-23. (1).
13. Serre T., Wolf L., Bileschi S., Riesenhuber M., Poggio T. Robust Object Recognition with Cortex-Like Mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29:411-426.
14. H. Jhuang, T. Serre, L. Wolf, T. Poggio, A Biologically Inspired System for Action Recognition, in: Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1-8.
15. Shen F., Tang Z., Xu J. Locality constrained representation based classification with spatial pyramid patches. Neurocomputing 2013, 101:104-115.
16. Z. Ligang, D. Tjondronegoro, V. Chandran, Toward a more robust facial expression recognition in occluded images using randomly sampled Gabor based templates, in: Proceedings of the 2011 IEEE International Conference on Multimedia and Expo (ICME), 2011, pp. 1-6.
17. Y. Miyakoshi, S. Kato, Facial emotion detection considering partial occlusion of face using Bayesian network, in: Proceedings of the 2011 IEEE Symposium on Computers and Informatics (ISCI), 2011, pp. 96-101.
18. S.F. Cotter, Sparse Representation for accurate classification of corrupted and occluded facial expressions, in: Proceedings of the IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), 2010, pp. 838-841.
19. S.F. Cotter, Recognition of occluded facial expressions using a fusion of localized sparse representation classifiers, in: Proceedings of the Digital Signal Processing Workshop and IEEE Signal Processing Education Workshop (DSP/SPE), 2011, IEEE, pp. 437-442.
20. Yongmian Z., Qiang J. Active and dynamic information fusion for facial expression understanding from image sequences. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27:699-714.
21. Huang X., Zhao G., Zheng W., Pietikäinen M. Towards a dynamic expression recognition system under facial occlusion. Pattern Recogn. Lett. 2012, 33:2181-2191.
22. J.-C. Lin, C.-H. Wu, W.-L. Wei, Facial action unit prediction under partial occlusion based on error weighted cross-correlation model, in: Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 3482-3486.
23. Halliday L.A. Emotion Detection: can Perceivers Identify an Emotion from Limited Information (M.S. Thesis) 2008, University of Canterbury, Christchurch, New Zealand.
24. Gabor D. Theory of communication. Inst. Electr. Eng. - J. - Radio Commun. Eng. 1946, 93:429-457.
25. M. Dunja, B. Janez, G. Marko, M.-F. Natasa, Feature selection using linear classifier weights: interaction with classification models, in: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, Sheffield, United Kingdom, 2004, pp. 234-241.
26. T. Kanade, J.F. Cohn, T. Yingli, Comprehensive database for facial expression analysis, in: Proceedings of the Fourth IEEE International Conference on 2000 Automatic Face and Gesture Recognition, 2000, pp. 46-53.
27. M. Lyons, S. Akamatsu, M. Kamachi, J. Gyoba, Coding facial expressions with Gabor wavelets, in: Proceedings of the Third IEEE International Conference on 1998 Automatic Face and Gesture Recognition, 1998, pp. 200-205.
28. Jongsun K., Jongmoo C., Juneho Y., Turk M. Effective representation using ICA for face recognition robust to local distortion and partial occlusion,. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27:1977-1981.
29. Ligang Z., Tjondronegoro D. Facial expression recognition using facial movement features. IEEE Trans. Affect. Comput. 2011, 2:219-229.