Facial expression recognition from near-infrared videos

Image and Vision Computing

Volumn 29, Issue 9, 2011, Pages 607-619

  Zhao, Guoying ^a   Huang, Xiaohua ^a,c   Taini, Matti ^a   Li, Stan Z ^b   Pietikäinen, Matti ^a  

^a UNIVERSITY OF OULU   (Finland)

^b INSTITUTE OF AUTOMATION   (China)

^c SOUTHEAST UNIVERSITY   (China)

Author keywords

Component based facial features; Facial expression recognition; Near infrared (NIR); Spatiotemporal descriptors; Visible light (VIS)

Indexed keywords

BINARY SEQUENCES; FEATURE EXTRACTION; GESTURE RECOGNITION; INFRARED DEVICES; VIDEO RECORDING;

FACIAL EXPRESSION RECOGNITION; FACIAL FEATURE; NEAR INFRA RED; SPATIOTEMPORAL DESCRIPTORS; VISIBLE LIGHT;

FACE RECOGNITION;

EID: 80052725518     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2011.07.002     Document Type: Article

References (42)

1. Y. Adini, Y. Moses, and S. Ullman Face recognition: the problem of compensating for changes in illumination direction IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 721 732 (Pubitemid 127762264)
2. X. Chen, P.J. Flynn, and K.W. Bowyer IR and visible light face recognition Computer Vision and Image Understanding 99 2005 332 358 (Pubitemid 41162461)
3. R. Duda, P. Hart, and D. Stork Pattern Classification 2001 Wiley & Sons New York
4. B. Fasel, and J. Luettin Automatic facial expression analysis: a survey Pattern Recognition 36 2003 259 275
5. X. Feng, A. Hadid, and M. Pietikäinen A coarse-to-fine classification scheme for facial expression recognition Image Analysis and Recognition, ICIAR 2004 Proceedings Lecture Notes in Computer Science 3212 2004 Springer 668 675 (Pubitemid 39749771)
6. X. Feng, M. Pietikäinen, and A. Hadid Facial Expression Recognition with Local Binary Patterns and Linear Programming Pattern Recognition and Image Analysis 2 2005 550 552
7. Face Recognition Vendor Tests (FRVT) Nat'l Inst. of Standards and Technology http://www.frvt.org 2006
8. A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman From few to many: illumination cone models for face recognition under variable lighting and pose IEEE Transactions on Pattern Analysis and Machine Intelligence 26 6 2001 643 660 (Pubitemid 32585276)
9. R. Gross, and V. Brajovic An image preprocessing algorithm for illumination invariant face recognition International Conference on Audio- and Video-Based Biometric Person Authentication 2003 10 18
10. B. Heisele, and T. Koshizen Components for Face Recognition Int'l Conf. Face and Gesture Recognition 2004
11. J. Holappa, T. Ahonen, and M. Pietikäinen An optimized illumination normalization method for face recognition IEEE International Conference on Biometrics: Theory, Applications and Systems 2008
12. Y. Ivanov, B. Heisele, and T. Serre Using component features for face recognition Int'l Conference on Automatic Face and Gesture Recognition 2004 421 426
13. T. Kanade, J.F. Cohn, and Y. Tian Comprehensive database for facial expression analysis Int'l Conf. Face and Gesture Recognition 2000 46 53
14. C. Kim, J. Oh, and C.H. Choi Combined subspace method single global and local features for face recognition International Joint Conference on Neural Network 2005 2030 2035 (Pubitemid 44591510)
15. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combing classifiers IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 1998 226 239
16. S.G. Kong, J. Heo, B. Abidi, J. Paik, and M. Abidi Recent advantages in visual and infrared face recognition - a review Computer Vision and Image Understanding 97 1 2005 103 135 (Pubitemid 40049163)
17. S. Kumano, K. Otsuka, J. Yamato, E. Maeda, and Y. Sato Pose-invariant facial expression recognition using variable-intensity templates International Journal of Computer Vision 83 2009 178 194
18. S.Z. Li, R. Chu, S. Liao, and L. Zhang Illumination invariant face recognition using near-infrared images, IEEE Trans Pattern Analysis and Machine Intelligence 29 4 2007 627 639 (Pubitemid 46464403)
19. Z. Li, J. Imai, and M. Kaneko Facial-component-based bag of words and PHOG descriptor for facial expression recognition IEEE International Conference on Systems, Man, and Cybernetics 2009 1353 1358
20. S. Liao, W. Fan, A.C.S. Chung, and D.-Y. Yeung Facial expression recognition using advanced local binary patterns, Tsallis Entropies and Global Appearance Features International Conference on Image Processing 2006 665 668
21. A. Mehrabian Communication without words Psychology Today 2 4 1968 53 56
22. S. Milborrow, and F. Nicolls Locating facial features with extended active shape model European Conference on Computer Vision 2008 504 513
23. T. Ojala, M. Pietikäinen, and T. Mäenpää Multiresolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Transactions on Pattern Analysis and Machine Intelligence 24 7 2002 971 987 (Pubitemid 34835471)
24. M. Pantic, and L.J.M. Rothkrantz Automatic analysis of facial expressions: the state of the art IEEE Transactions on Pattern Analysis and Machine Intelligence 22 12 2000 1424 1455
25. D.A. Socolinsky, and A. Selinger A comparative analysis of face recognition performance with visible and thermal infrared imagery International Conference on Pattern Recognition 2002 217 222 (Pubitemid 44850984)
26. C. Shan, S. Gong, and P.W. McOwan Facial expression recognition based on local binary patterns: a comprehensive study Image and Vision Computing 27 6 2009 803 816
27. D.A. Socolinsky, A. Selinger, and J.D. Neuheisel Face recognition with visible and thermal infrared imagery Computer Vision and Image Understanding 91 1 2004 72 114
28. Y. Sun, and L. Yin Evaluation of spatio-temporal regional features for 3D face analysis IEEE Computer Vision and Pattern Recognition Workshop 2009 13 19
29. M. Taini, G. Zhao, S.Z. Li, and M. Pietikäinen Facial expression recognition from near-infrared video sequences International Conference on Pattern Recognition 2008
30. M. Taini, G. Zhao, and M. Pietikäinen Weight-based facial expression recognition from near-infrared video sequences Image Analysis, SCIA 2009 Proceedings Lecture Notes in Computer Science 5575 2009 239 248
31. X. Tan, and B. Triggs Enhanced local texture feature sets for face recognition under difficult lighting conditions International Workshop on Analysis and Modeling of Faces and Gestures 2007 168 182
32. Y. Tian, T. Kanade, and J. Cohn Recognizing action units for facial expression analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 23 2 2001 97 115 (Pubitemid 32254704)
33. Y.L. Tian, T. Kanade, and J.F. Cohn Facial expression analysis S.Z. Li, A.K. Jain, Handbook of Face Recognition 2005 Springer 247 276
34. R.V. Mises Mathematical Theory of Probability and Statistics 1964 Academic Press New York
35. J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry, and Ma Yi Robust face recognition via sparse representation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2 2009 210 227
36. S.Y. Zhao, and R.R. Grigat An automatic face recognition system in the near infrared spectrum International Conference on Machine Learning and Data Mining in pattern recognition 2005 437 444
37. G. Zhao, and M. Pietikäinen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Transactions on Pattern Analysis and Machine Intelligence 29 6 2007 915 928 (Pubitemid 46667407)
38. G. Zhao, M. Barnard, and M. Pietikäinen Lipreading with local spatiotemporal descriptors IEEE Transactions on Multimedia. 11 7 2009 1254 1263
39. G. Zhao, and M. Pietikäinen Boosted multi-resolution spatiotemporal descriptors for facial expression recognition Pattern Recognition Letters 30 12 2009 1117 1127
40. Y. Zhang, and Q. Ji Active and dynamic information fusion for facial expression understanding from image sequences IEEE Transactions on Pattern Analysis and Maching Intelligence 27 5 2005 699 714 (Pubitemid 40608403)
41. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang Survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Transactions on Pattern Analysis and Machine Intelligence 31 1 2009 39 58
42. X. Zou, J. Kittler, and K. Messer Face Recognition Using Active Near-IR Illumination British Machine Vision Conference 2005 209 219