A bi-modal face recognition framework integrating facial expression with facial appearance

Pattern Recognition Letters

Volumn 30, Issue 12, 2009, Pages 1096-1109

  Tsai, Pohsiang ^a   Cao, Longbing ^a   Hintz, Tom ^a   Jan, Tony ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Biometrics; Facial appearance; Facial expression; Fusion techniques; Human Computer Interface (HCI); Multimodal biometrics

Indexed keywords

FACIAL APPEARANCE; FACIAL EXPRESSION; FUSION TECHNIQUES; HUMAN COMPUTER INTERFACE (HCI); MULTIMODAL BIOMETRICS;

BIOMETRICS; ELECTRIC CURRENTS; INTERFACES (COMPUTER);

FACE RECOGNITION;

EID: 67650214686     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2009.05.008     Document Type: Article

References (37)

1. Adini Y., Moses Y., and Ullman S. Face recognition: The problem of compensating for changes in illumination direction. IEEE Trans. Pattern Anal. Machine Intell. 19 7 (1997) 721-732
2. Belhumeur P.N., Hespanha J.P., and Kriegman D.J. Eigenfaces versus Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Pattern Anal. Machine Intell. 19 7 (1997) 711-729
3. Bishop C.M. Networks for Pattern Recognition (1995), Oxford University Press
4. Bronstein A.M., Bronstein M.M., and Kimmel R. Expression-invariant representations of faces. IEEE Trans. Image Process. 16 1 (2007) 188-197
5. Boyer K.W., Govindaraju V., and Ratha N.K. Introduction to the special issue on recent advances in biometric systems [Guest Editorial]. IEEE Trans. Syst. Man Cybernet. Part B 37 5 (2007) 1091-1095
6. Chang K.I., Bowyer K.W., and Flynn P.J. An evaluation of multimodal 2D + 3D face biometrics. IEEE Trans. Pattern Anal. Machine Intell. 27 4 (2005) 619-624
7. Chang K., Bowyer K.W., Sarkar S., and Victor B. Comparison and combination of ear and face images in appearance-based biometrics. IEEE Trans. Pattern Anal. Machine Intell. 25 9 (2003) 1160-1165
8. Chen L., Liao H.Y.M., Ko M.T., Lin J.C., and Yu G.J. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition 33 10 (2000) 1713-1726
9. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2000), Wiley, New York
10. Ivancevic, V., Kaine, A.K., McLindin, B.A., Sunde, J., 2003. Factor analysis of essential facial features. In: Internat. Conf. on Information Technology Interfaces, pp. 187-191.
11. Jain A.K., and Ross A. Multibiometric systems. Comm. ACM Special Issue Multimodal Interf. 47 (2004) 34-40
12. Jain A.K., Nandakumar K., Uludag U., and Lu X. Multimodal biometrics: Augmenting face with other cues. In: Zhao W., and Chellappa R. (Eds). Face Processing: Advanced Modelling and Methods (2006), Elsevier
13. Kirby M., and Sirovich L. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Trans. Pattern Anal. Machine Intell. 12 (1990) 103-108
14. Knappmeyer B., Thornton I.M., and Bulthoff H.H. The use of facial motion and facial form during the processing of identity. Vision Res. 43 18 (2003) 1921-1936
15. Liu Y., Schmidt K.L., Cohn J.F., and Mitra S. Facial asymmetry quantification for expression invariant human identification. Comput. Vision Image Understanding 91 1-2 (2003) 138-159
16. Lu J., Plataniotis K.N., and Venetsanopoulos A.N. Regularized discriminant analysis for the small sample size problem in face recognition. Pattern Recognition Lett. 24 16 (2003) 3079-3087
17. Lu J., Plataniotis K.N., and Venetsanopoulos A.N. Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recognition Lett. 26 2 (2005) 181-191
18. Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J., 1998. Coding facial expressions with Gabor wavelets. In: IEEE Internat. Conf. on Automatic Face and Gesture Recognition, pp. 200-205.
19. Lyons M.J., Budynek J., and Akamatsu S. Automatic classification of single facial images. IEEE Trans. Pattern Anal. Machine Intell. 21 12 (1999) 1357-1362
20. Martinez A.M. Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans. Pattern Anal. Machine Intell. 24 6 (2002) 748-763
21. National Science & Technology Council (NIST), 2006. Biometrics Glossary. .
22. Pantic M., and Rothkrantz L.J.M. Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Anal. Machine Intell. 22 12 (2000) 1424-1445
23. Pantic M., and Rothkrantz L.J.M. Expert system for automatic analysis of facial expressions. Image Vision Comput. 18 11 (2000) 881-905
24. Pantic, M., Bartlett, M.S., 2007. Machine analysis of facial expressions, face recognition. In: Delac, K., Grgic, M. (Eds.), I-Tech Education and Publishing, Vienna, Austria, pp. 377-416.
25. Pantic, M., Pentland, A., Nijholt, A., Huang, T.S., 2007. Human computing and machine understanding of human behavior: A survey. In: Huang, T.S., Nijholt, A., Pantic, M., Pentland, A. (Eds.), Artificial Intelligence for Human Computing. Lecture Notes in Artificial Intelligence, vol. 4451. Springer, pp. 47-71.
26. Phillips P.J., Hyeonjoon M., Rizvi S.A., and Rauss P.J. The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Machine Intell. 22 10 (2000) 1090-1104
27. Shakhnarovich, G., Lee, L., Darrell, T., 2001. Integrated face and gait recognition from multiple views. In: IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 439-446.
28. Tsai, P., Jan, T., 2005. Expression-invariant face recognition system using subspace model analysis. In: IEEE Internat. Conf. on Systems, Man and Cybernetics, vol. 2, pp. 1712-1717.
29. Tsai, P., Tran, T., Hintz, T., Jan, T., 2008. Adaptive multiple experts system for personal identification using facial behaviour biometrics. In: IEEE Internat. Conf. on Multimedia Signal Processing, pp. 660-665.
30. Tsai, P., Tran, T., Hintz, T., Jan, T., 2008. An evaluation of bi-modal facial appearance + facial expression face biometrics. In: IEEE Internat. Conf. on Pattern Recognition, pp. 1-5.
31. Toh K.A., Kim Y., Lee S., and Kim J. Fusion of visual and infra-red face scores by weighted power series. Pattern Recognition Lett. 29 5 (2008) 603-615
32. Tsai, P., Hintz, T., Jan, T., 2007. Facial behaviour as behaviour biometric? An empirical study. In: IEEE Conf. on Systems, Man, and Cybernetics, pp. 3917-3922.
33. Valstar, M., Pantic, M., 2006. Fully automatic facial action unit detection and temporal analysis. In: Internat. Conf. on Computer Vision and Pattern Recognition Workshop, pp. 149-149.
34. Wechsler H. Reliable Face Recognition Methods: System Design, Implementation and Evaluation (2007), Springer
35. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques (2005), Elsevier, New York
36. Yang, M.H., 2002. Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using Kernel methods. In: IEEE Internat. Conf. on Automatic Face and Gesture Recognition, pp. 215-220.
37. Zhou X., and Bhanu B. Integrating face and gait for human recognition at a distance in video. IEEE Trans. Syst. Man Cybernet. Part B 37 5 (2007) 1119-1137