Real-time face detection and motion analysis with application in "liveness" assessment

IEEE Transactions on Information Forensics and Security

Volumn 2, Issue 3, 2007, Pages 548-558

  Kollreider, Klaus ^b   Fronthaler, Hartwig ^b   Faraj, Maycel Isaac ^b   Bigun, Josef ^a,b  

^a IEEE

^b HALMSTAD UNIVERSITY   (Sweden)

Author keywords

AdaBoost; Antispoofing; Face detection; Landmark detection; Lip reading; Liveness; Object detection; Optical flow of lines; Quantized angles; Real time processing; Support vector machine (SVM)

Indexed keywords

COMPUTATIONAL METHODS; FEATURE EXTRACTION; OBJECT RECOGNITION; REAL TIME SYSTEMS; SUPPORT VECTOR MACHINES;

ADABOOST; ANTISPOOFING; LANDMARK DETECTION; LIP READING; OPTICAL FLOW OF LINES; QUANTIZED ANGLES;

FACE RECOGNITION;

EID: 34548094310     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2007.902037     Document Type: Article

References (29)

1. M.-H. Yang, D. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal., Mach. Intell., vol. 24, no. 1, pp. 34-58, Jan. 2002.
2. M. Hamouz, J. Kittler, J. Kamarainen, P. Paalanen, H. Kalviainen, and J. Matas, "Feature-based affine-invariant localization of faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 9, pp. 1490-1495, Sep. 2005.
3. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognit. Neuroci. (Winter), vol. 3, no. 1, pp. 71-86, 1991.
4. K. K. Sung and T. Poggio, "Example based learning for view-based human face detection," Cambridge, MA, 1994, Tech. Rep.
5. H. Rowley, S. Baluja, and T. Kanade, "Human face detection in visual scenes," Proc. Advances in Neural Information Processing Systems 8, pp. 875-881, 1996.
6. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learning, vol. 20, pp. 273-297, 1995.
7. E. Osuna, R. Freund, and F. Girosi, "Training support vector machines: An application to face detection," in IEEE Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico, Jun. 17-19, 1997, pp. 130-136.
8. H. Schneiderman and T. Kanade, "Probabilistic modeling of local appearance and spatial relationships for object recognition," in Proc. CVPR, 1998, vol. 00, pp. 45-15.
9. D. Nguyen, D. Halupka, P. Aarabi, and A. Sheikholeslami, "Real-time face detection and lip feature extraction using field-programmable gate arrays," IEEE Trans. Syst. Man Cybern., B, Cybern., vol. 36, no. 4, pp. 902-912, Aug. 2006.
10. Y. Freund and R. E. Shapire, "A decision-theoretic generalization of online learning and an application to boosting," J. Comput. Syst. Sci., vol. 5, no. l, pp. 119-139, 1997.
11. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. CVPR, Kauai, HI, Dec. 2001, pp. 511-518.
12. B. Froeba and C. Kueblbeck, "Real-time face detection using edge-orientation matching," in Proc. 3rd Int. Conf. Audio- and Video-Based Biometric Person Authentication, London, U.K., 2001, pp. 78-83.
13. S. Z. Li, L. Zhu, Z. Zhang, A. Blake, H. Zhang, and H. Shum, "Statistical learning of multi-view face detection," in Proc. 7th Eur. Conf. Computer Vision-Part IV, London, U.K., 2002, pp. 67-81.
14. J. Sochman and J. Matas, "WaldBoost learning for time constrained sequential detection," in Proc. IEEE Comput. Soc. Conf. Computer Vision and Pattern Recognition, Washington, DC, 2005, vol. 2, pp. 150-156.
15. J. Bigun, Vision with Direction. Berlin, Germany; Springer, 2006.
16. K. Kollreider, H. Fronthaler, and J. Bigun, "Evaluating liveness by face images and the structure tensor," in Proc. 4th IEEE Workshop on Automatic Identification Advanced Technologies AutoI, Buffalo, NY, Oct. 17-18, 2005, pp. 75-80.
17. F. Smeraldi and J. Bigun, "Retinal vision applied to facial features detection and face authentication," Pattern Recognit. Lett., vol. 23, pp. 463-475, 2002.
18. J. Bigun, H. Fronthaler, and K. Kollreider, "Assuring liveness in biometric identity authentication by real-time face tracking," in Proc. IEEE Int. Conf. Computational Intelligence for Homeland Security and Personal Safety, Venice, Italy, Jul. 21-22, 2004, pp. 104-112, IEEE Catalog EX815, ISBN 0-7803-8381-8.
19. J. Li, Y. Wang, T. Tan, and A. K. Jain, "Live face detection based on the analysis of fourier spectra," in Biometric Technology for Human Identification. Bellingham, WA: SPIE, 2004, pp. 296-303.
20. T. Choudhury, B. Clarkson, T. Jebara, and A. Pentland, "Multimodal person recognition using unconstrained audio and video," in Proc. 2nd Int. Conf. Audio-Visual Biometric Person Authentication, Washington, DC, Mar. 22-23, 1999.
21. I. H. W. G. C. H. Bredin and A. Miguel, "Detecting replay attacks in audiovisual identity verification," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Toulouse, France, May 14-19, 2006.
22. S. Dupont and J. Luettin, "Audio-visual speech modelling for continuous speech recognition," IEEE Trans. Multimedia, vol. 2, no. 3, pp. 141-151, Sep. 2000.
23. M. I. Faraj and J. Bigun, "Person verification by lip-motion," in Computer Vision and Pattern Recognition Workshop on Biometrics, Piscataway, NJ, Jun. 2006, pp. 37-44.
24. N. T. J. Luettin and S. Beet, "Speaker identification by lipreading," in Proc. 4th Int. Conf. Spoken Language Processing, Oct. 1996, vol. 1, pp. 62-65.
25. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal Mach. Intel!., vol. 19, no. 7, pp. 711-720, Jul. 1997.
26. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre, "XM2VTSDB: The extended M2VTS database," in Proc. Audio and Video Based Person Authentication, 1999, pp. 72-77.
27. J. Bigun, T. Bigun, and K. Nilsson, "Recognition by symmetry derivatives and the generalized structure tensor," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 12, pp. 1590-1605, Dec. 2004.
28. J. B. N. Pal, "On cluster validity for the fuzzy c-means model," IEEE Trans. Fuzzy Syst., vol. 3, no. 3, pp. 370-379, Aug. 1995.
29. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," 2001 [Online]. Available: http://www.csie.ntu.edu.tw/-cjlin/ libsvm.