Robust facial feature tracking under varying face pose and facial expression

Pattern Recognition

Volumn 40, Issue 11, 2007, Pages 3195-3208

  Tong, Yan ^a   Wang, Yang ^b   Zhu, Zhiwei ^c   Ji, Qiang ^a  

^a RENSSELAER POLYTECHNIC INSTITUTE   (United States)

^b CSIRO   (Australia)

^c SARNOFF CORPORATION   (United States)

Author keywords

Active shape model; Face pose estimation; Facial feature detection and tracking

Indexed keywords

DATA ACQUISITION; FEATURE EXTRACTION; HIERARCHICAL SYSTEMS; MATHEMATICAL MODELS;

ACTIVE SHAPE MODEL; FACE POSE ESTIMATION; FACIAL FEATURE DETECTION AND TRACKING; GABOR WAVELETS; GRAY-LEVEL PROFILES; SPATIAL RELATIONS; SWITCHING HYPOTHESIZED MEASUREMENTS;

FACE RECOGNITION;

EID: 34250877417     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.02.021     Document Type: Article

References (49)

1. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, Proceedings of International Joint Conference on Artificial Intelligence, 1981, pp. 674-679.
2. J. Shi, C. Tomasi, Good features to track, Proceedings of CVPR94, 1994, pp. 593-600.
3. F. Bourel, C. Chibelushi, A. Low, Robust facial feature tracking, Proceedings of 11th British Machine Vision Conference, vol. 1, 2000, pp. 232-241.
4. C. Tomasi, T. Kanade, Detection and tracking of point features, Carnegie Mellon University, Technical Report CMU-CS-91-132.
5. C. Poelman, The paraperspective and projective factorization method for recovering shape and motion, Carnegie Mellon University, Technical Report CMU-CS-95-173.
6. L. Torresani, C. Bregler, Space-time tracking, Proceedings of ECCV02, vol. 1, 2002, pp. 801-812.
7. Z. Zhu, Q. Ji, K. Fujimura, K. Lee, Combining Kalman filtering and mean shift for real time eye tracking under active IR illumination, Proceedings of ICPR02, vol. 4, 2002, pp. 318-321.
8. Kass M., WItkin A., and Terzopoulos D. Snakes: active contour models. Int. J. Comput. Vision 1 4 (1988) 321-331
9. Yuille A., Haallinan P., and Cohen D.S. Feature extraction from faces using deformable templates. Int. J. Comput. Vision 8 2 (1992) 99-111
10. Cootes T.F., Taylor C.J., Cooper D.H., and Graham J. Active shape models-their training and application. Comput. Vision Image Understanding 61 1 (1995) 38-59
11. Cootes T.F., Edwards G.J., and Taylor C. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23 6 (2001) 681-685
12. X.W. Hou, S.Z. Li, H.J. Zhang, Q.S. Cheng, Direct appearance models, Proceedings of CVPR01, vol. 1, 2001, pp. 828-833.
13. Wiskott L., Fellous J.M., Krüger N., and der Malsburg C.V. Face recognition by elastic bunch graph matching. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 775-779
14. Jones M.J., and Poggio T. Multi-dimensional morphable models: a framework for representing and matching object classes. Int. J. Comput. Vision 29 (1998) 107-131
15. Sclaroff S., and Isidoro J. Active blobs: region-based, deformable appearance models. Comput. Vision Image Understanding 89 2-3 (2003) 197-225
16. S.J. McKenna, S. Gong, R.P. Würtz, J. Tanner, D. Banin, Tracking facial feature points with Gabor wavelets and shape models, Proceedings of International Conference on Audio- and Video-based Biometric Person Authentication, 1997, pp. 35-42.
17. M. Rogers, J. Graham, Robust active shape model search, Proceedings of ECCV, vol. 4, 2002, pp. 517-530.
18. Cootes T.F., Wheeler G.V., Walker K.N., and Taylor C.J. View-based active appearance models. Image Vision Comput. 20 9 (2002) 657-664
19. T. Heap, D. Hogg, Wormholes in shape space: tracking through discontinuous changes in shape, Proceedings of ICCV98, 1998, pp. 344-349.
20. Cootes T.F., and Taylor C.J. A mixture model for representing shape variation. Image Vision Comput. 17 8 (1999) 567-573
21. C.M. Christoudias, T. Darrell, On modelling nonlinear shape-and-texture appearance manifolds, Proceedings of CVPR05, vol. 2, 2005, pp. 1067-1074.
22. Y. Li, S. Gong, H. Liddell, Modelling faces dynamically across views and over time, Proceedings of ICCV01, vol. 1, 2001, pp. 554-559.
23. V. Blanz, T. Vetter, A morphable model for the synthesis of 3D faces, Siggraph 1999, Computer Graphics Proceedings, 1999, pp. 187-194.
24. J. Xiao, S. Baker, I. Matthews, T. Kanade, Real-time combined 2 D + 3 D active appearance models, Proceedings of CVPR04, vol. 2, 2004, pp. 535-542.
25. Sozou P.D., Cootes T.F., Taylor C.J., and di Mauro E. Non-linear generalization of point distribution models using polynomial regression. Image Vision Comput. 13 5 (1995) 451-457
26. S. Romdhani, S. Gong, A. Psarrou, Multi-view nonlinear active shape model using kernel PCA, Proceedings of BMVC, 1999, pp. 483-492.
27. Yan S., Hou X., Li S.Z., Zhang H., and Cheng Q. Face alignment using view-based direct appearance models, Special issue on facial image processing, analysis and synthesis. Int. J. Imaging Syst. Technol. 13 1 (2003) 106-112
28. K. Grauman, T. Darrell, Fast contour matching using approximate earth movers's distance, Proceedings of CVPR04, vol. 1, 2004, pp. 220-227.
29. Tian Y., Kanade T., and Cohn J.F. Recognizing action units for facial expression analysis. IEEE Trans. on Pattern Anal. Mach. Intell. 23 2 (2001) 97-115
30. A. Yilmaz, K. Shafique, M. Shah, Estimation of rigid and non-rigid facial motion using anatomical face model, Proceedings of ICPR02, vol. 1, 2002, pp. 377-380.
31. Tao H., and Huang T.S. Visual estimation and compression of facial motion parameters: elements of a 3D model-based video coding system. Int. J. Comput. Vision 50 2 (2002) 111-125
32. Goldenstein S.K., Vogler C., and Metaxas D. Statistical cue integration in DAG deformable models. IEEE Trans. Pattern Anal. Mach. Intell. 25 7 (2003) 801-813
33. Xiao J., Chai J., and Kanade T. A closed-form solution to non-rigid shape and motion recovery. Int. J. Comput. Vision 67 2 (2006) 233-246
34. Dryden I.L., and Mardia K.V. Statistical Shape Analysis (1998), Wiley, Chichester
35. Or S.H., Luk W.S., Wong K.H., and King I. An efficient iterative pose estimation algorithm. Image Vision Comput. 16 5 (1998) 353-362
36. Fischler M.A., and Bolles R.C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24 6 (1981) 381-395
37. Trucco E., and Verri A. Introductory Techniques for 3-D Computer Vision (1998), Prentice-Hall, Englewood Cliffs
38. Y. Wang, T. Tan, K.-F. Loe, Joint region tracking with switching hypothesized measurements, Proceedings of ICCV03, vol. 1, 2003, pp. 75-82.
39. H. Gu, Q. Ji, Z. Zhu, Active facial tracking for fatigue detection, Proceedings of Sixth IEEE Workshop on Applications of Computer Vision, 2002, pp. 137-142.
40. Daugman J. Complete discrete 2D Gabor transforms by neural networks for image analysis and compression. IEEE Trans. ASSP 36 7 (1988) 1169-1179
41. Z. Zhang, M. Lyons, M. Schuster, S. Akamatsu, Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron, Proceedings of FGR98, 1998, pp. 454-459.
42. Y. Tian, T. Kanade, J.F. Cohn, Evaluation of Gabor-wavelet-based facial action unit recognition in image sequences of increasing complexity, Proceedings of FGR02, 2002, pp. 218-223.
43. F. Jiao, S.Z. Li, H.Y. Shum, D. Schuurmans, Face alignment using statistical models and wavelet features, Proceedings of CVPR03, vol. 1, 2003, pp. 321-327.
44. Fleet D.J., and Jepson A.D. Computation of component image velocity from local phase information. Int. J. Comput. Vision 5 1 (1990) 77-104
45. Theimer W.M. Phase-based binocular vergence control and depth reconstruction using active vision. CVGIP: Image Understanding 60 3 (1994) 343-358
46. P. Wang, Q. Ji, Learning discriminant features for multi-view face and eye detection, Proceedings of CVPR05, vol. 1, 2005, pp. 373-379.
47. P. Wang, M.B. Green, Q. Ji, J. Wayman, Automatic eye detection and its validation, IEEE Workshop on Face Recognition Grand Challenge Experiments (with CVPR05), vol. 3, 2005, pp. 164-164.
48. Viola P., and Jones M. Robust real-time object detection. Int. J. Comput. Vision 57 2 (2004) 137-154
49. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, W. Worek, Overview of the face recognition grand challenge, Proceedings of CVPR05, vol. 1, 2005, pp. 947-954.