A graphical model based solution to the facial feature point tracking problem

Image and Vision Computing

Volumn 29, Issue 5, 2011, Pages 335-350

  Coşar, Serhan ^a   Çetin, Müjdat ^a  

^a SABANCI UNIVERSITY   (Turkey)

Author keywords

Facial expression analysis; Facial feature tracking; Graphical models; Human computer interaction; Occlusion detector; Temporal and spatial models

Indexed keywords

DETECTORS; FACE RECOGNITION; GRAPHIC METHODS; INTERFACES (COMPUTER); KNOWLEDGE MANAGEMENT; SPEECH RECOGNITION;

FACIAL EXPRESSION ANALYSIS; FACIAL FEATURE TRACKING; GRAPHICAL MODELS; OCCLUSION DETECTOR; TEMPORAL AND SPATIAL MODELS;

HUMAN COMPUTER INTERACTION;

EID: 79551546716     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2010.12.001     Document Type: Article

References (41)

1. R.-S. Wang, and Y. Wang Facial feature extraction and tracking in video sequences IEEE First Workshop on Multimedia Signal Processing 1997 233 238
2. J.-W. Kima, M. Song, I.-J. Kim, Y.-M. Kwon, H.-G. Kim, and S.C. Ahn Automatic fdp/fap generation from an image sequence The 2000 IEEE International Symposium on Circuits and Systems, Proceedings 2000 ISCAS Geneva 40 43
3. K.-W. Wong, K.-M. Lam, W.-C. Siu, and K.-M. Tse Face segmentation and facial feature tracking for videophone applications Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing 2001 518 521
4. C. Tomasi, and T. Kanade Detection and tracking of point features Tech. Rep. CMU-CS-91-132 April 1991 Carnegie Mellon University
5. F. Bourel, C. Chibelushi, and A. Low Robust facial feature tracking Proc. 11th British Machine Vision Conference, Bristol, England vol. 1 2000 232 241
6. G. H, J. Q Information extraction from image sequences of real-world facial expressions Machine Vision and Applications 16 2 2005 105 115
7. J. Q, Y. X Real-time eye, gaze, and face pose tracking for monitoring driver vigilance Real-Time Imaging 8 5 2002 357 377
8. J. Wieghardt, R.P. Würtz, and C. von der Malsburg Gabor-based feature point tracking with automatically learned constraints Proceedings ECCV 2002, Copenhagen 2002
9. R.S. Feris, and R.M.C. Junior Locating and tracking facial landmarks using gabor wavelet networks ICAPR'01: Proceedings of the Second International Conference on Advances in Pattern Recognition 2001 Springer-Verlag London, UK 311 320
10. R. Feris, J. Cesar, and R.M. Tracking facial features using gabor wavelet networks Proceedings XIII Brazilian Symposium on Computer Graphics and Image Processing 2000 22 27
11. T.F. Cootes, G.J. Edwards, and C.J. Taylor Active appearance models ECCV'98: Proceedings of the 5th European Conference on Computer Vision-Volume II 1998 Springer-Verlag London, UK 484 498 (Pubitemid 128093046)
12. K.-W. Wan, K.-M. Lam, and K.-C. Ng An accurate active shape model for facial feature extraction Pattern Recognition Letters 26 15 2005 2409 2423 (Pubitemid 41394297)
13. Y. Tong, Y. Wang, Z. Zhu, and Q. Ji Facial feature tracking using a multi-state hierarchical shape model under varying face pose and facial expression 18th International Conference on Pattern Recognition 2006 283 286 (Pubitemid 46531898)
14. T. Chen, and R.R. Rao Audio-visual integration in multimodal communication Proceedings of the IEEE 1998 837 852 (Pubitemid 128720227)
15. C. Hu, R. Feris, and M. Turk Real-time view-based face alignment using active wavelet networks IEEE International Workshop on Analysis and Modeling of Faces and Gestures 2003 215 221
16. J. Ahlberg Using the active appearance algorithm for face and facial feature tracking IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems 2001 68 72
17. T. Goto, S. Kshirsagar, and N. Magnenat-Thalmann Automatic face cloning and animation using real-time facial feature tracking and speech acquisition IEEE Signal Processing Magazine 18 2001 17 25 (Pubitemid 32508870)
18. J. Xiao, S. Baker, I. Matthews, and T. Kanade Real-time combined 2d + 3d active appearance models Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Vol. 2 2004 535 542
19. C. Su, and L. Huang Spatio-temporal graphical-model-based multiple facial feature tracking EURASIP Journal on Applied Signal Processing 13 2005 2091 2100 (Pubitemid 41767945)
20. A.M. Baumberg, and D.C. Hogg An efficient method for contour tracking using active shape models In Proceeding of the Workshop on Motion of Nonrigid and Articulated Objects. IEEE Computer Society 1994 194 199
21. D. S. Bolme, Elastic bunch graph matching, Master's thesis, Colorado State University (2003).
22. J. Pearl Probabilistic Reasoning in Intelligent Systems 1988 Morgan Kaufman San Mateo
23. Y. Weiss Correctness of local probability propagation in graphical models with loops Neural Computation 12 1 2000 1 41
24. E. Sudderth, Embedded trees: estimation of gaussian processes on graphs with cycles, Master's thesis, MIT (2002).
25. A. Azarbayejani, B. Horowitz, and A. Pentland Recursive estimation of structure and motion using relative orientation constraints Computer Vision and Pattern Recognition, 1993. Proceedings CVPR'93., 1993 IEEE Computer Society Conference on 1993 294 299
26. C.S. Wiles, A. Maki, and N. Matsuda Hyperpatches for 3d model acquisition and tracking IEEE Transactions on Pattern Analysis and Machine Intelligence 23 12 2001 1391 1403 (Pubitemid 34035572)
27. R. Subbarao, P. Meer, and Y. Genc A balanced approach to 3d tracking from image streams ISMAR'05: Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society, Washington, DC, USA 2005 70 78 (Pubitemid 44733996)
28. M. Cordea, E. Petriu, N. Georganas, D. Petriu, and T. Whalen 3d head pose recovery for interactive virtual reality avatars Instrumentation and Measurement Technology Conference, 2001. IMTC 2001 Proceedings of the 18th IEEE vol. 1 2001 72 77 1 (Pubitemid 32883990)
29. L. Vacchetti, V. Lepetit, and P. Fua Stable real-time 3d tracking using online and offline information IEEE Transactions on Pattern Analysis and Machine Intelligence 26 2004 1385 1391
30. M. Pupilli, and A. Calway Real-time camera tracking using known 3d models and a particle filter Pattern Recognition, 2006. ICPR 2006 18th International Conference on Vol. 1 2006 199 203
31. H. Sidenbladh, M.J. Black, and D.J. Fleet Stochastic tracking of 3d human figures using 2d image motion In European Conference on Computer Vision 2000 702 718
32. E. Sudderth, M. Mandel, W. Freeman, and A. Willsky Visual hand tracking using nonparametric belief propagation Computer Vision and Pattern Recognition Workshop, 2004. CVPRW'04. Conference on 2004 189-189
33. E. Trucco, and A. Verri Introductory Techniques for 3-D Computer Vision 1998 Prentice Hall PTR Upper Saddle River, NJ, USA
34. D.A. Forsyth, and J. Ponce Computer Vision: A Modern Approach 2002 Prentice Hall
35. M. Stegmann, B. Ersboll, and R. Larsen Fame-a flexible appearance modeling environment Medical Imaging IEEE Transactions on vol. 22, (10) 2003 1319 1331
36. T. Kanade, J. Cohn, and Y.-L. Tian Comprehensive database for facial expression analysis Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00) 2000 46 53
37. R. Gross, I. Matthews, and S. Baker Active appearance models with occlusion Image and Vision Computing 24 1 2006 593 604 (Pubitemid 43867828)
38. M. Storer, P.M. Roth, M. Urschler, H. Bischof, and J.A. Birchbauer Active appearance model fitting under occlusion using fast-robust PCA In: Proc. International Conference on Computer Vision Theory and Applications (VISAPP) 2009 130 137
39. M.L. Cascia, and S. Sclaroff Fast, reliable head tracking under varying illumination IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1998 322 336
40. H. Abut, H. Erdoǧan, A. Erçil, B. Çürü klü, H. Koman, F. Taş, A. Argunşah, S. Coşar, B. Akan, H. Karabalkan, E. Çökelek, R. FIcIcI, V. Sezer, S. DanIş, M. Karaca, M.A.M. Uzunbaş, K. Eritmen, C. KalaycIoǧlu, M. Imamoǧlu, C. Karabat, and M. Peyiç Data collection with 'uyanik': too much pain; but gains are coming Proc. Biennial on DSP for In-Vehicle and Mobile Systems, Istanbul, Turkey 2007
41. S. Coşar, Facial feature point tracking based on a graphical model framework, Master's thesis, SabancI University (January 2008).