Feature-based lucas-kanade and active appearance models

IEEE Transactions on Image Processing

Volumn 24, Issue 9, 2015, Pages 2617-2632

  Antonakos, Epameinondas ^a   Alabort I Medina, Joan ^a   Tzimiropoulos, Georgios ^b   Zafeiriou, Stefanos P ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Active Appearance Models; Dense image feature descriptors; Face alignment; Face fitting; Lucas Kanade

Indexed keywords

ALIGNMENT; IMAGE RECOGNITION;

ACTIVE APPEARANCE MODELS; FACE ALIGNMENT; FACE FITTING; IMAGE FEATURES; LUCAS-KANADE;

ITERATIVE METHODS;

ALGORITHM; ANATOMY AND HISTOLOGY; BIOMETRY; FACE; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; PROCEDURES;

ALGORITHMS; BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED;

EID: 84930505487     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2431445     Document Type: Article

References (61)

1. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision", in Proc. Int. Joint Conf. Artif. Intell., vol. 81, 1981, pp. 674-679.
2. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
3. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models", Int. J. Comput. Vis., vol. 1, no. 4, pp. 321-331, Jan. 1988.
4. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active shape models-Their training and application", Comput. Vis. Image Understand., vol. 61, no. 1, pp. 38-59, Jan. 1995.
5. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: A unifying framework", Int. J. Comput. Vis., vol. 56, no. 3, pp. 221-255, Feb. 2004.
6. I. Matthews and S. Baker, "Active appearance models revisited", Int. J. Comput. Vis., vol. 60, no. 2, pp. 135-164, Nov. 2004.
7. S. Baker, R. Gross, I. Matthews, and T. Ishikawa, "Lucas-Kanade 20 years on: A unifying framework: Part 2", Robotics Inst., School Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-RI-TR-03-01, Feb. 2003.
8. G. Papandreou and P. Maragos, "Adaptive and constrained algorithms for inverse compositional active appearance model fitting", in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
9. G. D. Hager and P. N. Belhumeur, "Efficient region tracking with parametric models of geometry and illumination", IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 10, pp. 1025-1039, Oct. 1998.
10. S. Baker and I. Matthews, "Equivalence and efficiency of image alignment algorithms", in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Dec. 2001, pp. I-1090-I-1097.
11. C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. T. Freeman, "SIFT flow: Dense correspondence across different scenes", in Proc. Eur. Conf. Comput. Vis., 2008, pp. 28-42.
12. J. Alabort-i-Medina and S. Zafeiriou, "Bayesian active appearance models", in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2014, pp. 3438-3445.
13. G. Tzimiropoulos and M. Pantic, "Gauss-Newton deformable part models for face alignment in-the-wild", in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1851-1858.
14. R. Mégret, J. Authesserre, and Y. Berthoumieu, "Bidirectional composition on lie groups for gradient-based image alignment", IEEE Trans. Image Process., vol. 19, no. 9, pp. 2369-2381, Sep. 2010.
15. G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "Robust and efficient parametric face alignment", in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1847-1854.
16. S. Lucey, S. Sridharan, R. Navarathna, and A. B. Ashraf, "Fourier Lucas-Kanade algorithm", IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1383-1396, Jun. 2013.
17. N. Dowson and R. Bowden, "Mutual information for Lucas-Kanade tracking (MILK): An inverse compositional formulation", IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 1, pp. 180-185, Jan. 2008.
18. R. Gross, I. Matthews, and S. Baker, "Generic vs. person specific active appearance models", Image Vis. Comput., vol. 23, no. 11, pp. 1080-1093, Nov. 2005.
19. M. J. Black and A. D. Jepson, "EigenTracking: Robust matching and tracking of articulated objects using a view-based representation", Int. J. Comput. Vis., vol. 26, no. 1, pp. 63-84, Jan. 1998.
20. G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "Subspace learning from image gradient orientations", IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 12, pp. 2454-2466, Dec. 2012.
21. G. Tzimiropoulos, J. Alabort-i-Medina, S. Zafeiriou, and M. Pantic, "Generic active appearance models revisited", in Proc. Asian Conf. Comput. Vis., 2012, pp. 650-663.
22. T. F. Cootes and C. J. Taylor, "On representing edge structure for model matching", in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Dec. 2001, pp. I-1114-I-1119.
23. X. Gao, Y. Su, X. Li, and D. Tao, "Gabor texture in active appearance models", J. Neurocomput., vol. 72, nos. 13-15, pp. 3174-3181, Aug. 2009.
24. Y. Ge, D. Yang, J. Lu, B. Li, and X. Zhang, "Active appearance models using statistical characteristics of Gabor based texture representation", J. Vis. Commun. Image Represent., vol. 24, no. 5, pp. 627-634, 2013.
25. I. M. Scott, T. F. Cootes, and C. J. Taylor, "Improving appearance model matching using local image structure", in Proc. 18th Int. Conf. Inf. Process. Med. Imag., 2003, pp. 258-269.
26. P. Kittipanya-ngam and T. F. Cootes, "The effect of texture representations on AAM performance", in Proc. IEEE Int. Conf. Pattern Recognit., Aug. 2006, pp. 328-331.
27. M. B. Stegmann and R. Larsen, "Multi-band modelling of appearance", Image Vis. Comput., vol. 21, no. 1, pp. 61-67, Jan. 2003.
28. Y. Su, D. Tao, X. Li, and X. Gao, "Texture representation in AAM using Gabor wavelet and local binary patterns", in Proc. IEEE Int. Conf. Syst., Man Cybern., Oct. 2009, pp. 3274-3279.
29. C. B. H. Wolstenholme and C. J. Taylor, "Wavelet compression of active appearance models", in Proc. Int. Conf. Med. Image Comput. Comput. - Assist. Intervent., 1999, pp. 544-554.
30. S. Darkner, R. Larsen, M. B. Stegmann, and B. K. Ersbll, "Wedgelet enhanced appearance models", in Proc. Conf. Comput. Vis. Pattern Recognit. Workshop, Jun. 2004, p. 177.
31. E. Antonakos and S. Zafeiriou, "Automatic construction of deformable models in-the-wild", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1813-1820.
32. E. Antonakos, J. Alabort-i-Medina, G. Tzimiropoulos, and S. Zafeiriou, "HOG active appearance models", in Proc. IEEE Int. Conf. Image Process., Oct. 2014, pp. 224-228.
33. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection", in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 886-893.
34. D. G. Lowe, "Object recognition from local scale-invariant features", in Proc. IEEE 7th Int. Conf. Comput. Vis., Sep. 1999, pp. 1150-1157.
35. T. Ojala, M. Pietikäinen, and D. Harwood, "A comparative study of texture measures with classification based on featured distributions", Pattern Recognit., vol. 29, no. 1, pp. 51-59, Jan. 1996.
36. T. Ojala, M. Pietikäinen, and T. Mäenpää, "A generalized local binary pattern operator for multiresolution gray scale and rotation invariant texture classification", in Proc. Int. Conf. Adv. Pattern Recognit., 2001, pp. 399-408.
37. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns", IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
38. L. Wolf, T. Hassner, and Y. Taigman, "Descriptor based methods in the wild", in Proc. Faces Real-Life Images Workshop Eur. Conf. Comput. Vis. (ECCV), Oct. 2008.
39. P. Kovesi, "Symmetry and asymmetry from local phase", in Proc. 10th Austral. Joint Conf. Artif. Intell., Dec. 1997, pp. 1-6.
40. P. Kovesi, "Image features from phase congruency", VIDERE, J. Comput. Vis. Res., vol. 1, no. 3, pp. 1-26, 1999.
41. T. S. Lee, "Image representation using 2D Gabor wavelets", IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 10, pp. 959-971, Oct. 1996.
42. A. S. Georghiades, P. N. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
43. P. N. Belhumeur, D. W. Jacobs, D. Kriegman, and N. Kumar, "Localizing parts of faces using a consensus of exemplars", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 545-552.
44. X. Zhu and D. Ramanan, "Face detection, pose estimation, and landmark localization in the wild", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2879-2886.
45. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang, "Interactive facial feature localization", in Proc. Eur. Conf. Comput. Vis., 2012, pp. 679-692.
46. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "300 faces in-the-wild challenge: The first facial landmark localization challenge", in Proc. IEEE Int. Conf. Comput. Vis. Workshops (ICCVW), Dec. 2013, pp. 397-403.
47. X. Xiong and F. de la Torre, "Supervised descent method and its applications to face alignment", in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2013, pp. 532-539.
48. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic, "Robust discriminative response map fitting with constrained local models", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3444-3451.
49. J. Alabort-i-Medina, E. Antonakos, J. Booth, P. Snape, and S. Zafeiriou, "Menpo: A comprehensive platform for parametric image alignment and visual deformable models", in Proc. ACM Int. Conf. Multimedia, 2014, pp. 679-682.
50. G. Tzimiropoulos, J. Alabort-i-Medina, S. P. Zafeiriou, and M. Pantic, "Active orientation models for face alignment in-the-wild", IEEE Trans. Inf. Forensics Security, vol. 9, no. 12, pp. 2024-2034, Dec. 2014.
51. P. D. Kovesi. MATLAB and Octave Functions for Computer Vision and Image Processing. Centre Exploration Targeting, School Earth Environment, Univ. Western Australia. [Online]. Available: http://www.csse.uwa.edu.au/~pk/research/matlabfns
52. G. Tzimiropoulos and M. Pantic, "Optimization problems for fast AAM fitting in-the-wild", in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 593-600.
53. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "A semiautomatic methodology for facial landmark annotation", in Proc. IEEE Comput. Vis. Pattern Recognit. Workshops, Jun. 2013, pp. 896-903.
54. (Dec. 2013). 300 Faces In-the-Wild Challenge (300-W). [Online]. Available: http://ibug.doc.ic.ac.uk/resources/300-W
55. J. Orozco, B. Martinez, and M. Pantic, "Empirical analysis of cascade deformable models for multi-view face detection", in Proc. IEEE Int. Conf. Image Process., Sep. 2013. (2013). Robust Face Detector For Matlab. [Online]. Available: https://sites.google.com/site/chehrahome
56. A. Vedaldi and B. Fulkerson. (2008). VLFeat: An Open and Portable Library of Computer Vision Algorithms. [Online]. Available: http://www.vlfeat.org
57. (Jun. 201.3). IntraFace. [Online]. Available: http://www.humansensing.cs.cmu.edu/intraface
58. (Jun. 2013). CLM-WILD Face Tracker. [Online]. Available: https://sites.google.com/site/akshayasthana/clm-wild-code
59. L. Wiskott, J.-M. Fellous, N. Kuiger, and C. von der Malsburg, "Face recognition by elastic bunch graph matching", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 775-779, Jul. 1997.
60. B. Duc, S. Fischer, and J. Bigun, "Face authentication with Gabor information on deformable graphs", IEEE Trans. Image Process., vol. 8, no. 4, pp. 504-516, Apr. 1999.
61. J. Bruna and S. Mallat, "Invariant scattering convolution networks", IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1872-1886, Aug. 2013.