Mnemonic Descent Method: A Recurrent Process Applied for End-to-End Face Alignment

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 4177-4187

  Trigeorgis, George ^a   Snape, Patrick ^a   Nicolaou, Mihalis A ^b   Antonakos, Epameinondas ^a   Zafeiriou, Stefanos ^a,c  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF LONDON   (United Kingdom)

^c UNIVERSITY OF OULU   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; COMPUTER VISION; CONVOLUTION; DYNAMICAL SYSTEMS; IMAGE RECOGNITION; NETWORK ARCHITECTURE; NONLINEAR DYNAMICAL SYSTEMS; PATTERN RECOGNITION; RECURRENT NEURAL NETWORKS; REGRESSION ANALYSIS;

DESCENT DIRECTIONS; DESCENT METHOD; HEAD POSE ESTIMATION; IMAGE ALIGNMENT; LEAST SQUARES PROBLEMS; NONLINEAR LEAST SQUARES PROBLEMS; PROPOSED ARCHITECTURES; STATE OF THE ART;

LEAST SQUARES APPROXIMATIONS;

EID: 84986309468     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.453     Document Type: Conference Paper

References (66)

1. J. Alabort-i-Medina, E. Antonakos, J. Booth, P. Snape, and S. Zafeiriou. Menpo: A comprehensive platform for parametric image alignment and visual deformable models. In Proceedings of the ACM International Conference on Multimedia, MM'14, pages 679-682, New York, NY, USA, 2014. ACM.
2. E. Antonakos, J. Alabort-i-Medina, G. Tzimiropoulos, and S. Zafeiriou. Feature-based lucas-kanade and active appearance models. IEEE Transactions on Image Processing, 24(9):2617-2632, 2015.
3. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic. Incremental face alignment in the wild. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 1859-1866. IEEE, 2014.
4. A. Asthana, S. Zafeiriou, G. Tzimiropoulos, S. Cheng, and M. Pantic. From pixels to response maps: Discriminative image filtering for face alignment in the wild. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015.
5. T. Baltrusaitis, P. Robinson, and L.-P. Morency. Constrained local neural fields for robust facial landmark detection in the wild. In International Conference on Computer Vision Workshops (ICCVW), pages 354-361. IEEE, 2013.
6. P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar. Localizing parts of faces using a consensus of exemplars. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(12):2930-2940, 2013.
7. P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar. Localizing parts of faces using a consensus of exemplars. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35:2930-2940, 2013.
8. V. Blanz and T. Vetter. In the proceedings of siggraph. In Computer Graphics and Interactive Techniques, pages 187-194. ACM Press/Addison-Wesley Publishing Co., 1999.
9. A. M. Buchanan and A. W. Fitzgibbon. Damped Newton Algorithms for Matrix Factorization with Missing Data. In International Conference on Computer Vision and Pattern Recognition (CVPR), volume 2, pages 316-322. IEEE, 2005.
10. X. P. Burgos-Artizzu, P. Perona, and P. Dollár. Robust face landmark estimation under occlusion. In International Conference on Computer Vision (ICCV), pages 1513-1520. IEEE, 2013.
11. X. Cao, Y. Wei, F. Wen, and J. Sun. Face alignment by explicit shape regression. International Journal of Computer Vision, 107(2):177-190, 2014.
12. X. Chen and C. L. Zitnick. Learning a recurrent visual representation for image caption generation. arXiv preprint arXiv:1411.5654, 2015.
13. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681-685, 2001.
14. T. F. Cootes, M. C. Ionita, C. Lindner, and P. Sauer. Robust and Accurate Shape Model Matching Using Random Forest Voting. In European Conference on Computer Vision (ECCV), pages 278-291. Springer, 2012.
15. T. F. Cootes and P. Kittipanya-ngam. Comparing variations on the active appearance model algorithm. In British Machine Vision Conference, pages 1-10. Citeseer, 2002.
16. D. Cristinacce and T. Cootes. Automatic feature localisation with constrained local models. Pattern Recognition, 41(10):3054-3067, 2008.
17. N. Dalal and B. Triggs. Histograms of Oriented Gradients for Human Detection. In International Conference on Computer Vision and Pattern Recognition (CVPR), volume 1, pages 886-893. IEEE, 2005.
18. N. Dalal, B. Triggs, and C. Schmid. Human detection using oriented histograms of flow and appearance. In European Conference on Computer Vision, pages 428-441. Springer, 2006.
19. F. De la Torre, W.-S. Chu, X. Xiong, F. Vicente, X. Ding, and J. F. Cohn. Intraface. In Automatic Face and Gesture Recognition, 2015.
20. P. Dollár, P.Welinder, and P. Perona. Cascaded Pose Regression. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 1078-1085. IEEE, 2010.
21. J. Donahue, L. Anne Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan, K. Saenko, and T. Darrell. Long-Term Recurrent Convolutional Networks for Visual Recognition and Description. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 2625-2634, 2015.
22. K.-i. Funahashi and Y. Nakamura. Approximation of dynamical systems by continuous time recurrent neural networks. Neural networks, 6(6):801-806, 1993.
23. R. Garg, A. Roussos, and L. Agapito. Dense variational reconstruction of non-rigid surfaces from monocular video. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1272-1279, 2013.
24. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker. Multi-Pie. Image and Vision Computing, 28(5):807-813, 2010.
25. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. Signal Processing Magazine, 29(6):82-97, 2012.
26. V. Kazemi and J. Sullivan. One Millisecond Face Alignment with an Ensemble of Regression Trees. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 1867-1874. IEEE, 2014.
27. D. E. King. Dlib-ml: A machine learning toolkit. Journal of Machine Learning Research, 10:1755-1758, 2009.
28. D. Kingma and J. Ba. Adam: A method for stochastic optimization. International Conference on Learning Representations, 2014.
29. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang. Interactive facial feature localization. In European Conference on Computer Vision (ECCV), pages 679-692. Springer, 2012.
30. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang. Interactive facial feature localization. In Computer Vision-ECCV 2012, pages 679-692. Springer, 2012.
31. D. Lee, H. Park, and C. D. Yoo. Face Alignment using Cascade Gaussian Process Regression Trees. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 4204-4212, 2015.
32. D. G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60(2):91-110, 2004.
33. B. D. Lucas, T. Kanade, et al. An iterative image registration technique with an application to stereo vision. In International Joint Conference on Artificial Intelligence, volume 81, pages 674-679, 1981.
34. P. Martins, R. Caseiro, J. F. Henriques, and J. Batista. Discriminative Bayesian active shape models. In European Conference on Computer Vision (ECCV), pages 57-70. Springer, 2012.
35. I. Matthews and S. Baker. Active appearance models revisited. International Journal of Computer Vision, 60(2):135-164, 2004.
36. P. H. Pinheiro and R. Collobert. Recurrent Convolutional Neural Networks for Scene Labeling. In International Conference on Machine Learning, pages 2625-2634, 2014.
37. S. Ren, X. Cao, Y. Wei, and J. Sun. Face alignment at 3000 fps via regressing local binary features. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 1685-1692. IEEE, 2014.
38. C. Sagonas, E. Antonakos, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-the-wild challenge: Database and results. Image and Vision Computing, Special Issue on Facial Landmark Localisation "In-The-Wild", 2016.
39. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-the-wild challenge: The first facial landmark localization challenge. In International Conference on Computer Vision Workshops (ICCVW), pages 397-403. IEEE, 2013.
40. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. A semi-automatic methodology for facial landmark annotation. In International Conference on Computer Vision and Pattern Recognition Workshops (CVPR-W), pages 896-903, 2013.
41. J. M. Saragih, S. Lucey, and J. F. Cohn. Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision, 91(2):200-215, 2011.
42. J. Schmidhuber. Deep learning in neural networks: An overview. Neural Networks, 61:85-117, 2015.
43. B. Shi, X. Bai, W. Liu, and J. Wang. Deep Regression for Face Alignment. arXiv preprint arXiv:1409.5230, 2014.
44. C. C. Slama, C. Theurer, S. W. Henriksen, et al. Manual of photogrammetry. Number Ed. 4. American Society of photogrammetry, 1980.
45. P. Snape, A. Roussos, Y. Panagakis, and S. Zafeiriou. Face flow. In International Conference on Computer Vision (ICCV), pages 2993-3001. IEEE, 2015.
46. D. Sun, S. Roth, and M. J. Black. A quantitative analysis of current practices in optical flow estimation and the principles behind them. International Journal of Computer Vision, 106(2):115-137, 2014.
47. Y. Sun, X.Wang, and X. Tang. Deep Convolutional Network Cascade for Facial Point Detection. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 3476-3483. IEEE, 2013.
48. I. Sutskever, O. Vinyals, and Q. V. Le. Sequence to Sequence Learning with Neural Networks. In Advances in Neural Information Processing Systems, pages 3104-3112, 2014.
49. P. A. Tresadern, M. C. Ionita, and T. F. Cootes. Real-Time Facial Feature Tracking on a Mobile Device. International Journal of Computer Vision, 96(3):280-289, 2012.
50. G. Tzimiropoulos. Project-Out Cascaded RegressionWith an Application to Face Alignment. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 3659-3667, 2015.
51. L. Van der Maaten and G. Hinton. Visualizing data using t-SNE. Journal of Machine Learning Research, 9(2579-2605):85, 2008.
52. A. Vedaldi and B. Fulkerson. VLFeat: An open and portable library of computer vision algorithms. http://www.vlfeat.org/, 2008.
53. O. Vinyals, A. Toshev, S. Bengio, and D. Erhan. Show and Tell: A Neural Image Caption Generator. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 3156-3164, June 2015.
54. P. J. Werbos. Backpropagation Through Time: what it does and how to do it. Proceedings of the IEEE, 78(10):1550-1560, 1990.
55. Y. Wu, Z. Wang, and Q. Ji. Facial Feature Tracking Under Varying Facial Expressions and Face Poses Based on Restricted Boltzmann Machines. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 3452-3459. IEEE, 2013.
56. X. Xiong and F. De la Torre. Supervised descent method and its applications to face alignment. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 532-539. IEEE, 2013.
57. X. Xiong and F. De la Torre. Global Supervised Descent Method. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 2664-2673, 2015.
58. J. Yan, Z. Lei, D. Yi, and S. Z. Li. Learn to combine multiple hypotheses for accurate face alignment. In International Conference on Computer Vision Workshops (ICCVW), pages 392-396. IEEE, 2013.
59. H. Yang, W. Mou, Y. Zhang, I. Patras, H. Gunes, and P. Robinson. Face Alignment Assisted by Head Pose Estimation. In British Machine Vision Conference, 2015.
60. S. Zafeiriou, C. Zhang, and Z. Zhang. A survey on face detection in the wild: past, present and future. Computer Vision and Image Understanding, 138:1-24, 2015.
61. J. Zhang, S. Shan, M. Kan, and X. Chen. Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment. In European Conference on Computer Vision, pages 1-16. Springer, 2014.
62. Z. Zhang, P. Luo, C. C. Loy, and X. Tang. Learning Deep Representation for Face Alignment with Auxiliary Attributes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015.
63. E. Zhou, H. Fan, Z. Cao, Y. Jiang, and Q. Yin. Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In International Conference on Computer Vision Workshops (ICCVW), pages 386-391. IEEE, 2013.
64. S. Zhu, C. Li, C. C. Loy, and X. Tang. Face Alignment by Coarse-to-Fine Shape Searching. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 4998-5006, 2015.
65. X. Zhu and D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In International Conference on Computer Vision and Pattern Recognition (CVPR), pages 2879-2886, 2012.
66. D. Zikic, A. Kamen, and N. Navab. Revisiting Horn and Schunck: Interpretation as Gauss-Newton Optimisation. In British Machine Vision Conference, pages 1-12, 2010.