Fine-tuning regression forests votes for object alignment in the wild

IEEE Transactions on Image Processing

Volumn 24, Issue 2, 2015, Pages 619-631

  Yang, Heng ^a   Patras, Ioannis ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

facial feature; object alignment; Regression Forests

Indexed keywords

FACE RECOGNITION; FORESTRY; OBJECT RECOGNITION; REGRESSION ANALYSIS; SIEVES;

ALIGNMENT METHODS; FACIAL FEATURE; GLOBAL CONSTRAINTS; IMAGE LOCATIONS; INDIVIDUAL OBJECTS; OBJECT ANALYSIS; REGRESSION FORESTS; STATE OF THE ART;

ALIGNMENT;

ALIGNMENT; FORESTS; REGRESSION ANALYSIS;

EID: 84920972953     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2383325     Document Type: Article

References (45)

1. S. Koelstra, M. Pantic, and I. Patras, "A dynamic texture-based approach to recognition of facial actions and their temporal models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 1940-1954, Nov. 2010.
2. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
3. P. N. Belhumeur, D.W. Jacobs, D. Kriegman, and N. Kumar, "Localizing parts of faces using a consensus of exemplars," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 545-552.
4. M. Dantone, J. Gall, G. Fanelli, and L. Van Gool, "Real-time facial feature detection using conditional regression forests," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2578-2585.
5. B. Efraty, C. Huang, S. K. Shah, and I. A. Kakadiaris, "Facial landmark detection in uncontrolled conditions," in Proc. Int. Joint Conf. Biometrics, Oct. 2011, pp. 1-8.
6. X. Zhu and D. Ramanan, "Face detection, pose estimation, and landmark localization in the wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2879-2886.
7. X. Cao, Y. Wei, F. Wen, and J. Sun, "Face alignment by explicit shape regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2887-2894.
8. Y. Li, L. Gu, and T. Kanade, "Robustly aligning a shape model and its application to car alignment of unknown pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1860-1876, Sep. 2011.
9. J. Gall, A. Yao, N. Razavi, L. Van Gool, and V. Lempitsky, "Hough forests for object detection, tracking, and action recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2188-2202, Nov. 2011.
10. M. Sun, P. Kohli, and J. Shotton, "Conditional regression forests for human pose estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3394-3401.
11. G. Fanelli, J. Gall, and L. Van Gool, "Real time head pose estimation with random regression forests," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 617-624.
12. P. Kontschieder, S. R. Bulò, M. Donoser, M. Pelillo, and H. Bischof, "Evolutionary Hough games for coherent object detection," Comput. Vis. Image Understand., vol. 116, no. 11, pp. 1149-1158, Nov. 2012.
13. D. Vukadinovic and M. Pantic, "Fully automatic facial feature point detection using Gabor feature based boosted classifiers," in Proc. IEEE Int. Conf. Syst., Man Cybern., Oct. 2005, pp. 1692-1698.
14. C.-T. Liao, Y.-K. Wu, and S.-H. Lai, "Locating facial feature points using support vector machines," in Proc. 9th Int. Workshop Cellular Neural Netw. Appl., May 2005, pp. 296-299.
15. H. Yang and I. Patras, "Sieving regression forest votes for facial feature detection in the wild," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1936-1943.
16. V. N. Boddeti, T. Kanade, and B. V. K. V. Kumar, "Correlation filters for object alignment," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2291-2298.
17. D. Cristinacce and T. Cootes, "Feature detection and tracking with constrained local models," in Proc. Brit. Mach. Vis. Conf., 2006, pp. 929-938.
18. B. Martinez, M. F. Valstar, X. Binefa, and M. Pantic, "Local evidence aggregation for regression based facial point detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 5, pp. 1149-1163, Sep. 2012.
19. B. Amberg and T. Vetter, "Optimal landmark detection using shape models and branch and bound," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 455-462.
20. J. M. Saragih, S. Lucey, and J. F. Cohn, "Face alignment through subspace constrained mean-shifts," in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 1034-1041.
21. F. Zhou, J. Brandt, and Z. Lin, "Exemplar-based graph matching for robust facial landmark localization," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1025-1032.
22. H. Yang and I. Patras, "Face parts localization using structuredoutput regression forests," in Proc. Asian Conf. Comput. Vis., 2012, pp. 667-679.
23. P. Tresadern, P. Sauer, and T. F. Cootes, "Additive update predictors in active appearance models," in Proc. Brit. Mach. Vis. Conf., 2010, pp. 1-12.
24. P. Dollar, P. Welinder, and P. Perona, "Cascaded pose regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1078-1085.
25. X. Xiong and F. De La Torre, "Supervised descent method and its applications to face alignment," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 532-539.
26. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 886-893.
27. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
28. R. Girshick, J. Shotton, P. Kohli, A. Criminisi, and A. Fitzgibbon, "Efficient regression of general-activity human poses from depth images," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 415-422.
29. A. Criminisi, J. Shotton, and E. Konukoglu, "Decision forests: A unified framework for classification, regression, density estimation, manifold learning and semi-supervised learning," Found. Trends Comput. Graph. Vis., vol. 7, nos. 2-3, pp. 81-227, 2012.
30. H. Yang and I. Patras, "Privileged information-based conditional regression forest for facial feature detection," in Proc. 10th IEEE Int. Conf. Autom. Face Gesture Recognit., Apr. 2013, pp. 1-6.
31. X. Jia, H. Yang, A. Lin, K.-P. Chan, and I. Patras, "Structured semisupervised forest for facial landmarks localization with face mask reasoning," in Proc. Brit.Mach. Vis. Conf. (BMVA), Sep. 2014. [Online]. Available: http://www.bmva.org/bmvc/2014/papers/paper068/index.html
32. G. Fanelli, M. Dantone, J. Gall, A. Fossati, and L. Van Gool, "Random forests for real time 3D face analysis," Int. J. Comput. Vis., vol. 101, no. 3, pp. 437-458, Feb. 2013.
33. O. Barinova, V. S. Lempitsky, and P. Kholi, "On detection of multiple object instances using Hough transforms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1773-1784, Sep. 2012.
34. I. Patras and E. R. Hancock, "Coupled prediction classification for robust visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1553-1567, Sep. 2010.
35. N. Razavi, J. Gall, P. Kohli, and L. van Gool, "Latent Hough transform for object detection," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 312-325.
36. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
37. Y. Chen, X. S. Zhou, and T. S. Huang, "One-class SVM for learning in image retrieval," in Proc. Int. Conf. Image Process., Oct. 2001, pp. 34-37.
38. H. K. Ekenel and R. Stiefelhagen, "Why is facial occlusion a challenging problem?" in Proc. 3rd Int. Conf. Adv. Biometrics, 2009, pp. 299-308.
39. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," School Comput. Sci., Univ. Massachusetts, Amherst, MA, USA, Tech. Rep. 07-49, Oct. 2007.
40. M. Kostinger, P. Wohlhart, P. M. Roth, and H. Bischof, "Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, Nov. 2011, pp. 2144-2151.
41. CBCL StreetScenes. [Online]. Available: http://cbcl.mit.edu/softwaredatasets/streetscenes/, accessed Jul. 10, 2013.
42. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:27, 2011.
43. T. F. Cootes, M. C. Ionita, C. Lindner, and P. Sauer, "Robust and accurate shape model fitting using random forest regression voting," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 278-291.
44. Betaface. [Online]. Available: http://www.betaface.com/, accessed Sep. 26, 2013.
45. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Dec. 2001, pp. I-511-I-518.