Combining Facial Dynamics with Appearance for Age Estimation

IEEE Transactions on Image Processing

Volumn 24, Issue 6, 2015, Pages 1928-1943

  Dibeklioglu, Hamdi ^a,b   Alnajar, Fares ^b   Salah, Albert Ali ^c   Gevers, Theo ^b,d  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c BOGAZICI UNIVERSITY   (Turkey)

^d UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

Author keywords

Age estimation; Age grouping; Disgust; Expression dynamics; Smile; Spontaneity

Indexed keywords

ESTIMATION;

AGE ESTIMATION; AGE GROUPING; DISGUST; EXPRESSION DYNAMICS; SMILE; SPONTANEITY;

DYNAMICS;

ADOLESCENT; ADULT; AGED; AGING; ANATOMY AND HISTOLOGY; ANTHROPOMETRY; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; CHILD; COMPUTER ASSISTED DIAGNOSIS; FACE; FACIAL EXPRESSION; FEMALE; HUMAN; MALE; PATHOLOGY; PHOTOGRAPHY; PHYSIOLOGY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; AGING; ANTHROPOMETRY; ARTIFICIAL INTELLIGENCE; BIOMETRY; CHILD; FACE; FACIAL EXPRESSION; FEMALE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MALE; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; YOUNG ADULT;

EID: 84926512661     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2412377     Document Type: Article

References (53)

1. A. M. Albert, K. Ricanek, Jr., and E. Patterson, "A review of the literature on the aging adult skull and face: Implications for forensic science research and applications," Forensic Sci. Int., vol. 172, no. 1, pp. 1-9, 2007.
2. Y. Fu, G. Guo, and T. S. Huang, "Age synthesis and estimation via faces: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 1955-1976, Nov. 2010.
3. N. Ramanathan, R. Chellappa, and S. Biswas, "Computational methods for modeling facial aging: A survey," J. Vis. Lang. Comput., vol. 20, no. 3, pp. 131-144, 2009.
4. H. Han, C. Otto, and A. K. Jain, "Age estimation from face images: Human vs. machine performance," in Proc. Int. Conf. BTAS, Jun. 2013, pp. 1-8.
5. M. Lucassen, T. Gevers, and H. Dibeklioʇlu, "The effect of smile and illumination color on age estimation from faces," Perception, vol. 41, ECVP Abstract Supplement, p. 87, 2012. [Online]. Available: http://www.perceptionweb.com/abstract.cgi?id=v120501
6. P. Ekman, Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage. New York, NY, USA: Norton, 1992.
7. S. E. Brodie, "Aging and disorders of the eye," in Brocklehurst's Textbook of Geriatric Medicine and Gerontology, H. M. Fillit, K. Rockwood, and K. Woodhouse, Eds., 7th ed. Philadelphia, PA, USA: Saunders, 2010, ch. 96.
8. K. L. Minaker, "Common clinical sequelae of aging," in Goldman's Cecil Medicine, L. Goldman and A. I. Schafer, Eds., 24th ed. Philadelphia, PA, USA: Saunders, 2011, ch. 24.
9. S. J. Salasche, "Anatomy," in Flaps and Grafts in Dermatologic Surgery, 1st ed., T. E. Rohrer, J. L. Cook, T. H. Nguyen, and J. R. Mellette Jr., Eds. Philadelphia, PA, USA: Saunders Elsevier, 2007, ch. 1.
10. R. Sanders, "Torsional elasticity of human skin in vivo," Pflügers Arch. Eur. J. Physiol., vol. 342, no. 3, pp. 255-260, 1973.
11. H. Dibeklioʇlu, T. Gevers, A. A. Salah, and R. Valenti, "A smile can reveal your age: Enabling facial dynamics in age estimation," in Proc. ACM 20th Int. Conf. Multimedia, 2012, pp. 209-218.
12. A. J. O'Toole, T. Vetter, H. Volz, and E. M. Salter, "Three-dimensional caricatures of human heads: Distinctiveness and the perception of facial age," Perception, vol. 26, no. 6, pp. 719-732, 1997.
13. Y. Wu, N. M. Thalmann, and D. Thalmann, "A dynamic wrinkle model in facial animation and skin ageing," J. Vis. Comput. Animation, vol. 6, no. 4, pp. 195-205, 1995.
14. J. Suo, S.-C. Zhu, S. Shan, and X. Chen, "A compositional and dynamic model for face aging," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 3, pp. 385-401, Mar. 2010.
15. B. Tiddeman, M. Burt, and D. Perrett, "Prototyping and transforming facial textures for perception research," IEEE Comput. Graph. Appl., vol. 21, no. 5, pp. 42-50, Sep./Oct. 2001.
16. M. Ortega, L. Brodo, M. Bicego, and M. Tistarelli, "On the quantitative estimation of short-term aging in human faces," in Proc. 15th ICIAP, 2009, pp. 575-584.
17. Y. H. Kwon and N. da Vitoria Lobo, "Age classification from facial images," Comput. Vis. Image Understand., vol. 74, no. 1, pp. 1-21, 1999.
18. T. R. Alley, Social and Applied Aspects of Perceiving Faces. Hillsdale, NJ, USA: Lawrence Erlbaum Associates, 1988.
19. A. Lanitis, C. J. Taylor, and T. F. Cootes, "Toward automatic simulation of aging effects on face images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 442-455, Apr. 2002.
20. G. Guo, Y. Fu, C. R. Dyer, and T. S. Huang, "Image-based human age estimation by manifold learning and locally adjusted robust regression,"IEEE Trans. Image Process., vol. 17, no. 7, pp. 1178-1188, Jul. 2008.
21. X. Geng, Z.-H. Zhou, Y. Zhang, G. Li, and H. Dai, "Learning from facial aging patterns for automatic age estimation," in Proc. 14th Annu. ACM Int. Conf. Multimedia, 2006, pp. 307-316.
22. X. Geng, K. Smith-Miles, and Z.-H. Zhou, "Facial age estimation by nonlinear aging pattern subspace," in Proc. 16th ACM Int. Conf. Multimedia, 2008, pp. 721-724.
23. C. Zhan, W. Li, and P. Ogunbona, "Age estimation based on extended non-negative matrix factorization," in Proc. IEEE 13th Int. Workshop Multimedia Signal Process., Oct. 2011, pp. 1-6.
24. Y.-L. Chen and C.-T. Hsu, "Subspace learning for facial age estimation via pairwise age ranking," IEEE Trans. Inf. Forensics Security, vol. 8, no. 12, pp. 2164-2176, Dec. 2013.
25. W.-L. Chao, J.-Z. Liu, and J.-J. Ding, "Facial age estimation based on label-sensitive learning and age-oriented regression," Pattern Recognit., vol. 46, no. 3, pp. 628-641, 2013.
26. G. Guo, G. Mu, Y. Fu, and T. S. Huang, "Human age estimation using bio-inspired features," in Proc. IEEE CVPR, Jun. 2009, pp. 112-119.
27. F. Alnajar, C. Shan, T. Gevers, and J.-M. Geusebroek, "Learning-based encoding with soft assignment for age estimation under unconstrained imaging conditions," Image Vis. Comput., vol. 30, no. 12, pp. 946-953, 2012.
28. J. Ylioinas, A. Hadid, X. Hong, and M. Pietikäinen, "Age estimation using local binary pattern kernel density estimate," in Proc. 17th ICIAP, 2013, pp. 141-150.
29. J. Liu, Y. Ma, L. Duan, F. Wang, and Y. Liu, "Hybrid constraint SVR for facial age estimation," Signal Process., vol. 94, pp. 576-582, Jan. 2014.
30. G. Guo and X. Wang, "A study on human age estimation under facial expression changes," in Proc. IEEE CVPR, Jun. 2012, pp. 2547-2553.
31. C. Zhang and G. Guo, "Age estimation with expression changes using multiple aging subspaces," in Proc. IEEE 6th Int. Conf. BTAS, Sep./Oct. 2013, pp. 1-6.
32. A. Hadid, "Analyzing facial behavioral features from videos," in Proc. 2nd Int. Workshop Human Behavior Understand., 2011, pp. 52-61.
33. P. Ekman and W. V. Friesen, Facial Action Coding System: A Technique for the Measurement of Facial Movement. San Francisco, CA, USA: Consulting Psychologists Press, 1978.
34. P. Ekman and W. V. Friesen, "Felt, false, and miserable smiles,"J. Nonverbal Behavior, vol. 6, no. 4, pp. 238-252, 1982.
35. H. Dibeklioʇlu, A. A. Salah, and T. Gevers, "A statistical method for 2-D facial landmarking," IEEE Trans. Image Process., vol. 21, no. 2, pp. 844-858, Feb. 2012.
36. H. Tao and T. S. Huang, "Explanation-based facial motion tracking using a piecewise Bézier volume deformation model," in Proc. IEEE Comput. Soc. Conf. CVPR, vol. 1. Jun. 1999, pp. 611-617.
37. L. R. Rubin, "The anatomy of a smile: Its importance in the treatment of facial paralysis," Plastic Reconstructive Surgery, vol. 53, no. 4, pp. 384-387, 1974.
38. K. L. Schmidt, J. F. Cohn, and Y. Tian, "Signal characteristics of spontaneous facial expressions: Automatic movement in solitary and social smiles," Biological Psychol., vol. 65, no. 1, pp. 49-66, 2003.
39. P. F. Velleman, "Definition and comparison of robust nonlinear data smoothing algorithms," J. Amer. Statist. Assoc., vol. 75, no. 371, pp. 609-615, 1980.
40. H. Dibeklioʇlu, A. A. Salah, and T. Gevers, "Like father, like son: Facial expression dynamics for kinship verification," in Proc. IEEE ICCV, Dec. 2013, pp. 1497-1504.
41. Y. Freund, S. Dasgupta, M. Kabra, and N. Verma, "Learning the structure of manifolds using random projections," in Advances in Neural Information Processing Systems 20. Red Hook, NY, USA: Curran Associates, 2007, pp. 473-480.
42. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Robust object recognition with cortex-like mechanisms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 411-426, Mar. 2007.
43. T. Ojala, M. Pietikäinen, and D. Harwood, "A comparative study of texture measures with classification based on featured distributions,"Pattern Recognit., vol. 29, no. 1, pp. 51-59, 1996.
44. T. Ojala, M. Pietikäinen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns,"IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
45. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005.
46. H. Dibeklioʇlu, A. A. Salah, and T. Gevers, "Are you really smiling at me? Spontaneous versus posed enjoyment smiles," in Proc. ECCV, 2012, pp. 525-538.
47. Science Center NEMO. [Online]. Available: http://www.e-nemo.nl/, accessed Jan. 1, 2014.
48. G. Zhao and M. Pietikäinen, "Dynamic texture recognition using local binary patterns with an application to facial expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 915-928, Jun. 2007.
49. S. Ren, X. Cao, Y. Wei, and J. Sun, "Face alignment at 3000 fps via regressing local binary features," in Proc. IEEE Conf. CVPR, Jun. 2014, pp. 1685-1692.
50. A. C. Gallagher and T. Chen, "Understanding images of groups of people," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 256-263.
51. K. Ramesha, K. B. Raja, K. R. Venugopal, and L. M. Patnaik, "Feature extraction based face recognition, gender and age classification," Int. J. Comput. Sci. Eng., vol. 1, no. 1S, pp. 14-23, 2010.
52. K. Ueki, T. Hayashida, and T. Kobayashi, "Subspace-based age-group classification using facial images under various lighting conditions," in Proc. 7th Int. Conf. AFGR, Apr. 2006, pp. 43-48.
53. H. Dibeklioʇlu, A. A. Salah, and T. Gevers, "Recognition of genuine smiles," IEEE Trans. Multimedia, vol. 17, no. 3, pp. 279-294, Mar. 2015.