Demographic estimation from face images: Human vs. machine performance

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 6, 2015, Pages 1148-1161

  Han, Hu ^a   Otto, Charles ^a   Liu, Xiaoming ^a   Jain, Anil K ^a  

^a Michigan State University   (United States)

Author keywords

crowdsourcing; Demographic estimation; demographic informative feature; hierarchical approach; human vs. machine; quality assessment

Indexed keywords

FACE RECOGNITION;

AUTOMATIC ESTIMATION; CROWDSOURCING; DEMOGRAPHIC INFORMATIVE FEATURE; FACE IMAGE DATABASE; GROUP CLASSIFICATION; HIERARCHICAL APPROACH; MACHINE PERFORMANCE; QUALITY ASSESSMENT;

POPULATION STATISTICS;

ADOLESCENT; ADULT; ALGORITHM; ANATOMY AND HISTOLOGY; ANCESTRY GROUP; BIOMETRY; CHILD; CLASSIFICATION; FACE; FEMALE; HUMAN; IMAGE PROCESSING; MALE; PRESCHOOL CHILD; PROCEDURES; SEX DETERMINATION; YOUNG ADULT;

ADOLESCENT; ADULT; ALGORITHMS; BIOMETRIC IDENTIFICATION; CHILD; CHILD, PRESCHOOL; CONTINENTAL POPULATION GROUPS; FACE; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; SEX DETERMINATION ANALYSIS; YOUNG ADULT;

EID: 84929208117     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2362759     Document Type: Article

References (72)

1. S. Z. Li, and A. K. Jain, Eds. Handbook of Face Recognition, 2nd ed. New York, NY, USA: Springer, 2011.
2. N. Kumar, A. Berg, P. Belhumeur, and S. Nayar, "Describable visual attributes for face verification and image search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 1962-1977, Oct. 2011.
3. P. J. Phillips and A. J. O'Toole, "Comparison of human and computer performance across face recognition experiments," Image Vis. Comput., vol. 32, no. 1, pp. 74-85, Jan. 2014.
4. L. Best-Rowden, S. Bisht, J. Klontz, and A. K. Jain, "Unconstrained face recognition: Establishing baseline human performance via crowdsourcing," presented at the Proc. Int. Joint Conf. Biometrics, Clearwater, FL, USA, Sep. 2014.
5. W. J. Scheirer, N. Kumar, P. N. Belhumeur, and T. E. Boult, "Multi-attribute spaces: Calibration for attribute fusion and similarity search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2933-2940.
6. N. Chhaya and T. Oates, "Joint inference of soft biometric features," in Proc. 5th Int. Conf. Biometrics, 2012, pp. 466-471.
7. Z. Yang and H. Ai, "Demographic classification with local binary patterns," in Proc. 5th Int. Conf. Biometrics, 2007, pp. 464-473.
8. A. Hadid and M. Pietikänen, "Demographic classification from face videos using manifold learning," Neurocomputing, vol. 100, pp. 197-205, Jan. 2013.
9. L. T. Semaj, "The development of racial-classification abilities," J. Negro Educ., vol. 50, no. 1, pp. 41-47, 1981.
10. D. M. Burt and D. I. Perrett, "Perception of age in adult caucasian male faces: Computer graphic manipulation of shape and colour information," Proc. Biol Sci., vol. 259, no. 1355, pp. 137-143, Feb. 1995.
11. M. Rhodes, "Age estimation of faces: A review," Appl. Cognit. Psychol., vol. 23, no. 1, pp. 38-59, Jan. 2009.
12. G. W. Cottrell and J. Metcalfe, "EMPATH: Face, emotion, and gender recognition using holons," in Proc. Adv. Neural Inf. Process. Syst., 1990, pp. 564-571.
13. Y. H. Kwon and N. V. Lobo, "Age classification from facial images," Comput. Vis. Image Understanding, vol. 74, no. 1, pp. 1-21, Apr. 1999.
14. N. Ramanathan and R. Chellappa, "Modeling age progression in young faces," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 387-394.
15. M. C. Voelkle, N. C. Ebner, U. Lindenberger, and M. Riediger, "Let me guess how old you are: Effects of age, gender, and facial expression on perceptions of age," Psychol. Aging, vol. 27, no. 2, pp. 265-277, Jun. 2012.
16. Y. Fu, G. Guo, and T. S. Huang, "Age synthesis and estimation via faces: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 1955-1976, Nov. 2010.
17. A. Lanitis, C. Taylor, and T. Cootes, "Toward automatic simulation of aging effects on face images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 4, pp. 442-455, Apr. 2002.
18. J. Hayashi, M. Yasumoto, H. Ito, and H. Koshimizu, "Age and gender estimation based on wrinkle texture and color of facial images" in Proc. Int. Conf. Pattern Recognit., 2002, pp. 405-408.
19. X. Geng, Z.-H. Zhou, and K. Smith-Miles, "Automatic age estimation based on facial aging patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 12, pp. 2234-2240, Dec. 2007.
20. Facial Image Processing and Analysis (FIPA). FG-NET aging database [Online]. Avaialble: http://fipa.cs.kit.edu/433.php# Downloads
21. Y. Fu and T. S. Huang, "Human age estimation with regression on discriminative aging manifold," IEEE Trans. Multimedia, vol. 10, no. 4, pp. 578-584, Jun. 2008.
22. J. Suo, T. Wu, S.-C. Zhu, S. Shan, X. Chen, and W. Gao, "Design sparse features for age estimation using hierarchical face model," in Proc. 8th Int. Conf. Automatic Face Gesture Recognit., 2008, pp. 1-6.
23. G. Guo, G. Mu, Y. Fu, and T. S. Huang, "Human age estimation using bio-inspired features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 112-119.
24. M. Riesenhuber, and T. Poggio, "Hierarchical models of object recognition in cortex," Nat. Neurosci., vol. 2, no. 11, pp. 1019-1025, Nov. 1999.
25. G. Guo and G. Mu, "Simultaneous dimensionality reduction and human age estimation via kernel partial least squares regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 657-664.
26. S. E. Choi, Y. J. Lee, S. J. Lee, K. R. Park, and J. Kim, "Age estimation using a hierarchical classifier based on global and local facial features," Pattern Recognit., vol. 44, no. 6, pp. 1262-1281, Jun. 2011.
27. K. Luu, K. Seshadri, M. Savvides, T. Bui, and C. Suen, "Contourlet appearance model for facial age estimation," in Proc. Int. Joint Conf. Biometrics, 2011, pp. 1-8.
28. K.-Y. Chang, C.-S. Chen, and Y.-P. Hung. "Ordinal hyperplanes ranker with cost sensitivities for age estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 585-592.
29. T. Wu, P. Turaga, and R. Chellappa, "Age estimation and face verification across aging using landmarks," IEEE Trans. Inf. Forensics Security, vol. 7, no. 6, pp. 1780-1788, Dec. 2012.
30. P. Thukral, K. Mitra, and R. Chellappa, "A hierarchical approach for human age estimation," in Proc. IEEE Int. Conf. Acous., Speech Signal Process., 2012, pp. 1529-1532.
31. J. Lu and Y. Tan, "Ordinary preserving manifold analysis for human age and head pose estimation," IEEE Trans. Human-Mach. Syst., vol. 43, no. 2, pp. 249-258, Mar. 2013.
32. W.-L. Chao, J.-Z. Liu, and J.-J. Ding, "Facial age estimation based on label-sensitive learning and age-oriented regression," Pattern Recognit., vol. 46, no. 3, pp. 628-641, Mar. 2013.
33. G. Guo and G. Mu, "Joint estimation of age, gender and ethnicity: CCA vs. PLS," in Proc. Int. Conf. Automat. Face Gesture Recognit., 2013, pp. 1-6.
34. X. Geng, C. Yin, and Z.-H. Zhou, "Facial age estimation by learning from label distributions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 10, pp. 2401-2412, Oct. 2013.
35. E. Mäkinen and R. Raisamo, "An experimental comparison of gender classification methods," Pattern Recognit. Lett., vol. 29, no. 10, pp. 1544-1556, Jul. 2008.
36. R. Brunelli and T. Poggio, "HyberBF Networks for gender classification," in Proc. DARPA Image Understanding Workshop, 1995, pp. 311-314.
37. B. Moghaddam and M. Yang, "Gender classification with support vector machines," Proc. 4th Int. Conf. Automat. Face Gesture Recognit., 2000, pp. 306-311.
38. P. J. Phillips,H. Moon, S. A. Rizvi, and P. J. Rauss, "The FERET evaluation methodology for face-recognition algorithms," IEEE Trans. Pattern Anal.Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
39. S. Gutta, J. J. Huang, P. Jonathon, and H. Wechsler, "Mixture of experts for classification of gender, ethnic origin, and pose of human faces," IEEE Trans. Neural Netw., vol. 11, no. 4, pp. 948-960, Jul. 2000.
40. P. Viola and M. J. Jones, "Robust real-time object detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, May 2004.
41. B. Wu, H. Ai, and C. Huang, "LUT-based AdaBoost for gender classification," in Proc. 4th Int. Conf. Audio-Video-Based Biometric Person Authentication, 2003, pp. 104-110.
42. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," in Proc. Eur. Conf. Comput. Vis., 1998, pp. 484-498.
43. Y. Saatci and C. Town, "Cascaded classification of gender and facial expression using active appearance models," in Proc. 4th Int. Conf. Automat. Face Gesture Recognit., 2006, pp. 393-400.
44. S. Baluja and H. A. Rowley, "Boosting sex identification performance," Int. J. Comput. Vis., vol. 71, no. 1, pp. 111-119, Jan. 2007.
45. W. Gao and H. Ai, "Face gender classification on consumer images in a multiethnic environment," in Proc. Int. Conf. Biometrics, 2009, pp. 169-178.
46. J. Wu, W. A. P. Smith, and E. R. Hancock, "Facial gender classification using shape-from-shading," Image Vis. Comput., vol. 28, no. 6, pp. 1039-1048, Jun. 2010.
47. S. Mozaffari, H. Behravan, and R. Akbari, "Gender classification using single frontal image per person: Combination of appearance and geometric based features," in Proc. Int. Conf. Pattern Recognit., 2010, pp. 1192-1195.
48. Y. Wang, K. Ricanek, C. Chen, and Y. Chang, "Gender classification from infants to seniors," in Proc. 4th Int. Conf. Biometrics: Theory Appl. Syst., 2010, pp. 1-6.
49. Y. Dong and D. L. Woodard, "Eyebrow shape-based features for biometric recognition and gender classification: A feasibility study," in Proc. Int. Joint Conf. Biometrics, 2011, pp. 1-8.
50. G. Zhang and Y. Wang, "Hierarchical and discriminative bag of features for face profile and ear based gender classification," in Proc. Int. Joint Conf. Biometrics, 2011, pp. 1-8.
51. J. Bekios-Calfa, J. M. Buenaposada, and L. Baumela, "Revisiting linear discriminant techniques in gender recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 4, pp. 858-864, Apr. 2011.
52. L. Ballihi, B. B. Amor, M. Daoudi, A. Srivastava, and D. Aboutajdine, "Boosting 3-D-geometric features for efficient face recognition and gender classification," IEEE Trans. Inf. Forensics Security, vol. 7, no. 6, pp. 1766-1779, Dec. 2012.
53. C. Chen and A. Ross, "Local gradient gabor pattern (LGGP) with applications in face recognition, cross-spectral matching and soft biometrics," Proc. SPIE, 8712, Biometric and Surveillance Technology for Human and Activity Identification X, 87120R, May 2013.
54. J. E. Tapia and C. A. Perez, "Gender classification based on fusion of different spatial scale features selected by mutual information from histogram of LBP, intensity, and shape," IEEE Trans. Inf. Forensic Security, vol. 8, no. 3, pp. 488-499, Mar. 2013.
55. U. Tariq, Y. Hu, and T. S. Huang, "Gender and Ethnicity identification from silhouetted face profiles," in Proc. 16th Int. Conf. Image Process., 2009, pp. 2413-2416.
56. H. Han, C. Otto, and A. K. Jain, "Age estimation from face images: Human vs. machine performance," in Proc. Int. Conf. Biometrics, 2013, pp. 1-8.
57. Cognitec Systems GmbH. (2010). FaceVACS software developer kit [Online]. Available: http://www.cognitec-systems.de
58. T. Serre, L. Wolf, and T. Poggio, "Object recognition with features inspired by visual cortex," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 994-1000.
59. J. Mutch and D. Lowe, "Object class recognition and localization using sparse features with limited receptive fields," Int. J. Comput. Vis., vol. 80, no. 1, pp. 45-57, Oct. 2008.
60. E. Meyers and L. Wolf, "Using biologically inspired features for face processing," Int. J. Comput. Vis., vol. 76, no. 1, pp. 93-104, Jan. 2008.
61. C. Liu and H. Wechsler, "Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition," IEEE Trans. Image Process., vol. 11, no. 4, pp. 467-476, Apr. 2002.
62. V. N. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
63. K. Ricanek and T. Tesafaye, "MORPH: A longitudinal image database of normal adult age-progression," in Proc. Int. Conf. Automat. Face Gesture Recognit., 2006, pp. 341-345.
64. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the Cat's visual cortex," J. Physiol., vol. 160, no. 1, pp. 106-154, Jan. 1962.
65. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, Aug. 1997.
66. K. Tsukahara, K. Sugata, O. Osanai, A. Ohuchi, Y. Miyauchi, M. Takizawa, M. Hotta, and T. Kitahara, "Comparison of age-related changes in facial wrinkles and sagging in the skin of Japanese, Chinese and Thai women," J. Dermatol. Sci., vol. 47, no. 1, pp. 19-28, Jul. 2007.
67. E. Brown and D. I. Perrett, "What gives a face its gender?" Perception, vol. 22, no. 7, pp. 829-840, Jul. 1993.
68. L. Zhao and S. Bentin, "The role of features and configural processing in face-race classification," Vis. Res., vol. 51, nos. 23/24, pp. 2462-2470, Dec. 2011.
69. E. Tabassi, C. Wilson, and C. Watson, "Fingerprint image quality," Nat. Inst. Standards Technol., Gaithersburg, MD, USA, The Image Group of Information Access Division, Tech. Rep. NISTIR7151, Aug. 2004.
70. P. Grother and E. Tabassi, "Performance of biometric quality measures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 4, pp. 531-543, Apr. 2007.
71. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," Univ. Massachusetts, School of Computer Science, Amherst, MA, USA, Tech. Rep. 07-49, Oct. 2007.
72. K. O. May, "A set of independent necessary and sufficient conditions for simple majority decisions," Econometrica, vol. 20, no. 4, pp. 680-684, Oct. 1952.