Comparison of human and computer performance across face recognition experiments

Image and Vision Computing

Volumn 32, Issue 1, 2014, Pages 74-85

  Phillips, P Jonathon ^a   O'Toole, Alice J ^b  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^b UNIVERSITY OF TEXAS AT DALLAS   (United States)

Author keywords

Algorithm performance; Challenge problem; Face recognition; Human performance

Indexed keywords

ALGORITHMS; EXPERIMENTS; IMAGE MATCHING;

ALGORITHM PERFORMANCE; CHALLENGE PROBLEMS; COMPUTER PERFORMANCE; FACE RECOGNITION EXPERIMENT; HUMAN PERFORMANCE; PERFORMANCE ANALYSIS; PERFORMANCE INDICES; VIDEO IMAGERY;

FACE RECOGNITION;

EID: 84892489452     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2013.12.002     Document Type: Review

References (45)

1. A.J. O'Toole, P.J. Phillips, F. Jiang, J. Ayyad, N. Pénard, and H. Abdi Face recognition algorithms surpass humans matching faces across changes in illumination IEEE Trans. PAMI 29 1642-1646 2007 1642 1646
2. A.J. O'Toole, P.J. Phillips, and A. Narvekar Humans versus algorithms: comparisons from the FRVT Eighth International Conference on Automatic Face and Gesture Recognition 2006
3. P.J. Phillips, W.T. Scruggs, A.J. O'Toole, P.J. Flynn, K.W. Bowyer, C.L. Schott, and M. Sharpe FRVT 2006 and ICE 2006 large-scale results IEEE Trans. PAMI 32 2010 831 846
4. A.J. O'Toole, X. An, J. Dunlop, V. Natu, and P.J. Phillips Comparing face recognition algorithms to humans on challenging tasks ACM Trans. Appl. Percept. 9 2012
5. J.J. DiCarlo Untangling object recognition:which neuronal population codes can ex- 7Q1125 plain human object recognition performance? in: Neural Computation: Population 713 Coding of High-Level Representations 2011
6. N. Kriegeskorte, M. Mur, and P. Bandettini Representational similarity analysis - connecting the branches of systems neuroscience Front. Syst. Neurosci. 2 2008
7. A.J. O'Toole, P.J. Phillips, S. Weimer, D.A. Roark, J. Ayyad, R. Barwick, and J. Dunlop Recognizing people from dynamic and stable faces and bodies: dissecting identity with a fusion approach Vis. Res. 51 2011 74 83
8. A. Rice, P.J. Phillips, V. Natu, X. An, and A.J. O'Toole Unaware person recognition from the body when face identification fails Psychol. Sci. 24 2013 2235 2243
9. P.J. Phillips Improving face recognition technology IEEE Comput. 2011 96 98
10. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek Overview of the face recognition grand challenge IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005 947 954
11. P.J. Phillips, J.R. Beveridge, B.A. Draper, G. Givens, A.J. O'Toole, D.S. Bolme, J. Dunlop, Y.M. Lui, H. Sahibzada, and S. Weimer An introduction to the good, the bad, and the ugly face recognition challenge problem Proceedings Ninth IEEE International Conference on Automatic Face and Gesture Recognition 2011
12. J.R. Beveridge, D. Bolme, B.A. Draper, and M. Teixera The CSU face identification evaluation system Mach. Vis. Appl. 16 2005 128 138
13. H. Moon, and P.J. Phillips Computational and performance aspects of PCA-based face-recognition algorithms Perception 30 2001 303 321
14. M. Turk, and A. Pentland Eigenfaces for recognition J. Cogn. Neurosci. 3 1991 71 86
15. C. Liu Capitalize on dimensionality increasing techniques for improving face recognition performance IEEE Trans. PAMI 28 2006 725 737
16. M. Husken, B. Brauckmann, S. Gehlen, and C. von der Malsburg Strategies and benefits of fusion of 2D and 3D face recognition IEEE Workshop on Face Recognition Grand Challenge Experiments 2005 Computer Society Digital Library
17. C. Xie, M. Savvides, and V. Kumar Kernel correlation filter based redundant class-dependence feature analysis (KCFA) on FRGC2.0 data IEEE International Workshop Analysis and Modeling Faces and Gestures 2005 32 43
18. A.J. O'Toole, J. Harms, S.L. Snow, D.R. Hurst, M.R. Pappas, J.H. Ayyad, and H. Abdi A video database of moving faces and people IEEE Trans. PAMI 27 2005 812 816
19. P.J. Phillips, P.J. Flynn, J.R. Beveridge, W.T. Scruggs, A.J. O'Toole, D. Bolme, K.W. Bowyer, B.A. Draper, G.H. Givens, Y.M. Lui, H. Zahibsada, J.A. Scallan III, and S. Weimer Overview of the multiple biometrics grand challenge Proceedings Third IAPR International Conference on Biometrics 2009
20. Y.-C. Chen, V.M. Patel, P.J. Phillips, and R. Chellappa Dictionary-based face recognition from video Proceedings of the European Conference on Computer Vision 2012
21. J.P. Egan Signal Detection Theory and ROC Analysis 1975 Academic Press
22. N.A. Macmillan, and C.D. Creelman Detection Theory: A User's Guide 1991 Cambridge University Press Cambridge
23. G.H. Givens, J.R. Beveridge, P.J. Phillips, B.A. Draper, Y.M. Lui, and D.S. Bolme Introduction to face recognition and evaluation of algorithm performance Comput. Stat. Data Anal. 67 2013 236 247
24. J.R. Beveridge, G.H. Givens, P.J. Phillips, and B.A. Draper Factors that influence algorithm performance in the Face Recognition Grand Challenge Comput. Vis. Image Underst. 113 2009 750 762
25. R.S. Malpass, and J. Kravitz Recognition for faces of own and other race faces J. Pers. Soc. Psychol. 13 1969 330 334
26. C.A. Meissner, and J.C. Brigham Thirty years of investigating the own-race bias in memory for faces: a meta-analytic review Psychol. Public Policy Law 7 2001 3 35
27. R.K. Bothwell, J.C. Brigham, and R.S. Malpass Cross-racial identification Personal. Soc. Psychol. Bull. 15 1989 19 25
28. P.N. Shapiro, and S.D. Penrod Meta-analysis of face identification studies Psychol. Bull. 100 1986 139 156
29. P.J. Phillips, F. Jiang, A. Narvekar, and A.J. O'Toole An other-race effect for face recognition algorithms ACM Trans. Appl. Percept. 8 2011
30. N. Furl, P.J. Phillips, and A.J. O'Toole Face recognition algorithms and the other-race effect: computational mechanisms for a developmental contact hypothesis Cogn. Sci. 26 2002 797 815
31. M. Kirby, and L. Sirovich Application of the karhunen-loeve procedure for the characterization of human faces IEEE Trans. PAMI 12 1990 103 108
32. W. Zhao, A. Krishnaswamy, R. Chellappa, D. Swets, and J. Weng Discriminant analysis of principal components for face recognition H. Wechsler, P.J. Phillips, V. Bruce, F. Fogelman Soulie, T.S. Huang, Face Recognition: From Theory to Applications 1998 Springer-Verlag Berlin 73 85
33. K. Etemad, and R. Chellappa Discriminant analysis for recognition of human face images J. Opt. Soc. Am. A 14 1997 1724 1733
34. P. Belhumeur, J. Hespanha, and D. Kriegman Eigenfaces vs fisher faces: recognition using class specific linear projection IEEE Trans. PAMI 19 1997 711 720
35. A.J. O'Toole, P.J. Phillips, X. An, and J. Dunlop Demographic effects on estimates of automatic face recognition performance Proceedings, Ninth International Conference on Automatic Face and Gesture Recognition 2011
36. A.J. O'Toole, P.J. Phillips, X. An, and J. Dunlop Demographic effects on estimates of automatic face recognition performance Image Vis. Comput. 30 2012 169 176
37. A. O'Toole, H. Abdi, F. Jiang, and P.J. Phillips Fusing face recognition algorithms and humans IEEE Trans. Syst. Man Cybern. B 37 2007 1149 1155
38. I.S. Helland Partial least squares regression and statistical models Scand. J. Stat. 17 1990 97 114
39. R. Rosipal, and N. Kramer Overview and recent advances in partial least squares C. Saunders, M. Grobelnik, S. Gunn, J. Shawe-Taylor, Subspace, Latent Structure and Feature Selection Techniques 2006 Springer 34 51
40. P.J. Grother, G.W. Quinn, and P.J. Phillips MBE 2010: Report on the evaluation of 2D still-image face recognition algorithms, NISTIR 7709 National Institute of Standards and Technology 2010
41. R. Russell, B. Duchaine, and K. Nakayama Super-recognizers: people with extraordinary face recognition ability Psychon. Bull. Rev. 16 2009 252 257
42. A.M. Burton, S. Wilson, M. Cowan, and V. Bruce Face recognition in poor-quality video: evidence from security surveillance Psychol. Sci. 10 1999 243 248
43. W.-J. Lee, C. Wilkinson, A. Memon, and K. Houston Matching unfamiliar faces from poor quality closed-circuit television (CCTV) footage Axis Online J. CAHId 1 2009 19 28
44. C. Wilkinson, and R. Evans Are facial image analysis experts any better than the general public at identifying individuals from CCTV images? Sci. Justice 49 2009 191 196
45. R. Jenkins, D. White, X. Van Montfort, and A.M. Burton Variability in photos of the same face Cognition 121 2011 313 323