Comparing human and automatic face recognition performance

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 5, 2007, Pages 1248-1255

  Adler, Andy ^a   Schuckers, Michael E ^b,c  

^a CARLETON UNIVERSITY   (Canada)

^b ST LAWRENCE UNIVERSITY   (United States)

^c WEST VIRGINIA UNIVERSITY   (United States)

Author keywords

Biometrics; Detection error tradeoff; Face recognition; Performance analysis

Indexed keywords

ALGORITHMS; ERROR DETECTION; FACE RECOGNITION; IMAGE MATCHING; STATISTICAL METHODS;

AUTOMATIC FACE RECOGNITION (AFR); BIOMETRIC SYSTEMS; DETECTION ERROR TRADEOFF; HUMAN FACE RECOGNITION (HFR);

BIOMETRICS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; OBSERVER VARIATION; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; OBSERVER VARIATION; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 35148837975     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2007.907036     Document Type: Article

References (35)

1. A. Adler and J. Maclean, "Performance comparison of human and automatic face recognition," in Proc. Biometrics Consortium Conf., Washington, DC, Sep. 20-22, 2004.
2. D. M. Blackburn, J. M. Bone, and P. J. Phillips, FRVT 2000 evaluation report, 2001. [Online]. Available: http://www.frvt.org/DLs/ FRVT_2000.pdf
3. A. P. Bradley, "The use of the area under the ROC curve in the evaluation of machine learning algorithms," Pattern Recognit., vol. 30, no. 7, pp. 1145-1159, Jul. 1997.
4. V. Bruce, Z. Henderson, K. Greenwood, P. Hancock, M. Burton, and P. Miller, "Verification of face identities from images captured on video," J. Exper. Psychol., Appl., vol. 5, no. 4, pp. 339-360, Dec. 1999.
5. A. M. Burton, P. Miller, V. Bruce, P. J. B. Hancock, and Z. Henderson, "Human and automatic face recognition: A comparison across image formats," Vis. Res., vol. 41, no. 24, pp. 3185-3195, Nov. 2001.
6. C. H. Liu, H. Seetzen, A. M. Burton, and A. Chaudhuri, "Face recognition is robust with incongruent image resolution: Relationship to security video images," J. Exper. Psychol., Appl., vol. 9, no. 1, pp. 33-41, Mar. 2003.
7. C. Drummond and R. C. Holte, "What ROC curves can't do (and cost curves can)," in Proc. 1st Workshop ROCAI, 2004, pp. 19-26.
8. T. Fawcett, "ROC graphs: Notes and practical considerations for data tinning researchers," HP Labs., Palo Alto, CA, Tech. Rep. HPL-2003-4, 2003.
9. N. Furl, A. J. O'Toole, and P. J. Phillips, "Face recognition algorithms as models of the other race effect," Cogn. Sci., vol. 96, pp. 1-19, 2002.
10. K. Gates, "The past perfect promise of facial recognition technology," ACDIS (Arms Control, Disarmament, and International Security) GAT:1.2004, [Online]. Hvailable: http://www.acdis.uiuc.edu/Research/OPs/Gates/GatesOP.pdf
11. D. M. Green and J. A. Swets, Signal Detection Theory and Psychophysics. New York: Wiley, 1966.
12. S. Gong, S. J. McKenna, and A. Psarrou, Dynamic Vision: From Images to Face Recognition. London, U. K.: Imperial College Press, 2000.
13. P. J. B. Hancock, V. Bruce, and M. A. Burton, "A comparison of two computer-based face identification systems with human perceptions of faces," Vis. Res., vol. 38, no. 15/16, pp. 2277-2288, Aug. 1998.
14. J. A. Hanley and B. J. McNeil, "The meaning and use of the area under a receiver operating characteristic (ROC) curve," Radiology, vol. 143, pp. 29-36, 1982.
15. C. L. Herlitz, "Sex differences in face recognition - Women's faces make the difference," Brain Cogn., vol. 50, no. 1, pp. 121-128, Oct. 2002.
16. J. Hernández-Orallo, C. Ferri, N. Lachiche, and P. A. Flach, Eds., Proc. 1st Int. Workshop, ROCAI, Valencia, Spain, 2004.
17. A. K. Jain, K. Nandakumar, and A. Ross, "Score normalization in multi-modal biometric systems," Pattern Recognit., vol. 38, no. 12, pp. 2270-2285, Dec. 2005.
18. J. Karduan and O. Karduan, "Comparative diagnostic performance of three radiological procedures for the detection of lumbar disk herniation," Methods Inf. Med., vol. 29, no. 1, pp. 12-22, Jan. 1990.
19. R Kemp, N. Towell, and G. Pike, "When seeing should not be believing: Photographs, credit cards and fraud," Appl. Cogn. Psychol., vol. 11, no. 3, pp. 211-222, Jun. 1997.
20. S. Macskassy and F. Provost, "Confidence bands for ROC curves: Methods and an empirical study," in Proc. 1st Workshop ROCAI, 2004, pp. 61-70.
21. T. Mansfield and J. L. Wayman, Best Practices in Testing and Reporting Performance of Biometric Devices, 2002. [Online]. Available: Www.cesg.gov.uk/site/ast/biometrics/media/BestPractice.pdf
22. NIST, Fingerprint Vendor Technology Evaluation (FpVTE) 2003. [Online]. Available: http://fpvte.nist.gov/
23. NIST, NIST Special Database 18: Mugshot Identification Database (MID [Online]. Available: http://www.nist.gov/srd/nistsd18.htm
24. A. J. O'Toole, D. Roark, and H. Abdi, "Recognizing moving faces: A psychological and neural synthesis," Trends Cogn. Sci., vol. 6, no. 6, pp. 261-266, Jun. 2002.
25. P. J. Phillips, A. Martin, and C. L. Wilson, "An introduction to evaluating biometric systems," Computer, vol. 33, no. 2, pp. 56-63, Feb. 2000.
26. P. J. Phillips and E. M. Newton, "Meta-analysis of face recognition algorithms," in Proc. IEEE Int Conf. Autom. Face Gesture Recog., 2002, vol. 5, pp. 224-230.
27. P. J. Phillips, P. Grother, R. J. Micheals, D. M. Blackburn, E. Tabassi, and J. M. Bone, FRVT 2002: Evaluation report, 2003. [Online]. Available: http://www.frvt.org/DLs/FRVT_2002_Evaluation_Report.pdf
28. F. J. Provost, T. Fawcett, and R. Kohavi, "The case against accuracy estimation for comparing induction algorithms," in Proc. 15th Int. Conf. Machine Learning, 1998, pp. 445-453.
29. D. A. Roark, A. J. O'Toole, and H. Abdi, "Human recognition of familiar and unfamiliar people in naturalistic video analysis and modeling of faces and gestures," in Proc. IEEE Int. Workshop Anal. Model. Faces Gestures, Oct. 17, 2003, pp. 36-41.
30. M. Turk and A. Pentland, "Eigenfaces for recootion," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, Mar. 1991.
31. F. Wallholf, S. Muller, and G. Rigoll, "Recognition of face profiles from the MUGSHOT database using a hybrid connectionist/HMM approach," in Proc. IEEE Int. Conf. Acoust. Speech Signal, Salt Lake City, UT, Jul. 2001, pp. 1489-1492.
32. J. L. Wayman, "Fundamentals of biometric authentication technologies," in Proc. Card Tech/Secure Tech., 1999. [Online]. Available: http://www.engr.sjsu.edu/biometrics/nbtccw.pdf
33. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, Dec. 2003.
34. X.-H. Zhou, D. K. McClish, and N. A. Obuchowski, Statistical Methods in Diagnostic Medicine. Hoboken, NJ: Wiley, 2002.
35. P. J. Phillips, W. T. Scruggs, A. J. O'Toole, P. J. Flynn, K. W. Bowyer, C. L. Schott, and M. Sharpe, "FRVT 2006 and ICE 2006: Large-scale results," Nat. Inst. Standards and Technol., Gaithersburg, MD, NISTIR 7408, Mar. 2007.