Hand-drawn face sketch recognition by humans and a PCA-based algorithm for forensic applications

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 40, Issue 3, 2010, Pages 475-485

  Zhang, Yong ^a   McCullough, Christine ^a   Sullins, John R ^a   Ross, Christine R ^b  

^a YOUNGSTOWN STATE UNIVERSITY   (United States)

^b Ohio Bureau of Criminal Identification and Investigation   (United States)

Author keywords

Algorithm; Artist; Biometrics; Face; Forensics; Humans; Recognition; Sketch

Indexed keywords

ARTIST; CRIMINAL INVESTIGATION; DATA SETS; DISTINCTIVE FEATURES; FORENSIC APPLICATIONS; GEOMETRICAL DISTORTION; HUMAN PERFORMANCE; HUMAN VISUAL PERCEPTION; PCA ALGORITHMS; PRINCIPLE COMPONENT ANALYSIS; RECOGNITION ACCURACY; SCORE-LEVEL FUSION; SKETCH RECOGNITION; SUM RULE; TRANSFORMATION FUNCTIONS;

ALGORITHMS; BIOMETRICS; FACE RECOGNITION; PHOTOGRAPHY;

DRAWING (GRAPHICS);

EID: 77951205664     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2010.2041654     Document Type: Conference Paper

References (57)

1. K. T. Taylor, Forensic Art and Illustration. Boca Raton, FL: CRC Press, 2000.
2. L. Gibson, Forensic Art Essentials: A Manual for Law Enforcement Artists. New York: Academic, 2007.
3. L. Gibson and D. F. Mills, Faces of Evil: Kidnappers, Murderers, Rapists and the Forensic Artist Who Puts Them Behind Bars. Liberty Corner, NJ: New Horizon Press, 2006.
4. J. Boylan, Portraits of Guilt: The Woman Who Profiles the Faces of America's Deadliest Criminals. New York: Pocket Star, 2001.
5. D. Mcquiston-Surrett, L. D. Topp, and R. S. Malpass, "Use of facial composite systems in U.S. law enforcement agencies," Psychol., Crime Law, vol.12, no.5, pp. 505-517, Oct. 2006.
6. C. D. Frowd, D. Carson, H. Ness, J. Richardson, L. Morrison, S. McLanaghan, and P. J. B. Hancock, "A forensically valid comparison of facial composite systems," Psychol., Crime Law, vol.11, no.1, pp. 33-52, Mar. 2005. (Pubitemid 40131420)
7. C. D. Frowd, D. McQuiston-Surrett, S. Anandaciva, C. E. Ireland, and P. J. B. Hancock, "An evaluation of US systems for facial composite production," Ergonomics, vol.50, no.12, pp. 1987-1998, Dec. 2007. (Pubitemid 350176721)
8. C. D. Frowd, V. Bruce, A. McIntyre, D. Ross, S. Fields, Y. Plenderleith, and P. J. B. Hancock, "Implementing holistic dimensions for a facial composite system," J. Multimedia, vol.1, no.3, pp. 42-51, Jun. 2006.
9. C. D. Frowd, P. J. B. Hancock, and D. Carson, "EvoFIT: A holistic evolutionary facial imaging technique for creating composites," ACM Trans. Appl. Perception, vol.1, no.1, pp. 19-39, Jul. 2004.
10. C. D. Frowd, V. Bruce, D. Ross, A. McIntyre, and P. J. B. Hancock, "An application of caricature: How to improve the recognition of facial composites," Vis. Cogn., vol.15, no.8, pp. 954-984, Nov. 2007. (Pubitemid 350011583)
11. G. L. Wells and L. E. Hasel, "Facial composite production by eyewitnesses," Current Directions Psychol. Sci., vol.16, no.1, pp. 6-10, Feb. 2007.
12. G. L. Wells, S. D. Charman, and E. A. Olson, "Building face composites can harm lineup identification performance," J. Exp. Psychol.: Appl., vol.11, no.3, pp. 147-156, Sep. 2005.
13. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol.35, no.4, pp. 399-458, Dec. 2003.
14. K. W. Bowyer, K. Chang, and P. J. Flynn, "A survey of approaches and challenges in 3D and multi-modal 3D +2D face recognition," Comput. Vis. Image Underst., vol.101, no.1, pp. 1-15, Jan. 2006. (Pubitemid 41642085)
15. P. Sinha, B. J. Balas, Y. Ostrovsky, and R. Russell, "Face recognition by humans: 19 results all computer vision researchers should know about," Proc. IEEE, vol.94, no.11, pp. 1948-1962, Nov. 2006. (Pubitemid 46445564)
16. V. Bruce, P. J. B. Hancock, and A. M. Burton, "Comparisons between human and computer recognition of faces," in Proc. 3rd IEEE Int. Conf. Autom. Face Gesture Recog., Washington, DC, 1998, pp. 408-413.
17. P. J. B. Hancock, V. Bruce, and A. M. Burton, "Testing principal component representations for faces," in Proc. 4th Neural Comput. Psychol. Workshop, J. A. Bullinaria, D. W. Glasspool, and G. Houghton, Eds., 1997, pp. 84-97.
18. A. J. O'Toole, P. J. Phillips, F. Jiang, J. H. Ayyad, N. Penard, and H. Abdi, "Face recognition algorithms surpass humans matching faces over changes in illumination," IEEE Trans. Pattern Anal. Mach. Intell., vol.29, no.9, pp. 1642-1646, Sep. 2007. (Pubitemid 47299917)
19. A. J. O'Toole, H. Abdi, F. Jiang, and P. J. Phillips, "Fusing faceverification algorithms and humans," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.37, no.5, pp. 1149-1155, Oct. 2007.
20. A. Adler and M. E. Schuckers, "Comparing human and automatic face recognition performance," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.37, no.5, pp. 1248-1255, Oct. 2007. (Pubitemid 47534590)
21. R. G. Uhl and N. V. Lobo, "A framework for recognizing a facial image from a police sketch," in Proc. Conf. Comput. Vis. Pattern Recog., San Francisco, CA, 1996, pp. 586-593.
22. X. Tang and X. Wang, "Face sketch recognition," IEEE Trans. Circuits Syst. Video Technol., vol.14, no.1, pp. 50-57, Jan. 2004.
23. X. Tang and X. Wang, "Face sketch synthesis and recognition," in Proc. IEEE Int. Conf. Comput. Vis., 2003, pp. 687-694.
24. X. Wang and X. Tang, "Face photo-sketch synthesis and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.11, pp. 1955-1967, Nov. 2009.
25. P. C. Yuen and C. H. Man, "Human face image searching system using sketches," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.37, no.4, pp. 493-504, Jul. 2007.
26. H. Wechsler, Reliable Face Recognition Methods, System Design, Implementation and Evaluation. New York: Springer-Verlag, 2007.
27. A. A. Ross, K. Nandakumar, and A. K. Jain, Handbook of Multibiometrics. New York: Springer-Verlag, 2006.
28. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal.Mach. Intell., vol.20, no.3, pp. 226-239, Mar. 1998. (Pubitemid 128741312)
29. J. Kittler and F. M. Alkoot, "Sum versus vote fusion in multiple classifier systems," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.1, pp. 110- 115, Jan. 2003.
30. K. W. Bowyer, K. Chang, P. J. Flynn, and X. Chen, "Face recognition using 2-D, 3-D and infrared: Is multimodal better than multisample?," Proc. IEEE, vol.94, no.11, pp. 2000-2012, Nov. 2006. (Pubitemid 46445567)
31. S. J. Canavan, M. P. Kozak, Y. Zhang, S. R. Sullins, M. A. Shreve, and D. B. Goldgof, "Face recognition by multi-frame fusion of rotating heads in videos," in Proc. IEEE Int. Conf. BTAS, Washington, DC, Sep. 27-29, 2007, pp. 1-6.
32. D. Thomas, K. W. Bowyer, and P. J. Flynn, "Multi-frame approaches to improve face recognition," in Proc. IEEE Workshop Motion Video Comput., Austin, TX, 2007, p. 19.
33. D. Thomas, K.W. Bowyer, and P. J. Flynn, "Strategies for improving face recognition from video," in Advances in Biometrics: Sensors, Systems and Algorithms, N. Ratha and V. Govindaraju, Eds. New York: Springer- Verlag, 2007.
34. V. Bruce, H. Ness, P. J. Hancock, C. Newman, and J. Rarity, "Four heads are better than one: Combining face composites yields improvements in face likeness," J. Appl. Psychol., vol.87, no.5, pp. 894- 902, Oct. 2002.
35. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol.3, no.1, pp. 71-86, 1991.
36. [Online]. Available: www.cs.colostate.edu/evalfacerec/
37. D. A. Roark, A. J. O'Toole, and H. Abdi, "Human recognition of familiar and unfamiliar people in naturalistic video," in Proc. IEEE Int. Workshop Anal. Modeling Faces Gestures, Nice, France, 2003, pp. 36-43.
38. A. M. Burton, S. Wilson, M. Cowan, and V. Bruce, "Face recognition in poor-quality video: Evidence from security surveillance," Psychol. Sci., vol.10, no.3, pp. 243-248, May 1999.
39. V. Bruce, Z. Henderson, C. Newman, and A. M. Burton, "Matching identities of familiar and unfamiliar faces caught on CCTV images," J. Exp. Psychol.: Appl., vol.7, no.3, pp. 207-218, Sep. 2001.
40. K. W. Bowyer and P. J. Phillips, Empirical Evaluation Techniques in Computer Vision (Practitioners). Los Alamitos, CA: IEEE Comput. Soc. Press, 1998.
41. S. Z. Li and A. K. Jain, Eds., Handbook of Face Recognition. NewYork: Springer-Verlag, 2005.
42. P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, "The FERET evaluation methodology for face-recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol.22, no.10, pp. 1090-1104, Oct. 2000.
43. G. Rhodes, Superportraits: Caricatures and Recognition, Essays in Cognitive Psychology. Hove, U.K.: Psychology Press, 1997.
44. G. Rhodes and T. Tremewan, "Understanding face recognition: Caricature effects, inversion, and the homogeneity problem," Vis. Cogn., vol. 1, no. 2/3, pp. 275-311, Apr. 1994.
45. P. P. W. Chang, S. C. Levine, and P. J. Benson, "Children's recognition of caricatures," Dev. Psychol., vol.38, no.6, pp. 1038-1051, Nov. 2002.
46. J. Cohen, Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Hillsdale, NJ: Lawrence Erlbaum, 1988.
47. J. E. Kittler, W. Menard, and K. A. Phillips, "Weight concerns in individuals with body dysmorphic disorder," Eat. Behav., vol.8, no.1, pp. 115- 120, Jan. 2007.
48. P. J. B. Hancock, V. Bruce, and M. A. Burton, "A comparison of two computer-based face identification systems with human perceptions of faces," Vis. Res., vol. 38, no. 15/16, pp. 2277-2288, Aug. 1998.
49. J. Kittler, M. Ballette, J. Czyz, F. Roli, and L. Vandendorpe, "Enhancing the performance of personal identity authentication systems by fusion of face verification experts," in Proc. IEEE Int. Conf. Multimedia Expo, 2002, vol.2, pp. 581-584.
50. J.-E. Lee, A. K. Jain, and R. Jin, "Scars, marks and tattoos (SMT): Soft biometric for suspect and victim identification," in Proc. IEEE Biometric Symp., 2008, pp. 1-8.
51. B. Kamgar-Parsi, E. Lawson, and P. Baker, "Toward a human-like approach to face recognition," in Proc. IEEE Int. Conf. BTAS, Washington, DC, Sep. 27-29, 2007, pp. 1-6.
52. B. Kamgar-Parsi, S. Krawczyk, E. Lawson, and R. Stanchak, "Toward a human-like similarity measure for face recognition," in Proc. Biometric Consortium Conf.: Biometrics Symp., Baltimore, MD, 2006, pp. 1-6.
53. R. Russell, P. Sinha, I. Biederman, and M. Nederhouser, "Is pigmentation important for face recognition? Evidence from contrast negation," Perception, vol.35, no.6, pp. 749-759, 2006. (Pubitemid 44022033)
54. V. Bruce, E. Hanna, N. Dench, P. Healy, and A. M. Burton, "The importance of 'mass' in line drawings of faces," Appl. Cogn. Psychol., vol.6, no.7, pp. 619-628, Dec. 1992.
55. D. E. Pearson and J. A. Robinson, "Visual communication at very low data rates," Proc. IEEE, vol.73, no.4, pp. 795-812, Apr. 1985.
56. C. D. Frowd, D. Carson, H. Ness, D. McQuiston, J. Richardson, H. Baldwin, and P. J. B. Hancock, "Contemporary composite techniques: The impact of a forensically-relevant target delay," Legal Criminol. Psychol., vol.10, no.1, pp. 63-81, Feb. 2005. (Pubitemid 40343218)
57. G. Medioni, J. Choi, C.-H. Kuo, and D. Fidaleo, "Identifying noncooperative subjects at a distance using face images and inferred threedimensional face models," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.39, no.1, pp. 12-24, Jan. 2009.