Matching composite sketches to face photos: A component-based approach

IEEE Transactions on Information Forensics and Security

Volumn 8, Issue 1, 2013, Pages 191-204

  Han, Hu ^a   Klare, Brendan F ^b   Bonnen, Kathryn ^a   Jain, Anil K ^a,c  

^a Michigan State University   (United States)

^b NOBLIS   (United States)

^c Korea University   (South Korea)

Author keywords

Component based face representation; composite sketch; face recognition; forensic sketch; heterogeneous face recognition; modality gap

Indexed keywords

ACTIVE SHAPE MODEL; CBR; COMPONENT BASED; COMPONENT BASED APPROACH; FACE RECOGNITION SYSTEMS; FACE REPRESENTATIONS; FACIAL COMPONENTS; FACIAL LANDMARK; FORENSIC SKETCH; LAW-ENFORCEMENT AGENCIES; LOCAL BINARY PATTERNS; MATCHING PERFORMANCE; MODALITY GAP; MULTISCALES; PROTOTYPE SYSTEM; SIMILARITY SCORES; SKETCH RECOGNITION; SOFTWARE SYSTEMS;

FACE RECOGNITION; IMAGE SEGMENTATION; LAW ENFORCEMENT; PHOTOGRAPHY;

DRAWING (GRAPHICS);

EID: 84872110686     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2012.2228856     Document Type: Article

References (47)

1. K. T. Taylor, Forensic Art and Illustration. Boca Raton, FL: CRC Press, 2000.
2. D. Mcquiston, L. Topp, and R. Malpass, "Use of facial composite systems in US law enforcement agencies," Psychology, Crime and Law, vol. 12, no. 5, pp. 505-517, 2006. (Pubitemid 44372225)
3. X. Tang and X.Wang, "Face sketch recognition," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 1, pp. 50-57, Jan. 2004.
4. Q. Liu, X. Tang, H. Jin, H. Lu, and S.Ma, "A nonlinear approach for face sketch synthesis and recognition," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005, pp. 1005-1010. (Pubitemid 43897302)
5. D. Lin and X. Tang, "Inter-modality face recognition," in Proc. Eur. Conf. Computer Vision, 2006, pp. 13-26. (Pubitemid 44029617)
6. X. Wang and X. Tang, "Face photo-sketch synthesis and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 1955-1967, Nov. 2009.
7. B. Klare, Z. Li, and A. Jain, "Matching forensic sketches to mug shot photos," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 639-646, Mar. 2011.
8. P. C. Yuen and C. H. Man, "Human face image searching system using sketches," IEEE Trans. Syst., Man, Cybern. A, Syst. Humans, vol. 37, no. 4, pp. 493-504, Jul. 2007. (Pubitemid 47022853)
9. G.Wells and L. Hasel, "Facial composite production by eyewitnesses," Current Directions Psychol. Sci., vol. 16, no. 1, pp. 6-10, Feb. 2007.
10. C. Frowd, P. Hancock, and D. Carson, EvoFIT: A Holistic, "Evolutionary facial imaging technique for creating composites," ACM Trans. Appl. Psychol., vol. 1, no. 1, pp. 19-39, Jul. 2004.
11. C. Frowd, D. Carson, H. Ness, D. McQuiston, J. Richardson, H. Baldwin, and P. Hancock, "Contemporary composite techniques: The impact of a forensically-relevant target delay," Legal Criminol. Psychol., vol. 10, no. 1, pp. 63-81, Feb. 2005. (Pubitemid 40343218)
12. X. Wang and X. Tang, "Hallucinating face by eigentransformation, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 3, pp. 425-434, Aug. 2005. (Pubitemid 41194754)
13. W. Zhang, X. Wang, and X. Tang, "Coupled information-theoretic encoding for face photo-sketch recognition," in Proc. Conf. Computer Vision and Pattern Recognition, 2011, pp. 513-520.
14. A. Sharma and D. Jacobs, "Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 593-600.
15. X. Gao, J. Zhong, J. Li, and C. Tian, "Face sketch synthesis algorithm based on E-HMM and selective ensemble," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 4, pp. 487-496, Apr. 2008.
16. Handbook of Face Recognition, S. Z. Li andA.K. Jain, Eds., 2nd ed. New York: Springer, 2011.
17. Z. Lei and S. Li, "Coupled spectral regression for matching hegerogeneous faces," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009, pp. 1123-1128.
18. B. Heisele, P. Ho, J. Wu, and T. Poggio, "Face recognition: Component- based versus global approaches," Comput. Vis. Image Understand., vol. 91, no. 1, pp. 6-21, Jul. 2003.
19. Y. Ivanov, B.Heisele, and T. Serre, "Using component features for face recognition," in Proc. Automatic Face and Gesture Recognition, 2004, pp. 421-426.
20. D. Lin and X. Tang, "Recognize high resolution faces: From macrocosm to microcosm," in Proc. IEEE Computer Vision and Pattern Recognition, 2006, pp. 1355-1362.
21. P. Sinha, B. Balas, Y. Ostrovsky, and R. Russell, "Face recognition by humans: Nineteen results all computer vision researchers should know about," Proc. IEEE, vol. 94, no. 11, pp. 1948-1962, Nov. 2006.
22. B. Klare, A. Paulino, and A. Jain, "Analysis of facial features in identical twins," in Proc. Int. Joint Conf. Biometrics, 2011, pp. 1-8.
23. J. Huang, V. Blanz, and B. Heisele, "Face recognition using component- based SVM classification and morphable models," in Proc. First Int. Workshop on Pattern Recognition With Support Vector Machines, 2002, pp. 334-341.
24. J. W. Brahan, K. P. Lam, H. Chan, and W. Leung, "AICAMS - Artificial intelligence crime analysis and management system," Knowledge- Based Syst., vol. 11, no. 5-6, pp. 355-361, 1998. (Pubitemid 128423111)
25. PittPatt Face Recognition SDK, Pittsburgh Pattern Recognition [Online]. Available: http://www.pittpatt.com
26. H. Han, S. Shan, X. Chen, and W. Gao, "Illumination transfer using homomorphic wavelet filtering and its application to light-insensitive face recognition," in Proc. Automatic Face and Gesture Recognition, 2008, pp. 1-6.
27. H. Han, S. Shan, L. Qing, X. Chen, and W. Gao, "Lighting aware preprocessing for face recognition across varying illumination," in Proc. Eur. Conf. Computer Vision, 2010, pp. 308-321.
28. H. Han, S. Shan, X. Chen, S. Lao, and W. Gao, "Separability oriented preprocessing for illumination-invariant face recognition," in Proc. Eur. Conf. Computer Vision, 2012, pp. 307-320.
29. C. Jones and A. Abbott, "Color face recognition by hypercomplex gabor analysis," in Proc. Automatic Face and Gesture Recognition, 2006, pp. 126-131. (Pubitemid 44711339)
30. J. Yang and C. Liu, "A general discriminantmodel for color face recognition," in Proc. Int. Conf. Computer Vision, 2007, pp. 1-6.
31. T. Cootes, C. Taylor, D. Cooper, and J. Graham, "Active shape modelstheir training and application," Comput. Vis. Image Understand., vol. 61, no. 1, pp. 38-59, Jan. 1995.
32. S. Milborrow and F. Nicolls, "Locating facial features with an extended active shape model," in Proc. Eur. Conf. Computer Vision, 2008, pp. 504-513.
33. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002. (Pubitemid 34835471)
34. M. Heikkila andM. Pietikainen, "A texture-basedmethod formodeling the background and detecting moving objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 657-662, Apr. 2006. (Pubitemid 43264663)
35. M. Pietikainen, T. Nurmela, T. Maenpaa, and M. Turtinen, "Viewbased recognition of real-world textures," Pattern Recognit., vol. 37, no. 2, pp. 313-323, Feb. 2004.
36. A. M. Martinez and R. Benavente, The AR Face Database CVC Tech. Rep., 1998.
37. FACES 4.0, IQ Biometrix 2011 [Online]. Available: http://www. iqbiometrix.com
38. Identi-Kit, Identi-Kit Solutions 2011 [Online]. Available: http://www. identikit.net/
39. National Institute of Standards and Technology (NIST), NIST Special Database 32 - Multiple Encounter Dataset (MEDS) 2011 [Online]. Available: http://www.nist.gov/itl/iad/ig/sd32.cfm
40. FaceVACS Software Developer Kit, Cognitec Systems GmbH 2010 [Online]. Available: http://www.cognitec-systems.de
41. A. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern Recognit., vol. 38, no. 12, pp. 2270-2285, Dec. 2005. (Pubitemid 41336698)
42. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
43. C. Meissner and J. Brigham, "Thirty years of investigating the ownrace bias in memory for faces: A meta-analytic review," Psychology, Public Policy, and Law, vol. 7, no. 1, pp. 3-35, Mar. 2001. (Pubitemid 33656932)
44. SketchCop, SketchCop Solutions 2011 [Online]. Available: http://sketchcop.com/
45. A. K. Jain, B.Klare, andU. Park, "Face matching and retrieval in forensics applications," IEEE Multimedia, vol. 19, no. 1, p. 20, Jan. 2012.
46. R. K. Bothwell, J. C. Brigham, and R. S. Malpass, "Cross-racial identification," Personality Social Psychol. Bull., vol. 15, no. 1, pp. 19-25, 1989.
47. C. Otto, H. Han, and A. K. Jain, "How does aging affect facial components?," in Proc. ECCVWIAFWorkshop, Florence, Italy, Oct. 7-13, 2012, pp. 189-198.