Nighttime face recognition at large standoff: Cross-distance and cross-spectral matching

Pattern Recognition

Volumn 47, Issue 12, 2014, Pages 3750-3766

  Kang, Dongoh ^a   Han, Hu ^b   Jain, Anil K ^a,b   Lee, Seong Whan ^a  

^a Korea University   (South Korea)

^b Michigan State University   (United States)

Author keywords

Cross distance matching; Cross spectral matching; Heterogeneous face matching; Image restoration; K means clustering; Locally Linear Embedding (LLE); Nighttime face recognition

Indexed keywords

CAMERAS; IMAGE RECONSTRUCTION; INFRARED DEVICES; PROBES; RESTORATION; SECURITY SYSTEMS;

CROSS-DISTANCE MATCHING; FACE MATCHING; K-MEANS CLUSTERING; LOCALLY LINEAR EMBEDDING; SPECTRAL MATCHINGS;

FACE RECOGNITION;

EID: 84907712027     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.06.004     Document Type: Article

References (45)

1. Big Brother is DEFINITELY Watching You: Shocking Study Reveals UK has One CCTV for Every 32 People, 2011. [Online] 〈 http://www.dailymail.co.uk/news/article-1362493/One-CCTV-camera-32-people-Big-Brother-Britain.html 〉.
2. C. Norris, A Review of the Increased Use of CCTV and Video Surveillance for Crime Prevention Purposes in Europe, European Parliament, 2009. [Online] 〈 http://www.statewatch.org/news/2009/apr/ep-study-norris-cctv-video-surveillance.pdf 〉.
3. J.C. Klontz, A.K. Jain, A Case Study on Unconstrained Facial Recognition Using the Boston Marathon Bombings Suspects, MSU Technical Report, 2013. [Online] 〈 http://www.cse.msu.edu/biometrics/Publications/Face/KlontzJainCaseStudyUnconstrainedFacialRecognitionBostonMarathonBombimgSuspects.pdf 〉.
4. P.J. Phillips, P.J. Flynn, J.R. Beveridge, W.T. Scruggs, A.J. OToole, D. Bolme, K.W. Bowyer, B.A. Draper, G.H. Givens, Y.M. Lui, H. Sahibzada, J.A. Scallan, W. Samual, Overview of the multiple biometrics grand challenge, in: Proceedings of ICB, 2009, pp. 705-714.
5. D. Huang, Y. Wang, Y. Wang, A robust method for near infrared face recognition based on extended local binary pattern, in: Procedings of ISVC, 2007, pp. 437-446.
6. X. Zou, J. Kittler, K. Messer, Illumination invariant face recognition: a survey, in: Proceedings of IEEE BTAS, 2007.
7. Z. Pan, G.E. Healey, M. Prasad, and B.J. Tromberg Face recognition in hyperspectral images IEEE Trans. Pattern Anal. Mach. Intell. 25 2003 1552 1560
8. S. Zhao, R.-R. Grigat, An automatic face recognition system in the near infrared spectrum, in: Proceedings of MLDM, 2005, pp. 437-444.
9. L. Shen, J. He, S. Wu, S. Zheng, Face recognition from visible and near-infrared images using boosted directional binary code, in: Proceedings of ICIC, 2012, pp. 404-411.
10. S.Z. Li, R. Chu, S. Liao, and L. Zhang Illumination invariant face recognition using near-infrared images IEEE Trans. Pattern Anal. Mach. Intell. 29 2007 627 639
11. H. Maeng, H.-C. Choi, U. Park, S.-W. Lee, A. K. Jain, NFRAD: near-infrared face recognition at a distance, in: Proceedings of IJCB, 2011, pp. 1-7.
12. T. Bourlai, B. Cukic, Multi-spectral face recognition: identification of people in difficult environments, in: Proceedings of ISI, 2012, pp. 196-201.
13. F. Nicolo, and N.A. Schmid Long range cross-spectral face recognition: matching SWIR against visible light images IEEE Trans. Inf. Forensics Secur. 7 2012 1717 1726
14. Tactical Imager for Night/Day Extended-Range Surveillance WVHTCF, November 10, 2011. [Online] 〈 http://www.wvhtf.org/programs/advancedtech/activeswirimagingforlongrangenighttimesurveillanceandfacerecognition.php 〉.
15. S.Z. Li, and A.K. Jain Handbook of Face Recognition 2011 Springer-Verlag New York
16. B. Zhang, L. Zhang, D. Zhang, and L. Shen Directional binary code with application to PolyU near-infrared face database Pattern Recognit. Lett. 31 2010 2337 2344
17. H. Chang, D.-Y. Yeung, Y. Xiong, Super-resolution through neighbor embedding, in: Proceedings of IEEE CVPR, 2004.
18. J. Chen, D. Yi, J. Yang, G. Zaho, S.Z. Li, M. Pietikainen, Learning mappings for face synthesis from near infrared to visual light images, in: Proceedings of IEEE CVPR, 2009, pp. 156-163.
19. H. Han, S. Shan, X. Chen, S. Lao, W. Gao, Separability oriented preprocessing for illumination-insensitive face recognition, in: Proceedings of ECCV, 2012, pp. 307-320.
20. H. Han, S. Shan, X. Chen, and W. Gao A comparative study on illumination preprocessing in face recognition Pattern Recognit. 46 2013 1691 1699
21. J.-S. Lee Digital image enhancement and noise filtering by use of local statistics IEEE Trans. Pattern Anal. Mach. Intell. 2 1980 165 168
22. R. Wang, J. Yang, D. Yi, S.Z. Li, An analysis-by-synthesis method for heterogeneous face biometrics, in: Proceedings of ICB, 2009, pp. 319-326.
23. Z. Zhang, Y. Wang, Z. Zhang, Face synthesis from near-infrared to visual light via sparse representation, in: Proceedings of IJCB, 2011, pp. 1-6.
24. D. Yi, R. Liu, R. Chu, Z. Lei, S.Z. Li, Face Matching between near infrared and visible light images, in: Proceedings of ICB, 2007, pp. 523-530.
25. B. Klare, A.K. Jain, Heterogeneous face recognition: matching NIR to visible light images, in: Proceedings of ICPR, 2010, pp. 1513-1516.
26. H. Maeng, S. Liao, D. Kang, S.-W. Lee, A. K. Jain, Nighttime face recognition at long distance: cross-distance and cross-spectral matching, in: Proceedings of ACCV, 2012, pp. 708-721.
27. FaceVACS Software Developer Kit, Cognitec Systems GmbH, 〈 http://www.cognitec-systems.de 〉.
28. PittPatt Software Developer Kit, Pittsburgh Pattern Recognition, Inc.
29. B.F. Klare, and A.K. Jain Heterogeneous face recognition using kernel prototype similarities IEEE Trans. Pattern Anal. Mach. Intell. 35 2013 1410 1422
30. S. Liao, D. Yi, Z. Lei, R. Qin, S.Z. Li, Heterogeneous face recognition from local structures of normalized appearance, in: Proceedings of ICB, 2009, pp. 209-218.
31. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 2000 2323 2326
32. A.K. Jain, and R.C. Dubes Algorithms for Clustering Data 1988 Prentice-Hall New Jersey
33. D. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis. 60 2004 91 110
34. B. Klare, Z. Li, and A.K. Jain Matching forensic sketches to mugshot photos IEEE Trans. Pattern Anal. Mach. Intell. 33 2011 639 646
35. S.Z. Li, Z. Lei, M. Ao, The HFB face database for heterogeneous face biometrics research, in: Proceedings of IEEE CVPR Workshops, 2009, pp. 1-8.
36. Y. Li, S. Shan, H. Zhang, S. Lao, X. Chen, Fusing magnitude and phase features for robust face recognition, in: Proceedings of ACCV, 2012, pp. 601-612.
37. H. Han, B. Klare, K. Bonnen, and A.K. Jain Matching composite sketches to face photos: a component-based approach IEEE Trans. Inf. Forensics Secur. 8 2013 191 204
38. Near-infrared Illuminator, Raytec, 〈 http://www.rayteccctv.com 〉.
39. D.S. Bolme, J.R. Beveridge, M.L. Teixeira, B.A. Draper, The CSU face identification evaluation system: its purpose, features and structure, in: Proceedings of ICVS, 2003, pp. 304-313.
40. Q. Liu, X. Tang, H. Jin, H. Lu, S. Ma, A nonlinear approach for face sketch synthesis and recognition, in: Proceedings of IEEE CVPR, 2005, pp. 1005-1010.
41. K. Ricanek, T. Tesafaye, MORPH: a longitudinal image database of normal adult age-progression, in: Proceedings of FGR, 2006, pp. 341-345.
42. W. Gao, B. Cao, S. Shan, X. Chen, D. Zhou, X. Zhang, and D. Zhao The CAS-PEAL large-scale Chinese face database and baseline evaluations IEEE Trans. Syst. Man Cybern. Part-A Syst. Hum. 38 2008 149 161
43. CASIA-FaceV5, 〈 http://biometrics.idealtest.org/.
44. X. Wang, and X. Tang Face photo-sketch synthesis and recognition IEEE Trans. Pattern Anal. Mach. Intell. 31 2009 1955 1967
45. C. Cao, Y. Weng, S. Zhou, Y. Tong, and K. Zhou Face Warehouse: a 3D Facial Expression Database for Visual Computing IEEE Trans. Vis. Comput. Graph. 20 2014 413 425