Thermal and reflectance based personal identification methodology under variable illumination

Pattern Recognition

Volumn 43, Issue 5, 2010, Pages 1801-1813

  Arandjelović, Ognjen ^a   Hammoud, Riad ^b   Cipolla, Roberto ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b DELPHI CORPORATION   (United States)

Author keywords

Face; Fusion; Illumination; Infrared; Invariance; Recognition; Thermal

Indexed keywords

AUTOMATIC ALGORITHMS; DATA SETS; DECISION LEVEL FUSION; ELECTROMAGNETIC SPECTRA; FACE; FACE FUSION; FACIAL APPEARANCE; IDENTIFICATION RATES; ILLUMINATION CHANGES; PARTIAL OCCLUSIONS; PATTERN RECOGNITION PROBLEMS; PERSONAL IDENTIFICATION; POSE VARIATION; PRE-PROCESSING OF DATA; SIMILARITY SCORES; THERMAL SPECTRA; TRAINING IMAGE; VARIABLE ILLUMINATION;

INFRARED SPECTROSCOPY;

FACE RECOGNITION;

EID: 75749121359     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.11.023     Document Type: Article

References (69)

1. O. Arandjelović, R. Cipolla, Face recognition from video using the generic shape-illumination manifold, in: Proceedings of European Conference on Computer Vision (ECCV), vol. 4, 2006, pp. 27-40.
2. T.-J. Chin, D. Suter, A new distance criterion for face recognition using image sets, in: Proceedings of the Asian Conference on Computer Vision (ACCV), 2006, pp. 549-558.
3. J. Sivic, M. Everingham, A. Zisserman, Person spotting: video shot retrieval for face sets, in: Proceedings of the IEEE International Conference on Image and Video Retrieval (CIVR), 2005, pp. 226-236.
4. P.J. Phillips, P. Grother, R.J. Micheals, D.M. Blackburn, E. Tabassi, J.M. Bone, FRVT 2002: overview and summary, Technical Report, National Institute of Justice, March 2003.
5. O. Arandjelović, R. Cipolla, Incremental learning of temporally-coherent Gaussian mixture models, in: Proceedings of the IAPR British Machine Vision Conference (BMVC), vol. 2, September 2005, pp. 759-768.
6. T. Emidio de Campos, R.S. Feris, R.M. Cesar Jr., Eigenfaces versus eigeneyes: first steps toward performance assessment of representations for face recognition, in: Proceedings of the Mexican International Conference on Artificial Intelligence, 2000, pp. 193-201.
7. V. Krüger, A. Happe, G. Sommer, Affine real-time face tracking using Gabor wavelet networks, in: Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), vol. 1, 2000, pp. 127-130.
8. Krüger V., and Sommer G. Gabor wavelet networks for efficient head pose estimation. Journal of the Optical Society of America 19 6 (2002) 1112-1119
9. L. Torres, L. Lorente, J. Vila, Automatic face recognition of video sequences using selfeigenfaces, in: Proceedings of the IAPR International Symposium on Image/Video Communications over Fixed and Mobile Networks, 2000.
10. J.R. Price, T.F. Gee, Towards robust face recognition from video, in: Proceedings of the Applied Image Pattern Recognition Workshop, Analysis and Understanding of Time Varying Imagery, 2001, pp. 94-102.
11. Kittler J., Hatef M., Duin R., and Matas J. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 (1998) 226-239
12. G.J. Edwards, C.J. Taylor, T.F. Cootes, Learning to identify and track faces in image sequences, in: Proceedings of the IAPR British Machine Vision Conference (BMVC), 1997, pp. 130-139.
13. O. Yamaguchi, K. Fukui, K. Maeda, Face recognition using temporal image sequence, in: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (FGR), vol. (10), 1998, pp. 318-323.
14. Gittins R. Canonical Analysis: A Review with Applications in Ecology (1985), Springer, Berlin
15. Hotelling H. Relations between two sets of variates. Biometrika 28 (1936) 321-372
16. T.F. Cootes, G.J. Edwards, C.J. Taylor, Active appearance models, in: Proceedings of the European Conference on Computer Vision (ECCV), vol. 2, 1998, pp. 484-498.
17. C. Wallraven, V. Blanz, T. Vetter, 3D reconstruction of faces-combining stereo with class-based knowledge, in: Proceedings of the Deutsche Arbeitsgemeinschaft für Mustererkennung (DAGM) Symposium, 1999, pp. 405-412.
18. L.B. Wolff, D.A. Socolinsky, C.K. Eveland, Quantitative measurement of illumination invariance for face recognition using thermal infrared imagery, in: Proceedings of the IEEE International Workshop on Object Tracking and Classification Beyond the Visible Spectrum (OTCBVS), 2001.
19. Socolinsky D., Selinger A., and Neuheisel J. Face recognition with visible and thermal infrared imagery. Computer Vision and Image Understanding (CVIU) 91 1-2 (2003) 72-114
20. F. Prokoski, History, current status, and future of infrared identification, in: Proceedings of IEEE International Workshop on Object Tracking and Classification Beyond the Visible Spectrum (OTCBVS), 2000, pp. 5-14.
21. D. Socolinsky, A. Selinger, Thermal face recognition in an operational scenario, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 2004, pp. 1012-1019.
22. Kong S., Heo J., Abidi B., Paik J., and Abidi M. Recent advances in visual and infrared face recognition-a review. Computer Vision and Image Understanding (CVIU) 97 1 (2005) 103-135
23. D. Socolinsky, A. Selinger, Comparative study of face recognition performance with visible and thermal infrared imagery, in: Proceedings of IEEE International on Pattern Recognition (ICPR), 2002, pp. 217-222.
24. A. Selinger, D. Socolinsky, Appearance-based facial recognition using visible and thermal imagery: a comparative study, Technical Report 02-01, Equinox Corporation, 2002.
25. Srivastana A., and Liu X. Statistical hypothesis pruning for recognizing faces from infrared images. Image and Vision Computing 21 7 (2003) 651-661
26. P. Buddharaju, I. Pavlidis, I. Kakadiaris, Face recognition in the thermal infrared spectrum, in: Proceedings of the IEEE International Workshop on Object Tracking and Classification Beyond the Visible Spectrum (OTCBVS), 2004, p. 133.
27. G. Friedrich, Y. Yeshurun, Seeing people in the dark: face recognition in infrared images, in: Proceedings of the IAPR British Machine Vision Conference (BMVC), 2003, pp. 348-359.
28. Lin C.L., and Fan K.C. Biometric verification using thermal images of palm-dorsa vein patterns. IEEE Transactions on Circuits and Systems for Video Technology 14 2 (2004) 199-213
29. Im S.K., Choi H.S., and Kim S.W. A direction-based vascular pattern extraction algorithm for hand vascular pattern verification. ETRI Journal 25 2 (2003) 101-108
30. T. Shimooka, K. Shimizu, Artificial immune system for personal identification with finger vein pattern, in: Proceedings of the International Conference on Knowledge-Based Intelligent Information and Engineering Systems, September 2004, pp. 511-518.
31. Miura N., Nagasaka A., and Miyatake T. Feature extraction of finger vein patterns based on iterative line tracking and its application to personal identification. Systems and Computers in Japan 35 7 (2004) 61-71
32. Prokoski F.J., and Riedel R. BIOMETRICS: personal identification in networked society. Infrared Identification of Faces and Body Parts (1998), Kluwer Academic Publishers, Dordrecht 191-211 (Chapter 9)
33. P. Buddharaju, I.T. Pavlidis, P. Tsiamyrtzis, Physiology-based face recognition, in: Proceedings of IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS), September 2005.
34. O. Arandjelović, R.I. Hammoud, R. Cipolla, Multi-sensory face biometric fusion (for personal identification), in: Proceedings of IEEE International Workshop on Object Tracking and Classification Beyond the Visible Spectrum (OTCBVS), June 2006, pp. 128-135.
35. Li S.Z., Chu R., Liao S., and Zhang L. Illumination invariant face recognition using near-infrared images. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 29 4 (2007) 627-639
36. Chatzis V., Bors A.G., and Pitas I. Multimodal decision-level fusion for person authentication. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 29 6 (1999) 674-681
37. Ben-Yacoub S., Abdeljaoued Y., and Mayoraz E. Fusion of face and speech data for person identity verification. IEEE Transactions on Neural Networks 10 5 (1998) 1065-1075
38. E.S. Bigun, J. Bigun, B. Duc, S. Fischer, Expert conciliation for multimodal person authentication systems using bayesian statistics, in: Proceedings of International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA), 1997, pp. 291-300.
39. P. Verlinde, G. Cholet, Comparing decision fusion paradigms using k-NN based classifiers, decision trees and logistic regression in a multi-modal identity verification application, in: Proceedings of International Conference on Audio, and Video-Based Biometric Person Authentication (AVBPA), vol. 5(2), 1999, pp. 188-193.
40. Y. Wang, T. Tan, A.K. Jain, Combining face and iris biometrics for identity verification, in: Proceedings of International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA), 2003, pp. 805-813.
41. Brunelli R., and Falavigna D. Person recognition using multiple cues. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 17 10 (1995) 955-966
42. Ross A., and Jain A.K. Information fusion in biometrics. Pattern Recognition Letters 24 13 (2003) 2115-2125
43. A. Ross, R. Govindarajan, Feature level fusion using hand and face biometrics, in: Proceedings of SPIE Conference on Biometric Technology for Human Identification II, vol. 5779, March 2005, pp. 196-204.
44. J. Heo, S. Kong, B. Abidi, M.A. Abidi, Fusion of visual and thermal signatures with eyeglass removal for robust face recognition, in: Proceedings of IEEE International Workshop on Object Tracking and Classification Beyond the Visible Spectrum (OTCBVS), 2004, pp. 94-99.
45. A. Gyaourova, G. Bebis, I. Pavlidis, Fusion of infrared and visible images for face recognition, in: Proceedings of European Conference on Computer Vision (ECCV), vol. 4, May 2004, pp. 456-468.
46. J.G. Wang, E. Sung, R. Venkateswarlu, Registration of infrared and visible-spectrum imagery for face recognition, in: Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FGR), May 2004, pp. 638-644.
47. Chen X., Flynn P., and Bowyer K. IR and visible light face recognition. Computer Vision and Image Understanding (CVIU) 99 3 (2005) 332-358
48. X. Chen, P. Flynn, K. Bowyer, Visible-light and infrared face recognition, in: Proceedings of Workshop on Multimodal User Authentication, 2003, pp. 48-55.
49. J. Heo, B. Abidi, S.G. Kong, M. Abidi, Performance comparison of visual and thermal signatures for face recognition, Biometric Consortium Conference, September 2003.
50. Ross A., Nandakumar K., and Jain A.K. Handbook of Multibiometrics (2006), Springer, New York, USA
51. R. Cappelli, D. Maio, D. Maltoni, A computational approach to edge detection, in: Proceedings of International Workshop on Multiple Classifier Systems, 2000, pp. 351-361.
52. Identix Ltd. Faceit 〈http://www.FaceIt.com/〉.
53. Bichsel M., and Pentland A.P. Human face recognition and the face image set's topology. Computer Vision, Graphics and Image Processing: Image Understanding 59 2 (1994) 254-261
54. Björck Å., and Golub G.H. Numerical methods for computing angles between linear subspaces. Mathematics of Computation 27 123 (1973) 579-594
55. Press W.H., Teukolsky S.A., Vetterling W.T., and Flannery B.P. Numerical Recipes in C: The Art of Scientific Computing. second ed. (1992), Cambridge University Press, Cambridge
56. Arandjelović O., and Zisserman A. On film character retrieval in feature-length films. Interactive Video: Algorithms and Technologies (2006), Springer, Berlin 89-103
57. T.L. Berg, A.C. Berg, J. Edwards, M. Maire, R. White, Y.W. Teh, E. Learned- Miller, D.A. Forsyth, Names and faces in the news, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 2004, pp. 848-854.
58. Cristinacce D., Cootes T.F., and Scott I. A multistage approach to facial feature detection. Proceedings of IAPR British Machine Vision Conference (BMVC) vol. 1 (2004) 277-286
59. Felzenszwalb P.F., and Huttenlocher D. Pictorial structures for object recognition. International Journal of Computer Vision (IJCV) 61 1 (2005) 55-79
60. L. Trujillo, G. Olague, R. Hammoud, B. Hernandez, E. Romero, Automatic feature localization in thermal images for facial expression recognition, Computer Vision and Image Understanding (CVIU) 106 (2-3) 258-269.
61. A. Fitzgibbon, A. Zisserman, On affine invariant clustering and automatic cast listing in movies, in: Proceedings of European Conference on Computer Vision (ECCV), 2002, pp. 304-320.
62. Adini Y., Moses Y., and Ullman S. Face recognition: the problem of compensating for changes in illumination direction. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 19 7 (1997) 721-732
63. H. Wang, S.Z. Li, Y. Wang, Face recognition under varying lighting conditions using self quotient image, in: Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FGR), 2004, pp. 819-824.
64. D.S. Bolme, Elastic bunch graph matching, Master's Thesis, Colorado State University, 2003.
65. L. Wiskott, J-M. Fellous, N. Krüger, C. von der Malsburg, Face recognition by elastic bunch graph matching, Intelligent Biometric Techniques in Fingerprint and Face Recognition, 1999, pp. 355-396.
66. Arandjelović O., and Cipolla R. A methodology for rapid illumination-invariant face recognition using image processing filters. Computer Vision and Image Understanding (CVIU) 113 (2008)
67. Walker T.C., and Miller R.K. Health Care Business Market Research Handbook. fifth ed. (2001), Richard K. Miller & Associates Inc, Norcross, GA
68. Martinez A.M. Recognizing imprecisely localized, partially occluded and expression variant faces from a single sample per class. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 24 6 (2002) 748-763
69. Sung K.K., and Poggio T. Example-based learning for view-based human face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 20 1 (1998) 39-51