A comparative study of thermal face recognition methods in unconstrained environments

Pattern Recognition

Volumn 45, Issue 7, 2012, Pages 2445-2459

  Hermosilla, Gabriel ^a,b   Ruiz Del Solar, Javier ^a,b   Verschae, Rodrigo ^b   Correa, Mauricio ^a,b  

^a UNIVERSITY OF CHILE   (Chile)

^b UNIVERSITY OF CHILE   (Chile)

Author keywords

Face recognition; Thermal face recognition; Unconstrained environments

Indexed keywords

CALIBRATION PROCEDURE; COMPARATIVE STUDIES; DESCRIPTORS; FACE RECOGNITION METHODS; FACE RECOGNITION SYSTEMS; FACIAL EXPRESSIONS; GABORJETS; INDOOR SET-UP; INDOOR/OUTDOOR; LOCAL BINARY PATTERNS; NATURAL VARIATION; NORMALIZATION ALGORITHMS; OFFLINE; PROCESSING SPEED; RECOGNITION RATES; SCALE INVARIANT FEATURE TRANSFORMS; SPEEDED UP ROBUST FEATURES; TEST IMAGES; THERMAL SPECTRA; UNCONSTRAINED ENVIRONMENTS;

DATABASE SYSTEMS; GRAPHIC METHODS;

FACE RECOGNITION;

EID: 84858000683     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.01.001     Document Type: Article

References (44)

1. B. Abidi, S. Huq, M. Abidi, Fusion of visual, thermal, and range as a solution to illumination and pose restrictions in face recognition, in: Proceedings of IEEE International Carnahan Conference on Security Technology, Albuquerque, NM, October 2004, pp. 325330.
2. J. Ahmad, U. Ali, R.J. Qureshi, Fusion of thermal and visual images for efficient face recognition using Gabor filter, In: Proceedings of the 4th ACS/IEEE International Conference on Computer Systems and Applications, March 811, 2006, Dubai/Sharjah, UAE, pp. 135139.
3. T. Ahonen, A. Hadid, and M. Pietikainen Face description with local binary patterns: application to face recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence 28 12 2006 2037 2041 (Pubitemid 46405714)
4. M. Akhloufi, A. Bendada, Thermal faceprint: a new thermal face signature extraction for infrared face recognition, In CRV 2008, Fifth Canadian Conference on Computer and Robot Vision, Windsor, Ontario, 2830 May 2008, pp. 269272.
5. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool SURF: Speeded Up Robust Features Computer Vision and Image Understanding (CVIU) 110 3 2008 346 359
6. G. Bebis, A. Gyaourova, S. Singh, and I. Pavlidis Face recognition by fusing thermal infrared and visible imagery Image Vision Computing 24 no. 7 2006 727 742 (Pubitemid 44163391)
7. M.K. Bhowmik, D. Bhattacharjee, M. Nasipuri, D.K. Basu, M. Kundu, Optimum fusion of visual and thermal face images for recognition, in: Proceedings of the Sixth International Conference on Information Assurance and Security, IAS 2010, Atlanta, USA, IEEE Intelligent Transportation Systems Society, Aug 2325, 2010, pp. 311316.
8. P. Buddharaju, and I. Pavlidis Multi-spectral face recognition - fusion of visual imagery with physiological information R.I. Hammoud, B.R. Abidi, M.A. Abidi, Face Biometrics for Personal Identification: Multi-Sensory Multi-Modal Systems 2007 Springer 91 108
9. P. Buddharaju, I. Pavlidis, and C. Manohar Face recognition beyond the visible spectrum, advances in biometrics: sensors Algorithms and Systems 2007 157 180 (Springer)
10. P. Buddharaju, I. Pavlidis, I. Kakadiaris, Physiology-based face recognition, in: Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, Lake Como, Italy, 2005, pp. 354359.
11. P. Buddharaju, I. Pavlidis, I. Kakadiaris, Pose-invariant physiological face recognition in the thermal infrared spectrum, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, USA, 2006, pp. 5360.
12. J. Chen, S. Shan, Ch. He, G. Zhao, M. Pietikäinen, Ch.X. Chen, and W. Gao WLD: a robust local image descriptor IEEE Transactions on Pattern Analysis and Machine Intelligence 32.9 2010 1705 1720
13. X. Chen, P. Flynn, K.W. Bowyer, PCA-based face recognition in infrared imagery: baseline and comparative studies, IEEE International Workshop on Analysis and Modeling of Faces and Gestures, Nice, France, 2003, pp. 127134.
14. S.Y. Cho, L. Wang, W.L. Ong, Thermal imprint feature analysis for face recognition, Industrial Electronics, 2009. ISIE 2009, IEEE International Symposium on, pp. 18751880.
15. S. Desa, S. Hati, IR and visible face recognition using fusion of kernel based features, In: Proceedings of the 19th International Conference on Pattern Recognition ICPR, Tampa, Florida, USA, December 811 2008, pp. 14.
16. Equinox, 2011. Equinox Database. Available on July 2011 in:〈 http://www.equinoxsensors.com/products/HID.html 〉.
17. R. Gross Face databases S. Li, A. Jain, Handbook of Face Recognition 2005 Springer-Verlag (Chapter 13)
18. M. He, S.-J. Horng, P. Fan, R.-S. Run, R.-J. Chen, J.-L. Lai, M. Khan, and K. Sentosa Performance evaluation of score level fusion in multimodal biometric systems Pattern Recognition 43 5 2010 1789 1800
19. G. Hermosilla, P. Loncomilla, J. Ruiz-del-Solar, Thermal Face Recognition using Local Interest Points and Descriptors for HRI Applications, Lecture Notes in Computer Science 6556, RoboCup Symposium, 2010, pp. 2535.
20. G. Hermosilla, J. Ruiz-del-Solar, R. Verschae, M. Correa, Face recognition using thermal infrared images for humanrobot interaction applications: a comparative study, In: Proceedings of the 6th IEEE Latin American Robotics Symposium - LARS, Oct. 2930 2009, Valparaíso, Chile, (CD Proceedings).
21. M.M. Khan, R.D. Ward, M. Ingleby, Infrared thermal sensing of positive and negative affective states, in: Proceedings of the 2006 IEEE Conference on Robotics Automation and Mechatronics, 2006, pp. 16.
22. O.K. Kwon, S.G. Kong, Multiscale fusion of visual and thermal images for robust face recognition, in: Proceedings of the IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety, FL, vol. IV, March 2005, pp. 112116.
23. W. Lan, Face Recognition System Based on Spatial Constellation Model and Support Vector Machine, Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Masters Thesis, 2010.
24. H. Lategahn, S. Gross, T. Stehle, and T. Aach Texture classification by modeling joint distributions of local patterns with Gaussian mixtures IEEE Transactions on Image Processing 19 6 2010 1548 1557
25. D. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
26. H. Mendez, C. San Martín, J. Kittler, Y. Plasencia, and E. García Face recognition with LWIR imagery using local binary patterns LNCS 5558 2009 327 336
27. P. Narendra Reference-free nonuniformity compensation for IR imaging arrays Proceedings of the SPIE 252 1980 10 17 (Pubitemid 11521872)
28. P. Narendra, and N. Foss Shutterless fixed pattern noise correction for infrared imaging arrays Proceedings of the SPIE 282 1981 44 51 (Pubitemid 12527044)
29. OpenSURF library from Matlab. Available in October 2011 in 〈 http://www.mathworks.com/matlabcentral/fileexchange/28300-opensurf-including- image-warp 〉.
30. F.M. Pop, M. Gordan, C. Florea, A. Vlaicu, Fusion based approach for thermal and visible face recognition under pose and expressivity variation, Roedunet International Conference (RoEduNet), 2010, pp. 6166.
31. J. Ruiz-del-Solar, Ch. Devia, P. Loncomilla, F. Concha, Offline Signature Verification using Local Interest Points and Descriptors, Lecture Notes in Computer Science 5197 (CIARP 2008), 2008, pp. 2229.
32. J. Ruiz-del-Solar, P. Loncomilla, Ch. Devia, A. New, Approach for Fingerprint Verification based on Wide Baseline Matching using Local Interest Points and Descriptors, Lecture Notes in Computer Science 4872 (PSIVT 2007), 2007, pp. 586599.
33. J. Ruiz-del-Solar, and J. Quinteros Illumination compensation and normalization in eigenspace-based face recognition: a comparative study of different pre-processing approaches Pattern Recognition Letters 29 14 2008 1966 1979
34. J. Ruiz-del-Solar, R. Verschae, M. Correa, Recognition of Faces in Unconstrained Environments: A Comparative Study, EURASIP Journal on Advances in Signal Processing, special issue, Recent Advances in Biometric Systems: A Signal Processing Perspective, vol. 2009, Article ID 184617, p. 19, 2009. doi:10.1155/2009/184617
35. A. Selinger, D. Socolinsky, Appearance-Based Facial Recognition Using Visible and Thermal Imagery: A Comparative Study, Technical Report, Equinox Corporation, 2001.
36. D. Socolinsky, A. Selinger, A comparative analysis of face recognition performance with visible and thermal infrared imagery, in: Proceedings of the International Conference on Pattern Recognition (ICPR), Quebec, Canada, 2002.
37. D. Socolinsky, A. Selinger, Thermal Face Recognition Over Time, in: Proceedings of the 17th International Conference on Pattern Recognition (ICPR04), vol. 4, 2004, pp. 187190.
38. D. Socolinsky, L. Wolff, J. Neuheisel, C. Eveland, Illumination invariant face recognition using thermal infrared imagery, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2001.
39. X. Tan, S. Chen, Z.H. Zhou, and F. Zhang Face recognition from a single image per person: a survey Pattern Recognition 39 2006 1725 1745 (Pubitemid 43867575)
40. L. Trujillo, G. Olague, R. Hammoud, B. Hernandez, Automatic feature localization in thermal images for facial expression recognition, in: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR05) - Workshops, June 2026 2005, p. 14.
41. S. Wang, S. Lv, X. Wang, Infrared facial expression recognition using wavelet transform, in: Proceedings of the International Symposium on Computer Science and Computational Technology, vol. 2, 2008, pp. 327330.
42. Y. Yoshitomi, N. Miyawaki, S. Tomita, S. Kimura, Facial expression recognition using thermal image processing and neural network, in: Proceedings of the IEEE International Workshop Robot and Human Interactive Communication, 1997, pp. 380385.
43. Y. Yoshitomi, K. Sung-Ill, T. Kawano, T. Kilazoe, Effect of sensor fusion for recognition of emotional states using voice, face image and thermal image of face, in: Proceedings of the 9th IEEE International Workshop on Robot and Human Interactive Communication, 2000, pp. 178183.
44. J. Zou, Q. Ji, and G. Nagy A comparative study of local matching approach for face recognition IEEE Transactions on Image Processing 16 10 2007 2617 2628 (Pubitemid 47456027)