Discriminant Correlation Analysis: Real-Time Feature Level Fusion for Multimodal Biometric Recognition

IEEE Transactions on Information Forensics and Security

Volumn 11, Issue 9, 2016, Pages 1984-1996

  Haghighat, Mohammad ^a   Abdel Mottaleb, Mohamed ^a   Alhalabi, Wadee ^b,c  

^a University of Miami College of Engineering   (United States)

^b EFFAT UNIVERSITY   (Saudi Arabia)

^c KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

class structure; discriminant correlation analysis; feature level fusion; multimodal biometrics

Indexed keywords

BIOMETRICS; CLASSIFICATION (OF INFORMATION); CORRELATION METHODS; FEATURE EXTRACTION; INFORMATION FUSION; MODAL ANALYSIS;

CLASS STRUCTURES; CORRELATION ANALYSIS; FEATURE EXTRACTION TECHNIQUES; FEATURE LEVEL FUSION; LOW COMPUTATIONAL COMPLEXITY; MULTI-MODAL BIOMETRICS; MULTIMODAL BIOMETRIC SYSTEMS; PATTERN RECOGNITION PROBLEMS;

PATTERN RECOGNITION;

EID: 84979073626     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2016.2569061     Document Type: Article

References (61)

1. A. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems, " Pattern Recognit., vol. 38, no. 12, pp. 2270-2285, Dec. 2005.
2. A. Ross and A. Jain, "Information fusion in biometrics, " Pattern Recognit. Lett., vol. 24, no. 13, pp. 2115-2125, 2003.
3. A. Ross and A. K. Jain, "Multimodal biometrics: An overview, " in Proc. 12th Eur. Signal Process. Conf. (EUSIPCO), Sep. 2004, pp. 1221-1224.
4. M. M. Monwar and M. L. Gavrilova, "Multimodal biometric system using rank-level fusion approach, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 4, pp. 867-878, Aug. 2009.
5. X. Xu and Z. Mu, "Feature fusion method based on KCCA for ear and profile face based multimodal recognition, " in Proc. IEEE Int. Conf. Autom. Logistics (ICAL), Aug. 2007, pp. 620-623.
6. C. Liu and H. Wechsler, "A shape- and texture-based enhanced Fisher classifier for face recognition, " IEEE Trans. Image Process., vol. 10, no. 4, pp. 598-608, Apr. 2001.
7. J. Yang and J.-Y. Yang, "Generalized K-L transform based combined feature extraction, " Pattern Recognit., vol. 35, no. 1, pp. 295-297, Jan. 2002.
8. J. Yang, J.-Y. Yang, D. Zhang, and J.-F. Lu, "Feature fusion: Parallel strategy vs. serial strategy, " Pattern Recognit., vol. 36, no. 6, pp. 1369-1381, Jun. 2003.
9. Q.-S. Sun, S.-G. Zeng, Y. Liu, P.-A. Heng, and D.-S. Xia, "A new method of feature fusion and its application in image recognition, " Pattern Recognit., vol. 38, no. 12, pp. 2437-2448, Dec. 2005.
10. N. M. Correa, T. Adali, Y.-O. Li, and V. D. Calhoun, "Canonical correlation analysis for data fusion and group inferences, " IEEE Signal Process. Mag., vol. 27, no. 4, pp. 39-50, Jun. 2010.
11. J. Yang and X. Zhang, "Feature-level fusion of fingerprint and fingervein for personal identification, " Pattern Recognit. Lett., vol. 33, no. 5, pp. 623-628, Apr. 2012.
12. K.-H. Pong and K.-M. Lam, "Multi-resolution feature fusion for face recognition, " Pattern Recognit., vol. 47, no. 2, pp. 556-567, Feb. 2014.
13. W.-P. Li, J. Yang, and J.-P. Zhang, "Uncertain canonical correlation analysis for multi-view feature extraction from uncertain data streams, " Neurocomputing, vol. 149, pp. 1337-1347, Feb. 2015.
14. M. Haghighat, M. Abdel-Mottaleb, and W. Alhalabi, "Fully automatic face normalization and single sample face recognition in unconstrained environments, " Expert Syst. Appl., vol. 47, pp. 23-34, Apr. 2016.
15. J. R. Kettenring, "Canonical analysis of several sets of variables, " Biometrika, vol. 58, no. 3, pp. 433-451, 1971.
16. A. A. Nielsen, "Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data, " IEEE Trans. Image Process., vol. 11, no. 3, pp. 293-305, Mar. 2002.
17. Y.-H. Yuan, Q.-S. Sun, Q. Zhou, and D.-S. Xia, "A novel multiset integrated canonical correlation analysis framework and its application in feature fusion, " Pattern Recognit., vol. 44, no. 5, pp. 1031-1040, May 2011.
18. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
19. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation, " IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
20. A. Wagner, J. Wright, A. Ganesh, Z. Zhou, H. Mobahi, and Y. Ma, "Toward a practical face recognition system: Robust alignment and illumination by sparse representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 372-386, Feb. 2012.
21. A. Ross and N. Poh, "Multibiometric systems: Overview, case studies, and open issues, " in Handbook of Remote Biometrics. London, U.K.: Springer, 2009, pp. 273-292.
22. S. Shekhar, V. M. Patel, N. M. Nasrabadi, and R. Chellappa, "Joint sparse representation for robust multimodal biometrics recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 1, pp. 113-126, Jan. 2014.
23. S. Bahrampour, N. M. Nasrabadi, A. Ray, and W. K. Jenkins, "Multimodal task-driven dictionary learning for image classification, " IEEE Trans. Image Process., vol. 25, no. 1, pp. 24-38, Jan. 2016.
24. M. Haghighat, M. Abdel-Mottaleb, and W. Alhalabi, "Discriminant correlation analysis for feature level fusion with application to multimodal biometrics, " in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), Mar. 2016, pp. 1866-1870.
25. W. J. Krzanowski, Principles of Multivariate Analysis: A User's Perspective. London, U.K.: Oxford Univ. Press, 1988.
26. P. N. Belhumeur, J. P. Hespanha, and D. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
27. T.-K. Kim, J. Kittler, and R. Cipolla, "Discriminative learning and recognition of image set classes using canonical correlations, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1005-1018, Jun. 2007.
28. Y. Ma, S. Lao, E. Takikawa, and M. Kawade, "Discriminant analysis in correlation similarity measure space, " in Proc. 24th Int. Conf. Mach. Learn. (ICML), 2007, pp. 577-584.
29. M. Turk and A. Pentland, "Eigenfaces for recognition, " J. Cognit. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
30. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York, NY, USA: Wiley, 1973.
31. G. Fahmy, A. El-Sherbeeny, S. Mandala, M. Abdel-Mottaleb, and H. Ammar, "The effect of lighting direction/condition on the performance of face recognition algorithms, " Proc. SPIE, vol. 6202, pp. 188-200, Apr. 2006.
32. S. Crihalmeanu, A. Ross, S. Schuckers, and L. Hornak, "A protocol for multibiometric data acquisition, storage and dissemination, " Dept. Comput. Sci. Elect. Eng., West Virginia Univ., Morgantown, WV, USA, Tech. Rep., 2007.
33. A. M. Martinez and R. Benavente, "The AR face database, " Computer Vision Center (CVC), Autonomous Univ. Barcelona, Barcelona, Spain, Tech. Rep. #24, 1998.
34. A. M. Martínez and A. C. Kak, "PCA versus LDA, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001.
35. C. Liu and H. Wechsler, "Gabor feature based classification using the enhanced Fisher linear discriminant model for face recognition, " IEEE Trans. Image Process., vol. 11, no. 4, pp. 467-476, Apr. 2002.
36. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2005, pp. 886-893.
37. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features (SURF), " Comput. Vis. Image Understand., vol. 110, no. 3, pp. 346-359, 2008.
38. M. Haghighat, S. Zonouz, and M. Abdel-Mottaleb, "Identification using encrypted biometrics, " in Computer Analysis of Images and Patterns (CAIP). Berlin, Germany: Springer, 2013, pp. 440-448.
39. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
40. A. Vedaldi and B. Fulkerson. (2008). VLFeat: An Open and Portable Library of Computer Vision Algorithms. [Online]. Available: http://www.vlfeat.org/
41. Y.-O. Li, T. Adali, W. Wang, and V. D. Calhoun, "Joint blind source separation by multiset canonical correlation analysis, " IEEE Trans. Signal Process., vol. 57, no. 10, pp. 3918-3929, Oct. 2009.
42. A. Abaza, A. Ross, C. Hebert, M. A. F. Harrison, and M. S. Nixon, "A survey on ear biometrics, " ACM Comput. Surv., vol. 45, no. 2, p. 22, Feb. 2013.
43. X. Zhu and D. Ramanan, "Face detection, pose estimation, and landmark localization in the wild, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2879-2886.
44. J. Lei, J. Zhou, and M. Abdel-Mottaleb, "Gender classification using automatically detected and aligned 3D ear range data, " in Proc. Int. Conf. Biometrics (ICB), Jun. 2013, pp. 1-7.
45. J.-K. Kamarainen, V. Kyrki, and H. Kalviainen, "Invariance properties of Gabor filter-based features-overview and applications, " IEEE Trans. Image Process., vol. 15, no. 5, pp. 1088-1099, May 2006.
46. M. Haghighat, S. Zonouz, and M. Abdel-Mottaleb, "CloudID: Trustworthy cloud-based and cross-enterprise biometric identification, " Expert Syst. Appl., vol. 42, no. 21, pp. 7905-7916, Nov. 2015.
47. B. Krishnapuram, L. Carin, M. A. T. Figueiredo, and A. J. Hartemink, "Sparse multinomial logistic regression: Fast algorithms and generalization bounds, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 957-968, Jun. 2005.
48. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer-Verlag, 2006.
49. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, "SimpleMKL, " J. Mach. Learn. Res., vol. 9, pp. 2491-2521, Nov. 2008.
50. S. Chikkerur, C. Wu, and V. Govindaraju, "A systematic approach for feature extraction in fingerprint images, " in Biometric Authentication. Berlin, Germany: Springer, 2004, pp. 344-350.
51. S. J. Pundlik, D. L. Woodard, and S. T. Birchfield, "Non-ideal iris segmentation using graph cuts, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2008, pp. 1-6.
52. L. Masek and P. Kovesi, "Matlab source code for a biometric identification system based on iris patterns, " Dept. School Comput. Sci. Softw. Eng., Univ. Western Australia, Stirling Highway, WA, Australia, Tech. Rep., 2003, vol. 26.
53. A. K. Jain, S. Prabhakar, L. Hong, and S. Pankanti, "Filterbankbased fingerprint matching, " IEEE Trans. Image Process., vol. 9, no. 5, pp. 846-859, May 2000.
54. U. Park, R. Jillela, A. Ross, and A. K. Jain, "Periocular biometrics in the visible spectrum, " IEEE Trans. Inf. Forensics Security, vol. 6, no. 1, pp. 96-106, Mar. 2011.
55. A. Moorhouse, A. N. Evans, G. A. Atkinson, J. Sun, and M. L. Smith, "The nose on your face may not be so plain: Using the nose as a biometric, " in Proc. 3rd Int. Conf. Crime Detection Prevention (ICDP), Dec. 2009, pp. 1-6.
56. M. Balasubramanian, S. Palanivel, and V. Ramalingam, "Real time face and mouth recognition using radial basis function neural networks, " Expert Syst. Appl., vol. 36, no. 3, pp. 6879-6888, Apr. 2009.
57. H. Li, K.-A. Toh, and L. Li, Advanced Topics in Biometrics. Singapore: World Scientific, 2012.
58. H. Han, B. F. Klare, K. Bonnen, and A. K. Jain, "Matching composite sketches to face photos: A component-based approach, " IEEE Trans. Inf. Forensics Security, vol. 8, no. 1, pp. 191-204, Jan. 2013.
59. X. Wang and X. Tang, "Face photo-sketch synthesis and recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 1955-1967, Nov. 2009.
60. J. Xie. MATLAB Implementation of Converting Face to Sketch and Vice Versa, accessed on Feb. 24, 2016. [Online]. Available: https://github.com/ClaireXie/face2sketch
61. R. Srinivasan and A. Roy-Chowdhury, "Robust face recognition based on saliency maps of sigma sets, " in Proc. IEEE 7th Int. Conf. Biometrics Theory, Appl. Syst. (BTAS), Sep. 2015, pp. 1-6.