Exponential local discriminant embedding and its application to face recognition

IEEE Transactions on Cybernetics

Volumn 43, Issue 3, 2013, Pages 921-934

  Dornaika, Fadi ^a,b   Bosaghzadeh, Alireza ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^b BASQUE FOUNDATION FOR SCIENCE   (Spain)

Author keywords

Discriminant analysis; Face recognition; Feature extraction; Graph based embedding; Local discriminant embedding (LDE); Small sample size (SSS) problem

Indexed keywords

CLASSIFICATION ACCURACY; DIMENSIONALITY REDUCTION; DISCRIMINANT INFORMATIONS; GRAPH-BASED; HIGH DIMENSIONAL DATA; LINEAR DISCRIMINANT ANALYSIS; LOCAL DISCRIMINANT EMBEDDING; SMALL-SAMPLE-SIZE (SSS) PROBLEM;

DISCRIMINANT ANALYSIS; FEATURE EXTRACTION; MAPPING; METADATA; PRINCIPAL COMPONENT ANALYSIS;

FACE RECOGNITION;

ALGORITHM; ANATOMY AND HISTOLOGY; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; DISCRIMINANT ANALYSIS; FACE; HUMAN; IMAGE SUBTRACTION; PROCEDURES; STATISTICAL ANALYSIS; ARTICLE; HISTOLOGY; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; DATA INTERPRETATION, STATISTICAL; DISCRIMINANT ANALYSIS; FACE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SUBTRACTION TECHNIQUE;

EID: 84880936263     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2218234     Document Type: Article

References (52)

1. L. Maaten, E. Postma, and J. Herik, "Dimensionality reduction: A comparative review," TiCC, Tilburg Univ., Tilburg, The Netherlands, TiCC TR 2009-005, 2009.
2. L. Saul, K. Weinberger, F. Sha, J. Ham, and D. Lee, "Spectral methods for dimensionality reduction," in Semisupervised Learning. Cambridge, MA: MIT Press, 2006.
3. S. Yan, D. Xu, B. Zhang, H. Zhang, Q. Yang, and S. Lin, "Graph embedding and extension: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
4. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1299-1313, Sep. 2009.
5. A. Jain, R. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000.
6. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
7. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, Jun. 2003.
8. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
9. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 2, pp. 342-352, Apr. 2008.
10. A. M. Martinez and M. Zhu, "Where are linear feature extraction methods applicable?" IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 12, pp. 1934-1944, Dec. 2005.
11. H. Li, T. Jiang, and K. Zhang, "Efficient and robust feature extraction by maximum margin criterion," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 157-165, Jan. 2006.
12. T. Kim and J. Kittler, "Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 318-327, Mar. 2005.
13. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York: Academic, 1990.
14. Y. Tao and J. Yang, "Quotient vs. difference: Comparison between the two discriminant criteria," Neurocomputing, vol. 18, no. 10-12, pp. 1808-1817, Jun. 2010.
15. Y. Su, S. Shan, X. Chen, and W. Gao, "Classifiability-based discriminatory projection pursuit," IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 2050-2061, Dec. 2011.
16. D.-Q. Dai and P. C. Yuen, "Face recognition by regularized discriminant analysis," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 4, pp. 1080-1085, Aug. 2007.
17. J. Lu, K. Plataniotis, and A. Venetsanopoulos, "Face recognition using kernel direct discriminant analysis algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 117-126, Jan. 2003.
18. M. Sugiyama, "Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis," J. Mach. Learn. Res., vol. 8, no. 5, pp. 1027-1061, May 2007.
19. S. Yan, D. Xu, B. Zhang, and H.-J. Zhang, "Graph embedding: A general framework for dimensionality reduction," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 830-837.
20. X. He and P. Niyogi, "Locality preserving projections," in Proc. Conf. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, 2003.
21. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
22. Y. Xu, A. Zhong, J. Yang, and D. Zhang, "LPP solution schemes for use with face recognition," Pattern Recognit., vol. 43, no. 12, pp. 4165-4176, Dec. 2010.
23. T. Zhang, B. Fang, Y. Tang, Z. Shang, and B. Xu, "Generalized discriminant analysis: A matrix exponential approach," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 186-197, Feb. 2010.
24. Y. Fu, Z. Li, J. Yuan, Y. Wu, and T. S. Huang, "Locality versus globality: Query-driven localized linear models for facial image computing," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 12, pp. 1741-1752, Dec. 2008.
25. W. Yu, X. Teng, and C. Liu, "Face recognition using discriminant locality preserving projections," Image Vis. Comput., vol. 24, no. 3, pp. 239-248, Mar. 2006.
26. W. Wong and H. Zhao, "Supervised optimal locality preserving projection," Pattern Recognit., vol. 45, no. 1, pp. 186-197, Jan. 2012.
27. F. Wang, X. Wang, D. Zhang, C. Zhang, and T. Li, "Marginface: A novel face recognition method by average neighborhood margin maximization," Pattern Recognit., vol. 42, no. 11, pp. 2863-2875, Nov. 2009.
28. B. Alipanahi, M. Biggs, and A. Ghodsi, "Distance metric learning vs. Fisher discriminant analysis," in Proc. AAAI Conf. Artif. Intell., 2008, pp. 598-603.
29. A. Globerson and S. Roweis, "Metric learning by collapsing classes," in Proc. Conf. Adv. Neural Inf. Process. Syst., 2006, pp. 451-458.
30. K. Q. Weinberger and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," J. Mach. Learn. Res., vol. 10, pp. 207-244, Dec. 2009.
31. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell, "Distance metric learning with application to clustering with side-information," in Advances in Neural Information Processing Systems, vol. 15. Cambridge, MA: MIT Press, 2003, pp. 505-512.
32. H. Chen, H. Chang, and T. Liu, "Local discriminant embedding and its variants," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 846-853.
33. S. Wang, H. Chen, X. Peng, and C. Zhou, "Exponential locality preserving projections for small sample size problem," Neurocomputing, vol. 74, no. 17, pp. 3654-3662, Oct. 2011.
34. B. Schölkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
35. B. Schölkopf, A. Smola, and K. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, Jul. 1998.
36. S. Mika, G. Rätsch, B. Schölkopf, A. Smola, J. Weston, and K. Müller, "Invariant feature extraction and classification in kernel spaces," in Proc. Adv. Neural Inf. Process. Syst., 1999, pp. 526-532.
37. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Comput., vol. 12, no. 10, pp. 2385-2404, Oct. 2000.
38. L. Chen, H. Liao, J. Lin, M. Kao, and G. Yu, "A new LDA-based face recognition system which can solve the small sample size problem," Pattern Recognit., vol. 33, no. 10, pp. 1713-1726, Oct. 2000.
39. J. Yang, A. F. Frangi, D. Z. J.-Y. Yang, and Z. Jin, "KPCA plus LDA: A complete kernel Fisher discriminant framework for feature extraction and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 230-244, Feb. 2005.
40. D. Cai, X. He, K. Zhou, J. Han, and H. Bao, "Locality sensitive discriminant analysis," in Proc. Int. Joint Conf. Artif. Intell., 2007, pp. 708-713.
41. Y. Fu, M. Liu, and T. S. Huang, "Conformal embedding analysis with local graph modeling on the unit hypersphere," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-6.
42. H. Yu and H. Yang, "A direct LDA algorithm for high-dimensional data: With application to face recognition," Pattern Recognit., vol. 34, no. 10, pp. 2067-2070, Oct. 2001.
43. C. Moler and C. V. Loan, "Nineteen dubious ways to compute the exponential of a matrix, twenty-five years later," SIAM Rev., vol. 45, no. 1, pp. 3-49, Mar. 2003.
44. N. Higham, "The scaling and squaring method for the matrix exponential revisited," SIAM J. Matrix Anal. Appl., vol. 26, no. 4, pp. 1179-1196, 2005.
45. J. Shawe-Taylor and N. Cristianini, Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
46. X. Chai, S. Shan, X. Chen, and W. Gao, "Locally linear regression for pose-invariant face recognition," IEEE Trans. Image Process., vol. 16, no. 7, pp. 1716-1725, Jul. 2007.
47. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
48. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
49. X. Zhang and Y. Gao, "Face recognition across pose: A review," Pattern Recognit., vol. 42, no. 11, pp. 2876-2896, Nov. 2009.
50. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
51. D. Cai, X. He, and J. Han, "Efficient kernel discriminant analysis via spectral regression," in Proc. Int. Conf. Data Mining, 2007, pp. 427-432.
52. D. Cai, X. He, and J. Han, "Speed up kernel discriminant analysis," Int. J. Very Large Data Bases, vol. 20, no. 1, pp. 21-33, Feb. 2011.