Sparse approximation to the eigensubspace for discrimination

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 12, 2012, Pages 1948-1960

  Lai, Zhihui ^a,b   Wong, Wai Keung ^c   Jin, Zhong ^b   Yang, Jian ^b   Xu, Yong ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^c HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Elastic net; face recognition; feature extraction; manifold learning; sparse subspace

Indexed keywords

COMPETITIVE PERFORMANCE; ELASTIC NET; FEATURE EXTRACTION METHODS; IMAGE FEATURE EXTRACTIONS; MANIFOLD LEARNING; SPARSE APPROXIMATIONS; SPARSE SUBSPACE; TWO DIMENSIONAL (2 D);

FACE RECOGNITION; FEATURE EXTRACTION; VECTORS;

ITERATIVE METHODS;

EID: 84876523860     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2217154     Document Type: Article

References (47)

1. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000.
2. I. Joliffe, Principal Component Analysis. London, U.K.: Springer-Verlag, 1986.
3. K. Fukunnaga, Introduction to Statistical Pattern Recognition, 2nd ed. New York: Academic, 1991.
4. A. M. Martinez and A. C. Kak, "Principal components analysis versus linear discriminant analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001.
5. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriengman, "Eigenfaces versus fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
6. J. Yang, D. Zhang, A. F. Frangi, and J. Y. Yang, "Two-dimensional principal components analysis: A new approach to appearance-based face representation and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 131-137, Jan. 2004.
7. Y. Xu, D. Zhang, J. Yang, and J. Yang, "An approach for directly extracting features from matrix data and its application in face recognition," Neurocomputing, vol. 71, nos. 10-12, pp. 1857-1865, 2008.
8. W. Zuo, D. Zhang, and K. Wang, "Bidirectional principal components analysis with assembled matrix distance metric for image recognition," IEEE Trans. Syst., Man, Cybern., B, vol. 36, no. 4, pp. 863-872, Aug. 2006.
9. J. Ye, "Generalized low rank approximations of matrices," Mach. Learn., vol. 61, no. 1, pp. 167-191, 2005.
10. M. Li and B. Yuan, "2D-LDA: A statistical linear discriminant analysis for image matrix," Pattern Recognit. Lett., vol. 26, no. 5, pp. 527-532, 2005.
11. J. Ye, R. Janardan, and Q. Li, "Two-dimensional linear discriminant analysis," in Proc. 18th Annu. Conf. Neural Inf. Process. Syst., 2004, pp. 1569-1576.
12. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H. Zhang, "Discriminant analysis with tensor representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 526-532.
13. Z. Fan, Y. Xu, and D. Zhang, "Local linear discriminant analysis framework using sample neighbors," IEEE Trans. Neural Netw., vol. 22, no. 7, pp. 1119-1132, Jul. 2011.
14. S.-J. Wang, J. Yang, M.-F. Sun, X.-J. Peng, M.-M. Sun, and C.-G. Zhou, "Sparse tensor discriminant color space for face verification," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 6, pp. 876-888, Jun. 2012.
15. J. B. Tenenbaum, V. DeSilva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, pp. 2319-2323, Dec. 2000.
16. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, pp. 2323-2326, Dec. 2000.
17. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Advances in Neural Information Processing Systems 14. Cambridge, MA: MIT Press, 2001, pp. 589-591.
18. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, 2003.
19. H. Huang and H. He, "Super-resolution method for face recognition using nonlinear mappings on coherent features," IEEE Trans. Neural Netw., vol. 22, no. 1, pp. 121-130, Jan. 2011.
20. S. Zafeiriou, G. Tzimiropoulos, M. Petrou, and T. Stathaki, "Regularized kernel discriminant analysis with a robust kernel for face recognition and verification," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 526-534, Mar. 2012.
21. Y. Xu, F. Song, F. Ge, and Y. Zhao, "A novel local preserving projection scheme for use with face recognition," Expert Syst. Appl., vol. 37, no. 9, pp. 6718-6721, 2011.
22. X. He and P. Niyogi, "Locality preserving projections," in Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press, 2003.
23. X. He, S. Yan, Y. Hu, P. Niyogi, and H. J. Zhang, "Face recognition using laplacian faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
24. X. He, D. Cai, and P. Niyogi, "Tensor subspace analysis," Advances in Neural Information Processing Systems 18. Cambridge, MA: MIT Press, 2005.
25. B. Niu, Q. Yang, S. C. K. Shiu, and S. K. Pal, "Two-dimensional laplacianfaces method for face recognition," Pattern Recognit., vol. 41, no. 10, pp. 3237-3243, 2008.
26. D. Hu, G. Feng, and Z. Zhou, "Two-dimensional locality preserving projections with its application to palmprint recognition," Pattern Recognit., vol. 40, no. 1, pp. 339-342, 2007.
27. S. Chen, H. Zhao, M. Kong, and B. Luo, "A two-dimensional extension of locality preserving projections," Neurocomputing, vol. 70, nos. 4-6, pp. 912-921, 2007.
28. R. Zhi and Q. Ruan, "Facial expression recognition base on twodimensional discriminant locality preserving projections," Eurocomputing, vol. 70, no. 7, pp. 1543-1546, 2007.
29. M. Wan, Z. Lai, J. Shao, and Z. Jin, "Two-dimensional local graph embedding discriminant analysis with its application to face and palm biometrics," Eurocomputing, vol. 73, nos. 1-3, pp. 197-203, 2009.
30. Y. Xu, G. Feng, and Y. Zhao, "One improvement to two-dimensional locality preserving projection method for use with face recognition," Neurocomputing, vol. 73, nos. 1-3, pp. 245-249, 2009.
31. H. Zou, T. Hastie, and R. Tibshirani, "Sparse principal component analysis," J. Comput. Graph. Stat., vol. 15, no. 2, pp. 265-286, 2006.
32. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Annal. Stat., vol. 32, no. 2, pp. 407-499, 2004.
33. H. Zhou and T. Hastie, "Regression shrinkage and selection via the elastic net with applications to microarrays," Dept. Stat., Stanford Univ., Stanford, CA, Tech. Rep., 2003.
34. A. d'Aspremont, L. E. Chaoui, M. I. Jordan, and G. R. G. Lanckriet, "A direct formulation for sparse PCA using semidefinite programming," in Advances in Neural Information Processing Systems 17. Cambridge, MA: MIT Press, 2004.
35. B. Moghaddam, Y. Weiss, and S. Avidan, "Spectral bounds for sparse PCA: Exact and greedy algorithms," in Advances in Neural Information Processing Systems 18. Cambridge, MA: MIT Press, 2005.
36. B. Moghaddam, Y. Weiss, and S. Avidan, "Generalized spectral bounds for sparse LDA," in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 641-648.
37. L. Clemmensen, T. Hastie, and B. Ersboll, "Sparse discriminant analysis," U.S. Dept. Stat., Stanford Univ., Stanford, CA, Tech. Rep. 1-25, Jun. 2008.
38. Z. Qiao, L. Zhou, and J. Z. Huang, "Sparse linear discriminant analysis with applications to high dimensional low sample size data," Int. Assoc. Eng., J. Appl. Math., vol. 39, no. 1, pp. 48-60, 2010.
39. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer-Verlag, 2001.
40. Z. Zheng, "Sparse local preserving embedding," in Proc. 2nd Int. Congr. Image Signal Process., 2009, pp. 1-5.
41. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Mining Knowl. Discovery, vol. 22, no. 3, pp. 340-371, 2011.
42. R. A. Horn and C. R. Johnson, Topics in Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1991.
43. L. Elden, "Algorithms for the regularization of ill-conditioned least squares problems," BIT, vol. 17, no. 2, pp. 134-145, 1997.
44. L. Wang, X. Wang, and J. Feng, "On image matrix based feature extraction algorithms," IEEE Trans. Syst. Man Cybern. B, vol. 36, no. 1, pp. 194-197, Feb. 2006.
45. A. M. Martinez and R. Benavente, "The AR face database," Centre de Visio per Computador, Univ. Autonoma de Barcelona, Bellaterra, Barcelona, Tech. Rep. 24, Jun. 1998.
46. P. J. Phillips. (2004). The Facial Recognition Technology (FERET) Database [Online]. Available: http://www.itl.nist.gov/iad/humanid/feret/feret- master.html
47. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.