Fisher discriminant analysis with L1-norm

IEEE Transactions on Cybernetics

Volumn 44, Issue 6, 2014, Pages 828-842

  Wang, Haixian ^a   Lu, Xuesong ^b   Hu, Zilan ^c   Zheng, Wenming ^a  

^a Southeast University   (China)

^b SOUTHEAST UNIVERSITY   (China)

^c ANHUI UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Dimensionality reduction; L1 norm; LDA L1; linear discriminant analysis (LDA); robust modeling

Indexed keywords

ALGORITHMS; DISPERSIONS; FISHER INFORMATION MATRIX; STATISTICS;

DIMENSIONALITY REDUCTION; L1 NORM; LDA-L1; LINEAR DISCRIMINANT ANALYSIS; ROBUST MODELING;

FACE RECOGNITION;

EID: 84897022693     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2273355     Document Type: Article

References (38)

1. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York, NY, USA: Wiley, 2001.
2. I. T. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer-Verlag, 1986.
3. L. Xu and A. L. Yuille, "Robust principal component analysis by selforganizing rules based on statistical physics approach," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 131-143, Jan. 1995.
4. Q. Ke and T. Kanade, "Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 739-746. (Pubitemid 43897268)
5. C. Ding, D. Zhou, X. He, and H. Zha, "R1-PCA: Rotational invariant L1- norm principal component analysis for robust subspace factorization," in Proc. Int. Conf. Mach. Learn., 2006, pp. 281-288.
6. N. Kwak, "Principal component analysis based on L1-norm maximization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 1672-1680, Sep. 2008.
7. X. Li, Y. Pang, and Y. Yuan, "L1-norm-based 2DPCA," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1170-1175, Aug. 2009.
8. J. Yang, D. Zhang, A. F. Frangi, and J. Yang, "Two-dimensional PCA: A new approach to appearance-based face representation and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 131-137, Jan. 2004.
9. Y. Pang, X. Li, and Y. Yuan, "Robust tensor analysis with L1-norm," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 2, pp. 172-178, Feb. 2010.
10. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Annu. Eugen., vol. 7, no. 2, pp. 179-188, 1936.
11. A. M. Martinez and A. C. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001. (Pubitemid 32254716)
12. C. R. Rao, "The utilization of multiple measurements in problems of biological classification," J. Roy. Statist. Soc., Ser. B, vol. 10, no. 2, pp. 159-203, 1948.
13. M. Kyperountas, A. Tefas, and I. Pitas, "Weighted piecewise LDA for solving the small sample size problem in face verification," IEEE Trans. Neural Netw., vol. 18, no. 2, pp. 506-519, Mar. 2007. (Pubitemid 46522572)
14. C. Xiang, X. A. Fan, and T. H. Lee, "Face recognition using recursive Fisher linear discriminant," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2097-2105, Aug. 2008.
15. J. Ye, R. Janardan, C. H. Park, and H. Park, "An optimization criterion for generalized discriminant analysis on under-sampled problems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 982-994, Aug. 2004.
16. J. Ye and Q. Li, "A two-stage linear discriminant analysis via QRdecomposition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 929-941, Jun. 2005. (Pubitemid 40889843)
17. M. Sugiyama, "Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis," J. Mach. Learn. Res., vol. 8, pp. 1027-1061, May 2007. (Pubitemid 46798409)
18. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using Laplacian faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005. (Pubitemid 40377326)
19. X. Li, S. Fei, and T. Zhang, "Weighted maximum scatter difference based feature extraction and its application to face recognition," Mach. Vis. Appl., vol. 22, no. 3, pp. 591-595, May 2011.
20. H. Li, T. Jiang, and K. Zhang,"Efficient and robust feature extraction by maximum margin criterion," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 157-165, Jan. 2006. (Pubitemid 43263948)
21. X. Li, W. Hu, H. Wang, and Z. Zhang, "Linear discriminant analysis using rotational invariant L1 norm," Neurocomputing, vol. 73, nos. 13-15, pp. 2571-2579, Aug. 2010.
22. Y. Koren and L. Carmel, "Robust linear dimensionality reduction," IEEE Trans. Vis. Comput. Graph., vol. 10, no. 4, pp. 459-470, Jul./Aug. 2004.
23. G. A. F. Seber, Multivariate Observations. New York, NY, USA: Wiley, 1984, pp. 297-300.
24. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
25. F. Nie, H. Huang, C. Ding, D. Luo, and H. Wang, "Robust principal component analysis with non-greedy L1-norm maximization," in Proc. Int. Joint Conf. Artif. Intell., 2011, pp. 1433-1438.
26. D. Meng, Q. Zhao, and Z. Xu, "Improve robustness of sparse PCA by L1-norm maximization," Pattern Recognit., vol. 45, no. 1, pp. 487-497, Jan. 2012.
27. A. Frank and A. Asuncion. (2010). UCI Machine Learning Repository. [Online]. Available:http://archive.ics.uci.edu/ml
28. P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, "The FERET evaluation methodology for face-recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
29. J. J. Hull, "A database for handwritten text recognition research," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 5, pp. 550-554, May 1994.
30. M. J. Lyons, J. Budynek, and S. Akamatsu, "Automatic classification of single facial images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 12, pp. 1357-1362, Dec. 1999. (Pubitemid 30568926)
31. T. Tan and Z. Sun. (2010). CASIA-Fingerprint V5. [Online]. Available:http://biometrics.idealtest.org/
32. S. A. Nene, S. K. Nayar, and H. Murase, Columbia Object Image Library (COIL-20). Tech. Rep. CUCS-005-96, 1996.
33. J. Ye, "Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems," J. Mach. Learn. Res., vol. 6, pp. 483-502, Apr. 2005.
34. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognitive Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
35. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006. (Pubitemid 43022939)
36. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, no. 1, pp. 273-324, 1997. (Pubitemid 127401107)
37. R. Jenatton, G. Obozinski, and F. Bach, "Structured sparse principal component analysis," in Proc. Int. Conf. Artif. Intell. Statist., 2010, pp. 1-8.
38. H. Wang, Q. Tang, and W. Zheng, "L1-norm-based common spatial patterns," IEEE Trans. Biomed. Eng., vol. 59, no. 3, pp. 653-662, Mar. 2012.