Linear discriminant analysis based on L1-norm maximization

IEEE Transactions on Image Processing

Volumn 22, Issue 8, 2013, Pages 3018-3027

  Zhong, Fujin ^a,b   Zhang, Jiashu ^a  

^a SOUTHWEST JIAOTONG UNIVERSITY   (China)

^b YIBIN UNIVERSITY   (China)

Author keywords

L1 norm; L2 norm; Linear discriminant analysis (LDA); optimization; outliers

Indexed keywords

ARTIFICIAL DATASETS; CLASSIFICATION DATASETS; DIMENSIONALITY REDUCTION TECHNIQUES; L1 NORM; L2-NORM; LINEAR DISCRIMINANT ANALYSIS; OUTLIERS; WITHIN-CLASS SCATTER MATRIX;

DISPERSIONS; OPTIMIZATION;

STATISTICS;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL; PROCEDURES;

ALGORITHMS; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LINEAR MODELS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84878502282     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2253476     Document Type: Article

References (34)

1. I. T. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer-Verlag, 1986.
2. R. A. Fisher, "The use of multiple measures in taxonomic problems," Ann. Eugenics, vol. 7, no. 2, pp. 179-188, Sep. 1936.
3. S. K. Nayar, N. A. Nene, and H. Murase, "Subspace methods for robot vision," IEEE Trans. Robot. Autom., vol. 12, no. 5, pp. 750-758, Oct. 1996. (Pubitemid 126786250)
4. H. Murase, F. Kimura, M. Yoshimura, and Y. Miyake, "An improvement of the auto-correlation matrix in pattern matching method and its application to handprinted 'HIRAGANA," Trans. IECE, vol. 64, no. 3, pp. 276-283, 1981.
5. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognit. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
6. A. Iosifidis, A. Tefas, N. Nikolaidis, and I. Pitas, "Multi-view human movement recognition based on fuzzy distances and linear discriminant analysis," Comput. Vis. Image Understand., vol. 116, no. 3, pp. 347-360, Mar. 2012.
7. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
8. D. L. Swets and J. J. Weng, "Using discriminant Eigenfeatures for image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 8, pp. 831-836, Aug. 1996. (Pubitemid 126772824)
9. A. M. Martinez and A. C. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001. (Pubitemid 32254716)
10. M. J. Black and A. Rangarajan, "On the unification of line processes, outlier rejection, and robust statistics with applications in early vision," Int. J. Comput. Vis., vol. 19, no. 1, pp. 57-91, Jul. 1996. (Pubitemid 126713881)
11. Q. Ke and T. Kanade, "Robust subspace computation using L1 norm," Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-CS-03- 172, Aug. 2003.
12. A. Baccini, P. Besse, and A. D. Falguerolles, "A L1-norm PCA and a heuristic approach, ordinal and symbolic data analysis," in Ordinal and Symbolic Data Analysis, E. Diday, Y. Lechevalier, and P. Opitz, Eds. New York, NY, USA: Springer-Verlag, 1996, pp. 359-368.
13. H. Wang, Q. Tang, and W. Zheng, "L1-norm-based common spatial patterns," IEEE Trans. Biomed. Eng., vol. 59, no. 3, pp. 653-662, Mar. 2012.
14. Y. Pang, X. Li, and Y. Yuan, "Robust tensor analysis with L1-norm," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 2, pp. 172-178, Feb. 2010.
15. Q. Ke and T. Kanade, "Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 739-746. (Pubitemid 43897268)
16. C. Ding, D. Zhou, X. He, and H. Zha, "R1-PCA: Rotational invariant L1- norm principal component analysis for robust subspace factorization," in Proc. Int. Conf. Mach. Learn., 2006, pp. 281-288.
17. N. Kwak, "Principal component analysis based on L1-norm maximization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 672-1680, Sep. 2008.
18. X. L. Li, Y. W. Pang, and Y. Yuan, "L1-norm-based 2DPCA," IEEE Trans. Syts., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1170-1175, Aug. 2009.
19. S. Seth and J. C. Principe, "Compressed signal reconstruction using the correntropy induced metric," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Apr. 2008, pp. 3845-3848.
20. W. Yin, S. Osher, D. Goldfarb, and J. Darbon, "Bregman iterative algorithms for L1-minimization with applications to compressed sensing," SIAM J. Imaging Sci., vol. 1, no. 1, pp. 143-168, Jan. 2008.
21. J. Wright, Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
22. R. He, W. Zheng, and B. Hu, "Maximum correntropy criterion for robust face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1561-1576, Apr. 2011.
23. X. Li, W. Hua, H. Wang, and Z. Zhang, "Linear discriminant analysis using rotational invariant L1 norm," Neurocomputing, vol. 73, nos. 13-15, pp. 2571-2579, Aug. 2010.
24. H. A. Moghaddam, M. Matinfar, S. M. S. Sadough, and K. A. Zadeh, "Algorithms and networks for accelerated convergence of adaptive LDA," Pattern Recognit., vol. 38, no. 4, pp. 473-483, Apr. 2005.
25. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. New York, NY, USA: Academic, 1990.
26. I. Pima and M. Aladjem, "Regularized discriminant analysis for face recognition," Pattern Recognit., vol. 37, no. 9, pp. 1945-948, Sep. 2004. (Pubitemid 38804480)
27. J. Ye and Q. Li, "A two-stage Linear Discriminant Analysis via QRDecomposition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 929-941, Jun. 2005. (Pubitemid 40889843)
28. H. Yu and J. Yang, "A direct LDA algorithm for high-dimensional datawith application to face recognition," Pattern Recognit., vol. 34, no. 10, pp. 2067-2070, Oct. 2001.
29. R. Jenatton and G. Obozinski, and F. Bach, "Structured sparse principal component analysis," in Proc. Int. Conf. Artif. Intell. Stat., May 2010, pp. 1-8.
30. C. J. Veeman and M. J. T. Reinders, "The Nearest Subclass Classifier: A Compromise between the Nearest Mean and Nearest Neighbor Classifier," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 9, pp. 1417-1429, Sep. 2005. (Pubitemid 41387773)
31. A. Frank and A. Asuncion. (2010). UCI Machine Learning Repository [Online]. Available: http://archive.ics.uci.edu/ml
32. The ORL Face Database. AT&T (Olivetti) Research Laboratories, Cambridge, U.K. [Online]. Available: http:// www.uk.research.att.com/ facedatabase.html
33. P. J. Phillips, H. Wechsler, J. Huang, and P. J. Rauss, "The FERET database and evaluation procedure for face recognition algorithms," Image Vis. Comput., vol. 16, no. 5, pp. 295-306, Apr. 1998. (Pubitemid 128393579)
34. Binary Alphadigits Database. (2006, Oct. 15) [Online]. Available: http://www.cs.nyu.edu/ roweis/data.html.