A regularization framework for robust dimensionality reduction with applications to image reconstruction and feature extraction

Pattern Recognition

Volumn 43, Issue 4, 2010, Pages 1269-1281

  Liang, Zhizheng ^a   Li, Youfu ^b  

^a CHINA UNIVERSITY OF MINING AND TECHNOLOGY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Feature extraction; Image reconstruction; Nonlinear eigenvalue problem; Regularization framework; Robust; SCF iteration

Indexed keywords

DATA SETS; DIMENSIONALITY REDUCTION; FACE IMAGES; GENE EXPRESSION DATA; HAND-WRITTEN CHARACTERS; LINEAR PROJECTION METHOD; MACHINE-LEARNING; NONLINEAR EIGENVALUE PROBLEM; PRIOR KNOWLEDGE; REGULARIZATION FRAMEWORK; SELF-CONSISTENT FIELD;

COMPUTER VISION; COST FUNCTIONS; FEATURE EXTRACTION; GENE EXPRESSION; IMAGE RECONSTRUCTION; REPAIR; SWITCHING SYSTEMS;

EIGENVALUES AND EIGENFUNCTIONS;

EID: 74449091584     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.10.012     Document Type: Article

References (45)

1. Fukunaga K. Introduction to Statistical Pattern Recognition. second ed. (1990), Academic Press, New York
2. Belhumeur P.N., Hespanha J.P., and Kriegman D.J. Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence (1997) 711-720
3. Yan S., Xu D., Zhang B., Zhang H., Yang Q., and Lin S. Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence (2007) 40-51
4. S. Yan, D. Xu, B. Zhang, H.J. Zhang, Graph embedding: a general framework for dimensionality reduction, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 830-837.
5. Ye J. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. Journal of Machine Learning Research (2005) 483-502
6. Ye J., and Li Q. A two-stage discriminant analysis via QR decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence (2005) 929-941
7. He X., Yan S., Hu Y., Niyogi P., and Zhang H.J. Face recognition using Laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 3 (2005) 328-340
8. Pang Y., Zhang L., and Liu Z. Neighbourhood preserving projections (NPP): a novel linear dimension reduction method, Lecture Notes in Computer Science vol. 3644 (2005), Springer, Berlin pp. 117-125
9. Folub G.H., and Van Loan C.F. Matrix Computation. third ed. (1996), The Johns Hopkins University Press, MD, USA
10. S. Zhang, T. Sim, Discriminant subspace analysis: a Fukunaga-Koontz approach, IEEE Transactions on Pattern Analysis and Machine Intelligence 29 (10) (2007) 1732-1745.
11. H. Cevikalp, M. Neamtu, M. Wilkes, A. Barkana, Discriminative common vectors for face recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence 27 (1) (2005) 4-13.
12. Howland P., and Park H. Generalized discriminant analysis using the generalized singular value decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence 8 (2004) 995-1006
13. Ye J., Janardan R., Park C.H., and Park H. An optimization criterion for generalized discriminant analysis on undersampled problems. IEEE Transactions on Pattern Analysis and Machine Intelligence 8 (2004) 982-994
14. Li H., Zhang K., and Jiang T. Efficient and robust feature extraction by maximum margin criterion. IEEE Transactions on Neural Networks 17 1 (2006) 157-165
15. Chen L.F., Liao Y.M., Ko M.T., Lin J.C., and Yu G.J. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition (2000) 1713-1726
16. R. Huang, Q. Liu, H. Lu, S. Ma, Solving the small sample problem of LDA, in: Proceedings of the IEEE International Conference on Pattern Recognition, vol. 3, 2002, pp. 29-32.
17. Yu H., and Yang J. A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recognition 34 10 (2001) 2067-2070
18. S. Ji, J. Ye, A unified framework for generalized discriminant analysis for generalized linear discriminant analysis, 2008, pp. 1-7.
19. Kwak N. Principal component analysis based on L1-norm maximization. IEEE Transactions on Pattern Analysis and Machine Intelligence (2008) 1672-1680
20. Aanas H., Fisker R., Astrom K., and Carstensen J. Robust factorization. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 9 (2002) 1215-1225
21. C. Ding, D. Zhou, X. He, H. Zha, R1-PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization, in: Proceedings of the 23rd International Conference on Machine Learning, June 2006.
22. Baccini A., Besse P., and Falguerolles A.D. A L1-norm PCA and a heuristic approach. In: Diday E., Lechevalier Y., and Opitz P. (Eds). Ordinal and Symbolic Data Analysis (1996), Springer, Berlin 359-368
23. Q. Ke, T. Kanade, Robust subspace computation using L1 norm, Technical Report CMU-CS-03-172, Carnegie Mellon University, 〈http://citeseer.ist.psu.edu/ke03robust.html〉, August 2003.
24. Q. Ke, T. Kanade, Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 2005.
25. Liu J., Chen S., and Tan X. A study on three linear discriminant analysis based methods in the small sample size problem. Pattern Recognition 41 (2008) 102-116
26. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning-Data Mining, Inference, and Prediction (2001), Springer-Verlag, Berlin
27. Nikolova M. Analytical bounds on the minimizers of (nonconvex) regularized least-squares. AIMS Journal on Inverse Problems and Imaging 1 4 (2007) 661-677
28. Nikolova M. Minimizers of cost-functions involving non-smooth data-fidelity terms. Application to the processing of outliers. SIAM Journal on Numerical Analysis 40 3 (2002) 965-994
29. Nikolova M. Efficient reconstruction of piecewise constant images using nonsmooth nonconvex minimization. SIAM Journal on Imaging Sciences 1 1 (2008) 2-25
30. Durand S., and Nikolova M. Denoising of frame coefficients using L1 data-fidelity term and edge-preserving regularization. SIAM Journal on Multiscale Modeling and Simulation 6 (2007) 547-576
31. Nikolova M., and Ng M. Analysis of half-quadratic minimization methods for signal and image recovery. SIAM Journal on Scientific Computing 27 3 (2005) 937-966
32. Geman D., and Reynolds G. Constrained restoration and recovery of discontinuities. IEEE Transactions on Pattern Analysis and Machine Intelligence 14 (1992) 367-383
33. S. Geman, D.E. McClure, Statistical methods for topographic image reconstruction, in: Proceedings of the 46th Session of the ISI, Bulletin of the ISI, vol. 52, 1987, pp. 22-26.
34. Hebert T., and Leahy R. A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors. IEEE Transactions on Medical Imaging 8 (1989) 194-202
35. Leclerc Y.G. Constructing simple stable description for image partitioning. International Journal on Computer Vision 3 (1989) 73-102
36. Yang C., Meza J.C., and Wang L. A trust region direct constrained minimization algorithm for the Kohn-Sham equation. SIAM Journal on Scientific Computing 29 (2007) 1854-1875
37. Z. Bai, C. Yang, From self-consistency to SOAR: solving nonlinear eigenvalue problems, SIAM News, April, 2006.
38. C. Yang, W. Gao, J. Meza, On the convergence of the self-consistent field iteration for a class of nonlinear eigenvalue problems, with LBNL Report 63037, 2007.
39. D.J. Newman, S. Hettich, C.L. Blake, C.J. Merz, UCI repository of machine learning databases, 〈http://www.ics.uci.edu/mlearn/MLRepository.html〉, 1998.
40. Loog M., and Duin R.P. Linear dimensionality reduction via a heteroscedasitc extension of LDA: the Chernoff criterion. IEEE Transactions on Pattern Analysis and Machine Intelligence 1 (2004) 732-739
41. 〈http://images.ee.umist.ac.uk/danny/database.html〉.
42. Veer L., Dai H., Vijver M., Hart A.M., Mao M., et al. Gene expression profiling predicts clinical outcome of breast cancer. Letters to Nature 415 (2002) 530-536
43. N. Barkai, D.A. Tterman, et al., Broad patterns of gene expression revealed by clustering analysis of tumour and normal colon tissues probed by oligonucleotide arrays, in: Proceedings of National Academy of Sciences of the United States of American, vol. 96, 1999, pp. 6745-6750.
44. Armstrong S., et al. MLL translocations specify a distinct gene expression profile that distinguishes a unique leukaemia. Nature Genetics 30 (2002)
45. Khan J., et al. Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nature Medicine 7 6 (2001)