Modified principal component analysis: An integration of multiple similarity subspace models

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 8, 2014, Pages 1538-1552

  Fan, Zizhu ^a,b   Xu, Yong ^a,c   Zuo, Wangmeng ^a   Yang, Jian ^d   Tang, Jinhui ^d   Lai, Zhihui ^a,c   Zhang, David ^e  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b EAST CHINA JIAOTONG UNIVERSITY   (China)

^c Key Laboratory of Network Oriented Intelligent Computation   (China)

^d NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^e HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Feature extraction; modified principal component analysis (MPCA); similarity measurement; similarity subspace; weak machine cell (WMC)

Indexed keywords

CLUSTERING ALGORITHMS; EIGENVALUES AND EIGENFUNCTIONS; FEATURE EXTRACTION; IMAGE RECONSTRUCTION; MATRIX ALGEBRA; PRINCIPAL COMPONENT ANALYSIS; VIRTUAL REALITY;

APPLICATION SCENARIO; CLASSIFICATION ACCURACY; CLASSIFICATION RESULTS; FACE IMAGE RECONSTRUCTION; MACHINE CELL; MODIFIED PRINCIPAL COMPONENT ANALYSIS (MPCA); SIMILARITY MEASUREMENTS; SIMILARITY SUBSPACE;

VECTORS;

EID: 84904737019     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2294492     Document Type: Article

References (62)

1. X. Wang and X. Tang, "A unified framework for subspace face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1222-1228, Sep. 2004.
2. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognit. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
3. R. Fisher, "The use of multiple measures in taxonomic problems," Ann. Eugenics, vol. 7, no. 2, pp. 179-188, 1936.
4. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005. (Pubitemid 40377326)
5. J. Yang, D. Zhang, A. F. Frangi, and J.-Y. Yang, "Two-dimensional PCA: A new approach to appearance-based face representation and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 131-137, Jan. 2004.
6. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "MPCA: Multilinear principal component analysis of tensor objects," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 18-39, Jan. 2008. (Pubitemid 351279223)
7. N. Kwak, "Principal component analysis based on L1-norm maximization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 1672-1680, Sep. 2008.
8. D. Meng, Q. Zhao, and Z. Xu, "Improve robustness of sparse PCA by L1-norm maximization," Pattern Recognit., vol. 45, pp. 487-497, Jan. 2012.
9. E. J. Candes, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis?," J. ACM, vol. 58, no. 3, pp. 1-25, 2011.
10. X. Li, Y. Pang, and Y. Yuan, "L1-norm-based 2DPCA," IEEE Trans. Syst., Man, Cybern., Part B, Cybern., vol. 40, no. 4, pp. 1170-1175, Aug. 2010.
11. B. Schölkopf, A. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, 1998. (Pubitemid 128463674)
12. S. Y. Huang, Y. R. Yeh, and S. Eguchi, "Robust kernel principal component analysis," Neural Comput., vol. 21, no. 11, pp. 3179-3213, 2009.
13. Z. Koldovsky, P. Tichavsky, and E. Oja, "Efficient variant of algorithm FastICA for independent component analysis attaining the Cramér-Rao lower bound," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1265-1277, Sep. 2006. (Pubitemid 46445183)
14. M. E. Tipping and C. M. Bishop, "Mixtures of probabilistic principal component analyzers," Neural Comput., vol. 11, no. 2, pp. 443-482, 1999.
15. R. He, B. G. Hu, W. S. Zheng, and X. Kong, "Robust principal component analysis based on maximum correntropy criterion," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1485-1494, Jun. 2011.
16. J. Zhao, P. L. H. Yu, and J. T. Kwok, "Bilinear probabilistic principal component analysis," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 492-503, Mar. 2012.
17. L.-F. Chen, H.-Y. M. Liao, M.-T. Ko, J.-C. Lin, and G.-J. Yu, "A new LDA-based face recognition system which can solve the small sample size problem," Pattern Recognit., vol. 33, no. 10, pp. 1713-1726, 2000.
18. M. Zhu and A. M. Martinez, "Subclass discriminant analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1274-1286, Aug. 2006. (Pubitemid 46405025)
19. S. Wang, J. Yang, N. Zhang, and C. Zhou, "Tensor discriminant color space for face recognition," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2490-2501, Sep. 2011.
20. Z. Fan, Y. Xu, and D. Zhang, "Local linear discriminant analysis framework using sample neighbors," IEEE Trans. Neural Netw., vol. 22, no. 7, pp. 1119-1132, Jul. 2011.
21. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisher Faces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
22. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K. Muller, "Fisher discriminant analysis with kernels," in Proc. IEEE Signal Process. Soc. Workshop Neural Netw. Signal Process., Aug. 1999, pp. 41-48. (Pubitemid 30510358)
23. H. Xiong, M. N. S. Swamy, and M. O. Ahmad, "Two-dimensional FLD for face recognition," Pattern Recognit., vol. 38, no. 7, pp. 1121-1124, 2005. (Pubitemid 40537033)
24. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H.-J. Zhang, "Multilinear discriminant analysis for face recognition," IEEE Trans. Image Process., vol. 16, no. 1, pp. 212-220, Jan. 2007. (Pubitemid 46437483)
25. S. Chen, H. Zhao, M. Kong, and B. Luo, "2D-LPP: A two-dimensional extension of locality preserving projections," Neurocomputing, vol. 70, nos. 4-6, pp. 912-921, 2007. (Pubitemid 46043990)
26. B. Moghaddam, "Principal manifolds and probabilistic subspaces for visual recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 6, pp. 780-788, Jun. 2002. (Pubitemid 34669591)
27. T. K. Ho, "The random subspace method for constructing decision forests," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 8, pp. 832-844, Aug. 1998. (Pubitemid 128741345)
28. N. García-Pedrajas and D. Ortiz-Boyer, "Boosting random subspace method," Neural Netw., vol. 21, no. 9, pp. 1344-1362, 2008.
29. S. Yan, D. Xu, B. Zhang, H. J. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007. (Pubitemid 46415944)
30. X. Jiang, "Linear subspace learning-based dimensionality reduction," IEEE Signal Process. Mag., vol. 28, no. 2, pp. 16-26, Mar. 2011.
31. J. M. Leiva-Murillo and A. Artes-Rodriguez, "Maximization of mutual information for supervised linear feature extraction," IEEE Trans. Neural Netw., vol. 18, no. 5, pp. 1433-1441, Sep. 2007. (Pubitemid 47408542)
32. K. Torkkola and W. M. Campbell, "Mutual information in learning feature transformations," in Proc. 17th ICML, 2000, pp. 1015-1022.
33. Y. Freund and R. Schapire, "A desicion-theoretic generalization of online learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, Aug. 1997. (Pubitemid 127433398)
34. A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall, "Learning a mahalanobis metric from equivalence constraints," J. Mach. Learn. Res., vol. 6, no. 1, pp. 937-965, Sep. 2005.
35. K. Pearson, "LIII. On lines and planes of closest fit to systems of points in space," Phil. Mag., vol. 2, no. 6, pp. 559-572, 1901.
36. A. N. Gorban and A. Y. Zinovyev, "Principal graphs and manifolds," arXiv:0809.0490 [cs.LG], 2008, DOI: 10.4018/978-1-60566-766-9.
37. A. N. Gorban and A. Zinovyev, "Principal manifolds and graphs in practice: From molecular biology to dynamical systems," Int. J. Neural Syst., vol. 20, no. 3, pp. 219-232, 2010.
38. I. T. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer-Verlag, 2002.
39. Y. Koren and L. Carmel, "Robust linear dimensionality reduction," IEEE Trans. Visualizat. Comput. Graph., vol. 10, no. 4, pp. 459-470, Jul./Aug. 2004.
40. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York, NY, USA: Wiley, 2006.
41. R. Cangelosi and A. Goriely, "Component retention in principal component analysis with application to cDNA microarray data," Biol. Direct, vol. 2, no. 2, pp. 1-21, 2007.
42. P. A. Estévez, M. Tesmer, C. A. Perez, and J. M. Zurada, "Normalized mutual information feature selection," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 189-201, Feb. 2009.
43. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000. (Pubitemid 32132953)
44. L. Wang, N. Zhou, and F. Chu, "A general wrapper approach to selection of class-dependent features," IEEE Trans. Neural Netw., vol. 19, no. 7, pp. 1267-1278, Jul. 2008.
45. M. Sebban and R. Nock, "A hybrid filter/wrapper approach of feature selection using information theory," Pattern Recognit., vol. 35, no. 4, pp. 835-846, 2002. (Pubitemid 34128810)
46. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
47. I. Naseem, R. Togneri, and M. Bennamoun, "Linear regression for face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 2106-2112, Nov. 2010.
48. Y. Xu, D. Zhang, Z. Jin, M. Li, and J.-Y. Yang, "A fast kernelbased nonlinear discriminant analysis for multi-class problems," Pattern Recognit., vol. 39, no. 6, pp. 1026-1033, 2006.
49. J. R. Beveridge, B. A. Draper, J. M. Chang, M. Kirby, and C. Peterson, "Principal angles separate subject illumination spaces in YDB and CMU-PIE," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 351-356, Feb. 2009.
50. J. Lu, K. Plataniotis, A. Venetsanopoulos, and S. Z. Li, "Ensemble-based discriminant learning with boosting for face recognition," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 166-178, Jan. 2006. (Pubitemid 43263949)
51. J. Y. Choi, Y. M. Ro, and K. Plataniotis, "Boosting color feature selection for color face recognition," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1425-1434, May 2011.
52. A. M. Martinez and A. C. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001. (Pubitemid 32254716)
53. J. Yang, A. F. Frangi, D. Zhang, and Z. Jin, "KPCA plus LDA: A complete kernel Fisher discriminant framework for feature extraction and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 230-244, Feb. 2005. (Pubitemid 40377316)
54. N. Kwak and C.-H. Choi, "Feature extraction based on ICA for binary classification problems," IEEE Trans. Knowl. Data Eng., vol. 15, no. 6, pp. 1374-1388, Nov. 2003.
55. H. Li, T. Jiang, and K. Zhang, "Efficient and robust feature extraction by maximum margin criterion," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 157-165, Jan. 2006. (Pubitemid 43263948)
56. R. Duin and M. Loog, "Linear dimensionality reduction via a heteroscedastic extension of LDA: The Chernoff criterion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 6, pp. 732-739, Jun. 2004.
57. W. H. Yang and D. Q. Dai, "Two-dimensional maximum margin feature extraction for face recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 4, pp. 1002-1012, Aug. 2009.
58. D. Cai, X. He, and J. Han, "SRDA: An efficient algorithm for largescale discriminant analysis," IEEE Trans. Knowl. Data Eng., vol. 20, no. 1, pp. 1-12, Jan. 2008.
59. S. J. Russell and P. Norvig, Artificial Intelligence A Modern Approach, 2nd ed. Upper Saddle River, NJ, USA: Prentice-Hall, 2003.
60. R. Xu and D. Wunsch, "Survey of clustering algorithms," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 645-678, May 2005. (Pubitemid 40718010)
61. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," Adv. Neural Inf. Process. Syst., vol. 2, no. 1, pp. 849-856, 2002.
62. D. Cai, X. He, J. Han, and T. S. Huang, "Graph regularized nonnegative matrix factorization for data representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1548-1560, Aug. 2011.