Structure preserving non-negative matrix factorization for dimensionality reduction q

Computer Vision and Image Understanding

Volumn 117, Issue 9, 2013, Pages 1175-1189

  Li, Zechao ^a   Liu, Jing ^a   Lu, Hanqing ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Basis compactness; Dimensionality reduction; Multiplicative update algorithm; Non negative matrix factorization; Structure preserving

Indexed keywords

FACTORIZATION; ITERATIVE METHODS; MATRIX ALGEBRA; OPTIMIZATION; SEMANTICS; STRUCTURE (COMPOSITION); VIRTUAL REALITY;

BASIS COMPACTNESS; DIMENSIONALITY REDUCTION; MULTIPLICATIVE UPDATES; NONNEGATIVE MATRIX FACTORIZATION; STRUCTURE-PRESERVING;

DATA REDUCTION;

EID: 84885381199     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.04.003     Document Type: Article

References (44)

1. A. Batur, M. Hayes, Linear subspaces for illumination robust face recognition, in: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, 2001, pp. 296-301.
2. I.T. Jolliffe, Principal Component Analysis, Springer-Verlag, New York, 1989.
3. P.N. Belhumeur, J.P. Hespanha, D.J. Kriegman, Eigenfaces vs. fisherfaces: recognition using class specific linear projection, IEEE Trans. Pattern Anal. Mach. Intell. 19 (7) (1997) 711-720. (Pubitemid 127762263)
4. A. Martinez, A. Kak, Pca versus lda, IEEE Trans. Pattern Anal. Mach. Intell. 23 (2) (2001) 228-233. (Pubitemid 32254716)
5. K. Fukunnaga, Introduction to Statistical Pattern Recognition, second ed., Academic Press, New York, 1990.
6. H. Yu, J. Yang, A direct lda algorithms for high dimensional data-with application to face recognition, Pattern Recognit. 34 (2001) 2067-2070.
7. J. Ye, R. Janardan, C. Park, H. Park, An optimization criterion for generalized discriminant analysis on undersampled problems, IEEE Trans. Pattern Anal. Mach. Intell. 26 (8) (2004) 982-994.
8. X. Liu, A. Srivastava, K. Gallivan, Optimal linear representation of images for object recognition, IEEE Trans. Pattern Anal. Mach. Intell. 26 (5) (2004) 662-666.
9. Y. Wu, X. Liu, W. Mio, K.A. Gallivan, Two stage optimal component analysis via dimensional reduction, Comput. Vision Image Understand. (CVIU) 110 (1) (2008) 91-101.
10. J. Tenenbaum, V. Silva, J. Langford, A global geometric framework for nonlinear dimensionality reduction, Science 290 (22) (2000) 2319-2323. (Pubitemid 32041577)
11. S.T. Roweis, L.K. Saul, Nonlinear dimensionality reduction by locally linear embedding, Science 290 (5500) (2000) 2323-2326. (Pubitemid 32041578)
12. M. Belkin, P. Niyogi, Laplacian eigenmaps for dimensionality reduction and data representation, Neural Comput. 15 (6) (2003) 1373-1396. (Pubitemid 37049796)
13. X. He, P. Niyogi, Locality preserving projections, Adv. Neural Inform. Process. Syst. (2003).
14. X. He, D. Cai, S. Yan, H.-J. Zhang, Neighborhood preserving embedding, in: Proceedings of IEEE International Conference on Computer Vision, 2005, pp. 1208-1213. (Pubitemid 44042318)
15. J. Yang, D. Zhang, A. Frangi, J. Yang, Two-dimensional pca: a new approach to appearance-based face representation and recognition, IEEE Trans. Pattern Anal. Mach. Intell. 26 (1) (2004) 131-137.
16. J. Ye, Geberalized low rank approximations of matrices, in: Proceedings of IEEE International Conference on Machine Learning, 2004, pp. 895-902.
17. S. Yan, D. Xu, L. Zhang, X. Tang, H.-J. Zhang, Discriminant analysis with tensor representation, in: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, 2005, pp. 526-532.
18. J. Ye, R. Janardan, Q. Li, Two-dimensional linear discriminant analysis, Adv. Neural Inform. Process. Syst. (2005) 1569-1576.
19. D.D. Lee, H.S. Seung, Learning the parts of objects by non-negative matrix factorization, Nature 401 (6755) (1999) 788-791.
20. S.E. Palmers, Hierarchical structures in perceptual representation, Cognitive Psychol. 9 (1977) 441-474.
21. N.K. Logothetis, D.L. Sheinberg, Visual object recognition, Ann. Rev. Neurosci. 19 (1996) 577-621. (Pubitemid 26080840)
22. E. Wachsmuth, M.W. Oram, D.I. Perrett, Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque, Cereb. Cortex 4 (1994) 509-522. (Pubitemid 24297014)
23. S.Z. Li, X. Hou, H. Zhang, Q. Cheng, Learning spatially localized, parts-based representation, in: Proceedings of Computer Vision and Pattern Recognition, 2001, pp. 207-212.
24. S. Joshi, S. Karthikeyan, B. Manjunath, Anatomical parts-based regression using non-negative matrix factorization, in: Proceedings of Computer Vision and Pattern Recognition, 2010, pp. 2863-2870.
25. D.D. Lee, H.S. Seung, Algorithms for non-negative matrix factorization, Adv. Neural Inform. Process. Syst. 13 (2001) 556-562.
26. W. Xu, X. Liu, Y. Gong, Document clustering based on non-negative matrix factorization, in: Proceedings of ACM SIGIR Conference on Research and Development in Informaion Retrieval, 2003, pp. 267-273.
27. F. Shahnaz, M.W. Berry, V. Pauca, R.J. Plemmons, Document clustering using nonnegative matrix factorization, Inform. Process. Manage. 42 (2006) 373-386. (Pubitemid 41394167)
28. P.O. Hoyer, P. Dayan, Non-negative matrix factorization with sparseness constraints, J. Mach. Learn. Res. 5 (2004) 1457-1469.
29. Q. Gu, J. Zhou, Neighborhood preserving non-negative matrix factorization, in: Proceedings of The 20th British Machine Vision Conference, 2009.
30. Q. Gu, J. Zhou, Local learning regularized nonnegative matrix factorization, in: Proceedings of International Joint Conferences on Artificial Intelligence, 2009, pp. 1046-1051.
31. D. Cai, X. He, X. Wu, H. Bao, J. Han, Locality preserving nonnegative matrix factorization, in: Proceedings of International Joint Conferences on Artificial Intelligence, 2009, pp. 1010-1015.
32. H. Liu, Z. Wu, X. Li, D. Cai, T.S. Huang, Constrained nonnegative matrix factorization for image representation, IEEE Trans. Pattern Anal. Mach. Intell. 34 (7) (2012) 1299-1311.
33. D. Kong, C. Ding, H. Huang, Robust nonnegative matrix factorization using l21- norm, in: Proceedings of ACM International Conference on Information and Knowledge Management, 2011, pp. 673-682.
34. D. Cai, X. He, J. Han, T.S. Huang, Graph regularized non-negative matrix factorization for data representation, IEEE Trans. Pattern Anal. Mach. Intell. 33 (8) (2011) 1548-1560.
35. M. Belkin, P. Niyogi, Laplacian eigenmaps and spectral techniques for embedding and clustering, Adv. Neural Inform. Process. Syst. (2001) 585-591.
36. M.A. Carreira-Perpinan, The elastic embedding algorithm for dimensionality reduction, in: Proceedings of the 27th International Conference on Machine Learning, 2010, pp. 167-174.
37. S. Boyd, L. Vandenberghe, Convex Optimization, Cambridge University Press, Cambridge, 2004.
38. T.H. Cormen, R.L.R.C.E. Leiserson, C. Stein, Introduction to Algorithms, second ed., MIT Press and McGraw-Hill, New York, 2001.
39. J.B. MacQueen, Some methods for classification and analysis of multivariate observations, in: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, 1967, pp. 281-297.
40. T. Cover, P. Hart, Nearest neighbor pattern classification, IEEE Trans. Inform. Theory 13 (1) (1967) 21-27.
41. L.I. Kuncheva, L.C. Jain, Nearest neighbor classifier: simultaneous editing and feature selection, Pattern Recognit. Lett. 20 (11-13) (1999) 1149-1156. (Pubitemid 32261892)
42. T. Sim, S. Baker, M. Bsat, The cmu pose, illumination, and expression database, IEEE Trans. Pattern Anal. Mach. Intell. 25 (12) (2003) 1615-1618.
43. B. Schölkopf, A. Smola, K.-R. Müller, Nonlinear component analysis as a kernel eigenvalue problem, Neural Comput. 10 (5) (1998) 1299-1319. (Pubitemid 128463674)
44. D. You, O.C. Hamsici, A.M. Martinez, Kernel optimization in discriminant analysis, IEEE Trans. Pattern Anal. Mach. Intell. 33 (3) (2011) 631-638.