Laplacian Regularized Low-Rank Representation and Its Applications

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 3, 2016, Pages 504-517

  Yin, Ming ^a,b   Gao, Junbin ^c   Lin, Zhouchen ^d,e  

^a GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

^b BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^c CHARLES STURT UNIVERSITY   (Australia)

^d Peking University   (China)

^e SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Graph; Hyper Laplacian; Laplacian Matrix; Low Rank Representation; Manifold Structure; Regularization

Indexed keywords

COMPUTER VISION; IMAGE CLASSIFICATION; MATRIX ALGEBRA; PATTERN RECOGNITION; SIGNAL PROCESSING;

GRAPH; LAPLACIAN MATRICES; LAPLACIANS; LOW-RANK REPRESENTATIONS; MANIFOLD STRUCTURES; REGULARIZATION;

LAPLACE TRANSFORMS;

EID: 84962090301     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2462360     Document Type: Article

References (56)

1. D. Babacan, M. Luessi, R. Molina, and A. K. Katsaggelos, "Sparse Bayesian methods for low-rank matrix estimation," IEEE Trans. Signal Process., vol. 60, no. 8, pp. 3964-3977, Aug. 2012.
2. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, pp. 1373-1396, 2003.
3. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Proc. Adv. Neural Inf. Process. Syst., 2001, vol. 14, pp. 585-591.
4. G. F. Bull and J. Gao, "Transposed low rank representation for image classification," in Proc. Int. Conf. Digital Image Comput. Techn. Appl., 2012, pp. 1-7.
5. D. Cai, X. He, and J. Han, "Spectral regression: A unified approach for sparse subspace learning," in Proc. IEEE Int. Conf. Data Mining, 2007, pp. 73-82.
6. D. Cai, X. He, J. Han, and T. S. Huang, "Graph regularized nonnegative matrix factorization for data representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1548-1560, Aug. 2011.
7. D. Cai, X. He, X. Wang, H. Bao, and J. Han, "Locality preserving nonnegative matrix factorization," in Proc. Int. Joint Conf. Artif. Intell., 2009, pp. 1010-1015.
8. J. F. Cai, E. J. Candes, and Z. Shen, "A singular value thresholding algorithm for matrix completion," SIAM J. Optimization, vol. 20, no. 4, pp. 1956-1982, 2008.
9. E. Candes and B. Recht, "Exact matrix completion via convex optimization," Found. Comput. Math., vol. 9, pp. 717-772, 2008.
10. E. Candes, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis" J. ACM, vol. 58, article 11: 1-37, 2011.
11. C.-F. Chen, C.-P. Wei, and Y.-C. F. Wang, "Low-rank matrix recovery with structural incoherence for robust face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2618-2625.
12. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol. 43, no. 1, pp. 129-159, Jan. 2001.
13. B. Cheng, J. Yang, S. Yan, Y. Fu, and T. S. Huang, "Learning with '1-graph for image analysis," IEEE Trans. Image Process., vol. 19, no. 4, pp. 858-866, Apr. 2010.
14. F. R. K. Chung, Spectral Graph Theory. Providence, RI, USA: AMS, 1997.
15. P. G. Doyle and J. L. Snell, Random Walks and Electric Networks. Washington, DC, USA: MAA, 1984.
16. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
17. J. Gao, "Robust '1 principal component analysis and its Bayesian variational inference," Neural Comput., vol. 20, no. 2. pp. 555-572, 2008.
18. S. Gao, I. W.-H. Tsang, and L.-T. Chia, "Laplacian sparse coding, hypergraph Laplacian sparse coding, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 92-104, Jan. 2013.
19. R. Hadsell, S. Chopra, and Y. Lecun, "Dimensionality reduction by learning an invariant mapping," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2006, pp. 1735-1742.
20. X. He, D. Cai, Y. Shao, H. Bao, and J. Han, "Laplacian regularized Gaussian mixture model for data clustering," IEEE Trans. Knowl. Data Eng., vol. 23, no. 9, pp. 1406-1418, Sep. 2011.
21. X. He, D. Cai, S. Yan, and H.-J. Zhang, "Neighborhood preserving embedding," in Proc. IEEE 10th Int. Conf. Comput. Vis., 2005, pp. 1208-1213.
22. X. He, S. Yan, Y. Hu, P. Niyogi, and H. J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
23. S. Ji and J. Ye, "An accelerated gradient method for trace norm minimization," in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 457-464.
24. I. Jolliffe, Principal Component Analysis, 2nd ed. New York, NY, USA: Springer, 2002.
25. H. Kim and H. Park, "Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method," SIAM J. Matrix Analy. Appl., vol. 30, no. 2, pp. 713-730, 2008.
26. F. De la Torre and M. J. Black, "Robust principal component analysis for computer vision," in Proc. IEEE 8th Int. Conf. Comput. Vis., 2001, vol. 1, pp. 362-369.
27. Z. Lin, M. Chen, and Y. Ma, "The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices," UIUC, Champaign, IL, USA, Tech. Rep. UILU-ENG-09-2215, 2009.
28. Z. Lin, A. Ganesh, J. Wright, L. Wu, M. Chen, and Y. Ma, "Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix," UIUC, Champaign, IL, USA, Tech. Rep. UILUENG-09-2214, Jul. 2009.
29. Z. Lin, R. Liu, and Z. Su, "Linearized alternating direction method with adaptive penalty for low-rank representation," in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 612-620.
30. G. Liu, Z. Lin, S. Yan, J. Sun, and Y. Ma, "Robust recovery of subspace structures by low-rank representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
31. G. Liu, Z. Lin, and Y. Yu, "Robust subspace segmentation by lowrank representation," in Proc. Int. Conf. Mach. Learn., 2010, pp. 663-670.
32. G. Liu, H. Xu, and S. Yan, "Exact subspace segmentation and outlier detection by low-rank representation," in Proc. 15th Int. Conf. Artif. Intell. Stat., 2012, pp. 703-711.
33. G. Liu and S. Yan, "Latent low-rank representation for subspace segmentation and feature extraction," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 1615-1622.
34. R. Liu, Z. Lin, and Z. Su, "Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning," J. Mach. Learning Res., vol. 29, pp. 1-16, 2013.
35. X. Lu, Y. Wang, and Y. Yuan, "Graph-regularized low-rank representation for destriping of hyperspectral images," IEEE Trans. Geosci. Remote Sensing, vol. 51, no. 7, pp. 4009-4018, Jul. 2013.
36. L. Pu and B. Faltings, "Hypergraph learning with hyperedge expansion," in Proc. Eur. Conf. Mach. Learning Knowl. Discovery Databases, 2012, pp. 410-425.
37. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, pp. 2323-2326, 2000.
38. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
39. M. Tao and X. Yuan, "Recovering low-rank and sparse components of matrices from incomplete and noisy observations," SIAM J. Optimization, vol. 21, no. 2. pp. 57-81, 2011.
40. J. B. Tenenbaum, V. d. Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, pp. 2319-2323, 2000.
41. K. Toh and S. Yun, "An accelerated proximal gradient algorithms for nuclear norm regularized least squares problems," Pacific J. Optimization, vol. 6, pp. 615-640, 2010.
42. J. Wang, F. Wang, C. Zhang, H. C. Shen, and L. Quan, "Linear neighborhood propagation and its applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 9, pp. 1600-1615, Sep. 2009.
43. Z. Wen, D. Goldfarb, and W. Yin, "Alternating direction augmented Lagrangian methods for semidefinite programming," Math. Program. Comput., vol. 2, pp. 203-230, 2010.
44. J. Wright, A. Ganesh, S. Rao, and Y. Ma, "Robust principal component analysis: Exact recovery of corrupted low-rank matrices by convex optimization," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 2080-2088.
45. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2010.
46. L. Wu, A. Ganesh, B. Shi, Y. Matsushita, Y. Wang, and Y. Ma, "Convex optimization based low-rank matrix completion and recovery for photometric stereo and factor classification," submitted to IEEE Trans. Pattern Anal. Mach. Intell., Aug. 2012.
47. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1. pp. 40-51, Jan. 2007.
48. S. Yang, X. Wang, M. Wang, Y. Han, and L. Jiao, "Semi-supervised low-rank representation graph for pattern recognition," IET Image Process., vol. 7, no. 2. pp. 131-136, Mar. 2013.
49. M. Yin, S. Cai, and J. Gao, "Robust face recognition via double low-rank matrix recovery for feature extraction," in Proc. IEEE Int. Conf. Image Process., 2013, pp. 3770-3774.
50. Z. Zhang, X. Liang, A. Ganesh, and Y. Ma, "Tilt: Transform invariant low-rank textures," in Proc. 10th Asian Conf. Comput. Vis., 2010, pp. 314-328.
51. Z. Zhang and K. Zhao, "Low-rank matrix approximation with manifold regularization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 7, pp. 1717-1729, Jul. 2013.
52. M. Zheng, J. Bu, C. Chen, C. Wang, L. Zhang, G. Qiu, and D. Cai, "Graph regularized sparse coding for image representation," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1327-1336, May 2011.
53. Y. Zheng, X. Zhang, S. Yang, and L. Jiao, "Low-rank representation with local constraint for graph construction," Neurocomputing, vol. 122, pp. 398-405, 2013.
54. D. Zhou, J. Huang, and B. Scholkopf, "Learning with hypergraphs: Clustering, classification, and embedding," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 1601-1608.
55. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. Proc. Int. Conf. Mach. Learn., 2003, pp. 912-919.
56. L. Zhuang, H. Gao, Z. Lin, Y. Ma, X. Zhang, and N. Yu, "Non-negative low rank and sparse graph for semi-supervised learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2328-2335.