A fast tri-factorization method for low-rank matrix recovery and completion

Pattern Recognition

Volumn 46, Issue 1, 2013, Pages 163-173

  Liu, Yuanyuan ^a   Jiao, L C ^a   Shang, Fanhua ^a  

^a XIDIAN UNIVERSITY   (China)

Author keywords

Low rank representation; Low rank and sparse decomposition; Matrix completion; Nuclear norm minimization; Rank minimization

Indexed keywords

ALTERNATING DIRECTION METHODS; COMPLETION PROBLEM; COMPUTATION COSTS; CONVEX RELAXATION; ITERATIVE ALGORITHM; LOW RANK; LOW-RANK MATRICES; MATRIX COMPLETION; MATRIX RANK; MINIMIZATION ALGORITHMS; MINIMIZATION PROBLEMS; REAL WORLD DATA; ROBUST PRINCIPAL COMPONENT ANALYSIS; SPARSE DECOMPOSITION; VISION COMMUNITIES;

ALGORITHMS; FACTORIZATION; ITERATIVE METHODS; PRINCIPAL COMPONENT ANALYSIS; RELAXATION PROCESSES; SINGULAR VALUE DECOMPOSITION; VIRTUAL REALITY;

COMPUTER VISION;

EID: 84866023409     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.07.003     Document Type: Article

References (52)

1. Z. Liu, and L. Vandenberghe Interior-point method for nuclear norm approximation with application to system identification SIAM Journal on Matrix Analysis and Applications 31 3 2009 1235 1256
2. E.J. Candès, X. Li, Y. Ma, and J. Wright Robust principal component analysis? Journal of ACM 58 3 2011 1 37
3. Y. Peng, A. Ganesh, J. Wright, Y. Ma, RASL: robust alignment by sparse and low-rank decomposition for linearly correlated images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 763-770.
4. Y. Mu, J. Dong, X. Yuan, S. Yan, Accelerated low-rank visual recovery by random projection, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 2609-2616.
5. H. Jia, and A.M. Martinez Low-rank matrix fitting based on subspace perturbation analysis with applications to structure from motion IEEE Transactions on Pattern Analysis and Machine Intelligence 31 5 2009 841 854
6. X. Ding, L. He, and L. Carin Bayesian robust principal component analysis IEEE Transactions on Image Processing 20 12 2011 3419 3430
7. B. Chen, G. Liu, Z. Huang, S. Yan, Multi-task low-rank affinities pursuit for image segmentation, in: Proceedings of the IEEE Conference on Computer Vision (ICCV), 2011, pp. 2439-2446.
8. K. Min, Z. Zhang, J. Wright, Y. Ma, Decomposition background topics from keywords by principal component pursuit, in: Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM), 2010, pp. 269-278.
9. J. Chen, J. Zhou, J. Ye, Integrating low-rank and group-sparse structures for robust multi-task learning, in: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2011, pp. 42-50.
10. F. Shang, L.C. Jiao, J. Shi, M. Gong, and R.H. Shang Fast density-weighted low-rank approximation spectral clustering Data Mining and Knowledge Discovery 23 2 2011 345 378
11. G. Liu, Z. Lin, Y. Yu, Robust subspace segmentation by low-rank representation, in: Proceedings of the 27th International Conference on Machine Learning (ICML), 2010, pp. 663-670.
12. Y. Ni, J. Sun, X. Yuan, S. Yan, L. Cheong, Robust low-rank subspace segmentation with semidefinite guarantees, in: Proceedings of the IEEE International Conference on Data Mining (ICDM), 2010, pp. 1179-1188.
13. G. Liu, S. Yan, Latent low-rank representation for subspace segmentation and feature extraction, in: Proceedings of the IEEE Conference on Computer Vision (ICCV), 2011, pp. 1615-1622.
14. P. Favaro, R. Vidal, A. Ravichandran, A closed form solution to robust subspace estimation and clustering, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 1801-1807.
15. Z. Lin, R. Liu, Z. Su, Linearized alternating direction method with adaptive penalty for low-rank representation, in: Advances in Neural Information Processing Systems (NIPS) 25, 2011, pp. 612-620.
16. U. Shalit, D. Weinshall, G. Chechik, Online learning in the manifold of low-rank matrices, in: Advances in Neural Information Processing Systems (NIPS) 24, 2010, pp. 2128-2136.
17. T. Zhou, D. Tao, GoDec: randomized low-rank & sparse matrix decomposition in noisy case, in: Proceedings of the 28th International Conference on Machine Learning (ICML), 2011, pp. 33-40.
18. R. Vidal Subspace clustering IEEE Signal Processing Magazine 28 2 2011 52 68
19. K.-C. Toh, and S. Yun An accelerated proximal gradient algorithm for nuclear norm regularized least squares problems Pacific Journal of Optimization 6 2010 615 640
20. R.H. Keshavan, A. Montanari, and S. Oh Matrix completion from noisy entries Journal of Machine Learning Research 11 2010 2057 2078
21. E.J. Candès, and B. Recht Exact matrix completion via convex optimization Foundations of Computational Mathematics 9 6 2009 717 772
22. J. Cai, E.J. Candès, and Z. Shen A singular value thresholding algorithm for matrix completion SIAM Journal on Optimization 20 4 2010 1956 1982
23. S. Ma, D. Goldfarb, and L. Chen Fixed point and Bregman iterative methods for matrix rank minimization Mathematical Programming Series A 128 1 2011 321 353
24. Z. Lin, A. Ganesh, J. Wright, L. Wu, M. Chen, Y. Ma, Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix, Technical Report UILU-ENG-09-2214, University of Illinois, Urbana-Champaign, July 2009.
25. Z. Lin, M. Chen, L. Wu, The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices, Technical Report UILU-ENG-09-2215, University of Illinois, Urbana-Champaign, October 2009.
26. B. Recht, M. Fazel, and P. Parrilo Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization SIAM Review 52 3 2010 471 501
27. Z. Zhang, A. Ganesh, X. Liang, and Y. Ma TILT: transform invariant low-rank textures International Journal of Computer Vision 99 1 2012 1 24
28. C.H.Q. Ding, T. Li, W. Peng, H. Park, Orthogonal nonnegative matrix tri-factorizations for clustering, in: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2006, pp. 126-135.
29. F. Shang, Y. Liu, F. Wang, Learning spectral embedding for semi-supervised clustering, in: Proceedings of the IEEE International Conference on Data Mining (ICDM), 2011, pp. 597-606.
30. F. Shang, L.C. Jiao, and F. Wang Graph dual regularization non-negative matrix factorization for co-clustering Pattern Recognition 45 6 2012 2237 2250
31. F. Shang, L.C. Jiao, Y. Liu, F. Wang, Semi-supervised learning with mixed knowledge information, in: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2012.
32. J. Ye, R. Janardan, Q. Li, Two-dimensional linear discriminant analysis, in: Advances in Neural Information Processing Systems (NIPS), 2004, pp. 1569-1576.
33. G.H. Bakir, A. Gretton, M.O. Franz, B. Schölkopf, Multivariate regression via stiefel manifold constraints, in: Proceedings of the 26th DAGM Symposium, 2004, pp. 262-269.
34. A. Beck, and M. Teboulle A fast iterative shrinkage-thresholding algorithm for linear inverse problems SIAM Journal on Imaging Sciences 2 2009 183 202
35. W. Yin, S. Osher, D. Goldfarb, and J. Darbon Bregman iterative algorithms for l1-minimization with applications to compressed sensing SIAM Journal on Imaging Sciences 1 1 2008 143 168
36. J. Shi, and J. Malik Normalized cuts and image segmentation IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 2000 888 905
37. J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry, and Y. Ma Robust face recognition via sparse representation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2 2009 210 227
38. Y.C. Eldar, and M. Mishali Robust recovery of signals from a structured union of subspaces IEEE Transactions on Information Theory 55 11 2009 5302 5316
39. E. Elhamifar, R. Vidal, Sparse subspace clustering, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 2790-2797.
40. L. Qiao, S. Chen, and X. Tan Sparsity preserving projections with applications to face recognition Pattern Recognition 43 1 2010 331 341
41. R.M. Larsen, PROPACK-Software for large and sparse SVD Calculations, Available from 〈http://sun.stanford.edu/∼rmunk/PROPACK/〉.
42. P. Drineas, R. Kannan, and M.W. Mahoney Fast Monte Carlo algorithms for matrices II: computing a low-rank approximation to a matrix SIAM Journal on Computing 36 1 2006 158 183
43. I. Daubechies, M. Defrise, and C. De Mol An iterative thresholding algorithm for linear inverse problems with a sparsity constraint Communications on Pure and Applied Mathematics 57 11 2004 1413 1457
44. J. Yang, W. Yin, Y. Zhang, and Y. Wang A fast algorithm for edge-preserving variational multichannel image restoration SIAM Journal on Imaging Sciences 2 2 2009 569 592
45. Z. Wen, W. Yin, Y. Zhang, Solving a low-rank factorization model for matrix completion by a non-linear successive over-relaxation algorithm, Rice University CAAM Technical Report TR10-07.
46. Y. Shen, Z. Wen, Y. Zhang, Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization, Rice University CAAM Technical Report TR11-02.
47. K. Lee, J. Ho, and D. Kriegman Acquiring linear subspaces for face recognition under variable lighting IEEE Transactions on Pattern Analysis and Machine Intelligence 27 5 2005 684 698
48. R. Tron, R. Vidal, A benchmark for the comparison of 3-D motion segmentation algorithms, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2007, pp. 1-8.
49. J. Yan, M. Pollefeys, A general framework for motion segmentation: independent, articulated, rigid, non-rigid, degenerate and non-degenerate, in: Proceedings of the European Conference on Computer Vision (ECCV), 2006, pp. 94-106.
50. M. Fischler, and R. Bolles Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Communications of the ACM 24 6 1981 381 395
51. J. Costeira, and T. Kanade A multibody factorization method for independently moving objects International Journal of Computer Vision 29 3 1998 159 179
52. L. Cheng, M. Gong, D. Schuurmans, and T. Caelli Realtime discriminative background subtraction IEEE Transactions on Image Processing 20 5 2011 1401 1404