Robust recovery of corrupted low-rankmatrix by implicit regularizers

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 4, 2014, Pages 770-783

  He, Ran ^a   Tan, Tieniu ^a   Wang, Liang ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

correntropy; implicit regularizers; low rank matrix recovery; PCA

Indexed keywords

ERRORS; ESTIMATION; PRINCIPAL COMPONENT ANALYSIS; VIRTUAL REALITY;

CORRENTROPY; HALF-QUADRATIC OPTIMIZATIONS; IMPLICIT REGULARIZERS; LOW-RANK MATRIX RECOVERIES; PCA; PROXIMITY OPERATOR; REAL-WORLD PROBLEM; ROBUST PRINCIPAL COMPONENT ANALYSIS;

RECOVERY;

EID: 84897522870     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.188     Document Type: Article

References (53)

1. Z. Lin, A. Ganesh, J. Wright, L. Wu, M. Chen, and Y. Ma, "FastConvex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix," UIUC Technical Report UILU-ENG-09-2214, 2009.
2. C. Ding, D. Zhou, X. He, and H. Zha, "R1-PCA: Rotational Invariant l1-Norm Principal Component Analysis for Robust Subspace Factorization," Proc. Int'l Conf. Machine Learning, pp. 281-288, 2006.
3. C.M. Bishop, Patten Recognition and Machine Learning. Springer, 2006.
4. F. De La Torre and M. Black, "A Framework for Robust Subspace Learning," Int'l J. Computer Vision, vol. 54, no. 1-3, pp. 117-142, 2003.
5. R.A. Maronna, "Principal Components and Orthogonal Regression Based on Robust Scales," Technometrics, vol. 47, pp. 264-273, 2005.
6. R. He, B.-G. Hu, W.-S. Zheng, and X.W. Kong, "Robust Principal Component Analysis Based on Maximum Correntropy Criterion," IEEE Trans. Image Processing, vol. 20, no. 6, pp. 1485-1494, June 2011.
7. X. Wang and X. Tang, "A Unified Framework for Subspace Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1222-1228, Sept. 2004.
8. E.J. Cand-es, X. Li, Y. Ma, and J. Wright, "Robust Principal Component Analysis?" J. ACM, vol. 58, no. 3, article 11, 2011.
9. J. Iglesias, M. de Bruijne, M. Loog, F. Lauze, and M. Nielsen, "A Family of Principal Component Analyses for Dealing with Outliers," Proc. 10th Int'l Conf. Medical Image Computing & Computer-Assisted Intervention, pp. 178-185, 2007.-
10. P. Huber, Robust Statistics. John Wiley & Sons, 1981.-
11. J. Cai, E.J. Cand-es, and Z. Shen, "A Singular Value Thresholding-Algorithm for Matrix Completion," SIAM J. Optimization, vol. 20, no. 4, pp. 1956-1982, 2010.
12. J. Wright, A. Ganesh, S. Rao, and Y. Ma, "Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization," J. ACM, vol. 4, pp. 1-44, 2009.
13. Z. Lin, M. Chen, L. Wu, and Y. Ma, "The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices," UIUC Technical Report UILU-ENG-09-2215, 2009.
14. A. Ganesh, J. Wright, X. Li, E.J. Cand-es, and Y. Ma, "Dense Error Correction for Low-Rank Matrices via Principal Component Pursuit," The Computing Research Repository, 2010.
15. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, "Robust Recovery of Subspace Structures by Low-Rank Representation," The Computing Research Repository, 2010.
16. Y. Mu, J. Dong, X. Yuan, and S. Yan, "Accelerated Low-Rank Visual Recovery by Random Projection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2609-2616, 2011.
17. R. He, Z. Sun, T. Tan, and W.-S. Zheng, "Recovery of Corrupted Low-Rank Matrices via Half-Quadratic Based Nonconvex Minimization," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
18. P.L. Combettes and V.R. Wajs, "Signal Recovery by Proximal Forwardbackward Splitting," SIAM J. Multiscale Modeling & Simulation, vol. 4, no. 5, pp. 1168-1200, 2005.
19. J.M. Bioucas-Dias and M.A.T. Figueiredo, "A New Twist: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration," IEEE Trans. Image Processing, vol. 16, no. 12, pp. 2992-3004, Dec. 2007.
20. Z. Zhang, "Parameter Estimation Techniques: A Tutorial with Application to Conic Fitting," Image and Vision Computing, vol. 15, no. 1, pp. 59-76, 1997.
21. M. Nikolova and M.K. NG, "Analysis of Half-Quadratic Minimization Methods for Signal and Image Recovery," SIAM J. Scientific Computing, vol. 27, no. 3, pp. 937-966, 2005.
22. W.F. Liu, P.P. Pokharel, and J.C. Principe, "Correntropy: Properties and Applications in Non-Gaussian Signal Processing," IEEE Trans. Signal Processing, vol. 55, no. 11, pp. 5286-5298, Nov. 2007.
23. M.V. Afonso, J.M. Bioucas-Dias, and M.A.T. Figueiredo, "An Augmented Lagrangian Approach to Linear Inverse Problems with Compound Regularization," Proc. Int'l Conf. Image Processing, pp. 4169-4172, 2010.
24. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge Univ. Press, 2004.
25. J.-J. Moreau, "Fonctions Convexes Duales et Points Proximaux dans un Espace Hilbertien," Comptes Rendus de l'Acad-emie des Sciences. S-erie I. Math-ematique. Acad-emie des Sciences, vol. 255, pp. 2897-2899, 1962.
26. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T.S. Huang, and S. Yan, "Sparse Representation for Computer Vision and Pattern Recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, June 2010.
27. P. Gong, C. Zhang, Z. Lu, J. Huang, and J. Ye, "A General Iterative Shrinkage and Thresholding Algorithm for Non-Convex Regularized Optimization Problems," Proc. Int'l Conf. Machine Learning, 2013.
28. E.J. Cand-es and T. Tao, "The Power of Convex Relaxation: Near-Optimal Matrix Completion," IEEE Trans. Information Theory, vol. 56, no. 5, pp. 2053-2080, May 2010.
29. A. Singer and M. Cucuringu, "Uniqueness of Low-Rank Matrix Completion by Rigidity Theory," SIAM J. Matrix Analysis and Applications, vol. 31, pp. 1621-1641, 2010.
30. M. Fazel, "Matrix Rank Minimization with Applications," PhD dissertation, Stanford Univ., 2002.
31. R. Tibshirani, "Regression Shrinkage and Selection via the Lasso," J. Royal Statistical Soc. B, vol. 58, no. 1, pp. 267-288, 1996.
32. D. Hsu, S.M. Kakade, and T. Zhang, "Robust Matrix Decomposition with Sparse Corruptions," IEEE Trans. Information Theory, vol. 57, no. 11, pp. 7221-7234, Nov. 2011.
33. A. Ganesh, Z. Lin, J. Wright, L. Wu, M. Chen, and Y. Ma, "Fast Algorithms for Recovering a Corrupted Low-Rank Matrix," Proc. Int'l Workshop Computational Advances in Multi-Sensor Adaptive Processing, 2008.
34. M. Fornasier, H. Rauhut, and R. Ward, "Low Rank Matrix Recovery via Iteratively Reweighted Least Squares Minimization," submitted to SIAM J. Optimization, pp. 1-22, 2011.
35. V. Chandrasekaran, S. Sanghavi, P.A. Parrilo, and A.S. Willsky, "Sparse and Low-Rank Matrix Decompositions," Proc. IEEE Conf. Comm., Control, and Computing, pp. 962-967, 2009.
36. D. Gross, "Recovering Low-Rank Matrices from Few Coefficients in Any Basis," IEEE Trans. Information Theory, vol. 57, no. 3, pp. 1548-1566, Mar. 2011.
37. C.A. Micchelli, J.M. Morales, and M. Pontil, "A Family of Penalty Functions for Structured Sparsity," Proc. Advances in Neural Information Processing Systems, pp. 1-9, 2010.
38. R. He, W.-S. Zheng, and B.-G. Hu, "Maximum Correntropy Criterion for Robust Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 8, pp. 1561-1576, Aug. 2011.
39. R. Angst, C. Zach, and M. Pollefeys, "The Generalized Trace Norm and Its Application to Structure from Motion Problems," Proc. IEEE Int'l Conf. Computer Vision, pp. 2502-2509, 2011.
40. L. Yuan, J. Liu, and J. Ye, "Efficient Methods for Overlapping Group Lasso," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 35, no. 9, pp. 2104-2116, Sept. 2013.
41. J.M. Bioucas-Dias and M.A.T. Figueiredo, "An Iterative Algorithm for Linear Inverse Problems with Compound Regularizers," Proc. Int'l Conf. Image Processing, pp. 685-688, 2008.
42. A. Beck and M. Teboulle, "A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems," SIAM J. Imaging Sciences, vol. 2, no. 1, pp. 183-202, 2009.
43. K.-C. Toh and S. Yun, "An Accelerated Proximal Gradient Algorithm for Nuclear Norm Regularized Least Squares Problems," Pacific J. Optimization, vol. 6, pp. 615-640, 2010.
44. L. Li, W. Huang, I. Gu, and Q. Tian, "Statistical Modeling of Complex Backgrounds for Foreground Object Detection," IEEE Trans. Image Processing, vol. 13, no. 11, pp. 1459-1472, Nov. 2004.
45. K.-C. Lee, J. Ho, and D. Kriegman, "Acquiring Linear Subspaces for Face Recognition under Variable Lighting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 684-698, May 2005.
46. L. Wang, T. Tan, H. Ning, and W. Hu, "Silhoutte Analysis Based Gait Recognition for Human Identification," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1505-1518, Dec. 2003.
47. S. Sarkar, P.J. Phillips, Z. Liu, I.R. Vega, P. Grother, and K.W. Bowyer, "The Humanid Gait Challenge Problem: Data Sets, Performance, and Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 162-177, Feb. 2005.
48. S. Zheng, K. Huang, T. Tan, R. He, and J. Zhang, "Robust View Transformation Model for Gait Recognition," Proc. Int'l Conf. Image Processing, 2011.
49. J. Han and B. Bhanu, "Individual Recognition Using Gait Energy Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 2, pp. 316-322, Feb. 2006.
50. E. Grave, G. Obozinski, and F. Bach, "Trace Lasso: A Trace Norm Regularization for Correlated Designs," Proc. Advances in Neural Information Processing Systems (NIPS), 2012.
51. J. Idier, "Convex Half-Quadratic Criteria and Interacting Auxiliary Variables for Image Restoration," IEEE Trans. Image Processing, vol. 10, no. 7, pp. 1001-1009, July 2001.
52. W.F. Liu, P.P. Pokharel, and J.C. Principe, "Error Entropy, Correntropy and M-Estimation," Proc. IEEE Workshop Machine Learning for Signal Processing, pp. 179-184, 2006.
53. S. Seth and J. Principe, "Compressed Signal Reconstruction Using the Correntropy Induced Metric," Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, 2008