Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering

IEEE Transactions on Cybernetics

Volumn 47, Issue 4, 2017, Pages 1053-1066

  Peng, Xi ^a   Yu, Zhiding ^b   Yi, Zhang ^c   Tang, Huajin ^c  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c SICHUAN UNIVERSITY   (China)

Author keywords

Error removal; Feature extraction; Robustness; Spectral clustering; Spectral embedding

Indexed keywords

CLASSIFICATION (OF INFORMATION); ERRORS; GRAPH THEORY; GRAPHIC METHODS; IMAGE SEGMENTATION; LEARNING ALGORITHMS; LEAST SQUARES APPROXIMATIONS;

CLASSIFICATION/CLUSTERING; GRAPH-BASED LEARNING; LEAST SQUARE REGRESSION; LINEAR REPRESENTATION; LOW-RANK REPRESENTATIONS; NORMALIZED MUTUAL INFORMATION; STATE-OF-THE-ART METHODS; SUB-SPACE CLUSTERING;

CLUSTERING ALGORITHMS;

EID: 84960969128     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2016.2536752     Document Type: Article

References (55)

1. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding, " Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
2. S. C. Yan, et al., "Graph embedding and extensions: A general framework for dimensionality reduction, " IEEE Trans. Pattern. Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
3. L. Shao, D. Wu, X. Li, "Learning deep and wide: A spectral method for learning deep networks, " IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 12, pp. 2303-2308, Dec. 2014.
4. J. Wu, S. Pan, X. Zhu, Z. Cai, "Boosting for multi-graph classification, " IEEE Trans. Cybern., vol. 45, no. 3, pp. 416-429, Mar. 2015.
5. Z. Yu, et al., "Transitive distance clustering with k-means duality, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 987-994.
6. S. Jones and L. Shao, "Unsupervised spectral dual assignment clustering of human actions in context, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 604-611.
7. Z. Yu, et al., "Generalized transitive distance with minimum spanning random forest, " in Proc. Int. Joint Conf. Artif. Intell., Buenos Aires, Argentina, Jul. 2015, pp. 2205-2211.
8. Y. Yuan, J. Lin, Q. Wang, "Dual-clustering-based hyperspectral band selection by contextual analysis, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1431-1445, Mar. 2016.
9. E. Elhamifar and R. Vidal, "Sparse subspace clustering: Algorithm, theory, applications, " IEEE Trans. Pattern. Anal. Mach. Intell., vol. 35, no. 11, pp. 2765-2781, Nov. 2013.
10. L. S. Qiao, S. C. Chen, X. Y. Tan, "Sparsity preserving projections with applications to face recognition, " Pattern Recognit., vol. 43, no. 1, pp. 331-341, 2010.
11. B. Cheng, J. Yang, S. Yan, Y. Fu, T. S. Huang, "Learning with L1-graph for image analysis, " IEEE Trans. Image Process., vol. 19, no. 4, pp. 858-866, Apr. 2010.
12. G. Liu, et al., "Robust recovery of subspace structures by low-rank representation, " IEEE Trans. Pattern. Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
13. J. P. Costeira and T. Kanade, "A multibody factorization method for independently moving objects, " Int. J. Comput. Vis., vol. 29, no. 3, pp. 159-179, 1998.
14. X. He, S. Yan, Y. Hu, P. Niyogi, H.-J. Zhang, "Face recognition using Laplacianfaces, " IEEE Trans. Pattern. Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
15. J. Wang, "A linear assignment clustering algorithm based on the least similar cluster representatives, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 29, no. 1, pp. 100-104, Jan. 1999.
16. R. Vidal, Y. Ma, S. Sastry, "Generalized principal component analysis (GPCA), " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 12, pp. 1945-1959, Dec. 2005.
17. J. Yan and M. Pollefeys, "A general framework for motion segmentation: Independent, articulated, rigid, non-rigid, degenerate and nondegenerate, " in Proc. Eur. Conf. Comput. Vis., Graz, Austria, May 2006, pp. 94-106.
18. G. L. Chen and G. Lerman, "Spectral curvature clustering (SCC), " Int. J. Comput. Vis., vol. 81, no. 3, pp. 317-330, 2009.
19. S. Rao, R. Tron, R. Vidal, Y. Ma, "Motion segmentation in the presence of outlying, incomplete, or corrupted trajectories, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 10, pp. 1832-1845, Oct. 2010.
20. S. Xiao, W. Li, D. Xu, D. Tao, "FaLRR: A fast low rank representation solver, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Boston, MA, USA, Jun. 2015, pp. 4612-4620.
21. J. Tang, L. Shao, X. Li, K. Lu, "A local structural descriptor for image matching via normalized graph Laplacian embedding, " IEEE Trans. Cybern., vol. 46, no. 2, pp. 410-420, Feb. 2016.
22. R. Vidal, "Subspace clustering, " IEEE Signal Process. Mag., vol. 28, no. 2, pp. 52-68, Mar. 2011.
23. R. Liu, Z. Lin, F. De la Torre, Z. Su, "Fixed-rank representation for unsupervised visual learning, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 598-605.
24. G. C. Liu and S. C. Yan, "Latent low-rank representation for subspace segmentation and feature extraction, " in Proc. IEEE Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 1615-1622.
25. P. Favaro, R. Vidal, A. Ravichandran, "A closed form solution to robust subspace estimation and clustering, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2011, pp. 1801-1807.
26. X. Peng, L. Zhang, Z. Yi, "Scalable sparse subspace clustering, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 430-437.
27. Y. Wang and H. Xu, "Noisy sparse subspace clustering, " in Proc. Int. Conf. Mach. Learn., vol. 28. Atlanta, GA, USA, Jun. 2013, pp. 89-97.
28. J. Chen and J. Yang, "Robust subspace segmentation via low-rank representation, " IEEE Trans. Cybern., vol. 44, no. 8, pp. 1432-1445, Aug. 2014.
29. Y. Peng, J. Suo, Q. Dai, W. Xu, "Reweighted low-rank matrix recovery and its application in image restoration, " IEEE Trans. Cybern., vol. 44, no. 12, pp. 2418-2430, Dec. 2014.
30. S. Xiao, M. Tan, D. Xu, "Weighted block-sparse low rank representation for face clustering in videos, " in Proc. Eur. Conf. Comput. Vis., Zürich, Switzerland, Sep. 2014, pp. 123-138.
31. M. Lee, J. Lee, H. Lee, N. Kwak, "Membership representation for detecting block-diagonal structure in low-rank or sparse subspace clustering, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Boston, MA, USA, Jun. 2015, pp. 1648-1656.
32. J. Lu, G. Wang, W. Deng, K. Jia, "Reconstruction-based metric learning for unconstrained face verification, " IEEE Trans. Inf. Forensics Security, vol. 10, no. 1, pp. 79-89, Jan. 2015.
33. A. Y. Ng, M. I. Jordan, Y. Weiss, "On spectral clustering: Analysis and an algorithm, " in Proc. Adv. Neural Inf. Process. Syst., vol. 14. Vancouver, BC, Canada, Dec. 2002, pp. 849-856.
34. X. He, D. Cai, S. Yan, H.-J. Zhang, "Neighborhood preserving embedding, " in Proc. IEEE Conf. Comput. Vis., Beijing, China, Oct. 2005, pp. 1208-1213.
35. X. Peng, Z. Yi, H. Tang, "Robust subspace clustering via thresholding ridge regression, " in Proc. AAAI Conf. Artif. Intell., Austin, TX, USA, Jan. 2015, pp. 3827-3833.
36. D. H. Yan, L. Huang, M. I. Jordan, "Fast approximate spectral clustering, " in Proc. ACM SIGKDD Conf. Knowl. Disc. Data Mining, Paris, France, Jun. 2009, pp. 907-915.
37. U. V. Luxburg, "A tutorial on spectral clustering, " Stat. Comput., vol. 17, no. 4, pp. 395-416, 2007.
38. N. Papadakis and A. Bugeau, "Tracking with occlusions via graph cuts, " IEEE Trans. Pattern. Anal. Mach. Intell., vol. 33, no. 1, pp. 144-157, Jan. 2011.
39. A. E. Hoerl and R. W. Kennard, "Ridge regression: Biased estimation for nonorthogonal problems, " Technometrics, vol. 12, no. 1, pp. 55-67, 1970.
40. L. Zhang, M. Yang, X. Feng, "Sparse representation or collaborative representation: Which helps face recognition?" in Proc. IEEE Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 471-478.
41. A. S. Georghiades, P. N. Belhumeur, D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose, " IEEE Trans. Pattern. Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
42. J. A. Costa and A. O. Hero, "Geodesic entropic graphs for dimension and entropy estimation in manifold learning, " IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2210-2221, Aug. 2004.
43. M. Ester, H.-P. Kriegel, J. Sander, X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise, " in Proc. Int. Conf. Knowl. Disc. Data Mining, vol. 1996. Portland, OR, USA, 1996, pp. 226-231.
44. M. Turk and A. Pentland, "Eigenfaces for recognition, " J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
45. M. R. Osborne, B. Presnell, B. A. Turlach, "A new approach to variable selection in least squares problems, " SIAM J. Numer. Anal., vol. 20, no. 3, pp. 389-403, 2000.
46. A. Yang, A. Ganesh, S. S. Sastry, Y. Ma, "Fast L1-M inimization algorithms and an application in robust face recognition: A review, " Dept. EECS, Univ. California, Berkeley, Berkeley, CA, USA, Tech. Rep. UCB/EECS-2010-13, Feb. 2010.
47. A. Martínez and R. Benavente, "The AR face database, " Centre de Visió per Computador, Universitat Autoónoma de Barcelona, Barcelona, Spain, Tech. Rep. 24, 1998.
48. R. Gross, I. Matthews, J. Cohn, T. Kanade, S. Baker, "Multi-PIE, " Image Vis. Comput., vol. 28, no. 5, pp. 807-813, 2010.
49. X. Peng, L. Zhang, Z. Yi, K. K. Tan, "Learning localityconstrained collaborative representation for robust face recognition, " Pattern Recognit., vol. 47, no. 9, pp. 2794-2806, 2014.
50. C.-Y. Lu, et al., "Robust and efficient subspace segmentation via least squares regression, " in Proc. Eur. Conf. Comput. Vis., Florence, Italy, Oct. 2012, pp. 347-360.
51. Y. Liu, et al., "Understanding and enhancement of internal clustering validation measures, " IEEE Trans. Cybern., vol. 43, no. 3, pp. 982-994, Jun. 2013.
52. H. Xiong and Z. Li, "Clustering validation measures, " in Data Clustering: Algorithms and Applications, C. C. Aggarwal and C. K. Reddy, Eds. Boca Raton, FL, USA: CRC Press, 2014.
53. D. Cai, X. He, J. Han, "Document clustering using locality preserving indexing, " IEEE Trans. Knowl. Data Eng., vol. 17, no. 12, pp. 1624-1637, Dec. 2005.
54. M. Lee, J. Cho, C.-H. Choi, S. Oh, "Procrustean normal distribution for non-rigid structure from motion, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 1280-1287.
55. R. Tron and R. Vidal, "A benchmark for the comparison of 3-D motion segmentation algorithms, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 1-8.