Robust subspace clustering

Annals of Statistics

Volumn 42, Issue 2, 2014, Pages 669-699

  Soltanolkotabi, Mahdi ^a   Elhamifar, Ehsan ^b   Candès, Emmanuel J ^c  

^a Stanford University   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c STANFORD UNIVERSITY   (United States)

Author keywords

Dantzig selector; Geometric functional analysis; LASSO; Multiple hypothesis testing; Nonasymptotic random matrix theory; Spectral clustering; Subspace clustering; True and false discoveries; 1 minimization

Indexed keywords

EID: 84901725652     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/13-AOS1199     Document Type: Article

References (61)

1. AGARWAL, P. K. and MUSTAFA, N. H. (2004). k-means projective clustering. In Proceedings of the Twenty-third ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems 155-165.
2. ALDROUBI, A. and SEKMEN, A. (2012). Nearness to local subspace algorithm for subspace and motion segmentation. Signal Process. Lett., IEEE 19 704-707.
3. ARIAS-CASTRO, E. (2011). Clustering based on pairwise distances when the data is of mixed dimensions. IEEE Trans. Inform. Theory 57 1692-1706. MR2815843
4. ARIAS-CASTRO, E., CHEN, G. and LERMAN, G. (2011). Spectral clustering based on local linear approximations. Electron. J. Stat. 5 1537-1587. MR2861697
5. ARORA, S., GE, R., KANNAN, R. and MOITRA, A. (2012). Computing a nonnegative matrix factorization-provably. In STOC'12 - Proceedings of the 2012 ACM Symposium on Theory of Computing 145-161. ACM, New York. MR2961503
6. BAKO, L. (2011). Identification of switched linear systems via sparse optimization. Automatica J. IFAC 47 668-677. MR2878328
7. BALCAN, M.-F., BLUM, A. and GUPTA, A. (2009). Approximate clustering without the approximation. In Proceedings of the Twentieth Annual ACM-SIAM Symposium on Discrete Algorithms 1068-1077. SIAM, Philadelphia, PA. MR2807549
8. BAYATI, M. andMONTANARI, A. (2011). The dynamics of message passing on dense graphs, with applications to compressed sensing. IEEE Trans. Inform. Theory 57 764-785. MR2810285
9. BAYATI, M. andMONTANARI, A. (2012). The LASSO risk for Gaussian matrices. IEEE Trans. Inform. Theory 58 1997-2017. MR2951312
10. BECKER, S. R., CANDÈS, E. J. and GRANT, M. C. (2011). Templates for convex cone problems with applications to sparse signal recovery. Math. Program. Comput. 3 165-218. MR2833262
11. BELLONI, A., CHERNOZHUKOV, V. andWANG, L. (2011). Square-root lasso: Pivotal recovery of sparse signals via conic programming. Biometrika 98 791-806. MR2860324
12. BITTORF, V., RECHT, B., RE, C. and TROPP, J. A. (2012). Factoring nonnegative matrices with linear programs. In Proceedings of Natural Information Processing Systems Foundation NIPS.
13. BOULT, T. E. and GOTTESFELD BROWN, L. (1991). Factorization-based segmentation of motions. In Proceedings of the IEEE Workshop on Visual Motion 179-186.
14. BRADLEY, P. S. and MANGASARIAN, O. L. (2000). k-plane clustering. J. Global Optim. 16 23-32. MR1770524
15. CANDÈS, E. and TAO, T. (2007). The Dantzig selector: Statistical estimation when p is much larger than n. Ann. Statist. 35 2313-2351. MR2382644
16. CHEN, G. and LERMAN, G. (2009). Foundations of a multi-way spectral clustering framework for hybrid linear modeling. Found. Comput. Math. 9 517-558. MR2534403
17. CHEN, G. and LERMAN, G. (2009). Spectral curvature clustering (SCC). Int. J. Comput. Vis. 81 317-330.
18. CHEN, Y., NASRABADI, N. M. and TRAN, T. D. (2011). Hyperspectral image classification using dictionary-based sparse representation. IEEE Trans. Geosci. Remote Sens. 99 1-13.
19. DALALYAN, A. and CHEN, Y. (2012). Fused sparsity and robust estimation for linear models with unknown variance. In Advances in Neural Information Processing Systems 25 1268- 1276.
20. ELHAMIFAR, E. and VIDAL, R. (2009). Sparse subspace clustering. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2790-2797.
21. ELHAMIFAR, E. and VIDAL, R. (2010). Clustering disjoint subspaces via sparse representation. In IEEE International Conference on Acoustics Speech and Signal Processing, ICASSP 1926-1929. IEEE Press, New York.
22. ELHAMIFAR, E. and VIDAL, R. (2013). Sparse subspace clustering: Algorithms, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 35 2765-2781.
23. ERIKSSON, B., BALZANO, L. and NOWAK, R. (2011). High-rank matrix completion and subspace clustering with missing data. Preprint. Available at arXiv:1112.5629.
24. GIRAUD, C., HUET, S. and VERZELEN, N. (2012). High-dimensional regression with unknown variance. Statist. Sci. 27 500-518. MR3025131
25. GOH, A. and VIDAL, R. (2007). Segmenting motions of different types by unsupervised manifold clustering. In IEEE International Conference on Computer Vision and Pattern Recognition, CVPR 1-6. IEEE Press, New York.
26. GUNNEMANN, S., MULLER, E., RAUBACH, S. and SEIDL, T. (2011). Flexible fault tolerant subspace clustering for data with missing values. In IEEE International Conference on Data Mining, ICDM 231-240.
27. KANNAN, R. and VEMPALA, S. (2008). Spectral algorithms. Found. Trends Theor. Comput. Sci. 4 157-288 (2009). MR2558901
28. KELLER, F., MULLER, E. and BOHM, K. (2012). HICS: High contrast subspaces for densitybased outlier ranking. In IEEE International Conference on Data Engineering, ICDE 1037-1048.
29. KOTROPOULOS, Y. P. C. and ARCE, G. R. (2011). ℓ1-graph based music structure analysis. In International Society for Music Information Retrieval Conference, ISMIR.
30. LERMAN, G. and ZHANG, T. (2011). Robust recovery of multiple subspaces by geometric lp minimization. Ann. Statist. 39 2686-2715. MR2906883
31. LIU, G., LIN, Z., YAN, S., SUN, J., YU, Y. andMA, Y. (2013). Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35 171- 184.
32. LOH, P.-L. and WAINWRIGHT, M. J. (2012). High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity. Ann. Statist. 40 1637-1664. MR3015038
33. LU, L. and VIDAL, R. (2006). Combined central and subspace clustering for computer vision applications. In Proceedings of the 23rd International Conference on Machine Learning 593-600. ACM, New York.
34. MA, Y., DERKSEN, H., HONG, W. and WRIGHT, J. (2007). Segmentation of multivariate mixed data via lossy data coding and compression. IEEE Trans. Pattern Anal. Mach. Intell. 29 1546-1562. (Pubitemid 47299910)
35. MA, Y. and VIDAL, R. (2005). Identification of deterministic switched arx systems via identification of algebraic varieties. In Hybrid Systems: Computation and Control 449-465.
36. MA, Y., YANG, A. Y., DERKSEN, H. and FOSSUM, R. (2008). Estimation of subspace arrangements with applications in modeling and segmenting mixed data. SIAM Rev. 50 413-458. MR2429444
37. MCWILLIAMS, B. andMONTANA, G. (2014). Subspace clustering of high-dimensional data: A predictive approach. Data Min. Knowl. Discov. 28 736-772. MR3165525
38. MEINSHAUSEN, N. and BÜHLMANN, P. (2006). High-dimensional graphs and variable selection with the lasso. Ann. Statist. 34 1436-1462. MR2278363
39. MÜLLER, E., GUNNEMANN, S., ASSENT, I. and SEIDL, T. (2009). Evaluating clustering in subspace projections of high dimensional data. Proc. VLDB Endow. 2 1270-1281.
40. NG, A. Y., JORDAN, M. I. and WEISS, Y. (2002). On spectral clustering: Analysis and an algorithm. Adv. Neural Inf. Process. Syst. 2 849-856.
41. OZAY, N., SZNAIER, M. and LAGOA, C. (2010).Model (in) validation of switched arx systems with unknown switches and its application to activity monitoring. In IEEE Conference on Decision and Control, CDC 7624-7630.
42. OZAY, N., SZNAIER, M., LAGOA, C. and CAMPS, O. (2010). GPCA with denoising: A moments-based convex approach. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 3209-3216. IEEE Press, New York.
43. PARSONS, L., HAQUE, E. and LIU, H. (2004). Subspace clustering for high dimensional data: A review. ACM SIGKDD Explor. Newsl. 6 90-105.
44. ROSENBAUM, M. and TSYBAKOV, A. B. (2013). Improved matrix uncertainty selector. In From Probability to Statistics and Back: High-Dimensional Models and Processes - A Festschrift in Honor of Jon A. Wellner 276-290. IMS, Beachwood, OH.
45. ROSENBAUM, M. and TSYBAKOV, A. B. (2010). Sparse recovery under matrix uncertainty. Ann. Statist. 38 2620-2651. MR2722451
46. SOLTANOLKOTABI, M. and CANDÉS, E. J. (2012). A geometric analysis of subspace clustering with outliers. Ann. Statist. 40 2195-2238. MR3059081
47. SOLTANOLKOTABI, M., ELHAMIFAR, E. and CANDÈS, E. J. (2014). Supplement to "Robust subspace clustering." DOI:10.1214/13- AOS1199SUPP.
48. STÄDLER, N., BÜHLMANN, P. and VAN DE GEER, S. (2010). ℓ1-penalization for mixture regression models. TEST 19 209-256. MR2677722
49. SUN, T. and ZHANG, C.-H. (2012). Scaled sparse linear regression. Biometrika 99 879-898. MR2999166
50. TIPPING, M. E. and BISHOP, C. M. (1999). Probabilistic principal component analysis. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 611-622. MR1707864
51. TOMASI, C. and KANADE, T. (1992). Shape and motion from image streams under orthography: A factorization method. Int. J. Comput. Vis. 9 137-154. (Pubitemid 23621943)
52. TSENG, P. (2000). Nearest q-flat to m points. J. Optim. Theory Appl. 105 249-252. MR1757267
53. VIDAL, R. (2011). Subspace clustering. IEEE Signal Process. Mag. 28 52-68.
54. VIDAL, R., MA, Y. and SASTRY, S. (2005). Generalized principal component analysis (GPCA). IEEE Trans. Pattern Anal. Mach. Intell. 27 1945-1959. (Pubitemid 43051391)
55. YAN, J. and POLLEFEYS, M. (2006). A general framework for motion segmentation: Independent, articulated, rigid, nonrigid, degenerate and nondegenerate. In ECCV 2006 94-106.
56. ZHANG, A., FAWAZ, N., IOANNIDIS, S. and MONTANARI, A. (2012). Guess who rated this movie: Identifying users through subspace clustering. In Proceedings of the International Conference on Uncertainty in Articial Intelligence 944-953.
57. ZHANG, T., SZLAM, A. and LERMAN, G. (2009). Median k-flats for hybrid linear modeling with many outliers. In IEEE International Conference on Computer Vision Workshops, ICCV 234-241.
58. ZHANG, T., SZLAM, A., WANG, Y. and LERMAN, G. (2012). Hybrid linear modeling via local best-fit flats. Int. J. Comput. Vis. 100 217-240. MR2979307
59. ZHOU, F., TORRE, F. and HODGINS, J. K. (2008). Aligned cluster analysis for temporal segmentation of human motion. In IEEE International Conference on Automatic Face and Gesture Recognition, FG 1-7.
60. www.stanford.edu/-mahdisol/RSC
61. users.ece.gatech.edu/-sasif/homotopy.