Subspace clustering

IEEE Signal Processing Magazine

Volumn 28, Issue 2, 2011, Pages 52-68

  Vidal, Rene ^a  

^a Dynamical Vision   (United States)

Author keywords

Clustering algorithms; Data models; Noise; Polynomials; Principal component analysis; Signal processing algorithms; Subspace constraints

Indexed keywords

DATA STRUCTURES; POLYNOMIALS; PRINCIPAL COMPONENT ANALYSIS; SIGNAL PROCESSING;

HIGH DIMENSIONAL DATA; IN-BUILDINGS; MULTIPLE SOURCE; NOISE; SIGNAL PROCESSING ALGORITHMS; SUB-SPACE CLUSTERING; SUBSPACE CONSTRAINT;

CLUSTERING ALGORITHMS;

EID: 85032760331     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2010.939739     Document Type: Article

References (67)

1. A. Yang, J. Wright, Y. Ma, and S. Sastry, "Unsupervised segmentation of natural images via lossy data compression," Comput. Vis. Image Understand., vol. 110, no. 2, pp. 212-225, 2008.
2. R. Vidal, R. Tron, and R. Hartley, "Multiframe motion segmentation with missing data using power factorization and GPCA," Int. J. Comput. Vis., vol. 79, no. 1, pp. 85-105, 2008.
3. J. Ho, M. H. Yang, J. Lim, K.C. Lee, and D. Kriegman, "Clustering appearances of objects under varying illumination conditions," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003, pp. 11-18.
4. W. Hong, J. Wright, K. Huang, and Y. Ma, "Multi-scale hybrid linear models for lossy image representation," IEEE Trans. Image Processing, vol. 15, no. 12, pp. 3655-3671, 2006.
5. R. Vidal, S. Soatto, Y. Ma, and S. Sastry, "An algebraic geometric approach to the identification of a class of linear hybrid systems," in Proc. Conf. Decision and Control, 2003, pp. 167-172.
6. L. Parsons, E. Haque, and H. Liu, "Subspace clustering for high dimensional data: A review," ACM SIGKDD Explor. Newslett., vol. 6, no. 1, pp. 90-105, 2004.
7. T. E. Boult and L. G. Brown, "Factorization-based segmentation of motions," in Proc. IEEE Workshop Motion Understanding, 1991, pp. 179-186.
8. J. Costeira and T. Kanade, "A multibody factorization method for independently moving objects," Int. J. Comput. Vis., vol. 29, no. 3, pp. 159-179, 1998.
9. C. W. Gear, "Multibody grouping from motion images," Int. J. Comput. Vis., vol. 29, no. 2, pp. 133-150, 1998.
10. R. Vidal, Y. Ma, and S. Sastry, "Generalized principal component analysis (GPCA)," IEEE Trans. Pattern Anal. Machine Intell., vol. 27, no. 12, pp. 1-15, 2005.
11. P. S. Bradley and O. L. Mangasarian, "k-plane clustering," J. Global Optim., vol. 16, no. 1, pp. 23-32, 2000.
12. P. Tseng, "Nearest q-flat to m points," J. Optim. Theory Applicat., vol. 105, no. 1, pp. 249-252, 2000.
13. P. Agarwal and N. Mustafa, "k-means projective clustering," in Proc. ACM SIGMOD-SIGACT-SIGART Symp. Principles of Database Systems, 2004, pp. 155-165.
14. L. Lu and R. Vidal, "Combined central and subspace clustering on computer vision applications," in Proc. Int. Conf. Machine Learning, 2006, pp. 593-600.
15. T. Zhang, A. Szlam, and G. Lerman, "Median k-flats for hybrid linear modeling with many outliers," in Proc. Workshop Subspace Methods, 2009, pp. 234-241.
16. M. Tipping and C. Bishop, "Mixtures of probabilistic principal component analyzers," Neural Comput., vol. 11, no. 2, pp. 443-482, 1999.
17. Y. Sugaya and K. Kanatani, "Geometric structure of degeneracy for multibody motion segmentation," in Proc. Workshop Statistical Methods in Video Processing, 2004, pp. 13-25.
18. Y. Ma, H. Derksen, W. Hong, and J. Wright, "Segmentation of multivariate mixed data via lossy coding and compression," IEEE Trans. Pattern Anal. Machine Intell., vol. 29, no. 9, pp. 1546-1562, 2007.
19. S. Rao, R. Tron, Y. Ma, and R. Vidal, "Motion segmentation via robust subspace separation in the presence of outlying, incomplete, or corrupted trajectories," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
20. A. Y. Yang, S. Rao, and Y. Ma, "Robust statistical estimation and segmentation of multiple subspaces," in Proc. Workshop 25 Years of RANSAC, 2006.
21. J. Yan and M. Pollefeys, "A general framework for motion segmentation: Independent, articulated, rigid, non-rigid, degenerate and non-degenerate," in Proc. European Conf. Computer Vision, 2006, pp. 94-106.
22. T. Zhang, A. Szlam, Y. Wang, and G. Lerman, "Hybrid linear modeling via local best-fit flats," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010, pp. 1927-1934.
23. A. Goh and R. Vidal, "Segmenting motions of different types by unsupervised manifold clustering," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
24. E. Elhamifar and R. Vidal, "Sparse subspace clustering," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
25. E. Elhamifar and R. Vidal, "Clustering disjoint subspaces via sparse representation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2010, pp. 1926-1929.
26. G. Liu, Z. Lin, and Y. Yu, "Robust subspace segmentation by low-rank representation," in Proc. Int. Conf. Machine Learning, 2010.
27. G. Chen and G. Lerman, "Spectral curvature clustering (SCC)," Int. J. Comput. Vis., vol. 81, no. 3, pp. 317-330, 2009.
28. I. Jolliffe, Principal Component Analysis. New York: Springer-Verlag, 1986.
29. E. Beltrami, "Sulle funzioni bilineari," Giornale di Math. Battaglini, vol. 11, pp. 98-106, 1873.
30. M. C. Jordan, "M-emoire sur les formes bilin-eaires," J. Math. Pures Appliqu-es, vol. 19, pp. 35-54, 1874.
31. H. Stark and J.W. Woods, Probability and Random Processes with Applications to Signal Processing, 3rd ed. Englewood Cliffs, NJ: Prentice Hall, 2001.
32. C. Eckart and G. Young, "The approximation of one matrix by another of lower rank," Psychometrika, vol. 1, no. 3, pp. 211-218, 1936.
33. K. Kanatani, "Motion segmentation by subspace separation and model selection," in Proc. IEEE Int. Conf. Computer Vision, 2001, vol. 2, pp. 586-591.
34. N. Ichimura, "Motion segmentation based on factorization method and discriminant criterion," in Proc. IEEE Int. Conf. Computer Vision, 1999, pp. 600-605.
35. Y. Wu, Z. Zhang, T. S. Huang, and J. Y. Lin, "Multibody grouping via orthogonal subspace decomposition," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, vol. 2. pp. 252-257.
36. K. Kanatani and C. Matsunaga, "Estimating the number of independent motions for multibody motion segmentation," in Proc. European Conf. Computer Vision, 2002, pp. 25-31.
37. K. Kanatani, "Geometric information criterion for model selection," Int. J. Comput. Vis., vol. 26, no. 3, pp. 171-189, 1998.
38. L. Zelnik-Manor and M. Irani, "On single-sequence and multi-sequence factorizations," Int. J. Comput. Vis., vol. 67, no. 3, pp. 313-326, 2006.
39. Y. Ma, A. Yang, H. Derksen, and R. Fossum, "Estimation of subspace arrangements with applications in modeling and segmenting mixed data," SIAM Rev., vol. 50, no. 3, pp. 413-458, 2008.
40. H. Derksen, "Hilbert series of subspace arrangements," J. Pure Appl. Algebra, vol. 209, no. 1, pp. 91-98, 2007.
41. N. Ozay, M. Sznaier, C. Lagoa, and O. Camps, "GPCA with denoising: A moments-based convex approach," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
42. A. Yang, S. Rao, A. Wagner, Y. Ma, and R. Fossum, "Hilbert functions and applications to the estimation of subspace arrangements," in Proc. IEEE Int. Conf. Computer Vision, 2005.
43. K. Huang, Y. Ma, and R. Vidal, "Minimum effective dimension for mixtures of subspaces: A robust GPCA algorithm and its applications," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, vol. 2, pp. 631-638.
44. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2000.
45. A. Aldroubi and K. Zaringhalam, "Nonlinear least squares in RN," Acta Appl. Math., vol. 107, no. 1-3, pp. 325-337, 2009.
46. A. Aldroubi, C. Cabrelli, and U. Molter, "Optimal non-linear models for sparsity and sampling," J. Fourier Analysis Applicat., vol. 14, no. 5-6, pp. 793-812, 2008.
47. M. Tipping and C. Bishop, "Probabilistic principal component analysis," J. Royal Stat. Soc., vol. 61, no. 3, pp. 611-622, 1999.
48. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Stat. Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
49. C. Archambeau, N. Delannay, and M. Verleysen, "Mixtures of robust probabilistic principal component analyzers," Neurocomputing, vol. 71, no. 7-9, pp. 1274-1282, 2008.
50. A. Gruber and Y. Weiss, "Multibody factorization with uncertainty and missing data using the EM algorithm," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, vol. 1, pp. 707-714.
51. J. Paisley and L. Carin, "Nonparametric factor analysis with beta process priors," in Proc. Int. Conf. Machine Learning, 2009, pp. 777-780.
52. A. Leonardis, H. Bischof, and J. Maver, "Multiple eigenspaces," Pattern Recognit., vol. 35, no. 11, pp. 2613-2627, 2002.
53. Z. Fan, J. Zhou, and Y. Wu, "Multibody grouping by inference of multiple subspaces from high-dimensional data using oriented-frames," IEEE Trans. Pattern Anal. Machine Intell., vol. 28, no. 1, pp. 91-105, 2006.
54. M. A. Fischler and R. C. Bolles, "RANSAC random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
55. J. Yan and M. Pollefeys, "Articulated motion segmentation using RANSAC with priors," in Proc. Workshop Dynamical Vision, 2005, pp. 75-85.
56. U. von Luxburg, "A tutorial on spectral clustering," Stat. Comput., vol. 17, no. 4, pp. 395-416, 2007.
57. R. Tron and R. Vidal, "A benchmark for the comparison of 3-D motion segmentation algorithms," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
58. S. Agarwal, J. Lim, L. Zelnik-Manor, P. Perona, D. Kriegman, and S. Belongie, "Beyond pairwise clustering," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2005, vol. 2, pp. 838-845.
59. V. Govindu, "A tensor decomposition for geometric grouping and segmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005, pp. 1150-1157.
60. G. Chen and G. Lerman, "Foundations of a multi-way spectral clustering framework for hybrid linear modeling," Foundat. Comput. Math., vol. 9, no. 5, pp. 517-558, 2009.
61. G. Chen, S. Atev, and G. Lerman, "Kernel spectral curvature clustering (KSCC)," in Proc. Workshop Dynamical Vision, 2009.
62. F. Lauer and C. Schnö rr, "Spectral clustering of linear subspaces for motion segmentation," in Proc. IEEE Int. Conf. Computer Vision, 2009.
63. R. Vidal, "Online clustering of moving hyperplanes," in Proc. Neural Information Processing Systems, NIPS, 2006.
64. R. Vidal, Y. Ma, S. Soatto, and S. Sastry, "Two-view multibody structure from motion," Int. J. Comput. Vis., vol. 68, no. 1, pp. 7-25, 2006.
65. R. Vidal and Y. Ma, "A unified algebraic approach to 2-D and 3-D motion segmentation," J. Math. Imag. Vis., vol. 25, no. 3, pp. 403-421, 2006.
66. R. Vidal and R. Hartley, "Three-view multibody structure from motion," IEEE Trans. Pattern Anal. Machine Intell., vol. 30, no. 2, pp. 214-227, 2008.
67. S. Rao, A. Yang, S. Sastry, and Y. Ma, "Robust algebraic segmentation of mixed rigid-body and planar motions from two views," Int. J. Comput. Vis., vol. 88, no. 3, pp. 425-446, 2010.