Estimation of subspace arrangements with applications in modeling and segmenting mixed data

SIAM Review

Volumn 50, Issue 3, 2008, Pages 413-458

  Ma, Yi ^a   Yang, Allen Y ^b   Derksen, Harm ^c   Fossum, Robert M ^d  

^a University of Illinois at Urbana Champaign   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Generalized principal component analysis; Hilbert function; Minimum effective dimension; Model selection; Outlier detection; Subspace arrangement

Indexed keywords

APPLICATIONS; ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; COMPUTER NETWORKS; COMPUTER VISION; FINANCIAL DATA PROCESSING; IDENTIFICATION (CONTROL SYSTEMS); IMAGE PROCESSING; MODEL STRUCTURES; STATISTICAL METHODS;

GENERALIZED PRINCIPAL COMPONENT ANALYSIS; HILBERT FUNCTION; MINIMUM EFFECTIVE DIMENSION; MODEL SELECTION; OUTLIER DETECTION; SUBSPACE ARRANGEMENT;

DATA STRUCTURES;

EID: 50949096624     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/060655523     Document Type: Review

References (64)

1. H. AKAIKE, A new look at the statistical model selection, IEEE Trans. Automat. Control, 16 (1977), pp. 716-723.
2. D. BALLARD, Generalizing the Hough transform to detect arbitrary patterns, Pattern Recognition, 13 (1981), pp. 111-122.
3. V. BARNETT AND T. LEWIS, Outliers in Statistical Data, 2nd ed., John Wiley & Sons, New York, 1983.
4. P. BICKEL, Another look at robustness: A review of reviews and some new developments, Scand. J. Statist., 3 (1976), pp. 145-168.
5. A. BJORCK AND G. GOLUB, Numerical methods for computing angles between linear subspaces, Math. Comp., 27 (1973), pp. 579-594.
6. A. BJÖRNER, Subspace arrangements, in First European Congress of Mathematics (Paris, 1992), Vol. I, Progr. Math. 119, Birkhäuser, Basel, 1994, pp. 321-370.
7. A. BJÖRNER, I. PEEVA, AND J. SIDMAN, Subspace arrangements defined by products of linear forms, J. London Math. Soc. (2), 71 (2005), pp. 273-288.
8. N. CAMPBELL, The influence function as an aid in outlier detection in discriminant analysis, Appl. Statist., 27 (1978), pp. 251-258.
9. N. CAMPBELL, Robust procedures in multivariate analysis I: Robust covariance estimation, Appl. Statist., 29 (1980), pp. 231-237.
10. J. COSTEIRA AND T. KANADE, A multibody factorization method of independently moving objects, Internat. J. Comput. Vision, 29 (1998), pp. 159-179.
11. F. CRITCHLEY, Influence in principal components analysis, Biometrika, 72 (1985), pp. 627-636.
12. A. DEMPSTER, N. LAIRD, AND D. RUBIN, Maximum likelihood from incomplete data via the EM algorithm, J. Roy. Statist. Soc. Ser. B, 39 (1977), pp. 1-38.
13. H. DERKSEN, Hilbert Series of Subspace Arrangements, preprint, arXiv.org, 2005; available online from http://arxiv.org/abs/ math/0510584.
14. D. DONOHO, Sparse component analysis and optimal atomic decomposition, Constr. Approx., 17 (1998), pp. 353-382.
15. 1-norm Near-Solution Approximates the Sparsest Near-Solution, Technical report, Stanford University, Stanford, CA, 2004.
16. 1-norm Solution Is Also the Sparsest Solution, Technical report, Stanford University, Stanford, CA, 2004.
17. D. DONOHO, Neighborly Polytopes and Sparsest Solution of Underdetermined Linear Equations, Technical report, Stanford University, Stanford, CA, 2004.
18. D. EISENBUD, Commutative Algebra with a View Toward Algebraic Geometry, Springer-Verlag, New York, 1995.
19. T. FERGUSON, On the rejection of outliers, in Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability I, University of California Press, 1961, pp. 253-287.
20. M. FISCHLER AND R. BOLLES, Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, Comm. ACM, 24 (1981), pp. 381-85.
21. E. FORGY, Cluster analysis of multivariate data: Efficiency vs. interpretability of classifications (abstract), Biometrics, 21 (1965), pp. 768-769.
22. R. GNANADESIKAN AND J. KETTENRING, Robust estimates, residuals, and outlier detection with multiresponse data, Biometrics, 28 (1972), pp. 81-124.
23. F. HAMPEL, E. RONCHETTI, P. ROUSSEEUW, AND W. STAHEL, Robust statistics: The approach based on influence functions, John Wiley & Sons, New York, 1986.
24. M. HANSEN AND B. YU, Model selection and the principle of minimum description length, J. Amer. Statist. Assoc., 96 (2001), pp. 746 774.
25. J. HO, M. YANG, J. LIM, K. LEE, AND D. KRIEGMAN, Clustering appearances of objects under varying illumination conditions, in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition I, 2003, pp. 11-18.
26. W. HONG, J. WRIGHT, K. HUANG, AND Y. MA, A multi-scale hybrid linear model for lossy image representation, in Proceedings of the IEEE International Conference on Computer Vision I, 2005, pp. 764-771.
27. K. HUANG, A. WAGNER, AND Y. MA, Identification of hybrid linear time-invariant systems via subspace embedding and segmentation, in Proceedings of the IEEE Conference on Decision and Control 3, 2004, pp. 3227-3234.
28. P. HUBER, Robust Statistics, John Wiley & Sons, New York, 1981.
29. R. JANCEY, Multidimensional group analysis, Austral. J. Botany, 14 (1966), pp. 127-130.
30. I. JOLLIFFE, Principal Component Analysis, 2nd ed., Springer-Verlag, New York, 2002.
31. K. KANATANI, Model selection for geometric inference, in Proceedings of Asian Conference on Computer Vision, 2002, pp. xxi-xxxii.
32. K. KANATANI, Motion segmentation by subspace separation: Model selection and reliability evaluation, Internat. J. Image Graphics, 2 (2002), pp. 179-197.
33. S. LANG, Algebra, Springer-Verlag, New York, 2002.
34. S. LLOYD, Least squares quantization in PCM, IEEE Trans. Inform. Theory, 28 (1982), pp. 129-137.
35. Y. MA, H. DERKSEN, W. HONG, AND J. WRIGHT, Segmentation of multivariate mixed data via lossy coding and compression, IEEE Trans. Pattern Anal. Machine Intelligence, 29 (2007), pp. 1546-1562.
36. Y. MA AND R. VIDAL, A closed form solution to the identification of hybrid ARX models via the identification of algebraic varieties, in Proceedings of the International Conference on Hybrid Systems Computation and Control, 2005, pp. 449-465.
37. J. MACQUEEN, Some methods for classification and analysis of multivariate observations, in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press, 1967, pp. 281-297.
38. p, Technometrics, 15 (1973), pp. 661-675.
39. G. MCLACHLAN AND T. KRISHNAN, The EM Algorithm and Extensions, John Wiley & Sons, New York, 1997.
40. B. OLSHAUSEN AND D. FIELD, Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature, 381 (1996), pp. 607-609.
41. P. ORLIK, Introduction to Arrangements, CBMS Regional Conf. Ser. Math. 72, AMS, Providence, RI, 1989.
42. S. RAO, A. YANG, A. WAGNER, AND Y. MA, Segmentation of hybrid motions via hybrid quadratic surface analysis, in Proceedings of IEEE International Conference on Computer Vision, 2005, pp. 2-9.
43. J. RISSANEN, Modeling by shortest data description, Automatica, 14 (1978), pp. 465-471.
44. P. ROUSSEEUW, Least median of squares regression, J. Amer. Statist. Assoc., 79 (1984), pp. 871-880.
45. P. ROUSSEEUW AND A. LEROY, Robust regression and outlier detection, John Wiley & Sons, New York, 1987.
46. S. ROWEIS AND L. SAUL, Nonlinear dimensionality reduction by locally linear embedding, Science, 290 (2000), pp. 2323-2326.
47. P. SAMPSON, Fitting conic section to "very scattered" data: An iterative refinement of the Bookstein algorithm, Computer Vision, Graphics and Image Processing, 18 (1982), pp. 97-108.
48. K. SCHINDLER AND D. SUTER, Two-view multibody structure-and-motion with outliers, in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2005, pp. 643-648.
49. C. V. STEWART, Robust parameter estimation in computer vision, SIAM Rev., 41 (1999), pp. 513-537.
50. Y. SUGAYA AND K. KANATANI, Outlier removal for motion tracking by subspace separation, MICE Trans. Inform. Systems, E86-D (2003), pp. 1095-1102.
51. Y. SUGAYA AND K. KANATANI, Multi-stage optimization for multi-body motion segmentation, MICE Trans. Inform. Systems, E87-D (2M4), pp. 1935-1942.
52. G. TAUBIN, Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentation, IEEE Trans. Pattern Anal. Machine Intelligence, 13 (1991), pp. 1115-1138.
53. J. TENENBAUM, V. DE SILVA, AND J. LANGFORD, A global geometric framework for nonlinear dimensionality reduction, Science, 290 (2000), pp. 2319-2323.
54. W. TONG, C. TANG, AND G. MEDIONI, Simultaneous two-view epipolar geometry estimation and motion segmentation by 4D tensor voting, IEEE Trans. Pattern Anal. Machine Intelligence, 26 (2004), pp. 1167-1184.
55. P. TORR, Geometric motion segmentation and model selection, R. Sec. Lend. Philos. Trans. Ser. A Math. Phys. Eng. Sci., 356 (1998), pp. 1321-1340.
56. P. TORR AND C. DAVIDSON, IMPSAC: Synthesis of importance sampling and random sample consensus, IEEE Trans. Pattern Anal. Machine Intelligence, 25 (2003), pp. 354-364.
57. P. TORR AND D. MURRAY, The development and comparison of robust methods for estimating the fundamental matrix, Internat. J. Computer Vision, 24 (1997), pp. 271-300.
58. V. VAPNIK, The Nature of Statistical Learning Theory, Springer-Verlag, New York, 1995.
59. R. VIDAL AND Y. MA, A unified algebraic approach to 2-D and 3-D motion segmentation, in Proceedings of European Conference on Computer Vision, 2004, pp. 1-15.
60. R. VIDAL, Y. MA, AND J. PIAZZI, A new GPCA algorithm for clustering subspaces by fit- ting, differentiating and dividing polynomials, in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2004, pp. 510-517.
61. R. VIDAL, Y. MA, AND S. SASTRY, Generalized principal component analysis (GPCA), IEEE Trans. Pattern Anal. Machine Intelligence, 27 (2005), pp. 1-15.
62. C. WALLACE AND D. BOULTON, An information measure for classification, Computer J., 11 (1968), pp. 185-194.
63. A. YANG, Estimation of Subspace Arrangements: Its Algebra and Statistics, Ph.D. thesis, University of Illinois at Urbana-Champaign, 2006.
64. A. YANG, S. RAO, AND Y. MA, Robust statistical estimation and segmentation of multiple subspaces, in Workshop on 25 years of RANSAC, IEEE International Conference on Computer Vision and Pattern Recognition, 2006, p. 99.