Spectral properties of the alignment matrices in manifold learning

SIAM Review

Volumn 51, Issue 3, 2009, Pages 545-566

  Zha, Hongyuan ^a   Zhang, Zhenyue ^b  

^a Georgia Institute of Technology   (United States)

^b ZHEJIANG UNIVERSITY   (China)

Author keywords

Eigenvalue problem; Manifold learning; Nonlinear dimension reduction; Null space; Perturbation analysis

Indexed keywords

EIGENVALUE PROBLEM; MANIFOLD LEARNING; NONLINEAR DIMENSION REDUCTION; NULL SPACE; PERTURBATION ANALYSIS;

ALIGNMENT; EDUCATION; EIGENVALUES AND EIGENFUNCTIONS; MATRIX ALGEBRA; PARAMETERIZATION; SWITCHING SYSTEMS;

LEARNING ALGORITHMS;

EID: 68649111457     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/060676829     Document Type: Article

References (18)

1. M. BELKIN AND P. NIYOGI, Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering, Adv. Neural Inform. Process. Systems 14, MIT Press, Cambridge, MA, 2002.
2. M. BRAND, Charting a Manifold, Adv. Neural Inform. Process. Systems 15, MIT Press, Cambridge, MA, 2003.
3. M. BRAND, From subspace to submanifold methods, in Proceedings of the British Machine Vision Conference (BMVC), 2004.
4. M. BRAND, Nonrigid embeddings for dimensionality reduction, in Proceedings of the European Conference on Machine Learning (ECML), Springer, 2005, pp. 47-59.
5. D. DONOHO AND C. GRIMES, Hessian eigenmaps: New tools for nonlinear dimensionality reduction, Proc. Natl. Acad. Sci., 100 (2003), pp. 5591-5596.
6. G. H. GOLUB AND C. F. VAN LOAN, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
7. B. HENDRICKSON, Conditions for unique graph realizations, SIAM J. Comput., 21 (1992), pp. 65-84.
8. E. LEVINA AND P. BICKEL, Maximum Likelihood Estimation of Intrinsic Dimension, Adv. Neural Inform. Process. Systems 17, MIT Press, Cambridge, MA, 2005.
9. J. MUNKRES, Analysis on Manifolds, Addison-Wesley, Redwood City, CA, 1991.
10. S. ROWEIS AND L. SAUL, Nonlinear dimensionality reduction by locally linear embedding, Science, 290 (2000), pp. 2323-2326.
11. G. W. STEWART AND J.-G. SUN, Matrix Perturbation Theory, Academic Press, Boston, MA, 1990.
12. J. TENENBAUM, V. DE SILVA, AND J. LANGFORD, A global geometric framework for nonlinear dimension reduction, Science, 290 (2000), pp. 2319-2323.
13. J. WANG AND Z. ZHANG, MLLE: Modified Locally Linear Embedding Using Multiple Weights, Adv. Neural Inform. Process. Systems 19, MIT Press, Cambridge, MA, 2007.
14. X. YANG, S. MICHEA, AND H. ZHA, Conical dimension as an intrinsic dimension estimator and its applications, in Proceedings of the 7th SIAM International Conference on Data Mining, SIAM, Philadelphia, 2007, pp. 169-179.
15. X. YANG, H. FU, H. ZHA, AND J. BARLOW, Semi-supervised nonlinear dimensionality reduction, in Proceedings of International Conference on Machine Learning (ICML), IEEE, 2006, pp. 1065-1072.
16. H. ZHA AND Z. ZHANG, Spectral analysis of alignment in manifold learning, in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, 2005, pp. 1069-1072.
17. Z. ZHANG AND H. ZHA, Principal manifolds and nonlinear dimensionality reduction via tangent space alignment, SIAM J. Sci. Comput., 26 (2004), pp. 313-338.
18. Z. ZHANG AND H. ZHA, A Domain Decomposition Method for Fast Manifold Learning, Adv. Neural Inform. Process. Systems 18, MIT Press, Cambridge, MA, 2006.