Out-of-sample extensions for LLE, Isomap, MDS, Eigenmaps, and spectral clustering

Advances in Neural Information Processing Systems

Volumn , Issue , 2004, Pages

  Bengio, Yoshua ^a   Paiement, Jean François ^a   Vincent, Pascal ^a   Delalleau, Olivier ^a   Le Roux, Nicolas ^a   Ouimet, Marie ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS;

DIMENSIONALITY REDUCTION; EIGEN DECOMPOSITION; EMBEDDING ALGORITHMS; LAPLACIAN EIGENMAPS; LOCAL LINEAR EMBEDDING; MULTI-DIMENSIONAL SCALING; NUMERICAL EXPERIMENTS; OUT-OF-SAMPLE EXTENSION;

EIGENVALUES AND EIGENFUNCTIONS;

EID: 33947233031     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Baker, C. (1977). The numerical treatment of integral equations. Clarendon Press, Oxford.
2. Belkin, M. and Niyogi, P. (2003). Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6):1373-1396.
3. Bengio, Y., Vincent, P., Paiement, J., Delalleau, O., Ouimet, M., and Le Roux, N. (2003). Spectral clustering and kernel pca are learning eigenfunctions. Technical report, D́epartement d'informatique et recherche oṕerationnelle, Universit́e de Montŕeal.
4. Cox, T. and Cox, M. (1994). Multidimensional Scaling. Chapman & Hall, London.
5. de Silva, V. and Tenenbaum, J. (2003). Global versus local methods in nonlinear dimensionality reduction. In Becker, S., Thrun, S., and Obermayer, K., editors, Advances in Neural Information Processing Systems, volume 15, pages 705-712, Cambridge, MA. The MIT Press.
6. Gower, J. (1968). Adding a point to vector diagrams in multivariate analysis. Biometrika, 55(3):582- 585.
7. Koltchinskii, V. and Gińe, E. (2000). Random matrix approximation of spectra of integral operators. Bernoulli, 6(1):113-167.
8. Ng, A. Y., Jordan, M. I., and Weiss, Y. (2002). On spectral clustering: Analysis and an algorithm. In Dietterich, T. G., Becker, S., and Ghahramani, Z., editors, Advances in Neural Information Processing Systems 14, Cambridge, MA. MIT Press.
9. Roweis, S. and Saul, L. (2000). Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323-2326.
10. Saul, L. and Roweis, S. (2002). Think globally, fit locally: unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research, 4:119-155.
11. Scḧolkopf, B., Smola, A., and M̈uller, K.-R. (1998). Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299-1319.
12. Shawe-Taylor, J. and Williams, C. (2003). The stability of kernel principal components analysis and its relation to the process eigenspectrum. In Becker, S., Thrun, S., and Obermayer, K., editors, Advances in Neural Information Processing Systems, volume 15. The MIT Press.
13. Shi, J. and Malik, J. (1997). Normalized cuts and image segmentation. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 731-737.
14. Tenenbaum, J., de Silva, V., and Langford, J. (2000). A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319-2323.
15. Weiss, Y. (1999). Segmentation using eigenvectors: A unifying view. In Proceedings IEEE International Conference on Computer Vision, pages 975-982.
16. Williams, C. and Seeger, M. (2000). The effect of the input density distribution on kernel-based classifiers. In Proceedings of the Seventeenth International Conference on Machine Learning. Morgan Kaufmann.