Out-of-sample extrapolation of learned manifolds

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 30, Issue 9, 2008, Pages 1547-1556

  Chin, Tat Jun ^a   Suter, David ^b  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b MONASH UNIVERSITY   (Australia)

Author keywords

Manifold learning; Maximum Variance Unfolding; Out of sample extrapolation

Indexed keywords

TRELLIS CODES;

EIGEN FUNCTIONS; FINITE SAMPLES; GAUSSIAN; GAUSSIAN BASIS FUNCTIONS; KERNEL FUNCTIONS; KERNEL MATRICES; KERNEL PCA; MANIFOLD LEARNING; SAMPLE DATA;

EXTRAPOLATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 48049090960     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2007.70813     Document Type: Article

References (17)

1. C. Burges, "Geometric Methods for Feature Extraction and Dimensional Reduction," Data Mining and Knowledge Discovery Handbook: A Complete Guide for Practitioners and Researchers, L. Rokach and O. Maimon, eds. Kluwer Academic Publishers, 2005.
2. L. Saul, K. Weinberger, F. Sha, J. Ham, and D. Lee, "Spectral Methods for Dimensionality Reduction," Semisupervised Learning, O. Chapelle, B. Schölkopf, and A. Zien, eds. MIT Press, 2006.
3. K. Weinberger and L. Saul, "Unsupervised Learning of Image Manifolds by Semidefinite Programming," Int'l J. Computer Vision, vol. 70, no. 1, pp. 77-90, 2006.
4. Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet, "Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering," Proc. Advances in Neural Information Processing Systems, 2003.
5. Y. Bengio, O. Delalleau, N. Le Roux, J.-F. Paiement, P. Vincent, and M. Ouimet, "Learning Eigenfunctions Links Spectral Embedding and Kernel PCA," Neural Computation, vol. 16, no. 10, pp. 2197-2219, 2004.
6. B. Schölkopf, A. Smola, and K.-R. Müller, "Nonlinear Component Analysis as a Kernel Eigenvalue Problem, Neural Computation, vol. 10, pp. 1299-1319, 1998.
7. V. de Silva and J. Tenenbaum, "Global versus Local Methods in Nonlinear Dimensionality Reduction," Proc. Advances in Neural Information Processing Systems, pp. 705-712, 2003.
8. K. Weinberger, B. Packer, and L. Saul, "Nonlinear Dimensionality Reduction by Semidefinite Programming and Kernel Matrix Factorization," Proc. 10th Int'l Workshop Artificial Intelligence and Statistics (AISTATS '05), 2005.
9. S. Vishwanathan, K. Borgwardt, O. Guttman, and A. Smola, "Kernel Extrapolation," Neurocomputing, no. 69, pp. 721-729, 2006.
10. H. Gong, C. Pan, Q. Yang, H. Lu, and S. Ma, "Neural Network Modeling of Spectral Embedding," Proc. 17th British Machine Vision Conf. (BMVC '06), 2006.
11. A. Elgammal and C.-S. Lee, "Inferring 3D Body Pose from Silhouettes Using Activity Manifold Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '04), vol. 2, pp. 681-688, 2004.
12. L.K. Saul and S.T. Roweis, "Think Globally, Fit Locally: Unsupervised Learning of Low-Dimensional Manifolds," J. Machine Learning Research vol. 4, pp. 119-155, 2003.
13. C. Baker, The Numerical Treatment of Integral Equations. Clarendon Press, 1977.
14. C. Williams and M. Seeger, "Using the Nyström Method to Speed Up Kernel Machines," Proc. Advances in Neural Information Processing Systems, pp. 682-6881, 2001.
15. A. Schwaighofer, V. Tresp, and K. Yu, "Learning Gaussian Process Kernels via Hierarchical Bayes," Proc. Advances in Neural Information Processing Systems, 2005.
16. I.T. Nabney, NETLAB: Algorithms for Pattern Recognition. Springer, 2004.
17. G. Peters, "Efficient Pose Estimation Using View-Based Object Representations," Machine Vision and Applications, vol. 16, no. 1, pp. 59-63, 2004.