Pre-image problem in manifold learning and dimensional reduction methods

Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010

Volumn , Issue , 2010, Pages 921-924

  Arif, Omar ^a   Vela, Patricio Antonio ^a   Daley, Wayne ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION METHODS; DIMENSIONAL REDUCTION; EIGENVALUE DECOMPOSITION; INPUT SPACE; KERNEL MATRICES; KERNEL PRINCIPAL COMPONENT ANALYSIS; LEARNING METHODS; LOW DIMENSIONAL EMBEDDING; MANIFOLD LEARNING; PRE-IMAGE PROBLEM; TEST POINTS; TEST SAMPLES; TRAINING SAMPLE;

APPROXIMATION THEORY; EIGENVALUES AND EIGENFUNCTIONS; LEARNING SYSTEMS; SAMPLING;

PRINCIPAL COMPONENT ANALYSIS;

EID: 79952409031     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMLA.2010.146     Document Type: Conference Paper

References (21)

1. P. Arias, G. Randall, and G. Sapiro. Connecting the out-of-sample and pre-image problems in kernel methods. In IEEE Conference on Computer Vision and Pattern Recognition, pages 18-23, 2007.
2. Y. Bengio, J. Paiement, P. Vincent, O. Delalleau, N. L. Roux, and M. .Ouimet. Out-of-sample extensions for LLE, isomap, MDS, eigenmaps, and spectral clustering. In Advances in Neural Information Processing Systems, page 177, 2004.
3. Y. Bengio, P. Vincent, and J. Paiement. Learning eigenfunctions of similarity: linking spectral clustering and kernel PCA. Technical report, Departement dinformatique et recherche operationnelle, Universite de Montreal, 2003.
4. M. Cox. Multidimensional scaling. CRC Press, 2000.
5. D. DeCoste. Visualizing Mercer kernel feature spaces via kernelized locally linear embedding. In International Conference on Neural Information Processing, 2001.
6. J. Ham, D. Lee, S. Mika, and B. Schölkopf. A kernel view of the dimensionality reduction of manifolds. In International Conference on Machine Learning, pages 47-53, 2004.
7. J. Kwok and I. Tsang. The pre-image problem in kernel methods. IEEE Transactions on Neural Networks, 15(6):1517-1525, 2004.
8. S. Lafon. Diffusion maps and geometric harmonics. PhD thesis, Yale University, 2004.
9. M. Leventon. Statistical models in medical image analysis. PhD thesis, Massachusetts Institute of Technology, 2002.
10. A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. Advances in neural information processing systems, 2:849-856, 2002.
11. Y. Rathi, S. Dambreville, and A. Tannenbaum. Comparative analysis of kernel methods for statistical shape learning. Lecture Notes in Computer Science, 4241:96, 2006.
12. Y. Rathi, S. Dambreville, and A. Tannenbaum. Statistical shape analysis using kernel PCA. In Proceedings of SPIE, volume 6064, pages 425-432, 2006.
13. S. Roweis and L. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323, 2000.
14. L. Saul and S. Roweis. Think globally, fit locally: unsupervised learning of low dimensional manifolds. The Journal of Machine Learning Research, 4:119-155, 2003.
15. B. Schölkopf. The kernel trick for distances. In Advances in neural information processing systems, pages 301-307, 2001.
16. B. Schölkopf, S. Mika, C. Burges, P. Knirsch, K. Muller, G. Ratsch, and A. Smola. Input space vs. feature space in kernel-based methods. IEEE Transactions on Neural Networks, pages 1000-1017, 1999.
17. B. Scholköpf, A. Smola, and K.-R. Muller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, pages 1299-1319, 1998.
18. J. Tenenbaum, V. Silva, and J. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319, 2000.
19. C. Williams and M. Seeger. The effect of the input density distribution on kernel-based classifiers. In International Conference on Machine Learning, pages 1159-1166, 2000.
20. C. Williams and M. Seeger. Using the Nyström method to speed up kernel machines. In Advances in Neural Information Processing Systems, pages 682-688. MIT Press, 2001.
21. J. Zhang, S. Li, and J. Wang. Manifold learning and applications in recognition. Studies In Fuzziness and Soft Computing, 168:281-300, 2005.