Spectral dimensionality reduction

Studies in Fuzziness and Soft Computing

Volumn 207, Issue , 2006, Pages 519-550

  Bengio, Yoshua ^a   Delalleau, Olivier ^a   Le Roux, Nicolas ^a   Paiement, Jean François ^a   Vincent, Pascal ^a   Ouimet, Marie ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34047160381     PISSN: 14349922     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-35488-8_28     Document Type: Article

References (49)

1. C.T.H. Baker. The numerical treatment of integral equations. Clarendon Press, Oxford, 1977.
2. M. Belkin and P. Niyogi. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6):1373-1396, 2003a.
3. M. Belkin and P. Niyogi. Using manifold structure for partially labeled classification. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, Cambridge, MA, 2003b. MIT Press.
4. Y. Bengio, J.F. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet. Out-of-sample extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering. In S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, 2004.
5. Y. Bengio, P. Vincent, J.-F. Paiement, O. Delalleau, M. Ouimet, and N. Le Roux. Spectral clustering and kernel pca are learning eigenfunctions. Technical Report 1239, Département d'informatique et recherche opérationnelle, Université de Montréal, 2003.
6. H. Bourlard and Y. Kamp. Auto-association by multilayer perceptrons and singular value decomposition. Biological Cybernetics, 59:291-294, 1988.
7. M. Brand. Charting a manifold. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15. MIT Press, 2003.
8. F. Chung. Spectral graph theory. In CBMS Regional Conference Series, volume 92. American Mathematical Society, 1997.
9. T. Cox and M. Cox. Multidimensional Scaling. Chapman & Hall, London, 1994.
10. V. de Silva and J.B. Tenenbaum. Global versus local methods in nonlinear dimensionality reduction. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, pages 705-712, Cambridge, MA, 2003. MIT Press.
11. D.L. Donoho and C. Grimes. Hessian eigenmaps: new locally linear embedding techniques for high-dimensional data. Technical Report 2003-08, Dept. Statistics, Stanford University, 2003.
12. Z. Ghahramani and G.E. Hinton. The EM algorithm for mixtures of factor analyzers. Technical Report CRG-TR-96-1, Dpt. of Comp. Sci., Univ. of Toronto, 21 1996. URL citeseer.nj.nec.com/ghahramani97em.html.
13. J.C. Gower. Adding a point to vector diagrams in multivariate analysis. Biometrika, 55(3):582-585, 1968.
14. J. Ham, D.D. Lee, S. Mika, and B. Schölkopf. A kernel view of the dimensionality reduction of manifolds. Technical Report TR-110, Max Planck Institute for Biological Cybernetics, Germany, 2003.
15. T. Hastie and W. Stuetzle. Principal curves. Journal of the American Statistical Association, 84:502-516, 1989.
16. B. Kegl and A. Krzyzak. Piecewise linear skeletonization using principal curves. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1):59-74, 2002.
17. Balázs Kégl. Intrinsic dimension estimation using packing numbers. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, pages 681-688. MIT Press, Cambridge, MA, 2003.
18. T. Kohonen. The self-organizing map. Proceedings of the IEEE, 78(9):1464-1480, 1990.
19. V. Koltchinskii. Asymptotics of spectral projections of some random matrices approximating integral operators. In Eberlein, Hahn, and Talagrand, editors, Progress in Probability, volume 43, pages 191-227, Basel, 1998. Birkhauser.
20. V. Koltchinskii and E. Gin. Random matrix approximation of spectra of integral operators. Bernoulli, 6(1):113-167, 2000.
21. E. Kreyszig. Introductory Functional Analysis with Applications. John Wiley & Sons, Inc., New York, NY, 1990.
22. V. Kumar, A. Grama, A. Gupta, and G. Karypis. Introduction to Parallel Computing: Design and Analysis of Algorithms. Benjamin Cummings, Redwood City, CA, 1994.
23. J. Laub and K.-R. Müller. Feature discovery: unraveling hidden structure in non-metric pairwise data. Technical report, Fraunhofer FIRST.IDA, Germany, 2003.
24. A. Y. Ng, M. I. Jordan, and Y. Weiss. On spectral clustering: analysis and an algorithm. In T.G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14, Cambridge, MA, 2002. MIT Press.
25. R. Rosales and B. Frey. Learning generative models of affinity matrices. In Proceedings of the 19th Annual Conference on Uncertainty in Artificial Intelligence (UAI-03), pages 485-492, San Francisco, CA, 2003. Morgan Kaufmann Publishers.
26. S. Roweis and L. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323-2326, Dec. 2000.
27. D.E. Rumelhart, G.E. Hinton, and R.J. Williams. Learning internal representations by error propagation. In D.E. Rumelhart and J.L. McClelland, editors, Parallel Distributed Processing, volume 1, chapter 8, pages 318-362. MIT Press, Cambridge, 1986.
28. L. Saul and S. Roweis. Think globally, fit locally: unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research, 4:119-155, 2002.
29. Eric Saund. Dimensionality-reduction using connectionist networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(3):304-314, 1989.
30. B. Schölkopf, C. J. C. Burges, and A. J. Smola. Advances in Kernel. Methods - Support Vector Learning. MIT Press, Cambridge, MA, 1999.
31. B. Schölkopf, A. Smola, and K.-R. Müller. Nonlinear component analysis as a kernel eigenvalue problem. Technical Report 44, Max Planck Institute for Biological Cybernetics, Tbingen, Germany, 1996.
32. B. Schölkopf, A. Smola, and K.-R. Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299-1319, 1998.
33. J. Shawe-Taylor, N. Cristianini, and J. Kandola. On the concentration of spectral properties. In T.G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14- MIT Press, 2002.
34. J. Shawe-Taylor and C.K.I. Williams. The stability of kernel principal components analysis and its relation to the process eigenspectrum. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15. MIT Press, 2003.
35. J. Shi and J. Malik. Normalized cuts and image segmentation. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 731-737, 1997.
36. D. Spielman and S. Teng. Spectral partitioning works: planar graphs and finite element meshes. In Proceedings of the 37th Annual Symposium on Foundations of Computer Science, 1996.
37. G. Strang. Linear Algebra and Its Applications. Academic Press, New York, 1980.
38. Y. Whye Teh and S. Roweis. Automatic alignment of local representations. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15. MIT Press, 2003.
39. J. Tenenbaum, V. de Silva, and J.C.L. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319-2323, Dec. 2000.
40. W. Torgerson. Multidimensional scaling, 1: Theory and method. Psychometrika, 17:401-419, 1952.
41. A.W. van der Vaart and J. Wellner. Weak Convergence and Empirical Processes with applications to Statistics. Springer, New York, 1996.
42. Jakob J. Verbeek, Sam T. Roweis, and Nikos Vlassis. Non-linear cca and pea by alignment of local models. In S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems 16, Cambridge, MA, 2004. MIT Press.
43. P. Vincent and Y. Bengio. Manifold parzen windows. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, Cambridge, MA, 2003. MIT Press.
44. Michail Vlachos, Carlotta Domeniconi, Dimitrios Gunopulos, George Kollios, and Nick Koudas. Non-linear dimensionality reduction techniques for classification and visualization. In Proc. of 8th SIGKDD, Edmonton, Canada, 2002. URL citeseer.ist.psu.edu/573153.html.
45. Yair Weiss. Segmentation using eigenvectors: a unifying view. In Proceedings IEEE International Conference on Computer Vision, pages 975-982, 1999.
46. Christopher K. I. Williams and Matthias Seeger. Using the Nyström method to speed up kernel machines. In T.K. Leen, T.G. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages G82-G88, Cambridge, MA, 2001. MIT Press.
47. C.K.I. Williams. On a connection between kernel pea and metric multidimensional scaling. In T.K. Leen, T.G. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages G75-C81. MIT Press, 2001.
48. C.K.I. Williams and M. Seeger. The effect of the input density distribution on kernelbased classifiers. In Proceedings of the Seventeenth International Conference on Machine Learning. Morgan Kaufmann, 2000.
49. Laurent Zwald, Olivier Bousquet, and Gilles Blanchard. Statistical properties of kernel principal component analysis. Technical report, submitted, 2004.