Partial-Hessian strategies for fast learning of nonlinear embeddings

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 1, Issue , 2012, Pages 345-352

  Vladymyrov, Max ^a   Carreira Perpiñán, Miguel Á ^a  

^a Merced   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EMBEDDING ALGORITHMS; EMBEDDINGS; FAST LEARNING; GRAPH LAPLACIANS; HIGH QUALITY; LOCAL CONVERGENCE; LOW-DIMENSIONAL REPRESENTATION; NON-LINEAR MANIFOLD LEARNING; OPTIMIZATION STRATEGY; ORDERS OF MAGNITUDE; SPECTRAL DIRECTIONS; SPECTRAL METHODS; STOCHASTIC NEIGHBOR EMBEDDING; TRAINING METHODS;

LEARNING SYSTEMS;

LEARNING ALGORITHMS;

EID: 84867122992     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Belkin, M. and Niyogi, P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6):1373-1396, 2003.
2. Borg, I. and Groenen, P. Modern Multidimensional Scaling: Theory and Application. Springer-Verlag, second edition, 2005.
3. Carreira-Perpiñán, M. The elastic embedding algorithm for dimensionality reduction. In ICML, pp. 167-174, 2010.
4. Cook, J., Sutskever, I., Mnih, A., and Hinton, G. Visualizing similarity data with a mixture of maps. In AISTATS, 2007.
5. Goldberger, J., Roweis, S., Hinton, G., and Salakhutdinov, R. Neighbourhood components analysis. In NIPS, 2005.
6. Greengard, L. and Strain, J. The fast Gauss transform. SIAM J. Sci. Stat. Comput., 12(1):79-94, 1991.
7. Hinton, G. and Roweis, S. Stochastic neighbor embedding. In NIPS, pp. 857-864, 2003.
8. Memisevic, R. Kernel information embeddings. In ICML, pp. 633-640, 2006.
9. Memisevic, R. and Hinton, G. Improving dimensionality reduction with spectral gradient descent. Neural Networks, 18(5-6):702-710, June-July 2005.
10. Nocedal, J. and Wright, S. Numerical Optimization. Springer-Verlag, second edition, 2006.
11. Raykar, V. and Duraiswami, R. The improved fast Gauss transform with applications to machine learning. In Large Scale Kernel Machines. MIT Press, 2006.
12. Roweis, S. and Saul, L. Nonlinear dimensionality reduction by locally linear embedding. Science, 290:2323-2326, 2000.
13. Sammon, Jr., J. A nonlinear mapping for data structure analysis. IEEE Trans. Computers, 18(5):401-409, 1969.
14. van der Maaten, L. Fast optimization for t-SNE. Workshop on Challenges in Data Visualization at NIPS, 2010.
15. van der Maaten, L. and Hinton, G. Visualizing data using t-SNE. JMLR, 9:2579-2605, 2008.
16. Venna, J. and Kaski, S. Nonlinear dimensionality reduction as information retrieval. In AISTATS, pp. 568-575, 2007.
17. Weinberger, K. and Saul, L. Unsupervised learning of image manifolds by semidefinite programming. Int. J. Computer Vision, 70(1):77-90, 2006.