Embedding with autoencoder regularization

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8190 LNAI, Issue PART 3, 2013, Pages 208-223

  Yu, Wenchao ^a,b   Zeng, Guangxiang ^c   Luo, Ping ^d   Zhuang, Fuzhen ^a   He, Qing ^a   Shi, Zhongzhi ^a  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^d HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Autoencoder; Embedding; Representation Learning; Unsupervised Dimensionality Reduction

Indexed keywords

AUTO ENCODERS; DIMENSIONALITY REDUCTION; EMBEDDING; EMBEDDING ALGORITHMS; HIGH DIMENSIONAL DATA; MACHINE LEARNING APPLICATIONS; RECONSTRUCTION ERROR; REPRESENTATION LEARNING;

ALGORITHMS; SEMANTICS; VIRTUAL REALITY;

LEARNING SYSTEMS;

EID: 84886481158     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-40994-3_14     Document Type: Conference Paper

References (27)

1. Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. In: Neural Computation, pp. 1373-1396 (2003)
2. Bengio, Y., Courville, A., Vincent, P.: Unsupervised feature learning and deep learning: A review and new perspectives. In: CoRR (2012)
3. Bengio, Y., Lamblin, P., Popovici, D., Larochelle, H.: Greedy layer-wise training of deep networks. In: Advances in Neural Information Processing Systems, pp. 153-160 (2007)
4. Blake, C., Merz, C.: Uci repository of machine learning databases (1998)
5. Cox, T., Cox, M.: Multidimensional scaling. Chapman & Hall, London (1994)
6. Greene, W., Zhang, C.: Econometric analysis. Prentice Hall, Upper Saddle River (1997)
7. Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1735-1742 (2006)
8. He, X., Cai, D., Yan, S., Zhang, H.: Neighborhood preserving embedding. In: Tenth IEEE International Conference on Computer Vision, pp. 1208-1213 (2005)
9. Hinton, G., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science, 504-507 (2006)
10. Hinton, G.: A practical guide to training restricted boltzmann machines. Momentum (2010)
11. Jolliffe, I.: Principal component analysis. Springer, New York (1986)
12. Law, M., Jain, A.: Incremental nonlinear dimensionality reduction by manifold learning. IEEE Trans. Pattern Analysis and Machine Intelligence, 377-391 (2006)
13. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proceedings of the IEEE, 2278-2324 (1998)
14. Min, R., van der Maaten, L., Yuan, Z., Bonner, A., Zhang, Z.: Deep supervised t-distributed embedding. In: Proceedings of the 27th International Conference on Machine Learning (2010)
15. Narayanan, H., Mitter, S.: Sample complexity of testing the manifold hypothesis. In: Advances in Neural Information Processing Systems, pp. 1786-1794 (2010)
16. Ng, A.: Cs294a lecture notes: Sparse autoencoder. Stanford University (2010)
17. Niyogi, X.: Locality preserving projections. In: Advances in Neural Information Processing Systems, pp. 153-160 (2004)
18. Rifai, S., Vincent, P., Muller, X., Glorot, X., Bengio, Y.: Contractive auto-encoders: Explicit invariance during feature extraction. In: Proceedings of the 28th International Conference on Machine Learning (2011)
19. Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science, 2323-2326 (2000)
20. Rumelhart, D., Hintont, G., Williams, R.: Learning representations by back-propagating errors. Nature, 533-536 (1986)
21. Salakhutdinov, R., Hinton, G.: Learning a nonlinear embedding by preserving class neighbourhood structure. In: AI and Statistics (2007)
22. Saul, L., Roweis, S.: Think globally, fit locally: unsupervised learning of low dimensional manifolds. The Journal of Machine Learning Research, 119-155 (2003)
23. Socher, R., Pennington, J., Huang, E.H., Ng, A.Y., Manning, C.D.: Semi-supervised recursive autoencoders for predicting sentiment distributions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 151-161 (2011)
24. Tenenbaum, J., De Silva, V., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 2319-2323 (2000)
25. Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.: Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th International Conference on Machine Learning (2008)
26. Weston, J., Ratle, F., Collobert, R.: Deep learning via semi-supervised embedding. In: Proceedings of the 25th International Conference on Machine Learning (2008)
27. Williams, C.: On a connection between kernel pca and metric multidimensional scaling. In: Machine Learning, pp. 11-19. Springer (2002)