Deep learning via semi-supervised embedding

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7700 LECTURE NO, Issue , 2012, Pages 639-655

  Weston, Jason ^a   Ratle, Frédéric ^b   Mobahi, Hossein ^c   Collobert, Ronan ^d  

^a GOOGLE INC   (United States)

^b NUANCE COMMUNICATIONS   (United States)

^c University of Illinois at Urbana Champaign   (United States)

^d IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION; EMBEDDINGS; LEARNING SYSTEMS; NETWORK ARCHITECTURE; SEMI-SUPERVISED LEARNING;

EMBEDDING ALGORITHMS; ERROR RATE; KERNEL METHODS; LEARNING TECHNIQUES; MULTI-LAYER ARCHITECTURES; OUTPUT LAYER; REGULARIZER; SEMI-SUPERVISED;

DEEP LEARNING;

EID: 84872553130     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-35289-8_34     Document Type: Article

References (30)

1. Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 15(6), 1373-1396 (2003) (Pubitemid 37049796)
2. Belkin, M., Niyogi, P., Sindhwani, V.: Manifold regularization: A geometric framework for learning from Labeled and Unlabeled Examples. Journal of Machine Learning Research 7, 2399-2434 (2006) (Pubitemid 44708005)
3. Bengio, Y., Lamblin, P., Popovici, D., Larochelle, H.: Greedy layer-wise training of deep networks. In: Advances in Neural Information Processing Systems, NIPS 19 (2007)
4. Bromley, J., Bentz, J.W., Bottou, L., Guyon, I., LeCun, Y., Moore, C., Sackinger, E., Shah, R.: Signature verification using a siamese time delay neural network. International Journal of Pattern Recognition and Artificial Intelligence 7(4) (August 1993)
5. Caputo, B., Hornegger, J., Paulus, D., Niemann, H.: A spin-glass markov random field for 3-d object recognition. Technical Report LME-TR-2002-01, Institut fur Informatik, Universitat Erlangen Nurnberg (2002)
6. Caruana, R.: Multitask Learning. Machine Learning 28(1), 41-75 (1997) (Pubitemid 127507169)
7. Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning. Adaptive computation and machine learning. MIT Press, Cambridge (2006)
8. Chapelle, O., Weston, J., Scholkopf, B.: Cluster kernels for semi-supervised learning. In: Becker, S., Thrun, S., Obermayer, K. (eds.) NIPS, vol. 15, pp. 585-592. MIT Press, Cambridge (2003)
9. Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 57-64 (January 2005)
10. Collobert, R., Sinz, F., Weston, J., Bottou, L.: Large scale transductive svms. Journal of Machine Learning Research 7, 1687-1712 (2006) (Pubitemid 44223088)
11. Collobert, R., Weston, J.: Fast semantic extraction using a novel neural network architecture. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pp. 25-32 (2007)
12. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. The Journal of Machine Learning Research 12, 2493-2537 (2011)
13. Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: Proc. Computer Vision and Pattern Recognition Conference (CVPR 2006). IEEE Press (2006)
14. Hinton, G.E., Osindero, S., Teh, Y.: A fast learning algorithm for deep belief nets. Neural Comp. 18(7), 1527-1554 (2006) (Pubitemid 44024729)
15. Karlen, M., Weston, J., Erkan, A., Collobert, R.: Large scale manifold transduction. In: Proceedings of the 25th International Conference on Machine Learning, pp. 448-455. ACM (2008)
16. Kruskal, J.B.: Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29(1), 1-27 (1964)
17. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proceedings of the IEEE 86(11) (1998)
18. Mobahi, H., Collobert, R., Weston, J.: Deep learning from temporal coherence in video. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 737-744. ACM (2009)
19. Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library (coil-100). Technical Report CUCS-006-96 (February 1996)
20. Pradhan, S., Ward, W., Hacioglu, K., Martin, J., Jurafsky, D.: Shallow semantic parsing using support vector machines. In: Proceedings of HLT/NAACL 2004 (2004)
21. Ranzato, M., Huang, F., Boureau, Y., LeCun, Y.: Unsupervised learning of invariant feature hierarchies with applications to object recognition. In: Proc. Computer Vision and Pattern Recognition Conference (CVPR 2007). IEEE Press (2007)
22. Roobaert, D., Van Hulle, M.: View-based 3d object recognition with support vector machines. In: IEEE International Workshop on Neural Networks for Signal Processing, pp. 77-84 (1999) (Pubitemid 30510362)
23. Salakhutdinov, R., Hinton, G.: Learning a Nonlinear Embedding by Preserving Class Neighbourhood Structure. In: International Conference on Artificial Intelligence and Statistics, AISTATS (2007)
24. Sindhwani, V., Niyogi, P., Belkin, M.: Beyond the point cloud: From transductive to semi-supervised learning. In: International Conference on Machine Learning, ICML (2005)
25. Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319-2323 (2000) (Pubitemid 32041577)
26. Vapnik, V.: Statistical Learning Theory. John Wiley and Sons, New York (1998)
27. Wersing, H., Korner, E.: Learning optimized features for hierarchical models of invariant recognition. Neural Computation 15(7), 1559-1599 (2003)
28. Weston, J., Ratle, F., Collobert, R.: Deep learning via semi-supervised embedding. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1168-1175. ACM (2008)
29. Williams, C.K.I.: On a connection between kernel PCA and metric multidimensional scaling. In: Advances in Neural Information Processing Systems, NIPS 13 (2001)
30. Zhu, X., Ghahramani, Z.: Learning from labeled and unlabeled data with label propagation. Technical Report CMU-CALD-02-107, Carnegie Mellon University (2002)