Semi-supervised learning of compact document representations with deep networks

Proceedings of the 25th International Conference on Machine Learning

Volumn , Issue , 2008, Pages 792-799

  Ranzato, Marc'Aurelio ^a   Szummer, Martin ^b  

^a NEW YORK UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); DEEP LEARNING; INFORMATION RETRIEVAL SYSTEMS; LEARNING ALGORITHMS; SEARCH ENGINES; SUPERVISED LEARNING; TEXT PROCESSING; INFORMATION SERVICES; LEARNING SYSTEMS; ROBOT LEARNING;

CLASS INFORMATION; CLASSIFICATION SYSTEM; COMPACT REPRESENTATION; DOCUMENT REPRESENTATION; POLYSEMOUS WORD; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED; TEXT DOCUMENT;

MACHINE LEARNING; INFORMATION RETRIEVAL SYSTEMS;

AUTOENCODERS; CLASS INFORMATIONS; CLASSIFICATION SYSTEMS; COMPACT REPRESENTATIONS; DOCUMENT REPRESENTATIONS; POLYSEMOUS WORDS; RELATED WORDS; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING; TEXT DOCUMENTS;

EID: 56449123056     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1390156.1390256     Document Type: Conference Paper

References (15)

1. Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H. (2006). Greedy layer-wise training of deep networks. In NIPS.
2. Bengio, Y. and LeCun, Y. (2007). Scaling learning algorithms towards AI. MIT press.
3. Blei, D., Ng, A. Y., and Jordan, M. I. (2003). Latent Dirichlet allocation. JMLR.
4. Deerwester, S., Dumais, S., Landauer, T., Furnas, G., and Harshman, R. (1990). Indexing by latent semantic analysis. Joarn. of American Society of Information Science, 41:391-407.
5. Gehler, P. V., Holub, A. D., and Welling, M. (2006). The rate adapting Poisson model for information retrieval and object recognition. In ICML.
6. Hinton, G. (2000). Training products of experts by minimizing contrastive divergence. Technical report, U. Toronto.
7. Hinton, G., Osindero, S., and Teh, Y.-W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18:1527-1554.
8. Hinton, G. and Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507.
9. Hofmann, T. (1999). Probabilisitc latent semantic analysis. In Proc. of Uncertainty in Artificial Intelligence.
10. LeCun, Y., Bottou, L., Orr, G., and Muller, K. (1998). Efficient backprop. In Orr, G. and K., M., editors, Neural Networks: Tricks of the trade. Springer.
11. Ranzato, M., Boureau, Y., Chopra, S., and LeCun, Y. (2007a). A unified energy-based framework for unsupervised learning. In AI-STATS.
12. Ranzato, M., Boureau, Y., and LeCun, Y. (2007b). Sparse feature learning for deep belief networks. In NIPS. MIT Press.
13. Robertson, S. and Walker, S. (1994). Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval. In Proc. ACM SIGIR, pages 232-241.
14. Salakhutdinov, R. and Hinton. G. (2007a). Semantic hashing. In ACM SIGIR workshop on Information Retrieval and Applications of Graphical Models.
15. Salakhutdinov, R. and Hinton, G. (2007b). Using deep belief nets to learn covariance kernels for gaussian processes. In NIPS 20. MIT Press.