Discovering binary codes for documents by learning deep generative models

Topics in Cognitive Science

Volumn 3, Issue 1, 2011, Pages 74-91

  Hinton, Geoffrey ^a   Salakhutdinov, Ruslan ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Auto encoders; Binary codes; Deep learning; Document retrieval; Restricted Boltzmann machines; Semantic hashing

Indexed keywords

ARTIFICIAL INTELLIGENCE; DOCUMENTATION; INFORMATION RETRIEVAL; PROCEDURES; SEMANTICS; THEORETICAL MODEL;

ARTIFICIAL INTELLIGENCE; DOCUMENTATION; INFORMATION STORAGE AND RETRIEVAL; MODELS, THEORETICAL; SEMANTICS;

EID: 79961219393     PISSN: 17568757     EISSN: 17568765     Source Type: Journal    
DOI: 10.1111/j.1756-8765.2010.01109.x     Document Type: Article

References (20)

1. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022.
2. Deerwester, S. C., Dumais, S. T., Landauer, T. K., Furnas, G. W., & Harshman, R. A. (1990). Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41(6), 391-407.
3. Erhan, D., Manzagol, P., Bengio, Y., Bengio, S., & Vincent, P. (2009). The difficulty of training deep architectures and the effect of unsupervised pre-training. AISTATS 2009, 5, 153-160.
4. Gehler, P., Holub, A., & Welling, M. (2006). The rate adapting poisson (RAP) model for information retrieval and object recognition. Proceedings of the 23rd International Conference on Machine Learning. Pittsburgh, PA.
5. Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8), 1711-1800.
6. Hinton, G. E. (2007a). Learning multiple layers of representation. Trends in Cognitive Science, 11, 428-434.
7. Hinton, G. E. (2007b). To recognize shapes, first learn to generate images. In P. Cisek, D. Kalaska, & J. Haran (Eds.), Computational neuroscience: Theoretical insights into brain function (pp. 535-547). Montreal: Elsevier.
8. Hinton, G. E., & Roweis, S. T. (2003). Stochastic neighbor embedding. In S. Thrun, L. K. Saul, & B. Scholkopf (Eds.), Advances in neural information processing systems 15 (pp. 833-840). Cambridge, MA: MIT Press.
9. Hinton, G. E., & Salakhutdinov, R. R. (2006). Non-linear dimensionality reduction using neural networks. Science, 313, 504-507.
10. Hinton, G. E., & Sejnowski, T. J. (1983). Optimal perceptual inference. In Proceedings of the IEEE conference on computer vision and pattern recognition, Washington, DC.
11. Hinton, G. E., McClelland, J. L., & Rumelhart, D. E. (1986). Distributed representations. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: explorations in the microstructure of cognition. Volume 1: Foundations (pp. 77-109). Cambridge, MA: MIT Press.
12. Hinton, G. E., Osindero, S., & Teh, Y. W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18, 1527-1554.
13. Hofmann, T. (1999). Probabilistic latent semantic analysis. In P. Laskey & H. Prade (Eds.), Proceedings of the 15th conference on uncertainty in AI (pp. 286-296). Stockholm, Sweden: Morgan Kaufmann.
14. Jordan, M. (1999). Learning in Graphical Models. Cambridge, MA: MIT Press.
15. van der Maaten, L. J. P., & Hinton, G. E. (2008). Visualizing data using t-sne. Journal of Machine Learning Research, 9, 2579-2605.
16. Pearl, J. (1988). Probabilistic inference in intelligent systems: networks of plausible inference. San Mateo, CA: Morgan Kaufmann.
17. Salakhutdinov, R. R., & Hinton, G. E. (2007). Semantic hashing. In J. Fernandez-Luna, B. Piwowarski, & J. F. Huete (Eds.), Proceedings of the SIGIR Workshop on Information Retrieval and Applications of Graphical Models). Amsterdam, The Netherlands.
18. Salton, G., & Buckley, C. (1988). Term-weighting approaches in automatic text retrieval. Information Processing and Management, 24(5), 513-523.
19. Welling, M., Rosen-Zvi, M., & Hinton, G. (2005). Exponential family harmoniums with an application to information retrieval. In L. Saul, Y. Weiss, & L. Bottou (Eds.), Advances in neural information processing systems 17 (pp. 1481-1488). Cambridge, MA: MIT Press.
20. Xing, E., Yan, R., & Hauptmann, A. G. (2005). Mining associated text and images with dual-wing harmoniums. In F. Baccus, & T. Jaakkola (Eds.), Proceedings of the 21st conference on uncertainty in artificial intelligence (pp. 633-641). Edinburgh, Scotland: AUAI press.