A latent semantic model with convolutional-pooling structure for information retrieval

CIKM 2014 - Proceedings of the 2014 ACM International Conference on Information and Knowledge Management

Volumn , Issue , 2014, Pages 101-110

  Shen, Yelong ^a   He, Xiaodong ^a   Gao, Jianfeng ^a   Deng, Li ^a   Mesnil, Grégoire ^b  

^a MICROSOFT RESEARCH   (United States)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Convolutional neural network; Semantic representation; Web search

Indexed keywords

CONVOLUTION; CONVOLUTIONAL NEURAL NETWORKS; ENCODING (SYMBOLS); KNOWLEDGE MANAGEMENT; LINEAR TRANSFORMATIONS; MATHEMATICAL TRANSFORMATIONS; SEARCH ENGINES; SEMANTICS;

CLICKTHROUGH DATA; CONTEXTUAL FEATURE; HIGH LEVEL SEMANTICS; NON-LINEAR TRANSFORMATIONS; SEMANTIC INFORMATION; SEMANTIC REPRESENTATION; VECTOR REPRESENTATIONS; WEB SEARCHES;

SEMANTIC WEB;

EID: 84928315948     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2661829.2661935     Document Type: Conference Paper

References (42)

1. Bengio, Y., 2009. Learning deep architectures for AI. In Foundamental Trends in Machine Learning, Vol. 2, no. 1.
2. Bendersky, M., Metzler, D., and Croft, B., 2011. Parameterized concept weighting in verbose queries. In SIGIR, pp. 605-614.
3. Berger, A., and Lafferty, J. 1999. Information retrieval as statistical translation. In SIGIR, pp. 222-229.
4. Blei, D. M., and Ng, A. Y., and Jordan, M. J. 2003. Latent Dirichlet allocation. In Journal of Machine Learning Research, 3: 993-1022.
5. Burges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, and Hullender, G. 2005. Learning to rank using gradient descent. In ICML, pp. 89-96.
6. Buckley, D., Allan, J., and Salton, G. 1995. Automatic retrieval approaches using SMART: TREC-2. Information Processing and Management, 31: 315-326.
7. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., and Kuksa, P., 2011. Natural language processing (almost) from scratch. In Journal of Machine Learning Research, Vol. 12.
8. Deng, L., Abdel-Hamid, O., and Yu, D., 2013. A deep convolutional neural network using heterogeneous pooling for trading acoustic invariance with phonetic confusion, in ICASSP.
9. Deerwester, S., and Dumais, S. T., Furnas, G. W., Landauer, T., and Harshman, R. 1990. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6): 391-407.
10. Dumais, S. T., and Letsche, T. A., Littman, M. L., and Landauer, T. K. 1997. Automatic cross-linguistic information retrieval using latent semantic indexing. In AAAI-97 Spring Symposium Series: Cross-Language Text and Speech Retrieval.
11. Gao, J., Nie, J-Y., Wu, G. and Cao, G. 2004. Dependence language model for information retrieval. In SIGIR.
12. Gao, J., He, X., and Nie, J-Y. 2010. Clickthrough-based translation models for web search: from word models to phrase models. In CIKM, pp. 1139-1148.
13. Gao, J., He, X., Yih, W-T., and Deng, L., 2014. Learning continuous phrase representations for translation modeling. In ACL.
14. Gao, J., Pantel, P., Gamon, M., He, X., Deng, L., and Shen, Y. 2014. Modeling interestingness with deep neural networks. In EMNLP.
15. Gao, J., Toutanova, K., Yih, W-T. 2011. Clickthrough-based latent semantic models for web search. In SIGIR, pp. 675-684.
16. Girolami, M., and Kaban, A. 2003. On an equivalence between PLSA and LDA. In SIGIR, pp. 433-434.
17. He, X., Deng, L., and Chou, W., 2008. Discriminative learning in sequential pattern recognition. In IEEE Signal Processing Magazine. vol 5.
18. Hinton, G., and Salakhutdinov, R., 2010. Discovering binary codes for documents by learning deep generative models. In Topics in Cognitive Science, pp 1-18.
19. Hofmann, T. 1999. Probabilistic latent semantic indexing. In SIGIR, pp. 50-57.
20. Huang, P., He, X., Gao, J., Deng, L., Acero, A., and Heck, L. 2013. Learning deep structured semantic models for web search using clickthrough data. In CIKM.
21. Jarvelin, K. and Kekalainen, J. 2000. IR evaluation methods for retrieving highly relevant documents. In SIGIR.
22. Lavrenko, V., and Croft, B., 2001. Relevance-based language models. In SIGIR, pp. 120-127.
23. Lu, Z. and Li, H. 2013. A deep architecture for matching short texts. In NIPS.
24. Lv, Y., and Zhai, C., 2009. Positional Language Models for Information Retrieval. In SIGIR, pp. 299-306.
25. Metzler, D. and Croft, B. 2005. A Markov random field model for term dependencies. In SIGIR.
26. Metzler, D., and Croft, B. 2007. Latent Concept Expansion using Markov Random Fields. In SIGIR, pp. 311-318.
27. Mikolov, T., Yih, W., and Zweig, G., 2013. Linguistic regularities in continuous space word representations. In NAACL HLT.
28. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J. 2013. Distributed representations of words and phrases and their compositionality. In NIPS.
29. Mnih A., and Kavukcuoglu, K., 2013. Learning word embeddings efficiently with noise-contrastive estimation. In NIPS.
30. Montavon, G., Orr, G., Müller, K., 2012. Neural Networks: Tricks of the Trade (Second edition). Springer.
31. Platt, J., Toutanova, K., and Yih, W. 2010. Translingual document representations from discriminative projections. In EMNLP, pp. 251-261.
32. Salakhutdinov R., and Hinton, G., 2007. Semantic hashing. In Proc. SIGIR Workshop Information Retrieval and Applications of Graphical Models.
33. Shen, Y., He, X., Gao, J., Deng, L., and Mesnil, G., 2014. Learning semantic representations using convolutional neural networks for web search. In WWW.
34. Socher, R., Huval, B., Manning, C., Ng, A., 2012. Semantic compositionality through recursive matrix-vector spaces. In EMNLP.
35. Song, F. and Croft, B. 1999. A general language model for information retrieval. In CIKM, pp. 316-321.
36. Sparck-Jones, K. 1998. What is the role of NLP in text retrieval? In: Natural language information retrieval (Ed. T. Strzalkowski), Dordrecht: Kluwer.
37. Tur, G., Deng, L., Hakkani-Tur, D., and He, X., 2012. Towards deeper understanding deep convex networks for semantic utterance classification. In ICASSP
38. Wang, K., Li, X., and Gao, J. 2010. Multi-style language model for web scale information retrieval. In SIGIR.
39. Wei, X., and Croft, W. B. 2006. LDA-based document models for ad-hoc retrieval. In SIGIR, pp. 178-185.
40. Yih, W-T., He, X., and Meek, C., 2014. Semantic parsing for single-relation question answering. In ACL.
41. Zeiler, M., Taylor, G., and Fergus, R., 2011. Adaptive deconvolutional networks for mid and high level feature learning. In ICCV.
42. Zhai, C. and Lafferty, J. 2001. A study of smoothing methods for language models applied to ad hoc information retrieval. In SIGIR, pp. 334-342.