A hierarchical recurrent encoder-decoder for generative context-aware query suggestion

International Conference on Information and Knowledge Management, Proceedings

Volumn 19-23-Oct-2015, Issue , 2015, Pages 553-562

  Sordoni, Alessandro ^a   Bengio, Yoshua ^a   Vahabi, Hossein ^b   Lioma, Christina ^c   Simonsen, Jakob G ^c   Nie, Jian Yun ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b YAHOO RESEARCH   (United States)

^c UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Query suggestion; Recurrent neural networks

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECODING; KNOWLEDGE MANAGEMENT; LEARNING SYSTEMS; NETWORK ARCHITECTURE; SEARCH ENGINES;

CONTEXT- AWARENESS; CONTEXT-AWARE APPROACHES; DATA SPARSITY; DECODING TECHNIQUES; ENCODER-DECODER; ENCODER-DECODER ARCHITECTURE; QUERY SUGGESTION; SEARCH INTENTS;

RECURRENT NEURAL NETWORKS;

EID: 84958256008     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2806416.2806493     Document Type: Conference Paper

References (43)

1. R. Baeza-Yates, C. Hurtado, and M. Mendoza. Query recommendation using query logs in search engines. In In Proc of Int. Conf. on Current Trends in Database Tech., pages 588-596, 2004.
2. F. Bastien, P. Lamblin, R. Pascanu, J. Bergstra, I. J. Goodfellow, A. Bergeron, N. Bouchard, and Y. Bengio. Theano new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop, 2012.
3. Y. Bengio. Deep learning of representations: Looking forward. CoRR, abs/1305.0445, 2013.
4. Y. Bengio, R. Ducharme, and P. Vincent. A neural probabilisti language model. Journal of Machine Learning Research, 3:1137-1155, 2003.
5. Y. Bengio, P. Simard, and P. Frasconi. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, pages 157-166, 1994.
6. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio. Theano: a CPU and GPU math expression compiler. In In Proc. of SciPy, 2010.
7. P. Boldi, F. Bonchi, C. Castillo, D. Donato, A. Gionis, and S. Vigna. The query-flow graph: Model and applications. In In Proc. of CIKM, pages 609-618, 2008.
8. F. Bonchi, R. Perego, F. Silvestri, H. Vahabi, and R. Venturini Efficient query recommendations in the long tail via center-piece subgraphs. In In Proc. of SIGIR, pages 345-354, 2012.
9. D. Broccolo, L. Marcon, F. M. Nardini, R. Perego, and F. Silvestri. Generating suggestions for queries in the long tail with an inverted index. Inf. Process. Manage., 48(2):326-339, 2012.
10. H. Cao, D. Jiang, J. Pei, Q. He, Z. Liao, E. Chen, and H. Li. Context-aware query suggestion by mining click-through and session data. In In Proc. of SIGKDD, pages 875-883, 2008.
11. K. Cho, B. Merrienboer, Ç. Gülcehre, F. Bougares, H. Schwenk, and Y. Bengio. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In Proc. of EMNLP, 2014.
12. C. LA Clarke, N. Craswell, I. Soboroff, and E. M Voorhees. Overview of the trec 2011 web track. Proceedings of the 2011 Text Retrieval Conference (TREC 2011), 2011.
13. A. Graves. Generating sequences with recurrent neural networks. CoRR, abs/1308.0850, 2013.
14. M. Grbovic, N. Djuric, V. Radosavljevic, F. Silvestri, and N. Bhamidipati. Context- and content-aware embeddings for query rewriting in sponsored search. In Proc. of SIGIR. 2015.
15. Q. He, D. Jiang, Z. Liao, S. C. H. Hoi, K. Chang, E. P. Lim, and H. Li. Web query recommendation via sequential query prediction. In In Proc. of ICDE, pages 1443-1454, 2009.
16. S. El Hihi and Y. Bengio. Hierarchical recurrent neural networks for long-term dependencies. In NIPS, pages 493-499. Citeseer, 1995.
17. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9(8):1735-1780, 1997.
18. J. Huang and E. N. Efthimiadis. Analyzing and evaluating query reformulation strategies in web search logs. In In Proc. of CIKM, pages 77-86, 2009.
19. P. S. Huang, X. He, J. Gao, L. Deng, A. Acero, and L. Heck. Learning deep structured semantic models for web search using clickthrough data. In In Proc. of CIKM, pages 2333-2338, 2013.
20. A. Jain, U. Ozertem, and E. Velipasaoglu. Synthesizing high utility suggestions for rare web search queries. In In Proc. of SIGIR, pages 805-814, 2011.
21. B. J. Jansen, A. Spink, C. Blakely, and S. Koshman. Defining a session on web search engines: Research articles. J. Am. Soc. Inf. Sci. Technol., 58(6):862-871, April 2007.
22. J.Y. Jiang, Y.Y. Ke, P.Y. Chien, and P.J. Cheng. Learning user reformulation behavior for query auto-completion. In In Proc. of SIGIR, pages 445-454, 2014.
23. P. Koehn. Statistical machine translation. Cambridge University Press, 2009.
24. X. Li, C. Guo, W. Chu, Y.Y. Wang, and J. Shavlik. Deep learning powered in-session contextual ranking using clickthrough data. In In Proc. of NIPS, 2014.
25. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.
26. T. Mikolov, M. Karafiát, L. Burget, J. Cernocký, and S. Khudanpur. Recurrent neural network based language model. In In Proc. of ACISCA, pages 1045-1048, 2010.
27. B. Mitra. Exploring session context using distributed representations of queries and reformulations. In In Proc. of SIGIR. To appear, 2015.
28. U. Ozertem, O. Chapelle, P. Donmez, and E. Velipasaoglu. Learning to suggest: A machine learning framework for ranking query suggestions. In In Proc. of SIGIR, pages 25-34, 2012.
29. R. Pascanu, C. Gulcehre, K. Cho, and Y. Bengio. How to construct deep recurrent neural networks. arXiv preprint arXiv:1312.6026, 2013.
30. R. Pascanu, T. Mikolov, and Y. Bengio. On the difficulty of training recurrent neural networks. In Proc. of ICML, 2013.
31. K. Raman, P. Bennett, and K. Collins-Thompson. Understanding intrinsic diversity in web search: Improving whole-session relevance. ACM Trans. Inf. Syst., 32(4):20:1-20:45, October 2014.
32. D. E Rumelhart, G. E Hinton, and R. J Williams. Learning representations by back-propagating errors. Cognitive modeling, 1988.
33. E. Sadikov, J. Madhavan, L. Wang, and A. Halevy. Clustering query refinements by user intent. In In Proc. of WWW, pages 841-850, 2010.
34. R. L.T. Santos, C. Macdonald, and I. Ounis. Learning to rank query suggestions for adhoc and diversity search. Information Retrieval, 16(4):429-451, 2013.
35. Y. Shen, X. He, J. Gao, L. Deng, and G. Mesnil. A latent semantic model with convolutional-pooling structure for information retrieval. In In Proc. of CIKM, pages 101-110, 2014.
36. M. Shokouhi. Learning to personalize query auto-completion. In In Proc. of SIGIR, pages 103-112, 2013.
37. Anshumali Shrivastava and Ping Li. Asymmetric lsh (alsh) for sublinear time maximum inner product search (mips). In In Proc. of NIPS, pages 2321-2329, 2014.
38. A. Sordoni, J.Y. Nie, and Y. Bengio. Modeling term dependencies with quantum language models for ir. In In Proc. of SIGIR, pages 653-662, 2013.
39. I. Sutskever, O. Vinyals, and Q. V. V. Le. Sequence to sequence learning with neural networks. In In Proc. of NIPS, pages 3104-3112. 2014.
40. I. Szpektor, A. Gionis, and Y. Maarek. Improving recommendation for long-tail queries via templates. In In Proc. of WWW, pages 47-56, 2011.
41. H. Vahabi, M. Ackerman, D. Loker, R. Baeza-Yates, and A. Lopez-Ortiz. Orthogonal query recommendation. In In Proc. of RECSYS, RecSys '13, pages 33-40. ACM, 2013.
42. J.R. Wen, J.Y. Nie, and H.J. Zhang. Clustering user queries of a search engine. In In Proc. of WWW, pages 162-168. ACM, 2001.
43. Q. Wu, C. J. Burges, K. M. Svore, and J. Gao. Adapting boosting for information retrieval measures. Inf. Retr., 13(3):254-270, June 2010.