Learning to rank short text pairs with convolutional deep neural networks

SIGIR 2015 - Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2015, Pages 373-382

  Severyn, Aliaksei ^a   Moschittiy, Alessandro ^b,c  

^a GOOGLE   (United Kingdom)

^b QATAR COMPUTING RESEARCH INSTITUTE   (Qatar)

^c UNIVERSITY OF TRENTO   (Italy)

Author keywords

Convolutional neural networks; Learning to rank; Microblog search; Question answering

Indexed keywords

COMPUTER VISION; CONVOLUTION; INFORMATION RETRIEVAL; NETWORK ARCHITECTURE; NEURAL NETWORKS; QUERY PROCESSING; SEMANTICS; SPEECH RECOGNITION; SYNTACTICS;

CONVOLUTIONAL NEURAL NETWORK; FEATURE REPRESENTATION; LEARNING TO RANK; MICRO-BLOG; NATURAL LANGUAGE PROCESSING; QUESTION ANSWERING; STATE-OF-THE-ART PERFORMANCE; STATE-OF-THE-ART SYSTEM;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84953775876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2766462.2767738     Document Type: Conference Paper

References (40)

1. A. Agarwal, H. Raghavan, K. Subbian, P. Melville, D. Gondek, and R. Lawrence. Learning to rank for robust question answering. In CIKM, 2012.
2. J. W. Antoine Bordes and N. Usunier. Open question answering with weakly supervised embedding models. In ECML, Nancy, France, September 2014.
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003.
4. R. Berendsen, M. Tsagkias, W. Weerkamp, and M. De Rijke. Pseudo test collections for training and tuning microblog rankers. In SIGIR, 2013.
5. A. Bordes, S. Chopra, and J. Weston. Question answering with subgraph embeddings. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 615-620, Doha, Qatar, October 2014. Association for Computational Linguistics.
6. Z. Cao, T. Qin, T.-Y. Liu, M.-F. Tsai, and H. Li. Learning to rank: From pairwise approach to listwise approach. In Proceedings of the 24th International Conference on Machine Learning, ICML'07, pages 129-136, New York, NY, USA, 2007. ACM.
7. Y. Chen, M. Zhou, and S. Wang. Reranking answers from definitional QA using language models. In ACL, 2006.
8. R. Collobert and J. Weston. A unified architecture for natural language processing: deep neural networks with multitask learning. In ICML, pages 160-167, 2008.
9. H. Cui, M. Kan, and T. Chua. Generic soft pattern models for definitional QA. In SIGIR, Salvador, Brazil, 2005. ACM.
10. S. Deerwester, S. Dumais, G. Furnas, T. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of the American Society of Information Science, 1990.
11. M. Denil, A. Demiraj, N. Kalchbrenner, P. Blunsom, and N. De Freitas. Modelling, visualising and summarising documents with a single convolutional neural network. Technical report, University of Oxford, 2014.
12. J. Duchi, E. Hazan, and Y. Singer. Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res., 12:2121-2159, 2011.
13. A. Echihabi and D. Marcu. A noisy-channel approach to question answering. In ACL, 2003.
14. I. J. Goodfellow, D. Warde-Farley, M. Mirza, A. C. Courville, and Y. Bengio. Maxout networks. In ICML, pages 1319-1327, 2013.
15. M. Heilman and N. A. Smith. Tree edit models for recognizing textual entailments, paraphrases, and answers to questions. In NAACL, 2010.
16. M. Iyyer, J. Boyd-Graber, L. Claudino, R. Socher, and H. Daumé III. A neural network for factoid question answering over paragraphs. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 633-644, Doha, Qatar, October 2014. Association for Computational Linguistics.
17. J. Jeon, W. B. Croft, and J. H. Lee. Finding similar questions in large question and answer archives. In CIKM, 2005.
18. N. Kalchbrenner, E. Grefenstette, and P. Blunsom. A convolutional neural network for modelling sentences. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, June 2014.
19. Y. Kim. Convolutional neural networks for sentence classification. In EMNLP, pages 1746-1751, Doha, Qatar, October 2014.
20. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems 26, pages 3111-3119, 2013.
21. A. Moschitti, S. Quarteroni, R. Basili, and S. Manandhar. Exploiting syntactic and shallow semantic kernels for question/answer classification. In ACL, 2007.
22. V. Nair and G. E. Hinton. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML-10), pages 807-814, 2010.
23. I. Ounis, C. MacDonald, J. Lin, and I. Soboroff. Overview of the TREC-2011 microblog track. In TREC, 2011.
24. F. Radlinski and T. Joachims. Query chains: Learning to rank from implicit feedback. CoRR, 2006.
25. Y. Sasaki. Question answering as question-biased term extraction: A new approach toward multilingual qa. In ACL, 2005.
26. A. Severyn and A. Moschitti. Automatic feature engineering for answer selection and extraction. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 458-467, Seattle, Washington, USA, October 2013. Association for Computational Linguistics.
27. A. Severyn, A. Moschitti, M. Tsagkias, R. Berendsen, and M. De Rijke. A syntax-aware re-ranker for microblog retrieval. In SIGIR, 2014.
28. D. Shen and M. Lapata. Using semantic roles to improve question answering. In EMNLP-CoNLL, 2007.
29. I. Soboroff, I. Ounis, J. Lin, and I. Soboroff. Overview of the TREC-2012 microblog track. In TREC, 2012.
30. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15:1929-1958, 2014.
31. M. Surdeanu, M. Ciaramita, and H. Zaragoza. Learning to rank answers to non-factoid questions from web collections. Comput. Linguist., 37(2):351-383, June 2011.
32. J. Suzuki, Y. Sasaki, and E. Maeda. Svm answer selection for open-domain question answering. In COLING, 2002.
33. W. Tau Yih, M.-W. Chang, C. Meek, and A. Pastusiak. Question answering using enhanced lexical semantic models. In ACL, August 2013.
34. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res., 11:3371-3408, Dec. 2010.
35. M. Wang and C. D. Manning. Probabilistic tree-edit models with structured latent variables for textual entailment and question answering. In ACL, 2010.
36. M. Wang, N. A. Smith, and T. Mitaura. What is the jeopardy model? a quasi-synchronous grammar for qa. In EMNLP, 2007.
37. P. C. Xuchen Yao, Benjamin Van Durme and C. Callison-Burch. Answer extraction as sequence tagging with tree edit distance. In NAACL, 2013.
38. L. Yu, K. M. Hermann, P. Blunsom, and S. Pulman. Deep learning for answer sentence selection. CoRR, 2014.
39. M. D. Zeiler. Adadelta: An adaptive learning rate method. CoRR, 2012.
40. M. D. Zeiler and R. Fergus. Stochastic pooling for regularization of deep convolutional neural networks. CoRR, abs/1301.3557, 2013.