Convolutional neural network architectures for matching natural language sentences

Advances in Neural Information Processing Systems

Volumn 3, Issue January, 2014, Pages 2042-2050

  Hu, Baotian ^a   Lu, Zhengdong ^b   Li, Hang ^b   Chen, Qingcai ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b HUAWEI NOAH S ARK LAB   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CONVOLUTION; INFORMATION SCIENCE; NETWORK ARCHITECTURE; NEURAL NETWORKS; SEMANTICS;

CONVOLUTIONAL NEURAL NETWORK; EMPIRICAL STUDIES; HIERARCHICAL STRUCTURES; INTERNAL STRUCTURE; MATCHING ALGORITHM; MATCHING PATTERNS; NATURAL LANGUAGES; SEMANTIC MATCHING;

COMPUTATIONAL LINGUISTICS;

EID: 84937936034     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. O. Abdel-Hamid, A. Mohamed, H. Jiang, and G. Penn. Applying convolutional neural networks concepts to hybrid nn-hmm model for speech recognition. In Proceedings of ICASSP, 2012.
2. B. Antoine, X. Glorot, J. Weston, and Y. Bengio. A semantic matching energy function for learning with multi-relational data. Machine Learning, 94(2):233-259, 2014.
3. Y. Bengio. Learning deep architectures for ai. Found. Trends Mach. Learn., 2(1):1-127, 2009.
4. Y. Bengio, J. Louradourand, R. Collobert, and J. Weston. Curriculum learning. In Proceedings of ICML, 2009.
5. P. F. Brown, S. A. D. Pietra, V. J. D. Pietra, and R. L. Mercer. The mathematics of statistical machine translation: Parameter estimation. Computational linguistics, 19(2):263-311, 1993.
6. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493-2537, 2011.
7. G. E. Dahl, T. N. Sainath, and G. E. Hinton. Improving deep neural networks for lvcsr using rectified linear units and dropout. In Proceedings of ICASSP, 2013.
8. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. CoRR, abs/1207.0580, 2012.
9. N. Kalchbrenner, E. Grefenstette, and P. Blunsom. A convolutional neural network for modelling sentences. In Proceedings of ACL, Baltimore and USA, 2014.
10. Y. Kim. Convolutional neural networks for sentence classification. In Proceedings of EMNLP, 2014.
11. Y. LeCun and Y. Bengio. Convolutional networks for images, speech and time series. The Handbook of Brain Theory and Neural Networks, 3361, 1995.
12. Y. Lewis, David D. and Yang, T. G. Rose, and F. Li. Rcvl: A new benchmark collection for text categorization research. Journal of Machine Learning Research, 5:361-397, 2004.
13. Z. Lu and H. Li. A deep architecture for matching short texts. In Advances in NIPS, 2013.
14. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. CoRR, abs/1301.3781, 2013.
15. T. Mikolov and M. Karafiát. Recurrent neural network based language model. In Proceedings of INTERSPEECH, 2010.
16. C. Rich, L. Steve, and G. Lee. Overfitting in neural nets: Backpropagation, conjugate gradient, and early stopping. In Advances in NIPS, 2000.
17. V. Rus, P. M. McCarthy, M. C. Lintean, D. S. McNamara, and A. C. Graesser. Paraphrase identification with lexico-syntactic graph subsumption. In Proceedings of FLAIRS Conference, 2008.
18. Y. Shen, X. He, J. Gao, L. Deng, and G. Mesnil. Learning semantic representations using convolutional neural networks for web search. In Proceedings of WWW, 2014.
19. R. Socher, E. H. Huang, and A. Y. Ng. Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. In Advances in NIPS, 2011.
20. R. Socher, C. C. Lin, A. Y. Ng, and C. D. Manning. Parsing Natural Scenes and Natural Language with Recursive Neural Networks. In Proceedings of ICML, 2011.
21. R. Socher, J. Pennington, E. H. Huang, A. Y. Ng, and C. D. Manning. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings of EMNLP, 2011.
22. Y. Song and D. Roth. On dataless hierarchical text classification. In Proceedings of AAAI, 2014.
23. Y. Sun, X. Wang, and X. Tang. Hybrid deep learning for face verification. In Proceedings of ICCV, 2013.
24. S. V. N. Vishwanathan, N. N. Schraudolph, R. Kondor, and K. M. Borgwardt. Graph kernels. Journal of Machine Learning Research(JMLR), 11:1201-1242, 2010.
25. B. Wang, X. Wang, C. Sun, B. Liu, and L. Sun. Modeling semantic relevance for question-answer pairs in web social communities. In Proceedings of ACL, 2010.
26. H. Wang, Z. Lu, H. Li, and E. Chen. A dataset for research on short-text conversations. In Proceedings of EMNLP, Seattle, Washington, USA, 2013.
27. W. Wu, Z. Lu, and H. Li. Learning bilinear model for matching queries and documents. The Journal of Machine Learning Research, 14(1):2519-2548, 2013.
28. X. Xue, J. Jiwoon, and C. W. Bruce. Retrieval models for question and answer archives. In Proceedings of SIGIR '08, New York, NY, USA, 2008.