Can recursive neural tensor networks learn logical reasoning?

2nd International Conference on Learning Representations, ICLR 2014 - Workshop Track Proceedings

Volumn , Issue , 2014, Pages

  Bowman, Samuel R ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS;

LOGICAL REASONING; REASONING PATTERNS; RECURSIVE MODELING; RECURSIVE NEURAL NETWORKS; REPRESENTATION MODEL; VECTOR REPRESENTATIONS;

ANIMALS;

EID: 85083952396     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Ronan Collobert and Jason Weston. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proc. ICML. ACM, 2008.
2. Richard Socher, Jeffrey Pennington, Eric H. Huang, Andrew Y. Ng, and Christopher D. Manning. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proc. EMNLP. ACL, 2011.
3. Richard Socher, Alex Perelygin, Jean Y. Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, and Christopher Potts. Recursive deep models for semantic compositionality over a sentiment treebank. In Proc. EMNLP. EMNLP, 2013.
4. Danqi Chen, Richard Socher, Christopher D. Manning, and Andrew Y. Ng. Learning new facts from knowledge bases with neural tensor networks and semantic word vectors. In Proc. ICLR, 2013.
5. Marco Baroni, Raffaella Bernardi, and Roberto Zamparelli. Frege in space: A program for compositional distributional semantics. Submitted, draft at http://clic. cimec. unitn. it/composes, 2013.
6. Bill MacCartney. Natural language inference. PhD thesis, Stanford University, 2009.
7. Jack Hoeksema. Monotonicity phenomena in natural language. Linguistic Analysis, 16(1–2), 1986.
8. Víctor Sánchez-Valencia. Categorial grammar and natural reasoning. ILTI Publication Series for Logic, Semantics, and Philosophy of Language LP-91-08, University of Amsterdam, 1991.
9. Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. Linguistic regularities in continuous space word representations. Proceedings of NAACL-HLT, 2013.
10. Ido Dagan, Oren Glickman, and Bernardo Magnini. The PASCAL Recognising Textual Entailment Challenge. In Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Tectual Entailment. Springer, 2006.
11. Richard Socher, Brody Huval, Christopher D. Manning, and Andrew Y. Ng. Semantic compositionality through recursive matrix-vector spaces. In Proc. EMNLP, 2012.
12. Marco Baroni, Raffaella Bernardi, Ngoc-Quynh Do, and Chung-chieh Shan. Entailment above the word level in distributional semantics. In Proc. EACL. ACL, 2012.
13. Dan Garrette, Katrin Erk, and Raymond Mooney. A formal approach to linking logical form and vector-space lexical semantics. Computing Meaning, 4, 2013.
14. Richard Socher, Eric H. Huang, Jeffrey Pennington, Andrew Y. Ng, and Christopher D. Manning. Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. NIPS, 24, 2011.
15. Andrew L. Maas, Awni Y. Hannun, and Andrew Y. Ng. Rectifier nonlinearities improve neural network acoustic models. In Proc. ICML 30, 2013.
16. Christoph Goller and Andreas Kuchler. Learning task-dependent distributed representations by backpropagation through structure. In Proc. IEEE International Conference on Neural Networks, volume 1. IEEE, 1996.
17. John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. The Journal of Machine Learning Research, 2011.
18. Jorge Nocedal. Updating quasi-Newton matrices with limited storage. Mathematics of computation, 35(151), 1980.
19. Richard Socher, John Bauer, Christopher D. Manning, and Andrew Y. Ng. Parsing with compositional vector grammars. In Proc. ACL, 2013.
20. Thomas F. Icard. Inclusion and exclusion in natural language. Studia Logica, 100(4), 2012.
21. Bob Coecke, Mehrnoosh Sadrzadeh, and Stephen Clark. Mathematical foundations for a compositional distributional model of meaning. arXiv:1003.4394, 2010.
22. Edward Grefenstette. Towards a formal distributional semantics: Simulating logical calculi with tensors. arXiv:1304.5823, 2013.