Tree-structured composition in neural networks without tree-structured architectures

CEUR Workshop Proceedings

Volumn 1583, Issue , 2015, Pages

  Bowman, Samuel R ^a   Manning, Christopher D ^a   Potts, Christopher ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS; FORESTRY; SELF ORGANIZING MAPS;

ARTIFICIAL DATA; COMPOSITIONAL STRUCTURE; RECURSIVE STRUCTURE; SEQUENCE MODELING; SEQUENCE MODELS; TREE STRUCTURES; TREE-STRUCTURED; TREE-STRUCTURED NEURAL NETWORKS;

TREES (MATHEMATICS);

EID: 84977505088     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. Sequence to sequence learning with neural networks. In Proc. NIPS, 2014.
2. Chris Dyer, Miguel Ballesteros,Wang Ling, Austin Matthews, and Noah A. Smith. Transitionbased dependency parsing with stack long short-term memory. In Proc. ACL, 2015.
3. Kai Sheng Tai, Richard Socher, and Christopher D. Manning. Improved semantic representations from tree-structured long short-term memory networks. In Proc. ACL, 2015.
4. Jeffrey L. Elman. Finding structure in time. Cognitive science, 14(2), 1990.
5. Christoph Goller and Andreas Kuchler. Learning task-dependent distributed representations by backpropagation through structure. In Proc. IEEE International Conference on Neural Networks, 1996.
6. Richard Socher, Jeffrey Pennington, Eric H. Huang, Andrew Y. Ng, and Christopher D. Manning. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proc. EMNLP, 2011.
7. Minh-Thang Luong Li, Jiwei, Dan Jurafsky, and Eudard Hovy. When are tree structures necessary for deep learning of representations? Proc. EMNLP, 2015.
8. Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton. Grammar as a foreign language. In Proc. NIPS, 2015.
9. Andrej Karpathy, Justin Johnson, and Fei-Fei Li. Visualizing and understanding recurrent networks. arXiv:1506.02078, 2015.
10. Samuel R. Bowman, Christopher Potts, and Christopher D. Manning. Recursive neural networks can learn logical semantics. In Proc. of the 3rd Workshop on Continuous Vector Space Models and their Compositionality, 2015.
11. Bill MacCartney and Christopher D. Manning. An extended model of natural logic. In Proc. of the Eighth International Conference on Computational Semantics, 2009.
12. Danqi Chen, Richard Socher, Christopher D. Manning, and Andrew Y. Ng. Learning new facts from knowledge bases with neural tensor networks and semantic word vectors. In Proc. ICLR, 2013.
13. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. In Proc. ICLR, 2015.
14. Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural computation, 9 (8), 1997.
15. Wojciech Zaremba, Ilya Sutskever, and Oriol Vinyals. Recurrent neural network regularization. In Proc. ICLR, 2015.
16. Matthew D. Zeiler. ADADELTA: an adaptive learning rate method. arXiv:1212.5701, 2012.