Grammar as a foreign language

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 2773-2781

  Vinyals, Oriol ^a   Kaiser, Lukasz ^a   Koo, Terry ^a   Petrov, Slav ^a   Sutskever, Ilya ^a   Hinton, Geoffrey ^a  

^a GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; INFORMATION SCIENCE; NATURAL LANGUAGE PROCESSING SYSTEMS;

ATTENTION MECHANISMS; DOMAIN AGNOSTICS; DOMAIN SPECIFIC; FOREIGN LANGUAGE; INTENSIVE RESEARCH; NATURAL LANGUAGE PROCESSING; SEQUENCE MODELING; STATE OF THE ART;

SYNTACTICS;

EID: 84965136196     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Ilya Sutskever, Oriol Vinyals, and Quoc VV Le. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems, pages 3104-3112, 2014.
2. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473, 2014.
3. Thang Luong, Ilya Sutskever, Quoc V Le, Oriol Vinyals, and Wojciech Zaremba. Addressing the rare word problem in neural machine translation. arXiv preprint arXiv:1410.8206, 2014.
4. Sébastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. On using very large target vocabulary for neural machine translation. arXiv preprint arXiv:1412.2007, 2014.
5. Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural computation, 9(8):1735-1780, 1997.
6. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.
7. Eduard Hovy, Mitchell Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel. Ontonotes: The 90% solution. In NAACL. ACL, June 2006.
8. Slav Petrov and Ryan McDonald. Overview of the 2012 shared task on parsing the web. Notes of the First Workshop on Syntactic Analysis of Non-Canonical Language (SANCL), 2012.
9. John Judge, Aoife Cahill, and Josef van Genabith. Questionbank: Creating a corpus of parse-annotated questions. In Proceedings of ICCL & ACL'06, pages 497-504. ACL, July 2006.
10. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. Building a large annotated corpus of english: The penn treebank. Computational Linguistics, 19(2):313-330, 1993.
11. Zhenghua Li, Min Zhang, and Wenliang Chen. Ambiguity-aware ensemble training for semi-supervised dependency parsing. In Proceedings of ACL'14, pages 457-467. ACL, 2014.
12. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. Learning accurate, compact, and interpretable tree annotation. In ACL. ACL, July 2006.
13. Muhua Zhu, Yue Zhang, Wenliang Chen, Min Zhang, and Jingbo Zhu. Fast and accurate shift-reduce constituent parsing. In ACL. ACL, August 2013.
14. Slav Petrov. Products of random latent variable grammars. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the ACL, pages 19-27. ACL, June 2010.
15. Zhongqiang Huang and Mary Harper. Self-training PCFG grammars with latent annotations across languages. In EMNLP. ACL, August 2009.
16. David McClosky, Eugene Charniak, and Mark Johnson. Effective self-training for parsing. In NAACL. ACL, June 2006.
17. David Hall, Taylor Berg-Kirkpatrick, John Canny, and Dan Klein. Sparser, better, faster gpu parsing. In ACL, 2014.
18. Michael Collins. Three generative, lexicalised models for statistical parsing. In Proceedings of the 35th Annual Meeting of the ACL, pages 16-23. ACL, July 1997.
19. Dan Klein and Christopher D. Manning. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting of the ACL, pages 423-430. ACL, July 2003.
20. James Henderson. Inducing history representations for broad coverage statistical parsing. In NAACL, May 2003.
21. James Henderson. Discriminative training of a neural network statistical parser. In Proceedings of the 42nd Meeting of the ACL (ACL'04), Main Volume, pages 95-102, July 2004.
22. Ivan Titov and James Henderson. Constituent parsing with incremental sigmoid belief networks. In ACL. ACL, June 2007.
23. Ronan Collobert. Deep learning for efficient discriminative parsing. In International Conference on Artificial Intelligence and Statistics, 2011.
24. Richard Socher, Cliff C Lin, Chris Manning, and Andrew Y Ng. Parsing natural scenes and natural language with recursive neural networks. In ICML, 2011.
25. Adwait Ratnaparkhi. A linear observed time statistical parser based on maximum entropy models. In Second Conference on Empirical Methods in Natural Language Processing, 1997.
26. Michael Collins and Brian Roark. Incremental parsing with the perceptron algorithm. In Proceedings of the 42nd Meeting of the ACL (ACL'04), Main Volume, pages 111-118, July 2004.
27. Alex Graves. Generating sequences with recurrent neural networks. arXiv preprint arXiv:1308.0850, 2013.
28. Jan Chorowski, Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. End-to-end continuous speech recognition using attention-based recurrent nn: First results. arXiv preprint arXiv:1412.1602, 2014.
29. Nal Kalchbrenner and Phil Blunsom. Recurrent continuous translation models. In EMNLP, pages 1700-1709, 2013.
30. Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. Show and tell: A neural image caption generator. arXiv preprint arXiv:1411.4555, 2014.
31. Zoubin Ghahramani. A neural network for learning how to parse tree adjoining grammar. B. S. Eng Thesis, University of Pennsylvania, 1990.