Supertagging with LSTMs

2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference

Volumn , Issue , 2016, Pages 232-237

  Vaswani, Ashish ^a   Bisk, Yonatan ^a   Sagae, Kenji ^b   Musa, Ryan ^c  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b Kittai   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SYNTACTICS;

ABSOLUTE GAIN; FEED-FORWARD ARCHITECTURES; NEURAL MODELS; POS TAGGING; STATE-OF-THE-ART PERFORMANCE; SYNTACTIC INFORMATION;

COMPUTATIONAL LINGUISTICS;

EID: 84994085556     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/n16-1027     Document Type: Conference Paper

References (21)

1. Srinivas Bangalore and Aravind K. Joshi. 2010. Supertagging: Using Complex Lexical Descriptions in Natural Language Processing. The MIT Press.
2. Samy Bengio, Oriol Vinyals, Navdeep Jaitly, and Noam Shazeer. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. In Advances in Neural Information Processing Systems, pages 1171-1179.
3. Eugene Charniak, Don Blaheta, Niyu Ge, Keith Hall, John Hale, and Mark Johnson. 2000. Bllip 1987-89 wsj corpus release 1. Linguistic Data Consortium, Philadelphia, 36.
4. Yves Chauvin and David E Rumelhart. 1995. Backpropagation: theory, architectures, and applications. Psychology Press.
5. Stephen Clark and James Curran. 2007. Wide-Coverage Efficient Statistical Parsing with CCG and Log-Linear Models. Computational Linguistics, 33(4):493-552.
6. Stephen Clark, Darren Foong, Luana Bulat, and Wenduan Xu. 2015. The Java Version of the C&C Parser: Version 0.95. Technical report, University of Cambridge Computer Laboratory, August.
7. Stephen Clark. 2002. Supertagging for combinatory categorial grammar. In Proceedings of the 6th International Workshop on Tree Adjoining Grammars and Related Formalisms (TAG+6), pages 19-24.
8. A. Graves. 2013. Generating sequences with recurrent neural networks. arXiv preprint arXiv:1308.0850.
9. Julia Hockenmaier and Mark Steedman. 2007. CCG-bank: A Corpus of CCG Derivations and Dependency Structures Extracted from the Penn Treebank. Computational Linguistics, 33:355-396, September.
10. Mike Lewis and Mark Steedman. 2014a. A∗ ccg parsing with a supertag-factored model. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2014).
11. Mike Lewis and Mark Steedman. 2014b. Improved ccg parsing with semi-supervised supertagging. Transactions of the Association for Computational Linguistics, 2:327-338.
12. Mike Lewis, Kenton Lee, and Luke Zettlemoyer. 2016. LSTM CCG Parsing. In Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics.
13. Wang Ling, Tiago Luís, Luís Marujo, Ramón Fernandez Astudillo, Silvio Amir, Chris Dyer, Alan W Black, and Isabel Trancoso. 2015. Finding function in form: Compositional character models for open vocabulary word representation. arXiv preprint arXiv:1508.02096.
14. Mitchell P Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a Large Annotated Corpus of English: The Penn Treebank. Computational Linguistics, 19:313-330, June.
15. Vinod Nair and Geoffrey E. Hinton. 2010. Rectified linear units improve restricted Boltzmann machines. In Proceedings of ICML, pages 807-814.
16. Marc'Aurelio Ranzato, Sumit Chopra, Michael Auli, and Wojciech Zaremba. 2015. Sequence Level Training with Recurrent Neural Networks. arXiv preprint arXiv:1511.06732.
17. Anders Søgaard. 2011. Semisupervised condensed nearest neighbor for part-of-speech tagging. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers-Volume 2, pages 48-52. Association for Computational Linguistics.
18. Nitish Srivastava. 2013. Improving neural networks with dropout. Ph.D. thesis, University of Toronto.
19. Peilu Wang, Yao Qian, Frank K Soong, Lei He, and Hai Zhao. 2015. Part-of-speech tagging with bidirectional long short-term memory recurrent neural network. arXiv preprint arXiv:1510.06168.
20. Wenduan Xu, Michael Auli, and Stephen Clark. 2015. Ccg supertagging with a recurrent neural network. Volume 2: Short Papers, page 250.
21. W. Zaremba, I. Sutskever, and O. Vinyals. 2014. Recurrent neural network regularization. arXiv preprint arXiv:1409.2329.