Expected F-measure training for shift-reduce parsing with recurrent neural networks

2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference

Volumn , Issue , 2016, Pages 210-220

  Xu, Wenduan ^a   Auli, Michael ^b   Clark, Stephen ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b FACEBOOK AI RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; SYNTACTICS;

F MEASURE; SENTENCE LEVEL; STATE OF THE ART;

RECURRENT NEURAL NETWORKS;

EID: 84994130114     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/n16-1025     Document Type: Conference Paper

References (56)

1. Alfred V Aho and Jeffrey D Ullman. 1972. The theory of parsing, translation, and compiling. Prentice-Hall.
2. Michael Auli and Jianfeng Gao. 2014. Decoder integration and expected BLEU training for recurrent neural network language models. In Proc. of ACL (Volume 2).
3. Michael Auli and Adam Lopez. 2011. Training a log-linear parser with loss functions via softmax-margin. In Proc. of EMNLP.
4. Michael Auli, Michel Galley, and Jianfeng Gao. 2014. Large-scale expected BLEU training of phrase-based reordering models. In Proc. of EMNLP.
5. Miguel Ballesteros, Chris Dyer, and Noah A Smith. 2015. Improved transition-based parsing by modeling characters instead of words with LSTMs. In Proc. of EMNLP.
6. Srinivas Bangalore and Aravind K Joshi. 1999. Supertagging: An approach to almost parsing. In Computational linguistics. MIT Press.
7. Samy Bengio, Oriol Vinyals, Navdeep Jaitly, and Noam M. Shazeer. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. In Proc. of NIPS.
8. Yoshua Bengio. 2012. Practical recommendations for gradient-based training of deep architectures. In Neural Networks: Tricks of the Trade. Springer.
9. Eugene Charniak and Mark Johnson. 2005. Coarse-to-fine n-best parsing and MaxEnt discriminative reranking. In Proc. of ACL.
10. Danqi Chen and Christopher D Manning. 2014. A fast and accurate dependency parser using neural networks. In Proc. of EMNLP.
11. Stephen Clark and James R Curran. 2004. The importance of supertagging for wide-coverage CCG parsing. In Proc. of COLING.
12. Stephen Clark and James R. Curran. 2007. Wide-coverage efficient statistical parsing with CCG and log-linear models. In Computational Linguistics. MIT Press.
13. Michael Collins and Brian Roark. 2004. Incremental parsing with the perceptron algorithm. In Proc. of ACL.
14. Michael Collins. 2000. Discriminative reranking for natural language parsing. In Proc. of ICML.
15. Michael Collins. 2002. Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms. In Proc. of EMNLP.
16. Jacob Devlin, Rabih Zbib, Zhongqiang Huang, Thomas Lamar, Richard Schwartz, and John Makhoul. 2014. Fast and robust neural network joint models for statistical machine translation. In Proc. of ACL.
17. Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, and Noah A. Smith. 2015. Transition-based dependency parsing with stack long short-term memory. In Proc. of ACL.
18. Jeffrey L Elman. 1990. Finding structure in time. In Cognitive science. Elsevier.
19. Timothy A.D. Fowler and Gerald Penn. 2010. Accurate context-free parsing with Combinatory Categorial Grammar. In Proc. of ACL.
20. Jianfeng Gao and Xiaodong He. 2013. Training MRF-based phrase translation models using gradient ascent. In Proc. of NAACL.
21. Jianfeng Gao, Xiaodong He, Wen-tau Yih, and Li Deng. 2014. Learning continuous phrase representations for translation modeling. In Proc. of ACL.
22. Kevin Gimpel and Noah Smith. 2010. Softmax-margin CRFs: training log-linear models with cost functions. In Proc. of NAACL.
23. Yoav Goldberg, Kai Zhao, and Liang Huang. 2013. Efficient implementation for beam search incremental parsers. In Proc. of ACL (Volume 2).
24. Christoph Goller and Andreas Kuchler. 1996. Learning task-dependent distributed representations by backpropagation through structure. In Proc. of IEEE International Conference on Neural Networks.
25. Joshua Goodman. 1996. Parsing algorithms and metrics. In Proc. of ACL.
26. Xiaodong He and Li Deng. 2012. Maximum expected BLEU training of phrase and lexicon translation models. In Proc. of ACL.
27. Geoffrey E Hinton. 2002. Training products of experts by minimizing contrastive divergence. In Neural computation. MIT Press.
28. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. In Neural computation. MIT Press.
29. Julia Hockenmaier and Mark Steedman. 2007. CCG-Bank: A corpus of CCG derivations and dependency structures extracted from the Penn Treebank. In Computational Linguistics. MIT Press.
30. Julia Hockenmaier. 2003. Data and Models for Statistical Parsing with Combinatory Categorial Grammar. Ph.D. thesis, University of Edinburgh.
31. Eliyahu Kiperwasser and Yoav Goldberg. 2016. Easy-first dependency parsing with hierarchical tree LSTMs. arXiv:1603.00375.
32. Marco Kuhlmann and Giorgio Satta. 2014. A new parsing algorithm for combinatory categorial grammar. In Transactions of the Association for Computational Linguistics. ACL.
33. Joël Legrand and Ronan Collobert. 2015. Joint RNN-based greedy parsing and word composition. In Proc. of ICLR.
34. Marshall R. Mayberry and Risto Miikkulainen. 1999. Sardsrn: A neural network shift-reduce parser. In Proc. of IJCAI.
35. Risto Miikkulainen. 1996. Subsymbolic case-role analysis of sentences with embedded clauses. In Cognitive Science. Elsevier.
36. Tomáš Mikolov. 2012. Statistical Language Models Based on Neural Networks. Ph.D. thesis, Brno University of Technology.
37. J. Nivre and M Scholz. 2004. Deterministic dependency parsing of English text. In Proc. of COLING.
38. Joakim Nivre. 2008. Algorithms for deterministic incremental dependency parsing. In Computational Linguistics. MIT Press.
39. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proc. of ACL.
40. Antti-Veikko I Rosti, Bing Zhang, Spyros Matsoukas, and Richard Schwartz. 2010. BBN system description for WMT10 system combination task. In Proc. of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR.
41. David E Rumelhart, Geoffrey E Hinton, and Ronald J Williams. 1988. Learning representations by backpropagating errors. In Nature.
42. Kenji Sagae and Alon Lavie. 2006. A best-first probabilistic shift-reduce parser. In Proc. of COLING/ACL.
43. David A. Smith and Jason Eisner. 2006. Minimum-risk annealing for training log-linear models. In Proc. of COLING-ACL.
44. Ilya Sutskever, Oriol Vinyals, and Quoc Le. 2014. Sequence to sequence learning with neural networks. In Proc. of NIPS.
45. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proc. of ACL.
46. Ashish Vaswani and Kenji Sagae. 2016. Efficient structured inference for transition-based parsing with neural networks and error states. In Transactions of the Association for Computational Linguistics. ACL.
47. Krishnamurti Vijay-Shanker and David J Weir. 1993. Parsing some constrained grammar formalisms. In Computational Linguistics. MIT Press.
48. Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton. 2015. Grammar as a foreign language. In Proc. of NIPS.
49. Taro Watanabe and Eiichiro Sumita. 2015. Transition-based neural constituent parsing. In Proc. of ACL.
50. David Weiss, Chris Alberti, Michael Collins, and Slav Petrov. 2015. Structured training for neural network transition-based parsing. In Proc. of ACL.
51. Wenduan Xu, Stephen Clark, and Yue Zhang. 2014. Shift-Reduce CCG parsing with a dependency model. In Proc. of ACL.
52. Wenduan Xu, Michael Auli, and Stephen Clark. 2015. CCG supertagging with a recurrent neural network. In Proc. of ACL (Volume 2).
53. Yue Zhang and Stephen Clark. 2008. A tale of two parsers: investigating and combining graph-based and transition-based dependency parsing using beam-search. In Proc. of EMNLP.
54. Yue Zhang and Stephen Clark. 2011. Shift-Reduce CCG parsing. In Proc. of ACL.
55. Hao Zhou, Yue Zhang, Shujian Huang, and Jiajun Chen. 2015. A neural probabilistic structured-prediction model for transition-based dependency parsing. In Proc. of ACL.
56. Muhua Zhu, Yue Zhang, Wenliang Chen, Min Zhang, and Jingbo Zhu. 2013. Fast and accurate shift-reduce constituent parsing. In Proc. of ACL.