Recurrent neural network grammars

2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference

Volumn , Issue , 2016, Pages 199-209

  Dyer, Chris ^a   Kuncoro, Adhiguna ^a   Ballesteros, Miguel ^a,b   Smith, Noah A ^c  

^a Carnegie Mellon University ^*  (United States)

^b UNIVERSITAT POMPEU FABRA   (Spain)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; MODELING LANGUAGES; SYNTACTICS;

GENERATIVE MODEL; LANGUAGE MODEL; PHRASE STRUCTURE; PROBABILISTIC MODELS; STATE OF THE ART;

RECURRENT NEURAL NETWORKS;

EID: 84994082483     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/n16-1024     Document Type: Conference Paper

References (56)

1. Steven Abney, David McAllester, and Fernando Pereira. 1999. Relating probabilistic grammars and automata. In Proc. ACL.
2. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine transation by jointly learning to align and translate. In Proc. ICLR.
3. James K. Baker. 1979. Trainable grammars for speech recognition. The Journal of the Acoustical Society of America, 65(S1):S132-S132.
4. Paul Baltescu and Phil Blunsom. 2015. Pragmatic neural modelling in machine translation. In Proc. NAACL.
5. Dan Bikel. 2004. On the parameter space of generative lexicalized statistical parsing models. Ph.D. thesis, University of Pennsylvania.
6. Rens Bod. 2003. An efficient implementation of a new DOP model. In Proc. EACL.
7. Samuel R. Bowman, Jon Gauthier, Abhinav Rastogi, Raghav Gupta, Christopher D. Manning, and Christopher Potts. 2006. A fast unified model for parsing and sentence understanding. CoRR, abs/1603.06021.
8. Peter F. Brown, Peter V. deSouza, Robert L. Mercer, Vincent J. Della Pietra, and Jenifer C. Lai. 1992. Class-based n-gram models of natural language. Computational Linguistics, 18(4):467-479.
9. Jan Buys and Phil Blunsom. 2015a. A Bayesian model for generative transition-based dependency parsing. CoRR, abs/1506.04334.
10. Jan Buys and Phil Blunsom. 2015b. Generative incremental dependency parsing with neural networks. In Proc. ACL.
11. Eugene Charniak. 2000. A maximum-entropy-inspired parser. In Proc. NAACL.
12. Eugene Charniak. 2010. Top-down nearly-context-sensitive parsing. In Proc. EMNLP.
13. Ciprian Chelba and Frederick Jelinek. 2000. Structured language modeling. Computer Speech and Language, 14(4).
14. Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In Proc. EMNLP.
15. Noam Chomsky. 1957. Syntactic Structures. Mouton, The Hague/Paris.
16. Arnaud Doucet and Adam M. Johansen. 2011. A tutorial on particle filtering and smoothing: Fifteen years later. In Handbook of Nonlinear Filtering. Oxford.
17. Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, and Noah A. Smith. 2015. Transition-based dependency parsing with stack long short-term memory. In Proc. ACL.
18. Jay Earley. 1970. An efficient context-free parsing algorithm. Communications of the ACM, 13(2):94-102.
19. Jeffrey L. Elman. 1990. Finding structure in time. Cognitive Science, 14:179-211.
20. Ahmad Emami and Frederick Jelinek. 2005. A neural syntactic language model. Machine Learning, 60:195-227.
21. Michel Galley, Jonathan Graehl, Kevin Knight, Daniel Marcu, Steve DeNeefe, Wei Wang, and Ignacio Thayer. 2006. Scalable inference and training of context-rich syntactic translation models. In Proc. ACL.
22. Kevin Gimpel and Noah A. Smith. 2014. Phrase dependency machine translation with quasi-synchronous tree-to-tree features. Computational Linguistics, 40(2).
23. Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proc. ICML.
24. Joshua Goodman. 2001. Classes for fast maximum entropy training. CoRR, cs.CL/0108006.
25. James Henderson. 2003. Inducing history representations for broad coverage statistical parsing. In Proc. NAACL.
26. James Henderson. 2004. Discriminative training of a neural network statistical parser. In Proc. ACL.
27. Zhongqiang Huang and Mary Harper. 2009. Self-training PCFG grammars with latent annotations across languages. In Proc. EMNLP.
28. Frederick Jelinek and John D. Lafferty. 1991. Computation of the probability of initial substring generation by stochastic context-free grammars. Computational Linguistics, 17(3):315-323.
29. Mark Johnson. 2001. Joint and conditional estimation of tagging and parsing models. In Proc. ACL.
30. Eliyahu Kiperwasser and Yoav Goldberg. 2016. Easy-first dependency parsing with hierarchical tree LSTMs. ArXiv:1603.00375.
31. David McClosky, Eugene Charniak, and Mark Johnson. 2006. Effective self-training for parsing. In Proc. NAACL.
32. Tomáš Mikolov, Martin Karafiát, Lukáš Burget, Jan Černocký, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Proc. Interspeech.
33. Thomas Mueller, Helmut Schmid, and Hinrich Schütze. 2013. Efficient higher-order CRFs for morphological tagging. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 322-332. Association for Computational Linguistics, Seattle, Washington, USA. URL http://www.aclweb.org/anthology/D13-1032.
34. Terence Parr and Kathleen Fisher. 2011. LL(∗): The foundation of the ANTLR parser generator. In Proc. PLDI.
35. Slav Petrov and Dan Klein. 2007. Improved inference for unlexicalized parsing. In Proc. NAACL.
36. Brian Roark. 2001. Probabilistic top-down parsing and language modeling. Computational Linguistics, 27(2).
37. Brian Roark. 2004. Robust garden path parsing. JNLE, 10(1):1-24.
38. Kenji Sagae and Alon Lavie. 2005. A classifier-based parser with linear run-time complexity. In Proc. IWPT.
39. Hiroyuki Shindo, Yusuke Miyao, Akinori Fujino, and Masaaki Nagata. 2012. Bayesian symbol-refined tree substitution grammars for syntactic parsing. In Proc. ACL.
40. Hava T. Siegelmann and Eduardo D. Sontag. 1995. On the computational power of neural nets. Journal of Computer and System Sciences, 50.
41. Richard Socher, John Bauer, Christopher D. Manning, and Andrew Y. Ng. 2013a. Parsing with compositional vectors. In Proc. ACL.
42. Richard Socher, Eric H. Huang, Jeffrey Pennington, Andrew Y. Ng, and Christopher D. Manning. 2011. Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. In Proc. NIPS.
43. Richard Socher, Alex Perelygin, Jean Y. Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, and Christopher Potts. 2013b. Recursive deep models for semantic compositionality over a sentiment treebank. In Proc. EMNLP.
44. Guo-Zheng Sun, C. Lee Giles, and Hsing-Hen Chen. 1998. The neural network pushdown automaton: Architecture, dynamics and training. In Adaptive Processing of Sequences and Data Structures, volume 1387 of Lecture Notes in Computer Science, pages 296-345.
45. Kai Sheng Tai, Richard Socher, and Christopher D. Manning. 2015. Improved semantic representations from tree-structured long short-term memory networks. In Proc. ACL.
46. Ivan Titov and James Henderson. 2007. A latent variable model for generative dependency parsing. In Proc. IWPT.
47. Kristina Toutanova, Dan Klein, Christopher D. Manning, and Yoram Singer. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proc. NAACL.
48. Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton. 2015. Grammar as a foreign language. In Proc. ICLR.
49. Zhiguo Wang, Haitao Mi, and Nianwen Xue. 2015. Feature optimization for constituent parsing via neural networks. In Proc. ACL-IJCNLP.
50. Zhiguo Wang and Nianwen Xue. 2014. Joint POS tagging and transition-based constituent parsing in Chinese with non-local features. In Proc. ACL.
51. Tsung-Hsien Wen, Milica Gašić, Nikola Mrkšić, Pei-Hao Su, David Vandyke, and Steve Young. 2015. Semantically conditioned LSTM-based natural language generation for spoken dialogue systems. In Proc. EMNLP.
52. Kelvin Xu, Jimmy Lei Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhutdinov, Richard S. Zemel, and Yoshua Bengio. 2015. Show, attend and tell: Neural image caption generation with visual attention. In Proc. ICML.
53. Naiwen Xue, Fei Xia, Fu-dong Chiou, and Marta Palmer. 2005. The Penn Chinese TreeBank: Phrase structure annotation of a large corpus. Nat. Lang. Eng., 11(2).
54. Wojciech Zaremba, Ilya Sutskever, and Oriol Vinyals. 2015. Recurrent neural network regularization. In Proc. ICLR.
55. Yue Zhang and Stephen Clark. 2011. Syntactic processing using the generalized perceptron and beam search. Computational Linguistics, 37(1).
56. Muhua Zhu, Yue Zhang, Wenliang Chen, Min Zhang, and Jingbo Zhu. 2013. Fast and accurate shift-reduce constituent parsing. In Proc. ACL.