End-To-end learning of semantic role labeling using recurrent neural networks

ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference

Volumn 1, Issue , 2015, Pages 1127-1137

  Zhou, Jie ^a   Xu, Wei ^a  

^a BAIDU INC   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CONTEXT FREE GRAMMARS; LEARNING SYSTEMS; RECURRENT NEURAL NETWORKS; SEMANTIC WEB; SEMANTICS; SYNTACTICS;

COMPUTATIONALLY EFFICIENT; END-TO-END SYSTEMS; NATURAL LANGUAGE PROCESSING; RECURRENT NETWORKS; SEMANTIC ROLE LABELING; STATE-OF-THE-ART SYSTEM; SYNTACTIC STRUCTURE; TRADITIONAL MODELS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84943737769     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p15-1109     Document Type: Conference Paper

References (40)

1. G. Hinton A. Graves, A. Mohamed. 2013. Speech recognition with deep recurrent neural networks. In IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2013.
2. Emanuele Bastianelli, Giuseppe Castellucci, Danilo Croce, and Roberto Basili. 2013. Textual inference and meaning representation in human robot interaction. In Proceedings of the Joint Symposium on Semantic Processing. Textual Inference and Structures in Corpora, pages 65-69.
3. Yoshua Bengio, Patrice Simard, and Paolo Frasconi. 1994. Learning long-Term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2):157-166.
4. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, March.
5. Yoshua Bengio, Holger Schwenk, Jean-Sbastien Sencal, Frderic Morin, and Jean-Luc Gauvain. 2006. Neural probabilistic language models. In Innovations in Machine Learning, volume 194 of Studies in Fuzziness and Soft Computing, pages 137-186. Springer Berlin Heidelberg.
6. Xavier Carreras and Lluís Marquez. 2005. Introduction to the CoNLL-2005 shared task: Semantic role labeling. In Proceedings of the Ninth Conference on Computational Natural Language Learning (CoNLL-2005), pages 152-164, Ann Arbor, Michigan, June. Association for Computational Linguistics.
7. Eugene Charniak and Mark Johnson. 2005. Coarseto-fine n-best parsing and maxent discriminative reranking. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL 05, pages 173-180, Stroudsburg, PA, USA. Association for Computational Linguistics.
8. Eugene Charniak. 2000. A maximum-entropyinspired parser. In Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference, NAACL 2000, pages 132-139, Stroudsburg, PA, USA. Association for Computational Linguistics.
9. Michael Collins. 2003. Head-driven statistical models for natural language parsing. Comput. Linguist., 29(4):589-637, December.
10. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th International Conference on Machine Learning, ICML 08, pages 160-167, New York, NY, USA. ACM.
11. Ronan Collobert, Jason Weston, Ĺeon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Marchine Learning Research, 12:2493-2537, November.
12. Shen Dan and Mirella Lapata. 2007. Using semantic roles to improve question answering. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLPCoNLL).
13. Alex Graves, Marcus Liwicki, Santiago Fernandez, Roman Bertolami, Horst Bunke, and Jürgen Schmidhuber. 2009. A novel connectionist system for unconstrained handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(5):855-868.
14. Alex Graves, Greg Wayne, and Ivo Danihelka. 2014. Neural turing machines. arXiv:1410.5401.
15. S. Hochreiter and J. Jürgen Schmidhuber. 1997. Long short-Term memory. Neural Computation, 9(8):1735-1780.
16. Yoon Kim. 2014. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pages 1746-1751.
17. Peter Koomen, Vasin Punyakanok, Dan Roth, and Wen-Tau Yih. 2005. Generalized inference with multiple semantic role labeling systems. In Proceedings of the 9th Conference on Computational Natural Language Learning, CONLL 05, pages 181-184, Stroudsburg, PA, USA. Association for Computational Linguistics.
18. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 8th International Conference on Machine Learning, ICML 01, pages 282-289, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
19. Yann Lecun, Lon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. In Proceedings of the IEEE, pages 2278-2324.
20. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Distributed representations of phrases and their compositionality. In Advances on Neural Information Processing Systems.
21. Andriy Mnih and Koray Kavukcuoglu. 2013. Learning word embeddings efficiently with noise-contrastive estimation. In Advances in Neural Information Processing Systems, pages 2265-2273.
22. Alessandro Moschitti, Paul Morarescu, and Sanda M. Harabagiu. 2003. Open domain information extraction via automatic semantic labeling. In FLAIRS Conference03, pages 397-401.
23. Martha Palmer, Daniel Gildea, and Nianwen Xue. 2010. Semantic Role Labeling. Synthesis Lectures on Human Language Technology Series. Morgan and Claypool.
24. Jacob Persson, Richard Johansson, and Pierre Nugues. 2009. Text categorization using predicatecargument structures. In Proceedings of NODALIDA, pages 142-149.
25. Sameer Pradhan, Kadri Hacioglu, Wayne Ward, James H. Martin, and Daniel Jurafsky. 2005. Semantic role chunking combining complementary syntactic views. In Proceedings of the 9th Conference on Computational Natural Language Learning, CONLL 05, pages 217-220, Stroudsburg, PA, USA. Association for Computational Linguistics.
26. Sameer Pradhan, Alessandro Moschitti, Nianwen Xue, Hwee Tou Ng, Anders Björkelund, Olga Uryupina, Yuchen Zhang, and Zhi Zhong. 2013. Towards robust linguistic analysis using ontonotes. In Proceedings of the Seventeenth Conference on Computational Natural Language Learning, pages 143-152, Sofia, Bulgaria, August. Association for Computational Linguistics.
27. V. Punyakanok, D. Roth, and W. Yih. 2008a. The importance of syntactic parsing and inference in semantic role labeling. Computational Linguistics, 34(2).
28. Vasin Punyakanok, Dan Roth, andWen tau Yih. 2008b. The importance of syntactic parsing and inference in semantic role labeling. Computational linguistics, 6(9).
29. M. Schuster and K. K. Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 45:2673-2681.
30. Mihai Surdeanu, Sanda Harabagiu, JohnWilliams, and Paul Aarseth. 2003. Using predicate-Argument structures for information extraction. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics-Volume 1, ACL 03, pages 8-15, Stroudsburg, PA, USA. Association for Computational Linguistics.
31. Mihai Surdeanu, Lluís Marquez, Xavier Carreras, and Pere R. Comas. 2007. Combination strategies for semantic role labeling. Journal of Artificial Intelligence Research, 29:105-151.
32. Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances on Neural Information Processing Systems.
33. Oscar Täckström, Kuzman Ganchev, and Dipanjan Das. 2015. Efficient inference and structured learning for semantic role labeling. Transactions of the Association for Computational Linguistics, 3:29-41.
34. Kai Sheng Tai, Richard Socher, and Christopher D. Manning. 2015. Improved semantic representations from tree-structured long short-Term memory networks. In Proceedings of the 53st Annual Meeting on Association for Computational Linguistics, ACL 15, Stroudsburg, PA, USA. Association for Computational Linguistics.
35. Kristina Toutanova, Aria Haghighi, and Christopher D. Manning. 2008. A global joint model for semantic role labeling. Computational Linguistics, 34:161-191.
36. Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton. 2014. Grammar as a foreign language. arXiv:1412.7449.
37. Jason Weston, Sumit Chopra, and Antoine Bordes. 2014. Memory networks. arXiv:1410.3916.
38. Jason Weston, Antoine Bordes, Sumit Chopra, and Tomas Mikolov. 2015. Towards ai-complete question answering: A set of prerequisite toy tasks. arXiv: 1502.05698.
39. Mo Yu, Matthew Gormley, and Mark Dredze. 2014. Factor-based compositional embedding models. In Advances in Neural Information Processing Systems Workshop on Learning Semantics.
40. Xiang Zhang and Yann LeCun. 2015. Text understanding from scratch. arXiv:1502.01710.