Table filling multi-task recurrent neural network for joint entity and relation extraction

COLING 2016 - 26th International Conference on Computational Linguistics, Proceedings of COLING 2016: Technical Papers

Volumn , Issue , 2016, Pages 2537-2547

  Gupta, Pankaj ^a   Schütze, Hinrich ^a   Andrassy, Bernt ^b  

^a UNIVERSITY OF MUNICH   (Germany)

^b SIEMENS AG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; EXTRACTION; NETWORK ARCHITECTURE; RECURRENT NEURAL NETWORKS; SEMANTICS;

CORRESPONDING RELATIONS; ENTITY RECOGNITION; LABEL DEPENDENCIES; RELATION CLASSIFICATIONS; RELATION EXTRACTION; SEMANTIC COMPOSITION; SIMPLE APPROACH; STATE OF THE ART;

CLASSIFICATION (OF INFORMATION);

EID: 85050264296     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Frèdèric Bastien, Pascal Lamblin, Razvan Pascanu, James Bergstra, Ian J. Goodfellow, Arnaud Bergeron, Nicolas Bouchard, and Yoshua Bengio. 2012. Theano: new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop.
2. James Bergstra, Olivier Breuleux, Frederic Bastien, Pascal Lamblin, Guillaume Desjardins Razvan Pascanu, Joseph Turian, David Warde-Farley, and Yoshua Bengio. 2010. Theano: a cpu and gpu math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy).
3. Rich Caruana. 1998. Multitask learning. Springer.
4. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: deep neural networks with multitask learning. In Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.
5. L Van der Maaten and G Hinton. 2008. Visualizing data using t-sne. Proceedinggs of JMLR.
6. Daxiang Dong, Wei He Hua Wu, Dianhai Yu, and Haifeng Wang. 2015. Multi-task learning for multiple language translation. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pages 1723-1732.
7. Cicero Nogueira dos Santos, Bing Xiang, and Bowen Zhou. 2015. Classifying relations by ranking with convolutional neural networks. In Proceedings of the Association for Computational Linguistics.
8. Jeffrey L Elman. 1990. Finding structure in time. Cognitive science, 14(2).
9. Yoav Goldberg and Michael Elhadad. 2010. An efficient algorithm for easy-first non-directional dependency parsing. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 742-750.
10. M. Jordan. 1986. Serial order: A parallel distributed processing approach. Published in Tech. Rep. No. 8604. San Diego: University of California, Institute for Cognitive Science.
11. Rohit J. Kate and Raymond Mooney. 2010. Joint entity and relation extraction using card-pyramid parsing. In Proceedings of the Fourteenth Conference on Computational Natural Language Learning, pages 203-212.
12. Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016. Neural architectures for named entity recognition.
13. Qi Li and Heng J. 2014. Incremental joint extraction of entity mentions and relations. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pages 402-412.
14. Makoto Miwa and Yutaka Sasaki. 2014. Modeling joint entity and relation extraction with table representation. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 1858-1869.
15. Thien Huu Nguyen and Ralph Grishman. 2015. Relation extraction: Perspective from convolutional neural networks. In Proceedings of the NAACL Workshop on Vector Space Modeling for NLP.
16. Dan Roth and Wen-Tau Yih. 2004. A linear programming formulation for global inference in natural language tasks. In Hwee Tou Ng and Ellen Riloff, editors, HLT-NAACL 2004 Workshop: Eighth Conference on Computational Natural Language Learning (CoNLL-2004), pages 1-8.
17. Dan Roth and Wen-Tau Yih. 2007. Global inference for entity and relation identification via a linear programming formulation. In Hwee Tou Ng and Ellen Riloff, editors, HLT-NAACL 2004 Workshop: Eighth Conference on Computational Natural Language Learning (CoNLL-2004).
18. Michael L Seltzer and Jasha Droppo. 2013. Multi-task learning in deep neural networks for improved phoneme recognition. In Proceedings of the IEEE International Confonference on Acoustics, Speech, and Signal Processing (ICASSP).
19. Richard Socher, Brody Huval, Christopher D Manning, and Andrew Y Ng. 2012. In proceedings of emnlp/conll. Association for Computational Linguistics.
20. Veselin Stoyanov and Jason Eisner. 2012. Easy-first coreference resolution. In Proceedings of COLIN G 2012, page 2519-2534.
21. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.
22. Ngoc Thang Vu, Heike Adel, Pankaj Gupta, and Hinrich Schütze. 2016a. Combining recurrent and convolution neural networks for relation classification. In Proceedings of the NAACL.
23. Ngoc Thang Vu, Pankaj Gupta, Heike Adel, and Hinrich Schütze. 2016b. Bi-directional recurrent neural network with ranking loss for spoken language understanding. IEEE/ACM Trans. on Audio, Speech, and Language Processing.
24. Paul J Werbos. 1990. Backpropagation through time: what it does and how to do it. In Proceedings of the IEEE.
25. Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. 2014. Relation classification via convolutional deep neural network. In Proceedings of COLING.
26. Dongxu Zhang and Dong Wang. 2015. Relation classification via recurrent neural network. In ArXiv.
27. Y Zhang and D.-Y Yeung. 2012. A convex formulation for learning task relationships in multi-task learning. arXiv preprint arXiv: 1203.3536.