Relation extraction: Perspective from convolutional neural networks

1st Workshop on Vector Space Modeling for Natural Language Processing, VS 2015 at the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2015

Volumn , Issue , 2015, Pages 39-48

  Nguyen, Thien Huu ^a   Grishman, Ralph ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CHEMICAL DETECTION; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; EXTRACTION; NEURAL NETWORKS;

CONVOLUTIONAL NEURAL NETWORK; EMBEDDINGS; EXTRACTION SYSTEMS; FEATURE ENGINEERINGS; LEARN+; LINGUISTIC ANALYSIS; MULTIPLE WINDOWS; RELATION EXTRACTION; TRADITIONAL APPROACHES; WINDOW SIZE;

CONVOLUTION;

EID: 85112843528     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (49)

1. Yoshua Bengio, Réjean Ducharme, and Pascal Vincent. 2001. A Neural Probabilistic Language Model. In Advances in Neural Information Processing Systems 13 (NIPS’00), pages 932938, MIT Press, 2001.
2. John Blitzer, Ryan McDonald, and Fernando Pereira. 2006. Domain Adaptation with Structural Correspondence Learning. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, Sydney, Australia.
3. Elizabeth Boschee, Ralph Weischedel, and Alex Zamanian. 2005. Automatic Information Extraction. In Proceedings of the International Conference on Intelligence Analysis.
4. Razvan C. Bunescu and Raymond J. Mooney. 2005a. A Shortest Path Dependency Kenrel for Relation Extraction. In Proceedings of HLT/EMNLP.
5. Razvan C. Bunescu and Raymond J. Mooney. 2005b. Subsequence Kernels for Relation Extraction. In Proceedings of NIPS.
6. Yee S. Chan and Dan Roth. 2010. Exploiting Background Knowledge for Relation Extraction. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pages 152-160, Beijing, China, August.
7. Ronan Collobert and Jason Weston. 2008. A Unied Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning. In International Conference on Machine Learning, ICML, 2008.
8. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research 12:24932537.
9. Aron Culotta and Jeffrey Sorensen. 2004. Dependency Tree Kernels for Relation Extraction. In Proceedings of ACL 2004.
10. Hal Daumé III. 2007. Frustratingly Easy Domain Adaptation. In Proceedings of the ACL, pages 256-263, Prague, Czech Republic, June 2007.
11. Ralph Grishman, David Westbrook and Adam Meyers. 2005. NYUs English ACE 2005 System Description. ACE 2005 Evaluation Workshop.
12. Jing Jiang and ChengXiang Zhai. 2007. A Systematic Exploration of the Feature Space for Relation Extraction. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT’07), pages 113-120, 2007.
13. Iris Hendrickx, Su Nam Kim, Zornitsa Kozareva, Preslav Nakov, Diarmuid Ó Séaghdha, Sebastian Padó, Marco Pennacchiotti, Lorenza Romano, Stan Szpakowicz 2010. SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominals. In Proceedings of the 5th International Workshop on Semantic Evaluation, SemEval 2010.
14. Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2012. Improving Neural Networks by Preventing Co-Adaptation of Feature Detectors. CoRR, abs/1207.0580.
15. Raphael Hoffmann, Congle Zhang, Xiao Ling, Luke Zettlemoyer, and Daniel Weld. 2011. Knowledge-based Weak Supervision for Information Extraction of Overlapping Relations. In Proceedings of ACL 2011.
16. Nal Kalchbrenner, Edward Grefenstette and Phil Blunsom. 2014. A Convolutional Neural Network for Modelling Sentences. In Proceedings of ACL 2014.
17. Nanda Kambhatla. 2004. Combining Lexical, Syntactic, and Semantic Features with Maximum Entropy Models for Information Extraction. In Proceedings of ACL 2004.
18. Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proceedings of EMNLP 2014.
19. Yann LeCun, Léon Bottou, Yoshua Bengio and Patrick Haffner. 1988. Gradient-based learning applied to document recognition. In Proceedings of the IEEE, 86(11):22782324, November, 1988.
20. ChunYang Liu, WenBo Sun, WenHan Chao, and WanXiang Che. 2013. Convolution Neural Network for Relation Extraction. In Proceedings of 9th International Conference on Advanced Data Mining and Applications, Part II (ADMA 2013), Hangzhou, China, December, 2013.
21. David McClosky, Eugene Charniak, and Mark Johnson. 2010. Automatic Domain Adaptation for Parsing. In Proceedings of Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pages 28-36, Los Angeles, California, June 2010.
22. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. In Proceedings of NIPS, 2013.
23. Mike Mintz, Steven Bills, Rion Snow, and Daniel Jurafsky. 2009. Distant Supervision for Relation Extraction without Labeled Data. In Proceedings of ACL, 2009.
24. Andriy Mnih and Geoffrey Hinton. 2007. Three new Graphical Models for Statistical Language Modelling. In Proceedings of ICML’07, pages 641-648, Corvallis, OR, 2007.
25. Andriy Mnih and Geoffrey Hinton. 2009. A Scalable Hierarchical Distributed Language Model. In NIPS, page 1081-1088.
26. Mohit Iyyer, Jordan Boyd-Graber, Leonardo Claudino, Richard Socher and Hal Daumé III. 2014. A Neural Network for Factoid Question Answering over Paragraphs. In Proceedings of EMNLP 2014.
27. Thien Huu Nguyen and Ralph Grishman. 2014. Employing Word Representations and Regularization for Domain Adaptation of Relation Extraction. In Proceedings of ACL 2014, pages 68-74, Baltimore, Maryland, USA.
28. Truc-Vien T. Nguyen, Alessandro Moschitti, and Giuseppe Riccardi. 2009. Convolution Kernels on Constituent, Dependency and Sequential Structures for Relation Extraction. In Proceedings of EMNLP 09, pages 1378-1387, Stroudsburg, PA, USA.
29. Barbara Plank and Alessandro Moschitti. 2013. Embedding Semantic Similarity in Tree Kernels for Domain Adaptation of Relation Extraction. In Proceedings of the ACL 2013, pages 1498-1507, Sofia, Bulgaria.
30. Longhua Qian, Guodong Zhou, Qiaoming Zhu and Peide Qian. 2008. Exploiting Constituent Dependencies for Tree Kernel-based Semantic Relation Extraction. In Proceedings of COLING, pages 697-704, Manchester.
31. Sebastian Riedel, Limin Yao, and Andrew McCallum. 2010. Modeling Relations and their Mentions without Labeled Text. In Proceedings of ECML PKDD, 2010.
32. Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng and Grégoire Mesnil. 2014. Learning Semantic Representations Using Convolutional Neural Networks for Web Search. In Proceedings of WWW 2014.
33. Richard Socher, Eric H. Huang, Jeffrey Pennington, Andrew Y. Ng, and Christopher D. Manning. 2011. Dynamic Pooling and Unfolding Recursive Autoencoders for Paraphrase Detection. In Proceedings of NIPS 2011.
34. Richard Socher, Brody Huval, Christopher D. Manning and Andrew Y. Ng. 2012. Semantic Compositionality through Recursive Matrix-Vector Spaces. In Proceedings of EMNLP 2012.
35. Richard Socher, John Bauer, Christopher D. Manning and Andrew Y. Ng. 2013. Parsing with Compositional Vector Grammars. In Proceedings of ACL 2013.
36. Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Chris Manning, Andrew Ng and Chris Potts. 2013. Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank. In Proceedings of EMNLP 2013.
37. Richard Socher, Danqi Chen, Christopher D. Manning, Andrew Y. Ng. 2013. Reasoning With Neural Tensor Networks for Knowledge Base Completion. In Proceedings of NIPS 2013.
38. Ang Sun, Ralph Grishman, and Satoshi Sekine. 2011. Semi-supervised Relation Extraction with Large-scale Word Clustering. In Proceedings of ACL-HLT, pages 521-529, Portland, Oregon, USA.
39. Le Sun and Xianpei Han 2014. A Feature-Enriched Tree Kernel for Relation Extraction. In Proceedings of ACL 2014, pages 61-67, Baltimore, Maryland, USA.
40. Mihai Surdeanu, Julie Tibshirani, Ramesh Nallapati and Christopher D. Manning 2012. Multi-instance Multilabel Learning for Relation Extraction. In Proceedings of EMNLP-CoNLL 2012.
41. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: A simple and general method for semi-supervised learning. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL’10), pages 384-394, Uppsala, Sweden, July, 2010.
42. Wen-tau Yih, Xiaodong He, and Christopher Meek. 2014. Semantic Parsing for Single-Relation Question Answering. In Proceddings of ACL 2014.
43. Mo Yu, Matthew R. Gormley, and Mark Dredze. 2014. Factor-based Compositional Embedding Models. In the NIPS Learning Semantics Workshop 2014.
44. Matthew D. Zeiler. 2012. ADADELTA: An Adaptive Learning Rate Method. CoRR, abs/1212.5701.
45. Dmitry Zelenko, Chinatsu Aone, and Anthony Richardella. 2003. Kernel Methods for Relation Extraction. Journal of Machine Learning Research, 3:10831106.
46. Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou and Jun Zhao. 2014. Relation Classification via Convolutional Deep Neural Network. In Proceedings of COLING 2014.
47. Min Zhang, Jie Zhang, Jian Su, and GuoDong Zhou. 2006. A Composite Kernel to Extract Relations between Entities with both Flat and Structured Features. In Proceedings of COLING-ACL-06, pages 825-832, Sydney.
48. Guodong Zhou, Jian Su, Jie Zhang, and Min Zhang. 2005. Exploring various Knowledge in Relation Extraction. In Proceedings of ACL’05, pages 427-434, Ann Arbor, USA, 2005.
49. Guodong Zhou, Min Zhang, DongHong Ji, and QiaoMing Zhu. 2007. Tree Kernel-based Relation Extraction with Context-sensitive Structured Parse Tree Information. In Proceedings of EMNLP-CoNLL-07, pages 728-736, Prague.