Joint entity and relation extraction based on a hybrid neural network

Neurocomputing

Volumn 257, Issue , 2017, Pages 59-66

  Zheng, Suncong ^a   Hao, Yuexing ^a   Lu, Dongyuan ^b   Bao, Hongyun ^a   Xu, Jiaming ^a   Hao, Hongwei ^a   Xu, Bo ^a,c  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b UNIVERSITY OF INTERNATIONAL BUSINESS AND ECONOMICS   (China)

^c Shenzhen Fundamental Research Institutions   (China)

Author keywords

Classification; Information extraction; Neural network; Tagging

Indexed keywords

CHARACTER RECOGNITION; INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; NEURAL NETWORKS; SEMANTICS;

CONTEXTUAL INFORMATION; ENTITY EXTRACTIONS; HYBRID NEURAL NETWORKS; RELATION CLASSIFICATIONS; RELATION EXTRACTION; SEMANTIC RELATIONSHIPS; TAGGING; UNSTRUCTURED TEXTS;

CLASSIFICATION (OF INFORMATION);

ARTICLE; ARTIFICIAL NEURAL NETWORK; CALCULATION; COMPUTER NETWORK; CONTROLLED STUDY; CONVOLUTIONAL NEURAL NETWORK; HIDDEN MARKOV MODEL; HYBRID COMPUTER; LONG SHORT TERM MEMORY NETWORK; MATHEMATICAL COMPUTING; MEASUREMENT ERROR; MEASUREMENT PRECISION; PRIORITY JOURNAL;

EID: 85015787416     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2016.12.075     Document Type: Article

References (54)

1. Nadeau, D., Sekine, S., A survey of named entity recognition and classification. Lingvisticae Investigationes 30:1 (2007), 3–26.
2. Rink, B., Utd: classifying semantic relations by combining lexical and semantic resources. Proceedings of the 5th International Workshop on Semantic Evaluation, 2010, 256–259.
3. Li, Q., Ji, H., Incremental joint extraction of entity mentions and relations. Proceedings of the 52rd Annual Meeting of the Association for Computational Linguistics, 2014, 402–412.
4. Miwa, M., Sasaki, Y., Modeling joint entity and relation extraction with table representation. Proceedings of Conference on Empirical Methods in Natural Language Processing, 2014, 1858–1869.
5. Chan, Y.S., Roth, D., Exploiting syntactico-semantic structures for relation extraction. Proceedings of the 49rd Annual Meeting of the Association for Computational Linguistics, 2011, 551–560.
6. Yu, X., Lam, W., Jointly identifying entities and extracting relations in encyclopedia text via a graphical model approach. Proceedings of the 21th COLING International Conference, 2010, 1399–1407.
7. Li, L., Zhang, J., Jin, L., Guo, R., Huang, D., A distributed meta-learning system for chinese entity relation extraction. Neurocomputing 149 (2015), 1135–1142.
8. Miwa, M., Bansal, M., End-to-end relation extraction using lstms on sequences and tree structures. Proceedings of the 54rd Annual Meeting of the Association for Computational Linguistics, 2016.
9. dos Santos, C.N., Xiang, B., Zhou, B., Classifying relations by ranking with convolutional neural networks. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, vol. 1, 2015, 626–634.
10. Xu, Y., Mou, L., Li, G., Chen, Y., Peng, H., Jin, Z., Classifying relations via long short term memory networks along shortest dependency paths. Proceedings of Conference on Empirical Methods in Natural Language Processing, 2015.
11. Zou, L., Huang, R., Wang, H., Yu, J.X., He, W., Zhao, D., Natural language question answering over RDF: a graph data driven approach. Proceedings of the 2014 ACM SIGMOD international conference on Management of data, 2014, ACM, 313–324.
12. Sang, J., Xu, C., Liu, J., User-aware image tag refinement via ternary semantic analysis. IEEE Trans. Multimed. 14:3 (2012), 883–895.
13. Sang, J., Xu, C., Right buddy makes the difference: An early exploration of social relation analysis in multimedia applications. Proceedings of the 20th ACM International Conference on Multimedia, 2012, ACM, 19–28.
14. Luo, G., Huang, X., Lin, C.-Y., Nie, Z., Joint entity recognition and disambiguation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2015, 879–888.
15. J.P. Chiu, E. Nichols, Named entity recognition with bidirectional lstm-cnns, arXiv: 1511.08308 (2015).
16. Z. Huang, W. Xu, K. Yu, Bidirectional lstm-crf models for sequence tagging, arXiv: 1508.01991 (2015).
17. Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., Dyer, C., Neural architectures for named entity recognition. Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2016.
18. K. Xu Y. Feng, S. Huang, D. Zhao, Semantic relation classification via convolutional neural networks with simple negative sampling, arXiv: 1506.07650 (2015).
19. Zeng, D., Liu, K., Zhou, G., Zhao, J., Relation classification via convolutional deep neural network. Proceedings of the 25th COLING International Conference, 2014, 2335–2344.
20. Passos, A., Kumar, V., McCallum, A., Lexicon infused phrase embeddings for named entity resolution. Proceedings of the International Conference on Computational Linguistics, 2014, 78–86.
21. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P., Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12 (2011), 2493–2537.
22. X. Ma, E. Hovy, End-to-end sequence labeling via bi-directional lstm-cnns-crf, arXiv: 1603.01354 (2016).
23. Kambhatla, N., Combining lexical, syntactic, and semantic features with maximum entropy models for extracting relations. Proceedings of the 43th ACL International Conference, 2004, 22.
24. Socher, R., Huval, B., Manning, C.D., Nq, A.Y., Semantic compositionality through recursive matrix-vector spaces. Proceedings of the EMNLP International Conference, 2012, 1201–1211.
25. Yu, M., Gormleyl, M., Dredze, M., Factor-based compositional embedding models. Proceedings of the NIPS Workshop on Learning Semantics, 2014.
26. Yan, X., Moul, L., Li, G., Chen, Y., Peng, H., Jin, Z., Classifying relations via long short term memory networks along shortest dependency paths. Proceedings of EMNLP International Conference, 2015.
27. dos Santos, C.N., Xiangl, B., Zhou, B., Classifying relations by ranking with convolutional neural networks. Proceedings of the 53th ACL International Conference, vol. 1, 2015, 626–634.
28. Nguyen, T.-V.T., Moschittil, A., Riccardi, G., Convolution kernels on constituent, dependency and sequential structures for relation extraction. Proceedings of the EMNLP International Conference, 2009, 1378–1387.
29. Qin, P., Xu, W., Guo, J., An empirical convolutional neural network approach for semantic relation classification. Neurocomputing 190 (2016), 1–9.
30. Zheng, S., Xu, J., Zhou, P., Bao, H., Qi, Z., Xu, B., A neural network framework for relation extraction: Learning entity semantic and relation pattern. Knowl. Based Syst. 114 (2016), 12–23.
31. D. Zhang D. Wang, Relation classification via recurrent neural network, arXiv: 1508.01006 (2015).
32. Ebrahimi, J., Dou, D., Chain based RNN for relation classification. Proceedings of the NAACL International Conference, 2015, 1244–1249.
33. Zhang, S., Zheng, D., Hu, X., Yang, M., Bidirectional long short-term memory networks for relation classification. Proceedings of the Pacific Asia Conference on Language, Information and Computation, 2015, 73–78.
34. Sun, L., Han, X., A feature-enriched tree kernel for relation extraction. Proceedings of the 52th ACL International Conference, 2014, pages 61–67.
35. Roth, D., Yih, W.-t., Global inference for entity and relation identification via a linear programming formulation. Introduction to Statistical Relational Learning, 2007, 553–580.
36. Yang, B., Cardie, C., Joint inference for fine-grained opinion extraction. Proceedings of the 51rd Annual Meeting of the Association for Computational Linguistics, 2013, 1640–1649.
37. Singh, S., Riedel, S., Martin, B., Zheng, J., McCallum, A., Joint inference of entities, relations, and coreference. Proceedings of the 2013 Workshop on Automated Knowledge Base Construction, 2013, ACM, 1–6.
38. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. Proc. IEEE 86:11 (1998), 2278–2324.
39. Yu, J., Yang, X., Gao, F., Tao, D., Deep multimodal distance metric learning using click constraints for image ranking. IEEE Trans. Cybern., 2016, 10.1109/TCYB.2016.2591583.
40. Yu, J., Zhang, B., Kuang, Z., Lin, D., Fan, J., Image privacy protection by identifying sensitive objects via deep multi-task learning. Proceedings of the IEEE Transactions on Information Forensics and Security, 2016.
41. Kim, Y., Convolutional neural networks for sentence classification. Proceedings of the EMNLP International Conference, 2014.
42. Kalchbrenner, N., Grefenstette, E., Blunsom, P., A convolutional neural network for modelling sentences. Proceedings of the 52th ACL International Conference, 2014.
43. Wang, P., Xu, B., Xu, J., Tian, G., Liu, C.-L., Hao, H., Semantic expansion using word embedding clustering and convolutional neural network for improving short text classification. Neurocomputing 174 (2016), 806–814.
44. Zhu, X., Sobihani, P., Guo, H., Long short-term memory over recursive structures. Proceedings of the 32nd International Conference on Machine Learning (ICML-15), 2015, 1604–1612.
45. Graves, A., Supervised Sequence Labelling, 2012, Springer.
46. Luong, M.-T., Sutskever, I., Le, Q.V., Vinyals, O., Zaremba, W., Addressing the rare word problem in neural machine translation. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, 2015, 11–19.
47. Kiros, R., Zhu, Y., Salakhutdinov, R.R., Zemel, R., Urtasun, R., Torralba, A., Fidler, S., Skip-thought vectors. Proceedings of the Advances in Neural Information Processing Systems, 2015, 3276–3284.
48. Ratinov, L., Roth, D., Design challenges and misconceptions in named entity recognition. Proceedings of the Thirteenth Conference on Computational Natural Language Learning, 2009, Association for Computational Linguistics, 147–155.
49. Kalchbrenner, N., Grefenstette, E., Blunsom, P., A convolutional neural network for modelling sentences. Proceedings of Conference on Empirical Methods in Natural Language Processing, 2014.
50. Duan, K., Keerthi, S.S., Chu, W., Shevade, S.K., Poo, A.N., Multi-category classification by soft-max combination of binary classifiers. Multiple Classifier Systems, 2003, Springer, 125–134.
51. Dahl, G.E., Sainath, T.N., Hinton, G.E., Improving deep neural networks for LVCSR using rectified linear units and dropout. Proceedings of the ICASSP, 2013, 8609–8613.
52. Tieleman, T., Hinton, G., Lecture 6.5-rmsprop. COURSERA: Neural networks for machine learning, 2012.
53. Lafferty, J., McCallum, A., Pereira, F., Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proceedings of the Eighteenth International Conference on Machine Learning, ICML, vol. 1, 2001, 282–289.
54. Phillips, S.J., Anderson, R.P., Schapire, R.E., Maximum entropy modeling of species geographic distributions. Ecol. Modell. 190:3 (2006), 231–259.