An empirical convolutional neural network approach for semantic relation classification

Neurocomputing

Volumn 190, Issue , 2016, Pages 1-9

  Qin, Pengda ^a   Xu, Weiran ^a   Guo, Jun ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

Convolution neural network; Data driven; Dropout; Relation classification

Indexed keywords

COMPUTATIONAL LINGUISTICS; CONVOLUTION; LINGUISTICS; NEURAL NETWORKS; QUALITY CONTROL; SEARCH ENGINES; SEMANTICS;

CONVOLUTION NEURAL NETWORK; CONVOLUTIONAL NEURAL NETWORK; DATA DRIVEN; DATA-DRIVEN APPROACH; DROPOUT; LINGUISTIC KNOWLEDGE; RELATION CLASSIFICATIONS; STATE-OF-THE-ART SYSTEM;

CLASSIFICATION (OF INFORMATION);

ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION ALGORITHM; CLASSIFIER; CONVOLUTIONAL NEURAL NETWORK; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; NATURAL LANGUAGE PROCESSING; PRIORITY JOURNAL; RELATION CLASSIFICATION; SEMANTICS;

EID: 84955285770     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.12.091     Document Type: Article

References (40)

1. R. Grishman, Information Extraction: Capabilities and Challenges, 2011, August.
2. F. Wu, D.S. Weld, Open information extraction using Wikipedia, In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, 2010.
3. M. Lyyer, et al., A neural network for factoid question answering over paragraphs, In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014.
4. Yin S., Kaynak.O. Big data for modern industry: challenges and trends. Proc. IEEE 2015, 102(3):143-146.
5. I. Hendrickx, et al., Semeval-2010 task 8: multi-way classification of semantic relations between pairs of nominals. In: Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions, 2009.
6. Yin S., Zhu X. Intelligent particle filter and its application on fault detection of nonlinear system. IEEE Trans. Ind. Electron. 2015, 62(6):3852-3861.
7. Yin S., Wang G., Gao H. Data-Driven Process Monitoring Based on Modified Orthogonal Projections to Latent Structures. IEEE Trans. Control. Syst. Technol. 2015, http://dx.doi.org/10.1109/TCST.2015.2481318.
8. Yin S., Huang Z. Performance monitoring for vehicle suspension system via fuzzy positivistic C-means clustering based on accelerometer measurements. IEEE/ASME Trans. Mechatron. 2015, 20(5):2613-2620.
9. N. Kambhatla, Combining lexical, syntactic, and semantic features with maximum entropy models for extracting relations, In: Proceedings of the ACL 2004 on Interactive Poster and Demonstration Sessions, 2004.
10. Zelenko D., Aone C., Richardella A. Kernel methods for relation extraction. J. Mach. Learn. Res. 2003, 3:1083-1106.
11. M. Zhang, et al., A composite kernel to extract relations between entities with both flat and structured features, In: Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics, 2006.
12. M. Mintz, et al., Distant supervision for relation extraction without labeled data, In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2, 2009.
13. Yin S., Zhu X., Kaynak O. Improved PLS focused on key-performance-indicator-related fault diagnosis. Ind. Electron. IEEE Trans. 2015, 62(3):1651-1658.
14. S. Yin, et al., An improved incremental learning approach for KPI prognosis of dynamic fuel cell system, IEEE Transactions on Cybernetics, 2015. http://dx.doi.org/10.1109/TCYB.2015.2498194.
15. N. Kalchbrenner, E. Grefenstette, P. Blunsom, A Convolutional Neural Network for Modelling Sentences, arXiv Preprint arXiv:1404.2188, 2014.
16. Collobert R., et al. Natural language processing (almost) from scratch. J. Mach. Learn. Res. 2011, 12:2493-2537.
17. R. Socher, et al., Semantic compositionality through recursive matrix-vector spaces. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 2012.
18. D. Zeng, et al. Relation classification via convolutional deep neural network. In: Proceedings of the COLING, 2014.
19. M. Yu, M. Gormley, M. Dredze, Factor-based compositional embedding models, In: Proceedings of the NIPS Workshop on Learning Semantics, 2014.
20. C.N. Dos Santos, B. Xiang, B. Zhou, Classifying relations by ranking with convolutional neural networks. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics, 2015.
21. K. Xu, et al., Semantic Relation Classification via Convolutional Neural Networks with Simple Negative Sampling, arXiv Preprint arXiv:1506.07650, 2015.
22. Y. Xu, et al., Classifying relations via long short term memory networks along shortest dependency paths, In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2015.
23. Fundel K., Küffner R., Zimmer R. RelEx-relation extraction using dependency parse trees. Bioinformatics 2007, 23(3):365-371.
24. W.-t. Yih, X. He, C. Meek, Semantic parsing for single-relation question answering, In: Proceedings of the ACL, 2014.
25. J. Weston, S. Chopra, K. Adams, Tagspace: semantic embeddings from hashtags, In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014.
26. Xu W., Zhang C. Trigger word mining for relation extraction based on activation force. Int. J. Commun. Syst. 2014.
27. Y. LeCun, Y. Bengio, Convolutional networks for images, speech, and time series, In: M.A. Arbib (Ed.), The Handbook of Brain Theory and Neural Networks, Cambridge, MA, MIT Press, 1995, pp. 255-258.
28. G.E. Hinton, et al., Improving Neural Networks by Preventing Co-adaptation of Feature Detectors, arXiv Preprint arXiv:1207.0580, 2012.
29. J. Qiu, S. Ding, H. Gao, S. Yin, Fuzzy-model-based reliable static output feedback H-infinity control of nonlinear hyperbolic PDE systems, IEEE Transactions on Fuzzy Systems. 〈〉. http://dx.doi.org/10.1109/TFUZZ.2015.2457934.
30. Yin S., Li X., Gao H., Kaynak O. Data-based techniques focused on modern industry: an overview. IEEE Trans. Ind. Electron. 2015, 62(1):657-667.
31. Z.S. Harris, Distributional structure, Word, 1954.
32. Bengio Y., et al. A neural probabilistic language model. J. Mach. Learn. Res. 2003, 3:1137-1155.
33. Y. Kim, Convolutional Neural Networks for Sentence Classification, arXiv Preprint arXiv:1408.5882, 2014.
34. Y. Zhang, B. Wallace, A Sensitivity Analysis of (and Practitioners' Guide to) Convolutional Neural Networks for Sentence Classification, arXiv Preprint arXiv:1510.03820, 2015.
35. S. Yin, P. Shi, H. Yang, Adaptive fuzzy control of strict-feedback nonlinear time-delay systems with unmodeled dynamics, IEEE Transactions on Cybernetics. 〈〉. http://dx.doi.org/10.1109/TCYB.2015.2457894.
36. X. Glorot, A. Bordes, Y. Bengio, Deep sparse rectifier neural networks, In: Proceedings of the International Conference on Artificial Intelligence and Statistics, 2011.
37. M.D. Zeiler, ADADELTA: An Adaptive Learning Rate Method, arXiv Preprint arXiv:1212.5701, 2012.
38. B. Rink, S. Harabagiu, UTD: classifying semantic relations by combining lexical and semantic resources, In: Proceedings of the 5th International Workshop on Semantic Evaluation, 2010.
39. Stathakis D. How many hidden layers and nodes. Int. J. Remote Sens. 2009, 30(8):2133-2147.
40. Karsoliya S. Approximating number of hidden layer neurons in multiple hidden layer BPNN architecture. Int. J. Eng. Trends Technol. 2012, 3(6):713-717.