Knowledge-oriented convolutional neural network for causal relation extraction from natural language texts

Expert Systems with Applications

Volumn 115, Issue , 2019, Pages 512-523

  Li, Pengfei ^a   Mao, Kezhi ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Causal relationship; Convolutional neural network; Lexical knowledge base; Natural language processing; Relation extraction

Indexed keywords

CONVOLUTION; EXTRACTION; KNOWLEDGE BASED SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NEURAL NETWORKS; SEMANTICS;

AUTOMATICALLY GENERATED; CAUSAL RELATION EXTRACTIONS; CAUSAL RELATIONSHIPS; CLUSTERING TECHNIQUES; CONVOLUTIONAL NEURAL NETWORK; LEXICAL KNOWLEDGE BASE; NATURAL LANGUAGE TEXT; RELATION EXTRACTION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85052130680     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2018.08.009     Document Type: Article

References (56)

1. Ackerman, E.J.M., Extracting a causal network of news topics. Proceedings of the OTM confederated international conferences “on the move to meaningful internet systems” 2012, Springer, 33–42.
2. Araúz, P.L., Faber, P., Causality in the specialized domain of the environment. Proceedings of the semantic relations-II. Enhancing resources and applications workshop programme., 2012, Citeseer, 10.
3. Bethard, S., Martin, J.H., Learning semantic links from a corpus of parallel temporal and causal relations. Proceedings of the forty sixth annual meeting of the association for computational linguistics on human language technologies: Short papers, 2008, Association for Computational Linguistics, 177–180.
4. Blanco, E., Castell, N., Moldovan, D.I., Causal relation extraction. Proceedings of the language resources and evaluation conference, LREC, 2008.
5. Caselli, T., Vossen, P., The event storyline corpus: A new benchmark for causal and temporal relation extraction. Proceedings of the events and stories in the news workshop, 2017, 77–86.
6. Chan, K., Lam, W., Extracting causation knowledge from natural language texts. International Journal of Intelligent Systems 20:3 (2005), 327–358.
7. Chang, D.-S., Choi, K.-S., Causal relation extraction using cue phrase and lexical pair probabilities. Proceedings of the International conference on natural language processing, 2004, Springer, 61–70.
8. Cheong, H., Shu, L., Automatic extraction of causally related functions from natural-language text for biomimetic design. Proceedings of the international design engineering technical conferences and computers and information in engineering conference, 2012, American Society of Mechanical Engineers, 373–382.
9. David, M. L. (2018). Online statistics education: An interactive multimedia course of study. http://onlinestatbook.com.
10. Fellbaum, C. (2010). Theory and applications of ontology: Computer applications. Wordnet.
11. Girju, R., Automatic detection of causal relations for question answering. Proceedings of the ACL workshop on multilingual summarization and question answering-volume 12, 2003, Association for Computational Linguistics, 76–83.
12. Girju, R., Beamer, B., Rozovskaya, A., Fister, A., Bhat, S., A knowledge-rich approach to identifying semantic relations between nominals. Information Processing & Management 46:5 (2010), 589–610.
13. Girju, R., Moldovan, D.I., et al. Text mining for causal relations. Proceedings of the flairs conference, 2002, 360–364.
14. Goldvarg, E., Johnson-Laird, P.N., Naive causality: A mental model theory of causal meaning and reasoning1. Cognitive Science 25:4 (2001), 565–610.
15. Gómez-Adorno, H., Posadas-Durán, J.-P., Sidorov, G., Pinto, D., Document embeddings learned on various types of n-grams for cross-topic authorship attribution. Computing 100:7 (2018), 741–756.
16. Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y., Deep learning. 1, 2016, MIT press Cambridge.
17. Hashimoto, C., Torisawa, K., Kloetzer, J., Sano, M., Varga, I., Oh, J.-H., Kidawara, Y., Toward future scenario generation: Extracting event causality exploiting semantic relation, context, and association features. Proceedings of the fifty second annual meeting of the association for computational linguistics (volume 1: Long papers), 1, 2014, 987–997.
18. Hashimoto, K., Miwa, M., Tsuruoka, Y., Chikayama, T., Simple customization of recursive neural networks for semantic relation classification. Proceedings of the conference on empirical methods in natural language processing, 2013, 1372–1376.
19. Hendrickx, I., Kim, S.N., Kozareva, Z., Nakov, P., Ó Séaghdha, D., Padó S., et al. Semeval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals. Proceedings of the workshop on semantic evaluations: Recent achievements and future directions, 2009, Association for Computational Linguistics, 94–99.
20. Higashinaka, R., Isozaki, H., Automatically acquiring causal expression patterns from relation-annotated corpora to improve question answering for why-questions. ACM Transactions on Asian Language Information Processing (TALIP), 7(2), 2008, 6.
21. Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. Computing Research Repository (CoRR), arXiv: 1207.0580.
22. Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., Weischedel, R., Ontonotes: the 90% solution. Proceedings of the human language technology conference of the NAACL, companion volume: Short papers, 2006, Association for Computational Linguistics, 57–60.
23. Inui, T., Inui, K., Matsumoto, Y., Acquiring causal knowledge from text using the connective marker tame. ACM Transactions on Asian Language Information Processing (TALIP) 4:4 (2005), 435–474.
24. Ittoo, A., Bouma, G., Extracting explicit and implicit causal relations from sparse, domain-specific texts. Proceedings of the International conference on application of natural language to information systems, 2011, Springer, 52–63.
25. Jensen, L.J., Saric, J., Bork, P., Literature mining for the biologist: From information retrieval to biological discovery. Nature Reviews Genetics, 7(2), 2006, 119.
26. Kalchbrenner, N., Grefenstette, E., Blunsom, P., A Convolutional Neural Network for Modelling Sentences. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2014, Association for Computational Linguistics, Baltimore, Maryland, 655–665.
27. Khoo, C.S., Kornfilt, J., Oddy, R.N., Myaeng, S.H., Automatic extraction of cause-effect information from newspaper text without knowledge-based inferencing. Literary and Linguistic Computing 13:4 (1998), 177–186.
28. Kim, J.-D., Ohta, T., Tsujii, J., Corpus annotation for mining biomedical events from literature. BMC Bioinformatics, 9(1), 2008, 10.
29. Kim, Y., Convolutional neural networks for sentence classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014, 1746–1751.
30. Kingsbury, P., Palmer, M., Propbank: The next level of treebank. Proceedings of the treebanks and lexical theories, 3, 2003, Citeseer.
31. Le, Q., Mikolov, T., Distributed representations of sentences and documents. Proceedings of the international conference on machine learning, 2014, 1188–1196.
32. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. Proceedings of the IEEE 86:11 (1998), 2278–2324.
33. Lee, J.Y., Dernoncourt, F., Szolovits, P., Mit at semeval-2017 task 10: Relation extraction with convolutional neural networks. Proceedings of the 11th International Workshop on Semantic Evaluations (SemEval-2017), 2017, Association for Computational Linguistics, 978–984.
34. Lee, K.C., Lee, S., A causal knowledge-based expert system for planning an internet-based stock trading system. Expert Systems with Applications 39:10 (2012), 8626–8635.
35. Mele, F., Sorgente, A., Ontotimefl–a formalism for temporal annotation and reasoning for natural language text. Proceedings of the new challenges in distributed information filtering and retrieval, 2013, Springer, 151–170.
36. Mikolov, T., Corrado, G., Chen, K., Dean, J., Efficient Estimation of Word Representations in Vector Space. Proceedings of the International Conference on Learning Representations (ICLR 2013), 2013, 1–12.
37. Mirza, P., Sprugnoli, R., Tonelli, S., Speranza, M., Annotating causality in the tempeval-3 corpus. Proceedings of the EACL workshop on computational approaches to causality in language (CAtoCL), 2014, 10–19.
38. Nguyen, T.H., Grishman, R., Relation extraction: Perspective from convolutional neural networks. Proceedings of the first workshop on vector space modeling for natural language processing, 2015, 39–48.
39. Pakray, P., Gelbukh, A., An open-domain cause-effect relation detection from paired nominals. Proceedings of the Mexican international conference on artificial intelligence, 2014, Springer, 263–271.
40. Peña, A., Sossa, H., Gutiérrez, A., Causal knowledge and reasoning by cognitive maps: Pursuing a holistic approach. Expert Systems with Applications 35:1–2 (2008), 2–18.
41. Posadas-Durán, J.-P., Gómez-Adorno, H., Sidorov, G., Batyrshin, I., Pinto, D., Chanona-Hernández, L., Application of the distributed document representation in the authorship attribution task for small corpora. Soft Computing 21:3 (2017), 627–639.
42. Radinsky, K., Davidovich, S., Markovitch, S., Learning causality for news events prediction. Proceedings of the twenty first international conference on world wide web, 2012, ACM, 909–918.
43. Riaz, M., Girju, R., Recognizing causality in verb-noun pairs via noun and verb semantics. Proceedings of the EACL workshop on computational approaches to causality in language (CAtoCL), 2014, 48–57.
44. Rink, B., Bejan, C.A., Harabagiu, S.M., Learning textual graph patterns to detect causal event relations. Proceedings of the flairs conference, 2010.
45. Rink, B., Harabagiu, S., UTD: Classifying semantic relations by combining lexical and semantic resources. Proceedings of the fifth international workshop on semantic evaluation, 2010, Association for Computational Linguistics, 256–259.
46. Ruppenhofer, J., Ellsworth, M., Petruck, M.R., Johnson, C.R., Scheffczyk, J., FrameNet II: Extended theory and practice. 2016, Institut für Deutsche Sprache, Bibliothek.
47. Santos, C.N.D., Xiang, B., Zhou, B., Classifying relations by ranking with convolutional neural networks. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2015, 626–634.
48. Schuler, K.K., VerbNet: A broad-coverage, comprehensive verb lexicon. Ph.D. thesis University of Pennsylvania, 2005.
49. Socher, R., Huval, B., Manning, C.D., Ng, A.Y., Semantic compositionality through recursive matrix-vector spaces. Proceedings of the joint conference on empirical methods in natural language processing and computational natural language learning, 2012, Association for Computational Linguistics, 1201–1211.
50. Sorgente, A., Vettigli, G., Mele, F., Automatic extraction of cause-effect relations in natural language text. CEUR Workshop Proceedings, Vol. 1109, 2013, CEUR-WS, 37–48.
51. Turian, J., Ratinov, L., Bengio, Y., Word representations: a simple and general method for semi-supervised learning. Proceedings of the forty eighth annual meeting of the association for computational linguistics, 2010, Association for Computational Linguistics, 384–394.
52. Wang, S., Zhe, Z., Kang, Y., Wang, H., Chen, X., An ontology for causal relationships between news and financial instruments. Expert Systems with Applications 35:3 (2008), 569–580.
53. Yang, X., Mao, K., Multi level causal relation identification using extended features. Expert Systems with Applications 41:16 (2014), 7171–7181.
54. Zeiler, M. D. (2012). Adadelta: an adaptive learning rate method. Computing Research Repository (CoRR), abs/1212.5,6. Retrieved from 1212.5701.
55. Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J., Relation classification via convolutional deep neural network. Proceedings of the COLING twenty fifth international conference on computational linguistics: Technical papers, 2014, 2335–2344.
56. Zhao, S., Liu, T., Zhao, S., Chen, Y., Nie, J.-Y., Event causality extraction based on connectives analysis. Neurocomputing 173 (2016), 1943–1950.