Cause identification from aviation safety incident reports via weakly supervised semantic lexicon construction

Journal of Artificial Intelligence Research

Volumn 38, Issue , 2010, Pages 569-631

  Ul Abedin, Muhammad Arshad ^a   Ng, Vincent ^a   Khan, Latifur ^a  

^a The University of Texas at Dallas   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AVIATION SAFETY; BASELINE SYSTEMS; INCIDENT REPORTS; LEARNING PROCESS; LEARNING-BASED APPROACH; REPORTING SYSTEMS; SEMANTIC LEXICON; TEXT CLASSIFICATION; TRAINING DATA;

AVIATION;

TEXT PROCESSING;

EID: 77957878646     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.2986     Document Type: Article

References (72)

1. Ando, R. K. (2004). Semantic lexicon construction: Learning from unlabeled data via spectral analysis. In Proceedings of the 8th Conference on Computational Natural Language Learning, pp. 9-16.
2. Artstein, R., & Poesio, M. (2008). Inter-coder agreement for computational linguistics. Computional Linguistics, 34(4), 555-596.
3. Avancini, H., Lavelli, A., Sebastiani, F., & Zanoli, R. (2006). Automatic expansion of domain-specific lexicons by term categorization. ACM Transactions on Speech and Language Processing (TSLP), 3(1), 1-30.
4. Baker, L. D., & McCallum, A. K. (1998). Distributional clustering of words for text classification. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 96-103.
5. Banko, M., & Brill, E. (2001). Mitigating the paucity-of-data problem: Exploring the effect of training corpus size on classifier performance for natural language processing. In Proceedings of the 1st International Conference on Human Language Technology Research.
6. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022.
7. Brants, T., & Franz, A. (2006). Web 1T 5-gram Version 1. Linguistic Data Consortium, Philadelphia, USA.
8. Cheng, P. W. (1997). From covariation to causation: A causal power theory. Psychological Review, 104(2), 367-405.
9. Chinchor, N. (1992). The statistical significance of the MUC-4 results. In Proceedings of the 4th Message Understanding Conference, pp. 30-50.
10. Chinchor, N., Hirschman, L., & Lewis, D. D. (1993). Evaluating message understanding systems: An analysis of the Third Message Understanding Conference (MUC-3). Computational Linguistics, 19, 409-449.
11. Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273-1197
12. Crammer, K., & Singer, Y. (2002). On the algorithmic implementation of multiclass kernelbased vector machines. Journal of Machine Learning Research, 2, 265-292.
13. Curran, J. R., & Moens, M. (2002). Improvements in automatic thesaurus extraction. In Proceedings of the ACL 2002 Workshop on Unsupervised Lexical Acquisition, pp. 59-66.
14. Curran, J. R., Murphy, T., & Scholz, B. (2007). Minimising semantic drift with mutual exclusion bootstrapping. In Proceedings of the 10th Conference of the Pacific Association for Computational Linguistics, pp. 172-180.
15. Davidov, D., & Rappoport, A. (2006). Efficient unsupervised discovery of word categories using symmetric patterns and high frequency words. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics, pp. 297-304.
16. Dietterich, T. G. (1998). Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10(7), 1895-1923.
17. Dunning, T. (1993). Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1), 61-74.
18. Everitt, B. S. (1977). The Analysis of Contingency Tables. Chapman and Hall.
19. Ferryman, T. A., Posse, C., Rosenthal, L. J., Srivastava, A. N., & Statler, I. C. (2006). What happened, and why: Toward an understanding of human error based on automated analyses of incident reports Volume II. Tech. rep. NASA/TP-2006-213490, National Aeronautics and Space Administration.
20. Ganeri, J., Noordhof, P., & Ramachandran, M. (1996). Counterfactuals and preemptive causation. Analysis, 56(4), 219-225.
21. Garcia, D. (1997). COATIS, an NLP system to locate expressions of actions connected by causality links. In Proceedings of the 10th European Workshop on Knowledge Acquisition, Modeling and Mangement, pp. 347-352.
22. Girju, R. (2003). Automatic detection of causal relations for question answering. In Proceedings of the ACL 2003 Workshop on Multilingual Summarization and Question Answering, pp. 76-83.
23. Godbole, S., & Sarawagi, S. (2004). Discriminative methods for multi-labeled classification. In Proceedings of the 8th Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 22-30.
24. Griffiths, T. L., & Tenenbaum, J. B. (2005). Structure and strength in causal induction. Cognitive Psychology, 51, 334-384.
25. Grishman, R., & Ksiezyk, T. (1990). Causal and temporal text analysis: The role of the domain model. In Proceedings of the 13th International Conference on Computational Linguistics, pp. 126-131.
26. Halpern, J. Y., & Pearl, J. (2005). Causes and explanations: A structural-model approach. Part I: Causes. The British Journal for the Philosophy of Science, 56, 843-887. (Pubitemid 41795257)
27. Hassan, H., Hassan, A., & Emam, O. (2006). Unsupervised information extraction approach using graph mutual reinforcement. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pp. 501-508.
28. Hume, D. (1999 (Original work published 1748)). An Enquiry Concerning Human Understanding. Oxford University Press, USA.
29. Hume, D. (2000 (Original work published 1739)). A Treatise of Human Nature. Oxford University Press, USA.
30. Joachims, T. (1999). Advances in Kernel Methods - Support Vector Learning, chap. Making large-Scale SVM Learning Practical. MIT-Press.
31. Joachims, T. (1998). Text categorization with suport vector machines: Learning with many relevant features. In Proceedings of the 10th European Conference on Machine Learning, pp. 137-142.
32. Joachims, T. (1999). Transductive inference for text classification using support vector machines. In Proceedings of the 16th International Conference on Machine Learning, pp. 200-209.
33. Kaplan, R., & Berry-Rogghe, G. (1991). Knowledge-based acquisition of causal relationships in text. Knowledge Acquisition, 3(3), 317-337.
34. Kersey, C., Di Eugenio, B., Jordan, P., & Katz, S. (2009). KSC-PaL: A peer learning agent that encourages students to take the initiative. In Proceedings of the 4th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 55-63.
35. Khoo, C. S. G., Chan, S., & Niu, Y. (2000). Extracting causal knowledge from a medical database using graphical patterns. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics, pp. 336-343.
36. Ko, Y., Park, J., & Seo, J. (2004). Improving text categorization using the importance of sentences. Information Processing and Management, 40(1), 65-79.
37. Krippendorff, K. (2004). Content analysis: An introduction to its methodology. Sage Publications, Inc.
38. Lewis, D. (1973). Causation. Journal of Philosophy, 70(17), 556-567.
39. Lin, D. (1998). Dependency-based evaluation of MINIPAR. In Proceedings of the LREC Workshop on Evaluation of Parsing Systems, pp. 317-329.
40. Lin, D., & Pantel, P. (2001). Induction of semantic classes from natural language text. In Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 317-322.
41. Marcus, M. P., Santorini, B., & Marcinkiewicz, M. A. (1993). Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2), 313-330. Special Issue on Using Large Corpora.
42. McCallum, A., & Nigam, K. (1999). Text classification by bootstrapping with keywords, EM and shrinkage. In Proceedings of the ACL Workshop on Unsupervised Learning in Natural Language Processing, pp. 52-58.
43. Noreen, E. W. (1989). Computer-Intensive Methods for Testing Hypotheses : An Introduction. Wiley.
44. Pantel, P., & Lin, D. (2002). Discovering word senses from text. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 613-619.
45. Pantel, P., & Ravichandran, D. (2004). Automatically labeling semantic classes. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pp. 321-328.
46. Passonneau, R. (2004). Computing reliability for coreference annotation. In Proceedings of the Fourth International Conference on Language Resources and Evaluation, Vol.4, pp. 1503-1506.
47. Patwardhan, S., & Riloff, E. (2006). Learning domain-specific information extraction patterns from the web. In Proceedings of the COLING/ACL Workshop on Information Extraction Beyond The Document, pp. 66-73.
48. Patwardhan, S., & Riloff, E. (2007). Effective information extraction with semantic affinity patterns and relevant regions. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 717-727.
49. Pereira, F. C. N., Tishby, N., & Lee, L. (1993). Distributional clustering of English words. In Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics, pp. 183-190.
50. Phan, X.-H. (2006a). CRFChunker: CRF English Phrase Chunker. http://crfchunker. sourceforge.net/.
51. Phan, X.-H. (2006b). CRFTagger: CRF English POS Tagger. http://crftagger.sourceforge.net/.
52. Phillips, W., & Riloff, E. (2007). Exploiting role-identifying nouns and expressions for information extraction. In Proceedings of International Conference on Recent Advances in Natural Language Processing.
53. Polanyi, L., & Zaenen, A. (2006). Contextual valence shifters. In Computing Attitude and Affect in Text: Theory and Applications, pp. 1-10. Springer Verlag.
54. Posse, C., Matzke, B., Anderson, C., Brothers, A., Matzke, M., & Ferryman, T. (2005). Extracting information from narratives: An application to aviation safety reports. In Proceedings of the 2005 IEEE Aerospace Conference, pp. 3678-3690.
55. Read, J., Pfahringer, B., & Holmes, G. (2008). Multi-label classification using ensembles of pruned sets. In Proceedings of the 8th IEEE International Conference on Data Mining, pp. 995-1000.
56. Riloff, E. (1996). Automatically generating extraction patterns from untagged text. In Proceedings of the 13th National Conference on Artificial Intelligence, pp. 1044-1049.
57. Roark, B., & Charniak, E. (1998). Noun-phrase co-occurrence statistics for semi-automatic semantic lexicon construction. In Proceedings of the 17th International Conference on Computational Linguistics, pp. 1110-1116.
58. Rohwer, R., & Freitag, D. (2004). Towards full automation of lexicon construction. In Proceedings of the Computational Lexical Semantics Workshop at HLT-NAACL 2004, pp. 9-16.
59. Rychlý, P., & Kilgarriff, A. (2007). An efficient algorithm for building a distributional thesaurus (and other Sketch Engine developments). In Proceedings of the ACL 2007 Demo and Poster Sessions, pp. 41-44.
60. Sebastiani, F. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34(1), 1-47.
61. Sundheim, B. M. (1992). Overview of the fourth message understanding evaluation and conference. In Proceedings of the Fourth Message Understanding Conference, pp. 3- 21.
62. Tang, L., Rajan, S., & Narayanan, V. K. (2009). Large scale multi-label classification via metalabeler. In Proceedings of International World Wide Web Conference, pp. 211- 220.
63. Thelen, M., & Riloff, E. (2002). A bootstrapping method for learning semantic lexicons using extraction pattern contexts. In Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, pp. 214-221.
64. Tsoumakas, G., & Katakis, I. (2007). Multi-label classification: An overview. International Journal of Data Warehousing and Mining, 3(3), 1-13.
65. Tsoumakas, G., & Vlahavas, I. P. (2007). Random k -labelsets: An ensemble method for multilabel classification. In Proceedings of the 18th European Conference on Machine Learning, Vol.4701 of Lecture Notes in Computer Science, pp. 406-417.
66. Ueda, N., & Saito, K. (2002). Parametric mixture models for multi-labeled text. In Advances in Neural Information Processing Systems 15, pp. 721-728.
67. van Delden, S., & Gomez, F. (2004). Retrieving NASA problem reports: A case study in natural language information retrieval. Data and Knowledge Engineering, 48(2), 231-246.
68. Vapnik, V. N. (1998). Statistical Learning Theory. Wiley.
69. Yang, Y., & Pedersen, J. O. (1997). A comparative study on feature selection in text categorization. In Proceedings of the 14th International Conference on Machine Learning, pp. 412-420.
70. Yangarber, R. (2003). Counter-training in discovery of semantic patterns. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pp. 343-350.
71. Zaidan, O. F., Eisner, J., & Piatko, C. (2007). Using "annotator rationales" to improve machine learning for text categorization. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pp. 260-267.
72. Zhang, Q., Zhou, Y., Huang, X., & Wu, L. (2008). Graph mutual reinforcement based bootstrapping. Information Retrieval Technology, 4993/2008, 203-212.