Mining relational data from text: From strictly supervised to weakly supervised learning

Information Systems

Volumn 33, Issue 3, 2008, Pages 300-314

  Zhang, Zhu ^a  

^a UNIVERSITY OF ARIZONA   (United States)

Author keywords

Active learning; Bootstrapping; Information extraction; Random subspace method; Relation classification; Support vector machines

Indexed keywords

DATA STRUCTURES; LEARNING ALGORITHMS; SUPERVISED LEARNING; SUPPORT VECTOR MACHINES;

ACTIVE LEARNING; BOOTSTRAPPING; INFORMATION EXTRACTION; RANDOM SUBSPACE METHOD; RELATION CLASSIFICATION;

DATA MINING;

EID: 38349097381     PISSN: 03064379     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.is.2007.10.002     Document Type: Article

References (47)

1. H. Cunningham, D. Maynard, K. Bontcheva, V. Tablan, GATE: A framework and graphical development environment for robust NLP tools and applications, in: Proceedings of the 40th Anniversary Meeting of the Association for Computational Linguistics, 2002.
2. Zhou G., Su J., Zhang J., and Zhang M. Exploring various knowledge in relation extraction. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05), Association for Computational Linguistics (2005), Ann Arbor, Michigan 427-434
3. Zelenko D., Aone C., and Richardella A. Kernel methods for relation extraction. J. Mach. Learn. Res. 3 (2003) 1083-1106
4. A. Culotta, J. Sorensen, Dependency tree kernels for relation extraction, in: ACL, 2004, pp. 423-429.
5. Zhao S., and Grishman R. Extracting relations with integrated information using kernel methods. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05), Association for Computational Linguistics (2005), Ann Arbor, Michigan 419-426
6. B. Rosario, M. Hearst, Classifying semantic relations in bioscience text, in: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, 2004.
7. McDonald R., Pereira F., Kulick S., Winters S., Jin Y., and White P. Simple algorithms for complex relation extraction with applications to biomedical IE. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05), Association for Computational Linguistics (2005), Ann Arbor, Michigan 491-498
8. S. Brin, Extracting patterns and relations from the world wide web, in: WebDB Workshop at sixth International Conference on Extending Database Technology, EDBT'98, 1998.
9. E. Agichtein, L. Gravano, Snowball: Extracting relations from large plain-text collections, in: Proceedings of the Fifth ACM International Conference on Digital Libraries, 2000.
10. M. Banko, M.J. Cafarella, S. Soderland, M. Broadhead, O. Etzioni, Open information extraction from the web, in: IJCAI, 2007, pp. 2670-2676.
11. Sekine S. On-demand information extraction. Proceedings of the COLING/ACL on Main Conference Poster Sessions, Association for Computational Linguistics (2006), Morristown, NJ, USA 731-738
12. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines: And Other Kernel-based Learning Methods (2000), Cambridge University Press, Cambridge
13. Vapnik V.N. The Nature of Statistical Learning Theory (1995), Springer, New York
14. T. Joachims, Text categorization with support vector machines: learning with many relevant features, in: C. Nédellec, C. Rouveirol (Eds.), Proceedings of ECML-98, 10th European Conference on Machine Learning, vol. 1398, Chemnitz, DE, Springer Verlag, Heidelberg DE, 1998, pp. 137-142.
15. T. Kudo, Y. Matsumoto, Chunking with support vector machines, in: Proceedings of NAACL, 2001, pp. 192-199.
16. Lodhi H., Saunders C., Shawe-Taylor J., Cristianini N., and Watkins C. Text classification using string kernels. J. Mach. Learn. Res. 2 (2001) 419-444
17. Cancedda N., Gaussier E., Goutte C., and Renders J.M. Word sequence kernels. J. Mach. Learn. Res. 3 (2003) 1059-1082
18. Breiman L. Bagging predictors. Mach. Learn. 24 2 (1996) 123-140
19. Freund Y., and Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. System Sci. 55 1 (1997) 119-139
20. M. Banko, E. Brill, Scaling to very very large corpora for natural language disambiguation, in: Meeting of the Association for Computational Linguistics, 2001, pp. 26-33.
21. V. Ng, C. Cardie, Weakly supervised natural language learning without redundant views, in: HLT-NAACL 2003: Proceedings of the Main Conference, 2003, pp. 173-180.
22. Ho T.K. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20 8 (1998) 832-844
23. Breiman L. Random forests. Mach. Learn. 45 1 (2001) 5-32
24. Cohn D., Atlas L., and Ladner R. Improving generalization with active learning. Mach. Learn. 15 2 (1994) 201-221
25. C.A. Thompson, M.E. Califf, R.J. Mooney, Active learning for natural language parsing and information extraction, in: Proceedings of 16th International Conference on Machine Learning, Morgan Kaufmann, San Francisco CA, 1999, pp. 406-414.
26. D.D. Lewis, J. Catlett, Heterogeneous uncertainty sampling for supervised learning. in: W.W. Cohen, H. Hirsh (Eds.), Proceedings of ICML-94, 11th International Conference on Machine Learning, New Brunswick, US, Morgan Kaufmann Publishers, San Francisco, USA, 1994, pp. 148-156.
27. D.D. Lewis, W.A. Gale, A sequential algorithm for training text classifiers, in: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, Springer-Verlag, New York, Inc., 1994, pp. 3-12.
28. Freund Y., Seung H.S., Shamir E., and Tishby N. Selective sampling using the query by committee algorithm. Mach. Learn. 28 2-3 (1997) 133-168
29. Argamon-Engelson S., and Dagan I. Committee-based sample selection for probabilistic classifiers. J. Artif. Intell. Res. 11 (1999) 335-360
30. Tong S., and Koller D. Support vector machine active learning with applications to text classification. J. Mach. Learn. Res. 2 (2001) 45-66
31. Fujii A., Inui K., Tokunaga T., and Tanaka H. Selective sampling for example-based word sense disambiguation. Comput. Linguistics 24 4 (1998) 573-598
32. Ngai G., and Yarowsky D. Rule writing or annotation: Cost-efficient resource usage for base noun phrase chunking. Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (2000), Hong Kong, China 117-125
33. M. Sassano, An empirical study of active learning with support vector machines for japanese word segmentation, in: Proceedings of ACL-02, 40th Annual Meeting of the Association for Computational Linguistics, 2002.
34. Hwa R. Sample selection for statistical grammar induction. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) (2000), Hong Kong, China 45-52
35. J. Baldridge, M. Osborne, Active learning for HPSG parse selection, in: Proceedings of the seventh Conference on Natural Language Learning, 2003.
36. M. Tang, X. Luo, S. Roukos, Active learning for statistical natural language parsing, in: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), 2002, pp. 120-127.
37. X. Zhu, Semi-supervised learning literature survey. Technical Report 1530, Computer Sciences, University of Wisconsin-Madison. 〈http://www.cs.wisc.edu/∼jerryzhu/pub/ssl_survey.pdf〉.
38. D. Yarowsky, Unsupervised word sense disambiguation rivaling supervised methods, in: Meeting of the Association for Computational Linguistics,1995, pp. 189-196.
39. Abney S. Understanding the Yarowsky algorithm. Comput. Linguistics 30 3 (2004)
40. Blum A., and Mitchell T. Combining labeled and unlabeled data with co-training. COLT: Proceedings of the Workshop on Computational Learning Theory (1998), Morgan Kaufmann Publishers, Los Altos, CA
41. M. Collins, Y. Singer, Unsupervised models for named entity classification, in: EMNLP/VLC-99, 1999.
42. Goldman S., and Zhou Y. Enhancing supervised learning with unlabeled data. Proceedings of the 17th International Conference on Machine Learning (2000), Morgan Kaufmann, San Francisco, CA 327-334
43. Muslea I., Minton S., and Knoblock C.A. Selective sampling with redundant views. Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence (2000), AAAI Press/The MIT Press, New York, Cambridge 621-626
44. E. Charniak, A maximum-entropy-inspired parser, Technical Report CS-99-12, Computer Scicence Department, Brown University, 1999.
45. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines. Software available at, 〈 http://www.csie.ntu.edu.tw/∼cjlin/libsvm〉, 2001.
46. S. Abney, Bootstrapping, in: Proceedings of ACL-02, 40th Annual Meeting of the Association for Computational Linguistics, 2002.
47. Balcan M.-F., Blum A., and Yang K. Co-training and expansion: towards bridging theory and practice. In: Saul L.K., Weiss Y., and Bottou L. (Eds). Advances in Neural Information Processing Systems vol. 17 (2005), MIT Press, Cambridge, MA 489-496