Active learning for word sense disambiguation with methods for addressing the class imbalance problem

EMNLP-CoNLL 2007 - Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning

Volumn , Issue , 2007, Pages 783-800

  Zhu, Jingbo ^a   Hovy, Eduard ^b  

^a NORTHEASTERN UNIVERSITY   (China)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; CLASS IMBALANCE PROBLEMS; IMBALANCE PROBLEM; LOWER BOUNDS; OVER SAMPLING; RESAMPLING TECHNIQUE; UNDER-SAMPLING; UPPER BOUND; WORD-SENSE DISAMBIGUATION;

COMPUTATIONAL LINGUISTICS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053363150     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (52)

1. A. L. Berger, S. A. Della, and V. J Della. 1996. A maximum entropy approach to natural language processing. Computational Linguistics 22(1):39-71.
2. E Brill. 1992. A simple rule-based part of speech tagger. In the Proceedings of the Third Conference on Applied Natural Language Processing.
3. Y. S. Chan and H. T. Ng. 2006. Estimating class priors in domain adaptation. In Proc. of ACL06.
4. N. Chawla, K. Bowyer, L. Hall, W. Kegelmeyer. 2002. SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 2002(16): 321-357. (Pubitemid 43057176)
5. J. Chen, A. Schein, L. Ungar, M. Palmer. 2006. An empirical study of the behavior of active learning for word sense disambiguation. In Proc. of HLT-NAACL06.
6. I. Dagan, O. Glickman, A. Gliozzo, E. Marmorshtein, and C. Strapparava. 2006. Direct Word Sense Matching for Lexical Substitution. In Proc. of ACL'06.
7. H. T. Dang and M. Palmer. 2005. The Role of Semantic Roles in Disambiguating Verb Senses. In Proc. of ACL'05.
8. A. Estabrooks, T. Jo and N. Japkowicz. 2004. A multiple resampling method for learning from imbalanced data set. Computational Intelligence, 20(1):18-36.
9. Y. Hamamoto, S. Uchimura and S. Tomita. 1997. A bootstrap technique for nearest neighbor classifier design. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(1):73-79. (Pubitemid 127762882)
10. V. Hoste, A. Kool, and W. Daelemans. 2001. Classifier optimization and combination in the English all words task. In Proc. of the SENSEVAL-2 workshop.
11. E. Hovy, M. Marcus, M. Palmer, L. Ramshaw and R. Weischedel. 2006. Ontonotes: The 90% Solution. In Proc. of HLT-NAACL06.
12. N. Ide and J. Veronis. 1998. Introduction to the special issue on word sense disambiguation: the state of the art. Computational Linguistics, 24(1):1-37.
13. N. Japkowicz and S. Stephen. 2002. The class imbalance problem: a systematic study. Intelligent Data Analysis, 6(5):429-450.
14. T. Jo and N. Japkowicz. 2004. Class imbalances versus small disjuncts. SIGKSS Explorations, 6(1):40-49.
15. U. S. Kohomban and W. S. Lee. 2005. Learning Semantic Classes for Word Sense Disambiguation. In Proc. of ACL'05.
16. M. Kubat and S. Matwin. 1997. Addressing the curse of imbalanced training sets: one-sided selection. In Proc. of ICML97.
17. Y.K. Lee and H.T. Ng. 2002. An empirical evaluation of knowledge sources and learning algorithm for word sense disambiguation. In Proc. of EMNLP-2002.
18. D. D. Lewis and W. A. Gale. 1994. A sequential algorithm for training text classifiers. In Proc. of SIGIR-94.
19. D.D. Lewis and J. Catlett. 1994. Heterogeneous uncertainty sampling for supervised learning. In Proc. of ICML94.
20. M. Marcus, B. Santorini, and M. A. Marcinkiewicz. 1993. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics, 19(2):313-330.
21. th ICML.
22. D. McCarthy, R. Koeling, J. Weeds, and J. Carroll. 2004. Finding predominant senses in untagged text. In Proc. of ACL04.
23. I. Muslea, S. Minton, and C. A. Knoblock. 2000. Selective sampling with redundant views. In Proc. of National Conference on Artificial Intelligence.
24. I. Tomek. 1976. Two modifications of CNN. IEEE Transactions on Systems, Man and Cybernetics, 6(6):769-772.
25. G. M. Weiss. 2004. Mining with rarity - problems and solutions: a unifying framework. SIGKDD Explorations, 6(1):7-19.
26. N. Xue, J. Chen and M. Palmer. 2006. Aligning Features with Sense Distinction Dimensions. In Proc. of ACL'06.
27. Z. Zhou, X. Liu. 2006. Training cost-sensitive neural networks with methods addressing the class imbalance problem. IEEE Transactions on Knowledge and Data Engineering, 18(1):63-77. (Pubitemid 43145089)
28. L. Zhang, J. Zhu, and T. Yao. 2004. An evaluation of statistical spam filtering techniques. ACM Transactions on Asian Language Information Processing, 3(4):243-269. (Pubitemid 40155221)
29. C. Zhang and T. Chen. 2002. An active learning framework for content-based information retrieval. IEEE Transactions on Multimedia, 4(2):260-268.
30. Y. Altun, D. McAllester, and M. Belkin. 2005. Maximum Margin Semi-Supervised Learning for Structured Variables. In Proc. of NIPS*2005.
31. R. Ando and T. Zhang. 2005. A High-Performance Semi-Supervised Learning Method for Text Chunking. In Proc. of ACL-2005, pages 1-9.
32. U. Brefeld and T. Scheffer. 2006. Semi-Supervised Learning for Structured Output Variables. In Proc. of ICML-2006.
33. H. L. Chieu and Hwee T. Ng. 2003. Named Entity Recognition with a Maximum Entropy Approach. In Proc. of CoNLL-2003, pages 160-163.
34. A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977. Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society, Series B, 39:1-38.
35. R. Florian, A. Ittycheriah, H. Jing, and T. Zhang. 2003. Named Entity Recognition through Classifier Combination. In Proc. of CoNLL-2003, pages 168-171.
36. A. Fujino, N. Ueda, and K. Saito. 2005. A Hybrid Generative/ Discriminative Approach to Semi-Supervised Classifier Design. In Proc. of AAAI-05, pages 764- 769. (Pubitemid 43006701)
37. Y. Grandvalet and Y. Bengio. 2004. Semi-Supervised Learning by Entropy Minimization. In Proc. of NIPS*2004, pages 529-536.
38. F. Jiao, S. Wang, C.-H. Lee, R. Greiner, and D. Schuurmans. 2006. Semi-Supervised Conditional Random Fields for Improved Sequence Segmentation and Labeling. In Proc. of COLING/ACL-2006, pages 209- 216.
39. T. Kudo and Y. Matsumoto. 2001. Chunking with Support Vector Machines. In Proc. of NAACL 2001, pages 192-199.
40. J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proc. of ICML-2001, pages 282-289.
41. W. Li and A. McCallum. 2005. Semi-Supervised Sequence Modeling with Syntactic Topic Models. In Proc. of AAAI-2005, pages 813-818. (Pubitemid 43006709)
42. D. C. Liu and J. Nocedal. 1989. On the Limited Memory BFGS Method for Large Scale Optimization. Math. Programming, Ser. B, 45(3):503-528. (Pubitemid 20660315)
43. K. Nigam, A. McCallum, S. Thrun, and T. Mitchell. 2000. Text Classification from Labeled and Unlabeled Documents using EM. Machine Learning, 39:103- 134. (Pubitemid 30594822)
44. R. Raina, Y. Shen, A. Y. Ng, and A. McCallum. 2003. Classification with Hybrid Generative/Discriminative Models. In Proc. of NIPS*2003.
45. F. Sha and F. Pereira. 2003. Shallow Parsing with Conditional Random Fields. In Proc. of HLT/NAACL-2003, pages 213-220.
46. A. Smith, T. Cohn, and M. Osborne. 2005. Logarithmic Opinion Pools for Conditional Random Fields. In Proc. of ACL-2005, pages 10-17.
47. C. Sutton, M. Sindelar, and A. McCallum. 2006. Reducing Weight Under training in Structured Discriminative Learning. In Proc. of HTL-NAACL 2006, pages 89-95.
48. J. Suzuki, E. McDermott, and H. Isozoki. 2006. Training Conditional Random Fields with Multivariate Evaluation Measure. In Proc. of COLING/ACL-2006, pages 217-224.
49. E. F. Tjong Kim Sang and S. Buchholz. 2000. Introduction to the CoNLL-2000 Shared Task: Chunking. In Proc. of CoNLL-2000 and LLL-2000, pages 127-132.
50. E. T. Tjong Kim Sang and F. De Meulder. 2003. Introduction to the CoNLL-2003 Shared Task: Language- Independent Named Entity Recognition. In Proc. of CoNLL-2003, pages 142-147.
51. T. Zhang, F. Damerau, and D. Johnson. 2002. Text Chunking based on a Generalization of Winnow. Machine Learning Research, 2:615-637. (Pubitemid 135712575)
52. X. Zhu, Z. Ghahramani, and J. Lafferty. 2003. Semi- Supervised Learning using Gaussian Fields and Harmonic Functions. In Proc.of ICML-2003, pages 912- 919.