Reducing class imbalance during active learning for named entity annotation

K-CAP'09 - Proceedings of the 5th International Conference on Knowledge Capture

Volumn , Issue , 2009, Pages 105-112

  Tomanek, Katrin ^a   Hahn, Udo ^a  

^a FRIEDRICH SCHILLER UNIVERSITY JENA   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; CLASS IMBALANCE; DATA SETS; F-SCORE; LOW FREQUENCY; NAMED ENTITIES; NAMED ENTITY RECOGNITION; NATURAL LANGUAGE PROCESSING; PERFORMANCE OF CLASSIFIER; POOR PERFORMANCE; SKEWED DATA; TRAINING MATERIAL;

CLASSIFIERS; COMPUTATIONAL LINGUISTICS; LEARNING SYSTEMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 70449647082     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1597735.1597754     Document Type: Conference Paper

References (20)

1. A. Berger, S. Della Pietra, and V. Della Pietra. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71, 1996.
2. M. Bloodgood and V. Shanker. Taking into account the differences between actively and passively acquired data: The case of active learning with support vector machines for imbalanced datasets. In Proc. of the NAACL-HLT '09, pages 137-140, 2009.
3. N. Chawla, K. Bowyer, L. Hall, and W. Kegelmeyer. SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16:321-357, 2002.
4. D. Cohn, Z. Ghahramani, and M. Jordan. Active learning with statistical models. Journal of Artificial Intelligence Research, 4:129-145, 1996.
5. C. Elkan. The foundations of cost-sensitive learning. In Proc. of the IJCAI '01, pages 973-978, 2001.
6. S. Engelson and I. Dagan. Minimizing manual annotation cost in supervised training from corpora. In Proc. of the ACL '96, pages 319-326, 1996.
7. S. Ertekin, J. Huang, L. Bottou, and L. Giles. Learning on the border: Active learning in imbalanced data classification. In Proc. of the CIKM '07, pages 127-136, 2007.
8. Y. Freund, H. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. Machine Learning, 28(2-3):133-168, 1997.
9. U. Hahn, E. Beisswanger, E. Buyko, M. Poprat, K. Tomanek, and J. Wermter. Semantic annotations for biology: A corpus development initiative at the Jena University Language & Information Engineering Lab. In Proc. of the LREC '08, 2008.
10. R. Hwa. Sample selection for statistical parsing. Computational Linguistics, 30(3):253-276, 2004.
11. N. Japkowicz and S. Stephen. The class imbalance problem: A systematic study. Intelligent Data Analysis, 6(5):429-449, 2002.
12. S. Kulick, A. Bies, M. Liberman, M. Mandel, R. T. McDonald, M. S. Palmer, and A. I. Schein. Integrated annotation for biomedical information extraction. In Proc. of the HLT-NAACL '04 Workshop 'Linking Biological Literature, Ontologies and Databases: Tools for Users', pages 61-68, 2004.
13. J. Lafferty, A. McCallum, and F. Pereira. Conditional Random Fields: Probabilistic models for segmenting and labeling sequence data. In Proc. of the ICML '01, pages 282-289, 2001.
14. D. D. Lewis and W. A. Gale. A sequential algorithm for training text classifiers. In Proc. of the SIGIR '94, pages 3-12, 1994.
15. G. Ngai and D. Yarowsky. Rule writing or annotation: Cost-efficient resource usage for base noun phrase chunking. In Proc. of the ACL '00, pages 117-125, 2000.
16. F. Provost. Machine learning from imbalanced data sets 101 (extended abstract). In Proc. of the AAAI '00 Workshop on Learning from Imbalanced Data Sets, 2000.
17. E. Ringger, P. McClanahan, R. Haertel, G. Busby, M. Carmen, J. Carroll, K. Seppi, and D. Lonsdale. Active learning for part-of-speech tagging: Accelerating corpus annotation. In Proc. of the Linguistic Annotation Workshop at ACL '07, pages 101-108, 2007.
18. K. Tomanek, F. Laws, U. Hahn, and H. Schütze. On proper unit selection in Active Learning: Co-selection effects for named entity recognition. In Proc. of the NAACL-HLT '09 Workshop 'Active Learning for NLP', pages 9-17, 2009.
19. K. Tomanek, J. Wermter, and U. Hahn. An approach to text corpus construction which cuts annotation costs and maintains corpus reusability of annotated data. In Proc. of the EMNLP-CoNLL '07, pages 486-495, 2007.
20. J. Zhu and E. Hovy. Active learning for word sense disambiguation with methods for addressing the class imbalance problem. In Proc. of the EMNLP-CoNLL '07, pages 783-790, 2007.