Investigating the effects of selective sampling on the annotation task

CoNLL 2005 - Proceedings of the Ninth Conference on Computational Natural Language Learning

Volumn , Issue , 2005, Pages 144-151

  Hachey, Ben ^a   Alex, Beatrice ^a   Becker, Markus ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

ACTIVE LEARNING; DATA POINTS; HUMAN ANNOTATIONS; NAMED ENTITY RECOGNITION; POTENTIAL PROBLEMS; SELECTIVE SAMPLING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 37249016011     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1706543.1706569     Document Type: Conference Paper

References (18)

1. Shlomo Argamon-Engelson and Ido Dagan. 1999. Committee-based sample selection for probabilistic classifiers. Journal of Artificial Intelligence Research, 11:335-360.
2. Jason Baldridge and Miles Osborne. 2004. Ensemblebased active learning for parse selection. In Proceedings of the 5th Conference of the North American Chapter of the Association for Computational Linguistics.
3. Markus Becker, Ben Hachey, Beatrice Alex, and Claire Grover. 2005. Optimising selective sampling for bootstrapping named entity recognition. In ICML-2005 Workshop on Learning with Multiple Views.
4. Thorsten Brants. 2000. Inter-annotator agreement for a German newspaper corpus. In Proceedings of the 2nd International Conference on Language Resources and Evaluation (LREC-2000).
5. Jean Carletta, Amy Isard, Stephen Isard, Jacqueline C. Kowtko, Gwyneth Doherty-Sneddon, and Anne H. Anderson. 1997. The reliability of a dialogue structure coding scheme. Computational Linguistics, 23(1):13-31.
6. David. A. Cohn, Zoubin. Ghahramani, and Michael. I. Jordan. 1995. Active learning with statistical models. In G. Tesauro, D. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7, pages 705-712. The MIT Press.
7. Jenny Finkel, Shipra Dingare, Christopher Manning, Beatrice Alex Malvina Nissim, and Claire Grover. 2005. Exploring the boundaries: Gene and protein identification in biomedical text. BMC Bioinformatics. In press.
8. Rosie Jones, Rayid Ghani, Tom Mitchell, and Ellen Riloff. 2003. Active learning with multiple view feature sets. In ECML 2003 Workshop on Adaptive Text Extraction and Mining.
9. Jin-Dong Kim, Tomoko Ohta, Yoshimasa Tsuruoka, Yuka Tateisi, and Nigel Collier. 2004. Introduction to the bio-entity recognition task at JNLPBA. In Proceedings of the COLING 2004 International Joint Workshop on Natural Language Processing in Biomedicine and its Applications.
10. Dan Klein, Joseph Smarr, Huy Nguyen, and Christopher D. Manning. 2003. Named entity recognition with character-level models. In Proceedings the Seventh Conference on Natural Language Learning.
11. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1994. Building a large annotated corpus of English: The Penn treebank. Computational Linguistics, 19(2):313-330.
12. Andrew McCallum and Kamal Nigam. 1998. Employing EM and pool-based active learning for text classification. In Proceedings of the 15th International Conference on Machine Learning.
13. Grace Ngai and David Yarowsky. 2000. Rule writing or annotation: Cost-efficient resource usage for base noun phrase chunking. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics.
14. Patricia Robinson, Erica Brown, John Burger, Nancy Chinchor, Aaron Douthat, Lisa Ferro, and Lynette Hirschman. 1999. Overview: Information extraction from broadcast news. In Proceedings DARPA Broadcast News Workshop.
15. Erik F. Tjong Kim Sang. 2002. Introduction to the CoNLL-2002 shared task: Language-independent named entity recognition. In Proceedings of the 2002 Conference on Computational Natural Language Learning.
16. H. Sebastian Seung, Manfred Opper, and Haim Sompolinsky. 1992. Query by committee. In Computational Learning Theory.
17. Stephanie Strassel, Alexis Mitchell, and Shudong Huang. 2003. Multilingual resources for entity extraction. In Proceedings of the ACL 2003 Workshop on Multilingual and Mixed-language Named Entity Recognition.
18. Cynthia A. Thompson, Mary Elaine Califf, and Raymond J. Mooney. 1999. Active learning for natural language parsing and information extraction. In Proceedings of the 16th International Conference on Machine Learning.