Approximating learning curves for active-learning-driven annotation

Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

Volumn , Issue , 2008, Pages 1319-1324

  Tomanek, Katrin ^a   Hahn, Udo ^a  

^a FRIEDRICH SCHILLER UNIVERSITY JENA   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

GOLD;

ACTIVE LEARNING; CLASSIFIER PERFORMANCE; COMMITTEE MEMBERS; GOLD STANDARDS; LEARNING CURVES; NAMED ENTITY RECOGNITION; STATISTICAL LEARNING METHODS; TRAINING MATERIAL;

ARTIFICIAL INTELLIGENCE;

EID: 84975522959     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Adam L. Berger, Stephen A. Della Pietra, and Vincent J. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71.
2. Lynn Carlson, Daniel Marcu, and Mary Ellen Okurowski. 2003. Building a discourse-tagged corpus in the framework of Rhetorical Structure Theory. In Jan van Kuppevelt and Ronnie Smith, editors, Current Directions in Discourse and Dialogue, pages 85-112. Dordrecht: Kluwer Academic.
3. David A. Cohn, Zoubin Ghahramani, and Michael I. Jordan. 1996. Active Learning with statistical models. Journal of Artifical Intelligence Research, 4:129-145.
4. Sean Engelson and Ido Dagan. 1996. Minimizing manual annotation cost in supervised training from corpora. In ACL'96 - Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics, pages 319-326. University of California at Santa Cruz, CA, USA, 24-27 June 1996.
5. Udo Hahn, Elena Beisswanger, Ekaterina Buyko, Michael Poprat, Katrin Tomanek, and Joachim Wermter. 2008. Semantic annotations for biology: A corpus development initiative at the Jena University Language & Information Engineering (Julie) Lab. In LREC 2008 - Proceedings of the 6th International Conference on Language Resources and Evaluation. Marrakech, Morocco, June 28-30, 2008. Paris: European Language Resources Association (ELRA). (this volume).
6. Rebecca Hwa. 2001. On minimizing training corpus for parser acquisition. In CoNLL-2001 - Proceedings of the 5th Natural Language Learning Workshop, pages 84-89. Toulouse, France, 6-7 July 2001.
7. Seth Kulick, Ann Bies, Mark Liberman, Mark Mandel, Ryan McDonald, Martha Palmer, Andrew Schein, Lyle Ungar, Scott Winters, and Pete White. 2004. Integrated annotation for biomedical information extraction. In BioLink 2004 - Proceedings of the HLT-NAACL 2004 Workshop 'Linking Biological Literature, Ontologies and Databases: Tools for Users', pages 61-68. Boston, MA, USA, May 2004.
8. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML-2001 - Proceedings of the 18th International Conference on Machine Learning, pages 282-289. Williams College, MA, USA, June 28 - July 1, 2001.
9. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: The PENN TREEBANK. Computational Linguistics, 19(2):313-330.
10. Eleni Miltsakaki, Livio Robaldo, Alan Lee, and Aravind Joshi. 2008. Sense annotation in the Penn Discourse Treebank. In Alexander F. Gelbukh, editor, CICLing 2008 - Proceedings of the 9th International Conference on Computational Linguistics and Intelligent Text Processing, pages 275-286. Haifa, Israel, February 17-23, 2008. Berlin: Springer.
11. Grace Ngai and David Yarowsky. 2000. Rule writing or annotation: Cost-efficient resource usage for base noun phrase chunking. In ACL'00 - Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics, pages 117-125. Hong Kong, China, 1-8 August 2000.
12. Tomoko Ohta, Yuka Tateisi, and Jin-Dong Kim. 2002. The Genia corpus: An annotated research abstract corpus in molecular biology domain. In HLT 2002 - Human Language Technology Conference. Proceedings of the 2nd International Conference on Human Language Technology Research, pages 82-86. San Diego, CA, USA, March 24-27, 2002.
13. Martha Palmer, Daniel Gildea, and Paul Kingsbury. 2005. The Proposition Bank: An annotated corpus of semantic roles. Computational Linguistics, 31(1):71-106.
14. James Pustejovsky, Patrick Hanks, Roser Saurí, Andrew See, Robert Gaizauskas, Andrea Setzer, Dragomir Radev, Beth Sundheim, David Day, Lisa Ferro, and Marcia Lazo. 2003. The TimeBank corpus. In Proceedings of the Corpus Linguistics 2003 Conference, pages 647-656. Lancaster University, U. K., 28-31 March 2003.
15. Greg Schohn and David Cohn. 2000. Less is more: Active Learning with Support Vector Machines. In ICML 2000 - Proceedings of the 17th International Conference on Machine Learning, pages 839-846. Stanford, CA, USA, June 29 - July 2, 2000.
16. H. Sebastian Seung, Manfred Opper, and Haim Sompolinsky. 1992. Query by committee. In COLT'92 - Proceedings of the 5th Annual Conference on Computational Learning Theory, pages 287-294. Pittsburgh, PA, USA, July 27-29, 1992. New York, NY: ACM Press.
17. Erik F. Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the CoNLL-2003 shared task: Languageindependent named entity recognition. In CoNLL-2003 - Proceedings of the 7th Conference on Computational Natural Language Learning, pages 142-147. Edmonton, Canada, 2003.
18. Katrin Tomanek, Joachim Wermter, and Udo Hahn. 2007a. An approach to text corpus construction which cuts annotation costs and maintains reusability of annotated data. In EMNLP-CoNLL 2007 - Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 486-495. Prague, Czech Republic, June 28-30, 2007.
19. Katrin Tomanek, Joachim Wermter, and Udo Hahn. 2007b. Efficient annotation with the Jena ANnotation Environment (JANE). In The LAW at ACL 2007 - Proceedings of the Linguistic Annotation Workshop, pages 9-16. Prague, Czech Republic, June 28-29, 2007.
20. Andreas Vlachos. 2008. A stopping criterion for active learning. Computer Speech and Language, 22:295-312.
21. Jingbo Zhu, Huizhen Wang, and Eduard Hovy. 2008. Learning a stopping criterion for Active Learning for word sense disambiguation and text classification. In IJCNLP 2008 - Proceedings of the 3rd International Joint Conference on Natural Language Processing, pages 366-372. Hyderabad, India, January 7-12, 2008.