Reducing the need for double annotation

ACL HLT 2011 - LAW 2011: 5th Linguistic Annotation Workshop, Proceedings

Volumn , Issue , 2011, Pages 65-73

  Dligach, Dmitriy ^a   Palmer, Martha ^b  

^a University of Colorado at Boulder   (United States)

^b UNIVERSITY OF COLORADO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTICS;

DATA MINING;

EID: 84874886406     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Steven Abney, Robert E. Schapire, and Yoram Singer. 1999. Boosting applied to tagging and pp attachment. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 38-45.
2. Chih-Chung Chang and Chih-Jen Lin, 2001. LIBSVM: A library for support vector machines.
3. Jinying Chen, Andrew Schein, Lyle Ungar, and Martha Palmer. 2006. An empirical study of the behavior of active learning for word sense disambiguation. In Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, pages 120-127, Morristown, NJ, USA. Association for Computational Linguistics.
4. Markus Dickinson. 2009. Correcting dependency annotation errors. In EACL '09: Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics, pages 193-201, Morristown, NJ, USA. Association for Computational Linguistics.
5. Dmitriy Dligach and Martha Palmer. 2008. Novel semantic features for verb sense disambiguation. In HLT '08: Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies, pages 29-32, Morristown, NJ, USA. Association for Computational Linguistics.
6. Eleazar Eskin. 2000. Detecting errors within a corpus using anomaly detection. In Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference, pages 148-153, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
7. Fumiyo Fukumoto and Yoshimi Suzuki. 2004. Correcting category errors in text classification. In COLING '04: Proceedings of the 20th international conference on Computational Linguistics, page 868, Morristown, NJ, USA. Association for Computational Linguistics.
8. Eduard Hovy, Mitchell Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel. 2006. Ontonotes: The 90% solution. In NAACL '06: Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX, pages 57-60, Morristown, NJ, USA. Association for Computational Linguistics.
9. Pei-Yun Hsueh, Prem Melville, and Vikas Sindhwani. 2009. Data quality from crowdsourcing: A study of annotation selection criteria. In HLT '09: Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing, pages 27-35, Morristown, NJ, USA. Association for Computational Linguistics.
10. Pavel Kv̌etǒn and Karel Oliva. 2002. (semi-)automatic detection of errors in pos-tagged corpora. In Proceedings of the 19th international conference on Computational linguistics, pages 1-7, Morristown, NJ, USA. Association for Computational Linguistics.
11. Zhang Le, 2004. Maximum Entropy Modeling Toolkit for Python and C++..
12. David D. Lewis andWilliam A. Gale. 1994. A sequential algorithm for training text classifiers. In SIGIR '94: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, pages 3-12, New York, NY, USA. Springer-Verlag New York, Inc.
13. Dingsheng Luo, Xinhao Wang, Xihong Wu, and Huisheng Chi. 2005. Learning outliers to refine a corpus for chinese webpage categorization. In ICNC (1), pages 167-178..
14. Mitchell P. Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of english: The penn treebank. Comput. Linguist., 19(2):313-330.
15. Tetsuji Nakagawa and Yuji Matsumoto. 2002. Detecting errors in corpora using support vector machines.In Proceedings of the 19th international conference on Computational linguistics, pages 1-7, Morristown, NJ, USA. Association for Computational Linguistics.
16. V́aclav Nov́ak and Magda Raźimov́a. 2009. Unsupervised detection of annotation inconsistencies using apriori algorithm. In ACL-IJCNLP '09: Proceedings of the Third Linguistic Annotation Workshop, pages 138-141, Morristown, NJ, USA. Association for Computational Linguistics.
17. Fredrik Olsson. 2009. A literature survey of active machine learning in the context of natural language processing. In Technical Report, Swedish Institute of Computer Science.
18. John C. Platt and John C. Platt. 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Advances in Large Margin Classifiers, pages 61-74. MIT Press.
19. Burr Settles. 2009. Active learning literature survey. In Computer Sciences Technical Report 1648 University of Wisconsin-Madison.
20. Victor S. Sheng, Foster Provost, and Panagiotis G. Ipeirotis. 2008. Get another label? improving data quality and data mining using multiple, noisy labelers. In KDD '08: Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 614-622, New York, NY, USA. ACM.
21. Rion Snow, Brendan O'Connor, Daniel Jurafsky, and Andrew Y. Ng. 2008. Cheap and fast-but is it good?: evaluating non-expert annotations for natural language tasks. In EMNLP '08: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 254-263, Morristown, NJ, USA. Association for Computational Linguistics.
22. Hans van Halteren. 2000. The detection of inconsistency in manually tagged text. In Proceedings of LINC-00, Luxembourg.
23. Z. Zhong, H.T. Ng, and Y.S. Chan. 2008. Word sense disambiguation using OntoNotes: An empirical study. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 1002- 1010. Association for Computational Linguistics.
24. Jingbo Zhu. 2007. Active learning for word sense disambiguation with methods for addressing the class imbalance problem. In In Proceedings of ACL, pages 783- 790.