Closing the loop: Fast, interactive semi-supervised annotation with queries on features and instances

EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2011, Pages 1467-1478

  Settles, Burr ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; APPLICATION DOMAINS; SEMI-SUPERVISED; TRAINING ALGORITHMS; USER STUDY;

COMPUTATIONAL LINGUISTICS; LEARNING ALGORITHMS; USER INTERFACES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053225377     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. J. Attenberg, P. Melville, and F. Provost. 2010. A unified approach to active dual supervision for labeling features and examples. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD). Springer.
2. J. Baldridge and M. Osborne. 2004. Active learning and the total cost of annotation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 9-16. ACL Press.
3. J. Callan and M. Hoy. 2009. The clueweb09 dataset. http://lemurproject. org/clueweb09/.
4. A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E.R. Hruschka Jr., and T.M. Mitchell. 2010. Toward an architecture for never-ending language learning. In Proceedings of the Conference on Artificial Intelligence (AAAI), pages 1306-1313. AAAI Press.
5. F. Chang, J. Dean, S. Ghemawat, W.C. Hsieh, D.A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R.E. Gruber. 2008. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems, 26(2):1-26.
6. C.T. Chu, S.K. Kim, Y.A. Lin, Y. Yu, G. Bradski, A.Y. Ng, and K. Olukotun. 2007. Map-reduce for machine learning on multicore. In B. Schölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems, volume 19, pages 281-288. MIT Press.
7. W. Cohen and Y. Singer. 1996. Context-sensitive learning methods for text categorization. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, pages 307-315. ACM Press.
8. M. Craven, D. DiPasquo, D. Freitag, A. McCallum, T. Mitchell, K. Nigam, and S. Slattery. 1998. Learning to extract symbolic knowledge from the world wide web. In Proceedings of the National Conference on Artificial Intelligence (AAAI), pages 509-516. AAAI Press.
9. S. Della Pietra, V. Della Pietra, and J. Lafferty. 1997. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380-393.
10. G. Druck, G. Mann, and A. McCallum. 2008. Learning from labeled features using generalized expectation criteria. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, pages 595-602. ACM Press.
11. G. Druck, B. Settles, and A. McCallum. 2009. Active learning by labeling features. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 81-90. ACL Press.
12. N. Friedman, D. Geiger, and M. Goldszmidt. 1997. Bayesian network classifiers. Machine learning, 29(2):131-163.
13. S. Godbole, A. Harpale, S. Sarawagi, and S. Chakrabarti. 2004. Document classification through interactive supervision of document and term labels. In Proceedings of the Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD), pages 185-196. Springer.
14. M.A. Hearst. 1992. Automatic acquisition of hyponyms from large text corpora. In Proceedings of the Confer-ence on Computational Linguistics (COLING), pages 539-545. ACL.
15. D. Heckerman. 1995. A tutorial on learning with bayesian networks. Technical Report MSR-TR-95-06, Microsoft Research.
16. K. Lang. 1995. Newsweeder: Learning to filter netnews. In Proceedings of the International Conference on Machine Learning (ICML), pages 331-339. Morgan Kaufmann.
17. D. Lewis and J. Catlett. 1994. Heterogeneous uncertainty sampling for supervised learning. In Proceedings of the International Conference on Machine Learning (ICML), pages 148-156. Morgan Kaufmann.
18. B. Liu. 2010. Sentiment analysis and subjectivity. In N. Indurkhya and F.J. Damerau, editors, Handbook of Natural Language Processing,. CRC Press.
19. A. McCallum and K. Nigam. 1998. Employing EM in pool-based active learning for text classification. In Proceedings of the International Conference on Machine Learning (ICML), pages 359-367. Morgan Kaufmann.
20. P. Melville, W. Gryc, and R.D. Lawrence. 2009. Sentiment analysis of blogs by combining lexical knowledge with text classification. In Proceedings of the International Conference on Knowledge Discovery and Data Mining (KDD), pages 1275-1284. ACM Press.
21. S. Mohammad and T. Pedersen. 2004. Combining lexical and syntactic features for supervised word sense disambiguation. In Hwee Tou Ng and Ellen Riloff, editors, Proceedings of the Conference on Computational Natural Language Learning (CoNLL), pages 25-32. ACL Press.
22. I. Moulinier. 1996. A framework for comparing text categorization approaches. In Proceedings of the AAAI Symposium on Machine Learning in Information Access. AAAI Press.
23. A.Y. Ng and M. Jordan. 2002. On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes. In Advances in Neural Information Processing Systems (NIPS), volume 14, pages 841-848. MIT Press.
24. B. Pang, L. Lee, and S. Vaithyanathan. 2002. Thumbs up: Sentiment classification using machine learning techniques. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 79-86. ACL Press.
25. S. Petrović, M. Osborne, and V. Lavrenko. 2010. Streaming first story detection with application to Twitter. In Proceedings of the North American Association for Computational Linguistics (NAACL), pages 181-189. ACL Press.
26. H. Raghavan, O. Madani, and R. Jones. 2006. Active learning with feedback on both features and instances. Journal of Machine Learning Research, 7:1655-1686.
27. J.D. Rennie, L. Shih, J. Teevan, and D. Karger. 2003. Tackling the poor assumptions of naive bayes text classifiers. In Proceedings of the International Conference on Machine Learning (ICML), pages 285-295. Morgan Kaufmann.
28. E. Riloff and R. Jones. 1999. Learning dictionaries for information extraction by multi-level bootstrapping. In Proceedings of the Conference on Artificial Intelligence (AAAI), pages 474-479. AAAI Press.
29. A. Ritter, C. Cherry, and B. Dolan. 2010. Unsupervised modeling of Twitter conversations. In Proceedings of the North American Association for Computational Linguistics (NAACL), pages 172-180. ACL Press.
30. T. Rose, M. Stevenson, and M. Whitehead. 2002. The Reuters corpus vol. 1 from yesterday's news to tomorrow's language resources. In Proceedings of the Conference on Language Resources and Evaluation (LREC), pages 29-31.
31. F. Sebastiani. 2002. Machine learning in automated text categorization. ACM Computing Surveys, 34(1):1-47.
32. B. Settles. 2009. Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison.