Labeling the languages of words in mixed-language documents using weakly supervised methods

NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 1110-1119

  King, Ben ^a   Abney, Steven ^b  

^a The Department of Civil and Environmental Engineering   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LABELINGS; MONOLINGUAL TEXTS; RANDOM FIELD MODEL; SEQUENCE LABELING; SUPERVISED METHODS; TRAINING DATA;

EID: 84904535805     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Marco Baroni and Silvia Bernardini. 2004. Bootcat: Bootstrapping corpora and terms from the web. In Proceedings of the Fourth International Conference on Langauge Resources and Evaluation (LREC 2004), volume 4, pages 1313-1316, Lisbon, Portugal.
2. Kenneth R. Beesley. 1988. Language identifier: A computer program for automatic natural-language identification of on-line text. In Proceedings of the 29th Annual Conference of the American Translators Association, volume 47, page 54.
3. Kedar Bellare, Gregory Druck, and Andrew McCallum. 2009. Alternating projections for learning with expectation constraints. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, pages 43-50. AUAI Press.
4. William B. Cavnar and John M. Trenkle. 1994. Ngram-based text categorization. In Proceedings of the Third Annual Symposium on Document Analysis and Information (SDAIR 94), pages 161-175, Las Vegas, Nevada.
5. Ming-Wei Chang, Lev Ratinov, and Dan Roth. 2007. Guiding semi-supervision with constraintdriven learning. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 280-287, Prague, Czech Republic, June. Association for Computational Linguistics.
6. Chyng-Leei Chu, Dau-cheng Lyu, and Ren-yuan Lyu. 2007. Language identification on code-switching speech. In Proceedings of ROCLING.
7. Michael Collins and Yoram Singer. 1999. Unsupervised models for named entity classification. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 100-110.
8. Arthur P. Dempster, Nan M. Laird, and Donald B. Rubin. 1977. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological), pages 1-38.
9. Gregory Druck, Gideon Mann, and Andrew McCallum. 2008. Learning from labeled features using generalized expectation criteria. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR 2008), pages 595-602. ACM.
10. Ph. D. Thesis, University of Massachusetts Amherst
11. Gregory Druck. 2011. Generalized Expectation Criteria for Lightly Supervised Learning. Ph. D. Thesis, University of Massachusetts Amherst. Ted Dunning. 1994. Statistical identification of language. Technical report.
12. Kuzman Ganchev, Jõao Graca, Jennifer Gillenwater, and Ben Taskar. 2010. Posterior regularization for structured latent variable models. The Journal of Machine Learning Research, 11:2001-2049.
13. Aria Haghighi and Dan Klein. 2006. Prototype-driven learning for sequence models. In Proceedings of the Human Language Technology Conference of the NAACL, Main Conference, pages 320-327, New York City, USA, June. Association for Computational Linguistics.
14. A. S. House and E. P. Neuburg. 1977. Toward automatic identification of the language of an utterance. i. preliminary methodological considerations. The Journal of the Acoustical Society of America, 62:708.
15. Baden Hughes, Timothy Baldwin, Steven Bird, Jeremy Nicholson, and Andrew MacKinlay. 2006. Reconsidering language identification for written language resources. In Proc. International Conference on Language Resources and Evaluation, pages 485-488.
16. Aravind K. Joshi. 1982. Processing of sentences with intra-sentential code-switching. In Proceedings of the 9th conference on Computational linguistics-Volume 1, pages 145-150. Academia Praha.
17. Jan Landsbergen. 1989. The rosetta project. pages 82-87, Munich, Germany.
18. Dau-Cheng Lyu and Ren-Yuan Lyu. 2008. Language identification on code-switching utterances using multiple cues. In Ninth Annual Conference of the International Speech Communication Association.
19. Gideon S. Mann and Andrew McCallum. 2008. Generalized expectation criteria for semi-supervised learning of conditional random fields. In Proceedings of ACL-08: HLT, pages 870-878, Columbus, Ohio, June. Association for Computational Linguistics.
20. Gideon S. Mann and Andrew McCallum. 2010. Generalized expectation criteria for semi-supervised learning with weakly labeled data. The Journal of Machine Learning Research, pages 955-984.
21. Andrew McCallum. 2002. Mallet: A machine learning for language toolkit. http://mallet. cs. umass. edu.
22. Arjen Poutsma. 2002. Applying monte carlo techniques to language identification. Language and Computers, 45(1):179-189.
23. Sunita Sarawagi and William W. Cohen. 2004. Semimarkov conditional random fields for information extraction. Advances in Neural Information Processing Systems (NIPS 2004), 17:1185-1192.
24. Kevin P. Scannell. 2007. The cŕubadán project: Corpus building for under-resourced languages. In Building and Exploring Web Corpora: Proceedings of the 3rd Web as Corpus Workshop, volume 4, pages 5-15, Louvain-la-Neuve, Belgium.
25. Sameer Singh, Dustin Hillard, and Chris Leggetter. 2010. Minimally-supervised extraction of entities from text advertisements. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 73-81, Los Angeles, California, June. Association for Computational Linguistics.
26. Noah A. Smith and Jason Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05), pages 354-362, Ann Arbor, Michigan, June. Association for Computational Linguistics.
27. Thamar Solorio and Yang Liu. 2008. Learning to predict code-switching points. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 973-981, Honolulu, Hawaii, October. Association for Computational Linguistics.
28. Erik F. Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the conll-2003 shared task: Languageindependent named entity recognition. In Walter Daelemans and Miles Osborne, editors, Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, pages 142-147.
29. Fei Xia, William Lewis, and Hoifung Poon. 2009. Language ID in the context of harvesting language data off the web. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), pages 870-878, Athens, Greece, March. Association for Computational Linguistics