Creating robust supervised classifiers via web-scale N-gram data

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2010-July, Issue , 2010, Pages 865-874

  Bergsma, Shane ^a   Pitler, Emily ^b   Lin, Dekang ^c  

^a UNIVERSITY OF ALBERTA   (Canada)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); NATURAL LANGUAGE PROCESSING SYSTEMS;

DATA SET; LABELED TRAINING DATA; N-GRAMS; NOUN COMPOUNDS; PART OF SPEECH; ROBUST PERFORMANCE; SPELLING CORRECTION; STATE OF THE ART; SUPERVISED CLASSIFIERS;

COMPUTATIONAL LINGUISTICS;

EID: 85118438759     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Nir Ailon and Mehryar Mohri. 2008. An efficient reduction of ranking to classification. In COLT.
2. Michele Banko and Eric Brill. 2001. Scaling to very very large corpora for natural language disambiguation. In ACL.
3. Cory Barr, Rosie Jones, and Moira Regelson. 2008. The linguistic structure of English web-search queries. In EMNLP.
4. Shane Bergsma, Dekang Lin, and Randy Goebel. 2009. Web-scale N-gram models for lexical disambiguation. In IJCAI.
5. John Blitzer, Mark Dredze, and Fernando Pereira. 2007. Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In ACL.
6. Thorsten Brants and Alex Franz. 2006. The Google Web 1T 5-gram Corpus Version 1.1. LDC2006T13.
7. Thorsten Brants, Ashok C. Popat, Peng Xu, Franz J. Och, and Jeffrey Dean. 2007. Large language models in machine translation. In EMNLP.
8. Thorsten Brants. 2000. TnT - a statistical part-of-speech tagger. In ANLP.
9. Andrew Carlson, Tom M. Mitchell, and Ian Fette. 2008. Data analysis project: Leveraging massive textual corpora using n-gram statistics. Technial Report CMU-ML-08-107.
10. Kenneth Church, Ted Hart, and Jianfeng Gao. 2007. Compressing trigram language models with Golomb coding. In EMNLP-CoNLL.
11. Hal Daumé III. 2007. Frustratingly easy domain adaptation. In ACL.
12. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research, 9.
13. Dan Gildea. 2001. Corpus variation and parser performance. In EMNLP.
14. Andrew R. Golding and Dan Roth. 1999. A Winnow-based approach to context-sensitive spelling correction. Machine Learning, 34(1-3):107-130.
15. Thorsten Joachims. 2002. Optimizing search engines using clickthrough data. In KDD.
16. Frank Keller and Mirella Lapata. 2003. Using the web to obtain frequencies for unseen bigrams. Computational Linguistics, 29(3):459-484.
17. Adam Kilgarriff and Gregory Grefenstette. 2003. Introduction to the special issue on the Web as corpus. Computational Linguistics, 29(3):333-347.
18. Seth Kulick, Ann Bies, Mark Liberman, Mark Mandel, Ryan McDonald, Martha Palmer, Andrew Schein, Lyle Ungar, Scott Winters, and Pete White. 2004. Integrated annotation for biomedical information extraction. In BioLINK 2004: Linking Biological Literature, Ontologies and Databases.
19. Mirella Lapata and Frank Keller. 2005. Web-based models for natural language processing. ACM Transactions on Speech and Language Processing, 2(1):1-31.
20. Mark Lauer. 1995a. Corpus statistics meet the noun compound: Some empirical results. In ACL.
21. Mark Lauer. 1995b. Designing Statistical Language Learners: Experiments on Compound Nouns. Ph.D. thesis, Macquarie University.
22. Dekang Lin, Kenneth Church, Heng Ji, Satoshi Sekine, David Yarowsky, Shane Bergsma, Kailash Patil, Emily Pitler, Rachel Lathbury, Vikram Rao, Kapil Dalwani, and Sushant Narsale. 2010. New tools for web-scale N-grams. In LREC.
23. Robert Malouf. 2000. The order of prenominal adjectives in natural language generation. In ACL.
24. Mitchell P. Marcus, Beatrice Santorini, and Mary Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2):313-330.
25. Mitchell P. Marcus. 1980. Theory of Syntactic Recognition for Natural Languages. MIT Press, Cambridge, MA, USA.
26. David McClosky, Eugene Charniak, and Mark Johnson. 2006. Reranking and self-training for parser adaptation. In COLING-ACL.
27. Margaret Mitchell. 2009. Class-based ordering of prenominal modifiers. In 12th European Workshop on Natural Language Generation.
28. Natalia N. Modjeska, Katja Markert, and Malvina Nissim. 2003. Using the Web in machine learning for other-anaphora resolution. In EMNLP.
29. Preslav Nakov and Marti Hearst. 2005. Search engine statistics beyond the n-gram: Application to noun compound bracketing. In CoNLL.
30. Preslav Ivanov Nakov. 2007. Using the Web as an Implicit Training Set: Application to Noun Compound Syntax and Semantics. Ph.D. thesis, University of California, Berkeley.
31. Xuan-Hieu Phan. 2006. CRFTagger: CRF English POS Tagger. crftagger.sourceforge.net.
32. Laura Rimell and Stephen Clark. 2008. Adapting a lexicalized-grammar parser to contrasting domains. In EMNLP.
33. James Shaw and Vasileios Hatzivassiloglou. 1999. Ordering among premodifiers. In ACL.
34. Yoshimasa Tsuruoka, Yuka Tateishi, Jin-Dong Kim, Tomoko Ohta, John McNaught, Sophia Ananiadou, and Jun'ichi Tsujii. 2005. Developing a robust part-of-speech tagger for biomedical text. In Advances in Informatics.
35. Peter D. Turney. 2006. Similarity of semantic relations. Computational Linguistics, 32(3):379-416.
36. David Vadas and James R. Curran. 2007a. Adding noun phrase structure to the Penn Treebank. In ACL.
37. David Vadas and James R. Curran. 2007b. Large-scale supervised models for noun phrase bracketing. In PACLING.
38. Xiaofeng Yang, Jian Su, and Chew Lim Tan. 2005. Improving pronoun resolution using statistics-based semantic compatibility information. In ACL.