Twitter part-of-speech tagging for all: Overcoming sparse and noisy data

International Conference Recent Advances in Natural Language Processing, RANLP

Volumn , Issue , 2013, Pages 198-206

  Derczynski, Leon ^a   Ritter, Alan ^b   Clark, Sam ^b   Bontcheva, Kalina ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; NATURAL LANGUAGE PROCESSING SYSTEMS; SOCIAL NETWORKING (ONLINE); SPEECH;

IMPROVE PERFORMANCE; PART OF SPEECH; PART OF SPEECH TAGGING; PRE-REQUISITES; PRIOR PROBABILITY; SENTENCE ERRORS; SYSTEM COMBINATION; UNLABELED DATA;

COMPUTATIONAL LINGUISTICS;

EID: 84890513273     PISSN: 13138502     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. T. Almeida, J. Hidalgo, and A. Yamakami. 2011. Contributions to the study of SMS spam filtering: new collection and results. Proceedings of the 11th ACM symposium on Document engineering, pages 259- 62.
2. O. Ashtari. 2013. The super tweets of #sb47. http://blog.twitter.com/ 2013/02/the-supertweets-of-sb47.html.
3. S. Bird, E. Loper, and E. Klein. 2009. Natural Language Processing with Python. O'Reilly Media Inc.
4. K. Bontcheva, L. Derczynski, A. Funk, M. A. Greenwood, D. Maynard, and N. Aswani. 2013. TwitIE: A Fully-featured Information Extraction Pipeline for Microblog Text. In Proceedings of the International Conference on Recent Advances in Natural Language Processing. Association for Computational Linguistics.
5. T. Brants. 2000. TnT: a statistical part-of-speech tagger. In Proceedings of the sixth conference on Applied Natural Language Processing, pages 224-231. ACL.
6. E. Brill. 1995. Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging. Computational Linguistics, 21(4):543-565.
7. S. Clark, J. Curran, and M. Osborne. 2003. Bootstrapping PoS taggers using unlabelled data. In Proceedings of the seventh Conference on Natural Language Learning, pages 49-55. ACL.
8. A. Clark. 2003. Combining distributional and morphological information for part of speech induction. In Proceedings of the tenth conference of the European chapter of the Association for Computational Linguistics, pages 59-66. ACL.
9. S. Cucerzan and D. Yarowsky. 2002. Bootstrapping a multilingual part-of-speech tagger in one personday. In Proceedings of the 6th Conference on Natural Language Learning, pages 1-7. ACL.
10. A. Culotta. 2010. Towards detecting influenza epidemics by analyzing twitter messages. In Proceedings of the First Workshop on Social Media Analytics, pages 115-122. ACM.
11. H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. 2002. GATE: an Architecture for Development of Robust HLT Applications. In Proceedings of the 40th Anniversary Meeting of the Association for Computational Linguistics. ACL.
12. H. Cunningham, V. Tablan, A. Roberts, and K. Bontcheva. 2013. Getting more out of biomedical documents with gate's full lifecycle open source text analytics. PLoS ComputationalBiology, 9(2):e1002854, 02.
13. W. Darling, M. Paul, and F. Song. 2012. Unsupervised part-of-speech tagging in noisy and esoteric domains with a syntactic-semantic Bayesian HMM. In Proceedings of the conference of the European chapter of the Association for Computational Linguistics, pages 1-9. ACL.
14. L. Derczynski, D. Maynard, N. Aswani, and K. Bontcheva. 2013. Microblog-Genre Noise andImpact on Semantic Annotation Accuracy. In Proceedings of the 24th ACM Conference on Hypertext and Social Media. ACM.
15. E. Forsyth and C. Martell. 2007. Lexical and discourse analysis of online chat dialog. In International Conference on Semantic Computing, pages 19-26. IEEE.
16. J. Foster, O. Cetinoglu, J. Wagner, J. Le Roux, S. Hogan, J. Nivre, D. Hogan, and J. van Genabith. 2011. #hardtoparse: POS Tagging and Parsing the Twitterverse. In Proceedings of the AAAI Workshop on Analyzing Microtext.
17. P. Gadde, L. Subramaniam, and T. Faruquie. 2011. Adapting a wsj trained part-of-speech tagger to noisy text: preliminary results. In Proceedings of the Joint Workshop on Multilingual OCR and Analytics for Noisy Unstructured Text Data, pages 5:1-5:8. ACM.
18. J. Giménez and L. Marquez. 2004. SVMTool: A general POS tagger generator based on Support Vector Machines. In Proceedings of the 4th International Conference on Language Resources and Evaluation.
19. K. Gimpel, N. Schneider, B. O'Connor, D. Das, D. Mills, J. Eisenstein, M. Heilman, D. Yogatama, J. Flanigan, and N. Smith. 2011. Part-of-speech tagging for twitter: annotation, features, and experiments. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 42-47. ACL.
20. S. Goldman and Y. Zhou. 2000. Enhancing supervised learning with unlabeled data. In Proceedings of the International Conference on Machine Learning, pages 327-334.
21. B. Han and T. Baldwin. 2011. Lexical normalisation of short text messages: Makn sens a# twitter. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human LanguageTechnologies, volume 1, pages 368-378.
22. M. Kaufmann and J. Kalita. 2010. Syntactic normalization of twitter messages. In International Conference on Natural Language Processing.
23. F. Liu, F. Weng, and X. Jiang. 2012. A broadcoverage normalization system for social media language. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics.
24. C. Manning. 2011. Part-of-speech tagging from 97% to 100%: is it time for some linguistics? Computational Linguistics and Intelligent Text Processing, pages 171-189.
25. M. Marcus, M. Marcinkiewicz, and B. Santorini. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2):313-330.
26. Q. McNemar. 1947. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika, 12(2):153-157.
27. L. O'Carroll. 2012. Twitter active users pass 200 million. http://www.guardian.co.uk/technology/2012/dec/18/twitter-users-pass-200-million.
28. O. Owoputi, B. O'Connor, C. Dyer, K. Gimpel, and N. Schneider. 2012. Part-of-Speech Tagging for Twitter: Word Clusters and Other Advances. Technical Report CMU-ML-12-107, Machine Learning Department, Carnegie Mellon University.
29. J. Park, V. Barash, C. Fink, and M. Cha. 2013. Emoticon Style: Interpreting Differences in Emoticons Across Cultures. In Proceedings of the Seventh International AAAI Conference on Weblogs and Social Media, pages 466-475. AAAI Press.
30. D. Preotiuc-Pietro, S. Samangooei, T. Cohn, N. Gibbins, and M. Niranjan. 2012. Trendminer: An architecture for real time analysis of social media text. In Proceedings of the workshop on Real-Time Analysis and Mining of Social Streams.
31. A. Ritter, S. Clark, O. Etzioni, et al. 2011. Named entity recognition in tweets: an experimental study. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 1524- 1534. ACL.
32. T. Sakaki, M. Okazaki, and Y. Matsuo. 2010. Earthquake shakes Twitter users: real-time event detection by social sensors. In Proceedings of the 19th international conference on World Wide Web (WWW), pages 851-860. ACM.
33. D. Terdiman. 2012. Report: Twitter hits half a billion tweets a day. http://news.cnet.com/8301-10233-57541566-93/report-twitter-hits-half-a- billiontweets-a-day/.
34. K. Toutanova, D. Klein, C. Manning, and Y. Singer. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, pages 173-180. ACL.