Improved part-of-speech tagging for online conversational text with word clusters

NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 380-390

  Owoputi, Olutobi ^a   O'Connor, Brendan ^a   Dyer, Chris ^a   Gimpel, Kevin ^b   Schneider, Nathan ^a   Smith, Noah A ^a  

^a Carnegie Mellon University   (United States)

^b TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; SOCIAL NETWORKING (ONLINE); SYNTACTICS;

CLUSTER YIELD; LARGE-SCALES; LEXICAL FEATURES; LINGUISTIC PHENOMENA; PART OF SPEECH TAGGING; PARTS-OF-SPEECH TAGGING; QUALITATIVE ANALYSIS; STATE OF THE ART; WORD CLUSTERING; WORDS CLUSTERS;

COMPUTATIONAL LINGUISTICS;

EID: 84919651291     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. J. Allan and H. Raghavan. 2002. Using part-of-speech patterns to reduce query ambiguity. In Proc. of SIGIR.
2. G. Andrew and J. Gao. 2007. Scalable training of L1-regularized log-linear models. In Proc. of ICML.
3. P. Blunsom and T. Cohn. 2011. A hierarchical Pitman-Yor process HMM for unsupervised part of speech induction. In Proc. of ACL.
4. S. Brody and N. Diakopoulos. 2011. Cool: Using word lengthening to detect sentiment in microblogs. In Proc. of EMNLP.
5. P. F. Brown, P. V. de Souza, R. L. Mercer, V. J. Della Pietra, and J. C. Lai. 1992. Class-based n-gram models of natural language. Computational Linguistics, 18(4).
6. A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E. R. Hruschka Jr, and T. M. Mitchell. 2010. Toward an architecture for never-ending language learning. In Proc. of AAAI.
7. A. Clark. 2003. Combining distributional and morphological information for part of speech induction. In Proc. of EACL.
8. J. Eisenstein, N. A. Smith, and E. P. Xing. 2011. Discovering sociolinguistic associations with structured sparsity. In Proc. of ACL.
9. J. Eisenstein. 2013. What to do about bad language on the internet. In Proc. of NAACL.
10. A. Fader, S. Soderland, and O. Etzioni. 2011. Identifying relations for open information extraction. In Proc. of EMNLP.
11. E. N. Forsyth and C. H. Martell. 2007. Lexical and discourse analysis of online chat dialog. In Proc. of ICSC.
12. E. N. Forsyth. 2007. Improving automated lexical and discourse analysis of online chat dialog. Master's thesis, Naval Postgraduate School.
13. J. Foster, O. Cetinoglu, J. Wagner, J. L. Roux, S. Hogan, J. Nivre, D. Hogan, and J. van Genabith. 2011. hardtoparse: POS tagging and parsing the Twitterverse. In Proc. of AAAI-11 Workshop on Analysing Microtext.
14. K. Gimpel, N. Schneider, B. O'Connor, D. Das, D. Mills, J. Eisenstein, M. Heilman, D. Yogatama, J. Flanigan, and N. A. Smith. 2011. Part-of-speech tagging for Twitter: Annotation, features, and experiments. In Proc. of ACL.
15. Google. 2012. Freebase data dumps. http:// download. freebase. com/datadumps/.
16. B. Han and T. Baldwin. 2011. Lexical normalisation of short text messages: Makn sens a #twitter. In Proc. of ACL.
17. T. Koo, X. Carreras, and M. Collins. 2008. Simple semisupervised dependency parsing. In Proc. of ACL.
18. J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. of ICML.
19. P. Liang. 2005. Semi-supervised learning for natural language. Master's thesis, Massachusetts Institute of Technology.
20. D. C. Liu and J. Nocedal. 1989. On the limited memory BFGS method for large scale optimization. Mathematical programming, 45(1).
21. X. Liu, S. Zhang, F. Wei, and M. Zhou. 2011. Recognizing named entities in tweets. In Proc. of ACL.
22. M. Lui and T. Baldwin. 2012. langid. py: An off-Theshelf language identification tool. In Proc. of ACL.
23. M. P. Marcus, B. Santorini, and M. A. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2).
24. A. McCallum, D. Freitag, and F. Pereira. 2000. Maximum entropy Markov models for information extraction and segmentation. In Proc. of ICML.
25. D. McClosky, E. Charniak, and M. Johnson. 2010. Automatic domain adaptation for parsing. In Proc. of NAACL.
26. B. O'Connor, M. Krieger, and D. Ahn. 2010. TweetMotif: Exploratory search and topic summarization for Twitter. In Proc. of AAAI Conference on Weblogs and Social Media.
27. O. Owoputi, B. O'Connor, C. Dyer, K. Gimpel, and N. Schneider. 2012. Part-of-speech tagging for Twitter: Word clusters and other advances. Technical Report CMU-ML-12-107, Carnegie Mellon University.
28. B. Pang and L. Lee. 2008. Opinion mining and sentiment analysis. Now Publishers.
29. S. Petrov and R. McDonald. 2012. Overview of the 2012 shared task on parsing the web. Notes of the First Workshop on Syntactic Analysis of Non-Canonical Language (SANCL).
30. S. Petrov, D. Das, and R. McDonald. 2011. A universal part-of-speech tagset. ArXiv preprint arXiv:1104. 2086.
31. A. Ratnaparkhi. 1996. A maximum entropy model for part-of-speech tagging. In Proc. of EMNLP.
32. A. Ritter, S. Clark, Mausam, and O. Etzioni. 2011. Named entity recognition in tweets: An experimental study. In Proc. of EMNLP.
33. T. Schnoebelen. 2012. Do you smile with your nose? Stylistic variation in Twitter emoticons. University of Pennsylvania Working Papers in Linguistics, 18(2):14.
34. N. A. Smith and J. Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proc. of ACL.
35. O. Täckström, R. McDonald, and J. Uszkoreit. 2012. Cross-lingual word clusters for direct transfer of linguistic structure. In Proc. of NAACL.
36. J. Turian, L. Ratinov, and Y. Bengio. 2010. Word representations: A simple and general method for semisupervised learning. In Proc. of ACL.
37. P. D. Turney. 2002. Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews. In Proc. of ACL.
38. H. Zou and T. Hastie. 2005. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67(2):301-320.