Crouching dirichlet, hidden Markov model: Unsupervised POS tagging with context local tag generation

EMNLP 2010 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2010, Pages 196-206

  Moon, Taesun ^a   Erk, Katrin ^a   Baldridge, Jason ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; DIRICHLET; DOCUMENT CONTEXT; FUNCTION WORDS; HYPER-PARAMETER; NATURAL LANGUAGES; PART OF SPEECH TAGGING; POS TAGGING; PRIOR DISTRIBUTION; SEMI-SUPERVISED; SIMPLE MODIFICATIONS; TAG GENERATION;

COMPUTATIONAL LINGUISTICS; HIDDEN MARKOV MODELS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053261254     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. O. Abend, R. Reichart, and A. Rappoport. 2010. Improved unsupervised POS induction through prototype discovery. In Proceedings of ACL, pages 1298-1307.
2. S. Afonso, E. Bick, R. Haber, and D. Santos. 2002. Floresta sintá(c)tica": a treebank for Portuguese. In Proceedings of LREC, pages 1698-1703.
3. D. M. Blei, A. Y. Ng, and M. I. Jordan. 2003. Latent Dirichlet allocation. The Journal of Machine Learning Research, 3:993-1022.
4. J. L. Boyd-Graber and D. Blei. 2009. Syntactic topic models. In Proceedings of NIPS, pages 185-192.
5. S. Brants, S. Dipper, S. Hansen, W. Lezius, and G. Smith. 2002. The TIGER treebank. In Proceedings of the Workshop on Treebanks and Linguistic Theories.
6. T. Brants. 2000. TnT: a statistical part-of-speech tagger. In Proceedings of conference on Applied natural language processing, pages 224-231.
7. A. Clark. 2003. Combining distributional and morphological information for part of speech induction. In Proceedings of EACL, pages 59-66.
8. J. R. Finkel, T. Grenager, and C. D. Manning. 2007. The infinite tree. In Proceedings of ACL, pages 272-279.
9. W.N. Francis, H. Kučera, and A.W. Mackie. 1982. Frequency analysis of English usage: Lexicon and grammar. Houghton Mifflin Harcourt.
10. S. Frank, S. Goldwater, and F. Keller. 2009. Evaluating models of syntactic category acquisition without using a gold standard. In Proceedings of CogSci.
11. J. Gao and M. Johnson. 2008. A comparison of Bayesian estimators for unsupervised Hidden Markov Model POS taggers. In Proceedings of EMNLP, pages 344-352.
12. Y. Goldberg, M. Adler, and M. Elhadad. 2008. EM can find pretty good HMM POS-taggers (when given a good start). In Proceedings of ACL, pages 746-754.
13. S. Goldwater and T. L. Griffiths. 2007. A fully Bayesian approach to unsupervised part-of-speech tagging. In Proceedings of ACL, pages 744-751.
14. J. Graca, K. Ganchev, B. Taskar, and F. Pereira. 2009. Posterior vs parameter sparsity in latent variable models. In Proceedings of NIPS, pages 664-672.
15. T. L. Griffiths, M. Steyvers, D. M. Blei, and J. M. Tenenbaum. 2005. Integrating topics and syntax. In Proceedings of NIPS, pages 537-544.
16. A. Haghighi and D. Klein. 2006. Prototype-driven learning for sequence models. In Proceedings of HLT/NAACL, pages 320-327.
17. W. P. Headden III, D. McClosky, and E. Charniak. 2008. Evaluating unsupervised part-of-speech tagging for grammar induction. In Proceedings of COLING, pages 329-336.
18. G.E. Hinton. 2002. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800.
19. M. Johnson. 2007. Why doesn't EM find good HMM POS-taggers. In Proceedings of EMNLP-CoNLL, pages 296-305.
20. P. Liang and D. Klein. 2009. Online EM for unsupervised models. In Proceedings of HLT/NAACL, pages 611-619.
21. M.P. Marcus, B. Santorini, and M.A. Marcinkiewicz. 1994. Building a large annotated corpus of English: The Penn Treebank. Comp. ling., 19(2):313-330.
22. M. Meila. 2007. Comparing clusterings - an information based distance. Journal of Multivariate Analysis, 98(5):873-895.
23. A. Palmer, T. Moon, and J. Baldridge. 2009. Evaluating automation strategies in language documentation. In Proceedings of the NAACL-HLT 2009 Workshop on Active Learning for Natural Language Processing, pages 36-44.
24. T. C. Pixabaj, M. A. Vicente Méndez, M. Vicente Méndez, and O. A. Damián. 2007. Text Collections in Four Mayan Languages. Archived in The Archive of the Indigenous Languages of Latin America.
25. S. Ravi and K. Knight. 2009. Minimized models for unsupervised part-of-speech tagging. In Proceedings of ACL and AFNLP, pages 504-512.
26. R. Reichart, O. Abend, and A. Rappoport. 2010a. Type level clustering evaluation: New measures and a POS induction case study. In Proceedings of CoNLL, pages 77-87.
27. R. Reichart, R. Fattal, and A. Rappoport. 2010b. Improved unsupervised POS induction using intrinsic clustering quality and a Zipfian constraint. In Proceedings of CoNLL, pages 57-66.
28. H. Schütze. 1993. Part-of-speech induction from scratch. In Proceedings of ACL, pages 251-258.
29. N.A. Smith and J. Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proceedings of ACL, pages 354-362.
30. B. Snyder, T. Naseem, J. Eisenstein, and R. Barzilay. 2008. Unsupervised multilingual learning for POS tagging. In Proceedings of EMNLP, pages 1041-1050.
31. A.R. Teichert and H. Daumé III. 2010. Unsupervised Part of Speech Tagging Without a Lexicon. In NIPS Workshop on Grammar Induction, Representation of Language and Language Learning 2010.
32. K. Toutanova, D. Klein, C. Manning, and Y. Singer. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of NAACL, pages 173-180.
33. J. Van Gael, A. Vlachos, and Z. Ghahramani. 2009. The infinite HMM for unsupervised PoS tagging. In Proceedings of EMNLP, pages 678-687.
34. L. Xu, D. Wilkinson, F. Southey, and D. Schuurmans. 2006. Discriminative unsupervised learning of structured predictors. In Proceedings of ICML, pages 1057-1064.
35. Q. Zhao and M. Marcus. 2009. A simple unsupervised learner for POS disambiguation rules given only a minimal lexicon. In Proceedings of EMNLP, pages 688-697.