Improved unsupervised POS induction using intrinsic clustering quality and a Zipfian constraint

CoNLL 2010 - Fourteenth Conference on Computational Natural Language Learning, Proceedings of the Conference

Volumn , Issue , 2010, Pages 57-66

  Reichart, Roi ^a   Fattal, Raanan ^a   Rappoport, Ari ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

FUNCTIONS; INDUSTRIAL PLANTS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CLUSTERING QUALITY; DISTRIBUTIONS OF WORDS; EVALUATION MEASURES; GOLD STANDARDS; LOCAL MAXIMUM; NONCONVEX FUNCTIONS; OPTIMIZATION PROCEDURES; QUALITY MEASURES;

COMPUTATIONAL LINGUISTICS;

EID: 80053248813     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. Michele Banko and Robert C. Moore, 2003. Part of Speech Tagging in Context. COLING'04.
2. Chris Biemann, 2006. Unsupervised Part-of-Speech Tagging Employing Efficient Graph Clustering. COLING-ACL'06 Student Research Workshop.
3. Thorsten Brants, 1997. The NEGRA Export Format. CLAUS Report, Saarland University.
4. Eric Brill, 1995. Unsupervised Learning if Disambiguation Rules for Part of Speech Tagging. 3rd Workshop on Very Large Corpora.
5. Peter F. Brown, Vincent J. Della Pietra, Peter V. de Souze, Jenifer C. Lai and Robert Mercer, 1992. Class-Based N-Gram Models of Natural Language. Computational Linguistics, 18:467-479.
6. Alexander Clark, 2003. Combining Distributional and Morphological Information for Part of Speech Induction. EACL'03.
7. Sajib Dasgupta and Vincent Ng, 2007. Unsu-pervised Part-of-Speech Acquisition for Resource-Scarce Languages. EMNLP'07.
8. Steven Finch, Nick Chater and Martin Redington, 1995. Acquiring syntactic information from distributional statistics. Connectionist models of memory and language. UCL Press, London.
9. Dayne Freitag, 2004. Toward Unsupervised Whole-Corpus Tagging. COLING'04.
10. Jianfeng Gao and Mark Johnson, 2008. A comparison of Bayesian estimators for unsupervised Hidden Markov Model POS taggers. EMNLP'08.
11. Yoav Goldberg, Meni Adler and Michael Elhadad, 2008. EM Can Find Pretty Good HMM POS-Taggers (When Given a Good Start). ACL'08
12. Sharon Goldwater, Tom Griffiths, and Mark Johnson, 2006. Interpolating between types and tokens by estimating power-law generators. NIPS'06.
13. Sharon Goldwater and Tom Griffiths, 2007. A fully Bayesian approach to unsupervised part-of-speech tagging. ACL'07.
14. Joshua Goodman, 2001. A Bit of Progress in Language Modeling, Extended Version. Microsoft Research Technical Report MSR-TR-2001-72.
15. Joaõ Graça, Kuzman Ganchev, Ben Taskar and Frenando Pereira, 2009. Posterior vs. Parameter Spar-sity in Latent Variable Models. NIPS'09.
16. Maurice Kendall and Jean Dickinson, 1990. Rank Correlation methods. Oxford University Press, New York.
17. Aria Haghighi and Dan Klein, 2006. Prototype-driven Learning for Sequence Labeling. HLT-NAACL'06.
18. Mark Johnson, 2007. Why Doesnt EM Find Good HMM POS-Taggers? EMNLP-CoNLL'07.
19. Harold W. Kuhn, 1955. The Hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2:83-97.
20. Mirella Lapata, 2006. Automatic Evaluation of Information Ordering: Kendall's Tau. Computational Linguistics, 4:471-484.
21. Sven Martin, Jorg Liermann, and Hermann Ney, 1998. Algorithms for bigram and trigram word clustering. Speech Communication, 24:19-37.
22. Marina Meila, 2007. Comparing Clustering - an Information Based Distance. Journal of Multivariate Analysis, 98:873-895.
23. Bernard Merialdo, 1994. Tagging English Text with a Probabilistic Model. Computational Linguistics, 20(2):155-172.
24. Michael Mitzenmacher, 2004. A Brief History of Generative Models for Power Law and Lognormal Distributions. Internet Mathematics, 1(2):226-251.
25. James Munkres, 1957. Algorithms for the Assignment and Transportation Problems. Journal of the SIAM, 5(1):32-38.
26. Hermann Ney, Ute Essen, and Reinhard Kneser, 1994. On structuring probabilistic dependencies in stochastic language modelling. Computer Speech and Language, 8:1-38.
27. Sujith Ravi and Kevin Knight, 2009. Minimized Models for Unsupervised Part-of-Speech Tagging. ACL'09.
28. Roi Reichart and Ari Rappoport, 2009. The NVI Clustering Evaluation Measure. CoNLL'09.
29. Kenneth Rose, Eitan Gurewitz, and Geoffrey C. Fox, 1990. Statistical Mechanics and Phase Transitions in Clustering. Physical Review Letters, 65(8):945-948.
30. Andrew Rosenberg and Julia Hirschberg, 2007. V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure. EMNLP'07.
31. Hinrich Schuetze, 1995. Distributional part-of-speech tagging. EACL'95.
32. Noah A. Smith and Jason Eisner, 2004. Annealing Techniques for Unsupervised Statistical Language Learning. ACL'04.
33. Noah A. Smith and Jason Eisner, 2005. Contrastive Estimation: Training Log-Linear Models on Unla-beled Data. ACL'05.
34. Benjamin Snyder, Tahira Naseem, Jacob Eisenstein, and Regina Barzilay, 2009. Adding More Languages Improves Unsupervised Multilingual Part-of-Speech Tagging: A Bayesian Non-Parametric Approach. NAACL'09.
35. Benjamin Snyder, Tahira Naseem, Jacob Eisenstein, and Regina Barzilay, 2008. Unsupervised Multilingual Learning for POS Tagging. EMNLP'08.
36. Jurgen Van Gael, Andreas Vlachos and Zoubin Ghahra-mani, 2009. The Infinite HMM for Unsupervised POS Tagging. EMNLP'09.
37. Qin Iris Wang and Dale Schuurmans, 2005. Improved Estimation for Unsupervised Part-of-Speech Tagging. IEEE NLP-KE'05.
38. Shaojun Wang, Dale Schuurmans and Yunxin Zhao, 2002. The Latent Maximum Entropy Principle. ISIT'02.
39. Qiuye Zhao and Mitch Marcus, 2009. A Simple Un-supervised Learner for POS Disambiguation Rules Given Only a Minimal Lexicon. EMNLP'09.