A Bayesian mixture model for part-of-speech induction using multiple features

EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2011, Pages 638-647

  Christodoulopoulos, Christos ^a   Goldwater, Sharon ^a   Steedman, Mark ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN MIXTURE MODEL; INDUCTION SYSTEM; MIXTURE MODEL; MULTINOMIAL MIXTURE MODELS; MULTIPLE FEATURES; PARALLEL CORPORA; PART OF SPEECH; SIMILAR MODELS; STATE OF THE ART;

COMPUTATIONAL LINGUISTICS; MIXTURES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053235089     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. Anne Abeillé, Lionel Clément, and Alexandra Kinyon. 2000. Building a treebank for French. In In Proceedings of the LREC 2000.
2. David Bamman, Francesco Mambrini, and Gregory Crane. 2009. An ownership model of annotation: The Ancient Greek dependency treebank. In TLT 2009-Eighth International Workshop on Treebanks and Linguistic Theories.
3. Taylor Berg-Kirkpatrick, Alexandre B. Côté, John DeNero, and Dan Klein. 2010. Painless unsupervised learning with features. In Proceedings of NAACL 2010, pages 582-590, Los Angeles, California, June.
4. Chris Biemann. 2006. Unsupervised part-of-speech tagging employing efficient graph clustering. In Proceedings of COLING ACL 2006, pages 7-12, Morristown, NJ, USA.
5. Alena Böhmová, Jan Hajič, Eva Hajičová, and Barbora Hladká. 2001. The Prague dependency treebank: Three-level annotation scenario. In Anne Abeillé, editor, Treebanks: Building and Using Syntactically Annotated Corpora, pages 103 - 126. Kluwer Academic Publishers.
6. Sabine Brants, Stefanie Dipper, Silvia Hansen, Wolfgang Lezius, and George Smith. 2002. The TIGER tree-bank. In Proceedings of the Workshop on Treebanks and Linguistic Theories, Sozopol.
7. Peter F. Brown, Vincent J. Della Pietra, Peter V. Desouza, Jennifer C. Lai, and Robert L. Mercer. 1992. Class-based n-gram models of natural language. Computational Linguistics, 18(4):467-479.
8. Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceedings of the Tenth Conference on Computational Natural Language Learning, CoNLL-X '06, pages 149-164, Stroudsburg, PA, USA. Association for Computational Linguistics.
9. Christos Christodoulopoulos, Sharon Goldwater, and Mark Steedman. 2010. Two decades of unsupervised POS induction: How far have we come? In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pages 575-584, Cambridge, MA, October. Association for Computational Linguistics.
10. Montserrat Civit, Ma. Martí, and Núria Bufí. 2006. Cat3lb and cast3lb: From constituents to dependencies. In Tapio Salakoski, Filip Ginter, Sampo Pyysalo, and Tapio Pahikkala, editors, Advances in Natural Language Processing, volume 4139 of Lecture Notes in Computer Science, pages 141-152. Springer Berlin / Heidelberg.
11. Alexander Clark. 2003. Combining distributional and morphological information for part of speech induction. In Proceedings of EACL 2003, pages 59-66, Morristown, NJ, USA.
12. Mathias Creutz and Krista Lagus. 2005. Inducing the morphological lexicon of a natural language from unannotated text. In In Proceedings of the International and Interdisciplinary Conference on Adaptive Knowledge Representation and Reasoning (AKRR'05), volume 5, pages 106-113.
13. Sašo Džeroski, Tomaž Erjavec, Nina Ledinek, Petr Pajas, Zdenek Žabokrtsky, and Andreja Žele. 2006. Towards a Slovene dependency treebank. In Proceedings Int. Conf. on Language Resources and Evaluation (LREC).
14. Tomaž Erjavec. 2004. MULTEXT-East version 3: Multilingual morphosyntactic specifications, lexicons and corpora. In Fourth International Conference on Language Resources and Evaluation, (LREC'04), pages 1535 - 1538, Paris. ELRA.
15. Sharon Goldwater and Tom Griffiths. 2007. A fully bayesian approach to unsupervised part-of-speech tagging. In Proceedings of ACL 2007, pages 744-751, Prague, Czech Republic, June.
16. Aria Haghighi and Dan Klein. 2006. Prototype-driven learning for sequence models. In Proceedings of NAACL 2006, pages 320-327, Morristown, NJ, USA.
17. Jan Hajič, Jarmila Panevová, Zdeňka Urešová, Alevtina Bémová, and Petr Pajas. 2003. PDTVALLEX: creating a large-coverage valency lexicon for treebank annotation. In Proceedings of The Second Workshop on Treebanks and Linguistic Theories, pages 57-68. Vaxjo University Press.
18. Mark Johnson. 2007. Why doesn't EM find good HMM POS-taggers? In Proceedings of EMNLP-CoNLL 2007, pages 296-305, Prague, Czech Republic, June.
19. Yasushira Kawata and Julia Bartels. 2000. Stylebook for the Japanese treebank in VERMOBIL. Technical report, Universität Tüubingen.
20. Chen Keh-Jiann, Chu-Ren Huang, Feng-Yi Chen, ChiChing Luo, Ming-Chung Chang, Chao-Jan Chen, and Zhao-Ming Gao. 2003. Sinica treebank: Design criteria, representational issues and implementation. In Anne Abeillé, editor, Treebanks: Building and Using Syntactically Annotated Corpora, pages 231-248. Kluwer Academic Publishers.
21. Dan Klein and Christopher D. Manning. 2002. A generative constituent-context model for improved grammar induction. In Proceedings of ACL 40, pages 128-135.
22. Michael Lamar, Yariv Maron, Mark Johnson, and Elie Bienenstock. 2010. SVD and clustering for unsuper-vised POS tagging. In Proceedings of the ACL 2010 Conference Short Papers, pages 215-219, Strouds-burg, PA, USA. Association for Computational Linguistics.
23. Yoong Keok Lee, Aria Haghighi, and Regina Barzilay. 2010. Simple type-level unsupervised POS tagging. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP '10, pages 853-861, Stroudsburg, PA, USA. Association for Computational Linguistics.
24. Mitchell Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics, 19(2):331-330.
25. Tahira Naseem, Benjamin Snyder, Jacob Eisenstein, and Regina Barzilay. 2009. Multilingual Part-of-Speech tagging: Two unsupervised approaches. Journal of Artificial Intelligence Research, 36:341-385.
26. Franz J. Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Comput. Linguist., 29(1):19-51.
27. Kemal Oflazer, Bilge Say, Dilek Z. Hakkani-Tür, and Gökhan Tür, 2003. Building A Turkish Treebank, chapter 1, pages 1-17. Kluwer Academic Publishers.
28. Carl Rasmussen. 2000. The infinite Gaussian mixture model. In Advances in Neural Information Processing Systems 12.
29. Sujith Ravi and Kevin Knight. 2009. Minimized models for unsupervised Part-of-Speech tagging. In Proceedings of ACL-IJCNLP 2009, pages 504-512, Suntec, Singapore, August.
30. Martin Redington, Nick Chater, and Steven Finch. 1998. Distributional information: a powerful cue for acquiring syntactic categories. Cognitive Science, 22:425 - 469.
31. Andrew Rosenberg and Julia Hirschberg. 2007. V-measure: A conditional entropy-based external cluster evaluation measure. In Proceedings of EMNLP-CoNLL 2007, pages 410-420.
32. Hinrich Schütze. 1995. Distributional part-of-speech tagging. In Proceedings of EACL 7, pages 141-148, San Francisco, CA, USA.
33. Kiril Simov, Petya Osenova, Alexander Simov, and Milen Kouylekov. 2004. Design and implementation of the Bulgarian HPSG-based treebank. Research on Language & Computation, 2(4):495-522.
34. Noah A. Smith and Jason Eisner. 2005. Contrastive estimation: training log-linear models on unlabeled data. In Proceedings of ACL 2005, pages 354-362, Morris-town, NJ, USA.
35. Otakar Smrž and Petr Pajas. 2004. Morphotrees of Arabic and their annotation in the TrEd environment. In Proceedings of the NEMLAR International Conference on Arabic Language Resources and Tools, pages 38-41.
36. Ben Snyder and Regina Barzilay. 2008. Unsupervised multilingual learning for morphological segmentation. In Proceedings of ACL.
37. Kristina Toutanova and Mark Johnson. 2007. A Bayesian LDA-based model for semi-supervised part-of-speech tagging. In Proceedings of NIPS 2007.