A comparison of Bayesian estimators for unsupervised Hidden Markov Model POS taggers

EMNLP 2008 - 2008 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference: A Meeting of SIGDAT, a Special Interest Group of the ACL

Volumn , Issue , 2008, Pages 344-352

  Gao, Jianfeng ^a   Johnson, Mark ^b  

^a MICROSOFT RESEARCH   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; HIDDEN MARKOV MODELS; MAXIMUM PRINCIPLE; NATURAL LANGUAGE PROCESSING SYSTEMS;

BAYESIAN ESTIMATORS; BAYESIAN TECHNIQUES; DIFFERENT SIZES; EXPECTATION MAXIMIZATION; LARGE DATASETS; NUMBER OF STATE; SMALL DATA SET; VARIATIONAL BAYES;

COMPUTATIONAL LINGUISTICS;

EID: 80053359625     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1613715.1613761     Document Type: Conference Paper

References (16)

1. Matthew J. Beal. 2003. Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, Gatsby Computational Neuroscience unit, University College London.
2. Julian Besag. 2004. An introduction to Markov Chain Monte Carlo methods. In Mark Johnson, Sanjeev P. Khudanpur, Mari Ostendorf, and Roni Rosenfeld, editors, Mathematical Foundations of Speech and Language Processing, pages 247-270. Springer, New York.
3. Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.
4. Alexander Clark. 2003. Combining distributional and morphological information for part of speech induction. In 10th Conference of the European Chapter of the Association for Computational Linguistics, pages 59-66. Association for Computational Linguistics.
5. Stuart Geman and Donald Geman. 1984. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6:721-741.
6. Sharon Goldwater and Tom Griffiths. 2007. A fully Bayesian approach to unsupervised part-of-speech tagging. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 744-751, Prague, Czech Republic, June. Association for Computational Linguistics.
7. Aria Haghighi and Dan Klein. 2006. Prototype-driven learning for sequence models. In Proceedings of the Human Language Technology Conference of the NAACL, Main Conference, pages 320-327, New York City, USA, June. Association for Computational Linguistics.
8. Frederick Jelinek. 1997. Statistical Methods for Speech Recognition. The MIT Press, Cambridge, Massachusetts.
9. Mark Johnson, Thomas Griffiths, and Sharon Goldwater. 2007. Bayesian inference for PCFGs via Markov chainMonte Carlo. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference, pages 139-146, Rochester, New York, April. Association for Computational Linguistics.
10. Mark Johnson. 2007. Why doesn't EM find good HMM POS-taggers? In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 296-305.
11. David J.C.MacKay. 1997. Ensemble learning for hidden Markov models. Technical report, Cavendish Laboratory, Cambridge.
12. David J.C. MacKay. 2003. Information Theory, Inference, and Learning Algorithms. Cambridge University Press.
13. Chris Manning and Hinrich Schütze. 1999. Foundations of Statistical Natural Language Processing. The MIT Press, Cambridge,Massachusetts.
14. Marina Meilǎ. 2003. Comparing clusterings by the variation of information. In Bernhard Schölkopf andManfred K. Warmuth, editors, COLT 2003: The Sixteenth Annual Conference on Learning Theory, volume 2777 of Lecture Notes in Computer Science, pages 173-187. Springer.
15. Christian P. Robert and George Casella. 2004. Monte Carlo Statistical Methods. Springer.
16. Noah A. Smith and Jason Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proceedings of the 43rd AnnualMeeting of the Association for Computational Linguistics (ACL'05), pages 354-362, Ann Arbor, Michigan, June. Association for Computational Linguistics.