Posterior vs. Parameter sparsity in latent variable models

Advances in Neural Information Processing Systems 22 - Proceedings of the 2009 Conference

Volumn , Issue , 2009, Pages 664-672

  Graça, João V ^a   Ganchev, Kuzman ^b   Ben, Taskar ^b   Pereira, Fernando ^c  

^a INESC ID   (Portugal)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY IMPROVEMENT; CLOSED-CLASS WORDS; DIRICHLET PRIOR; DISCRIMINATIVE MODELS; HIDDEN-MARKOV MODELS; LATENT VARIABLE MODELING; NATURAL LANGUAGES; PART-OF-SPEECH INDUCTIONS; REGULARIZATION FRAMEWORK; VARIATIONAL EM;

HIDDEN MARKOV MODELS;

EID: 80053292525     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. S. Afonso, E. Bick, R. Haber, and D. Santos. Floresta Sinta(c)tica: a treebank for Portuguese. In In Proc. LREC, pages 1698-1703, 2002.
2. K. Bellare, G. Druck, and A. McCallum. Alternating projections for learning with expectation constraints. In In Proc. UAI, 2009.
3. D.P. Bertsekas, M.L. Homer, D.A. Logan, and S.D. Patek. Nonlinear programming. Athena scientific, 1995.
4. Jianfeng Gao and Mark Johnson. A comparison of Bayesian estimators for unsupervised Hidden Markov Model POS taggers. In In Proc. EMNLP, pages 344-352, Honolulu, Hawaii, October 2008. ACL.
5. Y. Goldberg, M. Adler, and M. Elhadad. Em can find pretty good hmm pos-taggers (when given a good start). In Proc. ACL, pages 746-754, 2008.
6. S. Goldwater and T. Griffiths. A fully bayesian approach to unsupervised part-of-speech tagging. In In Proc. ACL, volume 45, page 744, 2007.
7. J. Graça, K. Ganchev, and B. Taskar. Expectation maximization and posterior constraints. In In Proc. NIPS. MIT Press, 2008.
8. A. Haghighi and D. Klein. Prototype-driven learning for sequence models. In In Proc. NAACL, pages 320-327, 2006.
9. M Johnson. Why doesn't EM find good HMM POS-taggers. In In Proc. EMNLP-CoNLL, 2007.
10. P. Liang, M. I. Jordan, and D. Klein. Learning from measurements in exponential families. In In proc. ICML, 2009.
11. G. Mann and A. McCallum. Simple, robust, scalable semi-supervised learning via expectation regularization. In Proc. ICML, 2007.
12. G. Mann and A. McCallum. Generalized expectation criteria for semi-supervised learning of conditional random fields. In In Proc. ACL, pages 870 - 878, 2008.
13. M.P. Marcus, M.A. Marcinkiewicz, and B. Santorini. Building a large annotated corpus of English: The Penn Treebank. Computational linguistics, 19(2):313-330, 1993.
14. B. Merialdo. Tagging English text with a probabilistic model. Computational linguistics, 20(2):155-171, 1994.
15. Sujith Ravi and Kevin Knight. Minimized models for unsupervised part-of-speech tagging. In In Proc. ACL, 2009.
16. Kiril Simov, Petya Osenova, Milena Slavcheva, Sia Kolkovska, Elisaveta Balabanova, Dimitar Doikoff, Krassimira Ivanova, Alexander Simov, Er Simov, and Milen Kouylekov. Building a linguistically interpreted corpus of bulgarian: the bultreebank. In In Proc. LREC, page pages, 2002.
17. N.A. Smith and J. Eisner. Contrastive estimation: Training log-linear models on unlabeled data. In In Proc. ACL, pages 354-362, 2005.
18. K. Toutanova and M. Johnson. A Bayesian LDA-based model for semi-supervised part-of-speech tagging. In Proc. NIPS, 20, 2007.