Variational inference for grammar induction with prior knowledge

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 1-4

  Cohen, Shay B ^a   Smith, Noah A ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

COMPUTATIONAL TRACTABILITY; GRAMMAR INDUCTION; HIDDEN VARIABLE; INDEPENDENCE ASSUMPTION; POSTERIOR DISTRIBUTIONS; PRIOR KNOWLEDGE; SOFT CONSTRAINT; VARIATIONAL INFERENCE; MEAN-FIELD; PRIOR-KNOWLEDGE; PROBABILISTICS; VARIATIONAL EM;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053261113     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1667583.1667585     Document Type: Conference Paper

References (12)

1. M. J. Beal and Z. Gharamani. 2003. The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures. In Proc. of Bayesian Statistics.
2. C. Bishop, N. Lawrence, T. S. Jaakkola, and M. I. Jordan. 1998. Approximating posterior distributions in belief networks using mixtures. In Advances in NIPS.
3. C. M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.
4. S. Boyd and L. Vandenberghe. 2004. Convex Optimization. Cambridge Press.
5. S. B. Cohen and N. A. Smith. 2009. Variational inference with prior knowledge. Technical report, Carnegie Mellon University.
6. S. B. Cohen, K. Gimpel, and N. A. Smith. 2008. Logistic normal priors for unsupervised probabilistic grammar induction. In Advances in NIPS.
7. J. V. Graça, K. Ganchev, and B. Taskar. 2007. Expectation maximization and posterior constraints. In Advances in NIPS.
8. D. Klein and C. D. Manning. 2004. Corpus-based induction of syntactic structure: Models of dependency and constituency. In Proc. of ACL.
9. F. C. N. Pereira and Y. Schabes. 1992. Inside-outside reestimation from partially bracketed corpora. In Proc. of ACL.
10. K. Rose, E. Gurewitz, and G. C. Fox. 1990. Statistical mechanics and phrase transitions in clustering. Physical Review Letters, 65(8):945-948.
11. N. A. Smith and J. Eisner. 2006. Annealing structural bias in multilingual weighted grammar induction. In Proc. of COLING-ACL.
12. N. Xue, F. Xia, F.-D. Chiou, and M. Palmer. 2004. The Penn Chinese Treebank: Phrase structure annotation of a large corpus. Natural Language Engineering, 10(4):1-30.