Unambiguity regularization for unsupervised learning of probabilistic grammars

EMNLP-CoNLL 2012 - 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Proceedings of the Conference

Volumn , Issue , 2012, Pages 1324-1334

  Tu, Kewei ^a   Honavar, Vasant ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Iowa State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONALLY EFFICIENT; DEPENDENCY GRAMMAR; EXPECTATION-MAXIMIZATION ALGORITHMS; GRAMMAR LEARNING; NATURAL LANGUAGE GRAMMARS; NATURAL LANGUAGES; PROBABILISTIC GRAMMARS; STATE OF THE ART;

ALGORITHMS; FORMAL LANGUAGES; UNSUPERVISED LEARNING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84883368614     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. I. Aduriz, M. J. Aranzabe, J. M. Arriola, A. Atutxa, A. Diaz de Ilarraza, A. Garmendia, and M. Oronoz. 2003. Construction of a basque dependency treebank. In Proc. of the 2nd Workshop on Treebanks and Linguistic Theories (TLT).
2. Susana Afonso, Eckhard Bick, Renato Haber, and Diana Santos. 2002. "floresta sintá(c)tica": a treebank for Portuguese. In Proceedings of the 3rd Intern. Conf. on Language Resources and Evaluation (LREC), pages 1968-1703.
3. J. K. Baker. 1979. Trainable grammars for speech recognition. In Speech Communication Papers for the 97th Meeting of the Acoustical Society of America.
4. Van Der Beek, G. Bouma, R. Malouf, G. Van Noord, and Rijksuniversiteit Groningen. 2002. The alpino dependency treebank. In In Computational Linguistics in the Netherlands (CLIN, pages 1686-1691.
5. Phil Blunsom and Trevor Cohn. 2010. Unsupervised induction of tree substitution grammars for dependency parsing. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP '10, pages 1204-1213, Stroudsburg, PA, USA. Association for Computational Linguistics.
6. Matthias Buch-Kromann, Jürgen Wedekind, and Jakob Elming. 2007. The copenhagen danish-english dependency treebank v. 2.0. Http://www.buch-kromann. dk/matthias/cdt2.0/.
7. Stanley F. Chen. 1995. Bayesian grammar induction for language modeling. In Proceedings of the 33rd annual meeting on Association for Computational Linguistics.
8. Shay B. Cohen and Noah A. Smith. 2009. Shared logistic normal distributions for soft parameter tying in un-supervised grammar induction. In HLT-NAACL, pages 74-82.
9. Shay B. Cohen, Kevin Gimpel, and Noah A. Smith. 2008. Logistic normal priors for unsupervised probabilistic grammar induction. In NIPS, pages 321-328.
10. Tomaz Erjavec, Darja Fiser, Simon Krek, and Nina Ledinek. 2010. The jos linguistically tagged corpus of slovene. In LREC.
11. Jenny Rose Finkel, Trond Grenager, and Christopher D. Manning. 2007. The infinite tree. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 272-279. Association for Computational Linguistics, June.
12. Kuzman Ganchev, João Graça, Jennifer Gillenwater, and Ben Taskar. 2010. Posterior regularization for structured latent variable models. Journal of Machine Learning Research, 11:2001-2049.
13. Jennifer Gillenwater, Kuzman Ganchev, João Graça, Fernando Pereira, and Ben Taskar. 2010. Sparsity in dependency grammar induction. In ACL '10: Proceedings of the ACL 2010 Conference Short Papers, pages 194-199, Morristown, NJ, USA. Association for Computational Linguistics.
14. Yves Grandvalet and Yoshua Bengio. 2005. Semi-supervised learning by entropy minimization. In Lawrence K. Saul, Yair Weiss, and Léon Bottou, editors, Advances in Neural Information Processing Systems 17, pages 529-536. MIT Press, Cambridge, MA.
15. Jan Hajič, Alena Böhmová, Eva Hajičová, and Barbora Vidová-Hladká. 2000. The Prague Dependency Treebank: A Three-Level Annotation Scenario. In A. Abeillé, editor, Treebanks: Building and Using Parsed Corpora, pages 103-127. Amsterdam: Kluwer.
16. Jan Hajič, Otakar Smrž, Petr Zemánek, Jan Šnaidauf, and Emanuel Beška. 2004. Prague arabic dependency treebank: Development in data and tools. In In Proc. of the NEMLAR Intern. Conf. on Arabic Language Resources and Tools, pages 110-117.
17. William P. Headden, III, Mark Johnson, and David McClosky. 2009. Improving unsupervised dependency parsing with richer contexts and smoothing. In HLT-NAACL, pages 101-109.
18. Mark Johnson, Thomas L. Griffiths, and Sharon Goldwater. 2007. Bayesian inference for pcfgs via markov chain monte carlo. In HLT-NAACL, pages 139-146.
19. Dan Klein and Christopher D. Manning. 2004. Corpus-based induction of syntactic structure: Models of dependency and constituency. In Proceedings of ACL.
20. Kenichi Kurihara and Taisuke Sato. 2004. An application of the variational Bayesian approach to probabilistic contextfree grammars. In IJCNLP-04 Workshop beyond shallow analyses.
21. K. Lari and S. Young. 1990. The estimation of stochastic context-free grammars using the inside-outside algorithm. Computer Speech and Language, 4:35-36.
22. Percy Liang, Slav Petrov, Michael I. Jordan, and Dan Klein. 2007. The infinite pcfg using hierarchical Dirichlet processes. In Proceedings of EMNLP-CoNLL, pages 688-697.
23. Christopher D. Manning and Hinrich Schütze. 1999. Foundations of statistical natural language processing. MIT Press, Cambridge, MA, USA.
24. Joakim Nivre, Jens Nilsson, and Johan Hall. 2006. Tal-banken05: A Swedish Treebank with Phrase Structure and Dependency Annotation. In Proceedings of the fifth international conference on Language Resources and Evaluation (LREC2006), May 24-26, 2006, Genoa, Italy, pages 1392-1395. European Language Resource Association, Paris.
25. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and inter-pretable tree annotation. In ACL-44: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, pages 433-440, Morristown, NJ, USA. Association for Computational Linguistics.
26. Hoifung Poon and Pedro Domingos. 2011. Sum-product networks: A new deep architecture. In Proceedings of the Twenty-Seventh Conference on Uncertainty in Artificial Intelligence (UAI).
27. Kenneth Rose. 1998. Deterministic annealing for clustering, compression, classification, regression, and related optimization problems. In Proceedings of the IEEE, pages 2210-2239.
28. Noah A. Smith and Jason Eisner. 2004. Annealing techniques for unsupervised statistical language learning. In Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, ACL '04, Stroudsburg, PA, USA. Association for Computational Linguistics.
29. David A. Smith and Jason Eisner. 2007. Bootstrapping feature-rich dependency parsers with entropic priors. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 667-677, Prague, June.
30. Valentin I. Spitkovsky, Hiyan Alshawi, Daniel Jurafsky, and Christopher D. Manning. 2010. Viterbi training improves unsupervised dependency parsing. In Proceedings of the Fourteenth Conference on Computational Natural Language Learning, CoNLL '10, pages 9-17, Stroudsburg, PA, USA. Association for Computational Linguistics.