Unsupervised dependency parsing with transferring distribution via parallel guidance and entropy regularization

52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014 - Proceedings of the Conference

Volumn 1, Issue , 2014, Pages 1337-1348

  Ma, Xuezhe ^a   Xia, Fei ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ENTROPY; FORESTRY; LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS; TRANSLATION (LANGUAGES);

CROSS-LINGUAL; DEPENDENCY PARSER; LABELED TRAINING DATA; PARALLEL GUIDANCE; PROBABILISTIC PARSING MODELS; RESOURCE-RICH; STATE-OF-THE-ART PERFORMANCE; UNSUPERVISED DEPENDENCY PARSING;

COMPUTATIONAL LINGUISTICS;

EID: 84906922946     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p14-1126     Document Type: Conference Paper

References (52)

1. Steven Abney. 2004. Understanding the Yarowsky algorithm. Computational Linguistics, 30:2004.
2. James K. Baker. 1979. Trainable grammars for speech recognition. In Proceedings of 97th meeting of the Acoustical Society of America, pages 547-550.
3. Taylor Berg-Kirkpatrick and Dan Klein. 2010. Phylogenetic grammar induction. In Proceedings of ACL- 2010, pages 1288-1297, Uppsala, Sweden, July.
4. Phil Blunsom and Trevor Cohn. 2010. Unsupervised induction of tree substitution grammars for dependency parsing. In Proceedings of EMNLP-2010, pages 1204-1213, Cambridge,MA, October.
5. Matthew Brand. 1998. Structure learning in conditional probability models via an entropic prior and parameter extinction. Neural Computation, 11(5):1155-1182.
6. Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceeding of CoNLL-2006, pages 149-164, New York, NY.
7. David Burkett and Dan Klein. 2008. Two languages are better than one (for syntactic parsing). In Proceedings of EMNLP-2008, pages 877-886, Honolulu, Hawaii, October.
8. Xavier Carreras. 2007. Experiments with a higherorder projective dependency parser. In Proceedings of the CoNLL Shared Task Session of EMNLPCONLL, pages 957-961.
9. Glenn Carroll and Eugene Charniak. 1992. Two experiments on learning probabilistic dependency grammars from corpora. In Proceedings of Working Notes of the Workshop Statistically-Based NLP Techniques.
10. Wenliang Chen, Jun'ichi Kazama, and Kentaro Torisawa. 2010. Bitext dependency parsing with bilingual subtree constraints. In Proceedings of ACL- 2010, pages 21-29, Uppsala, Sweden, July.
11. Shay Cohen and Noah A. Smith. 2009. Shared logistic normal distributions for soft parameter tying in unsupervised grammar induction. In Proceedings of NAACL/HLT-2009, pages 74-82, Boulder, Colorado, June.
12. Shay B. Cohen, Dipanjan Das, and Noah A. Smith. 2011. Unsupervised structure prediction with nonparallel multilingual guidance. In Proceedings of EMNLP-2011, pages 50-61, Edinburgh, Scotland, UK., July.
13. Dipanjan Das and Slav Petrov. 2011. Unsupervised part-of-speech tagging with bilingual graphbased projections. In Proceedings of ACL/HLT- 2011, pages 600-609, Portland, Oregon, USA, June.
14. Kuzman Ganchev, Jennifer Gillenwater, and Ben Taskar. 2009. Dependency grammar induction via bitext projection constraints. In Proceedings of ACL/AFNLP-2009, pages 369-377, Suntec, Singapore, August.
15. Jennifer Gillenwater, Kuzman Ganchev, João Graça, Fernando Pereira, and Ben Taskar. 2010. Sparsity in dependency grammar induction. In Proceedings of the ACL 2010 Conference Short Papers, pages 194-199, Uppsala, Sweden, July.
16. Joao V. Graca, Lf Inesc-id, Kuzman Ganchev, and Ben Taskar. 2007. Expectation maximization and posterior constraints. In Advances in NIPS, pages 569-576.
17. Yves Grandvalet and Yoshua Bengio. 2004. Semisupervised learning by entropyminimization. In Advances in Neural Information Processing Systems.
18. Liang Huang, Wenbin Jiang, and Qun Liu. 2009. Bilingually-constrained (monolingual) shift-reduce parsing. In Proceedings of EMNLP-2009, pages 1222-1231, Singapore, August.
19. Rebecca Hwa, Philip Resnik, Amy Weinberg, Clara Cabezas, and Okan Kolak. 2005. Bootstrapping parsers via syntactic projection across parallel texts. Natural Language Engineering, 11:11-311.
20. Feng Jiao, Shaojun Wang, Chi-Hoon Lee, Russell Greiner, and Dale Schuurmans. 2006. Semisupervised conditional random fields for improved sequence segmentation and labeling. In Proceedings of COLING/ACL-2006, pages 209-216, Sydney, Australia, July.
21. Jason Katz-Brown, Slav Petrov, Ryan McDonald, Franz Och, David Talbot, Hiroshi Ichikawa, Masakazu Seno, and Hideto Kazawa. 2011. Training a parser for machine translation reordering. In Proceedings of EMNLP-2011, pages 183-192, Edinburgh, Scotland, UK., July.
22. Dan Klein and Christopher Manning. 2004. Corpusbased induction of syntactic structure: Models of dependency and constituency. In Proceedings of ACL- 2004, pages 478-485, Barcelona, Spain, July.
23. Philipp Koehn. 2005. Europarl: A Parallel Corpus for Statistical Machine Translation. In Conference Proceedings: the tenth Machine Translation Summit, pages 79-86, Phuket, Thailand.AAMT, AAMT.
24. Terry Koo and Michael Collins. 2010. Efficient thirdorder dependency parsers. In Proceedings of ACL- 2010, pages 1-11, Uppsala, Sweden, July.
25. Terry Koo, Amir Globerson, Xavier Carreras, and Michael Collins. 2007. Structured predicition models via the matrix-tree theorem. In Proceedings of EMNLP-CONLL 2007, pages 141-150, Prague, Czech, June.
26. William D. Lewis and Fei Xia. 2010. Developing odin: A multilingual repository of annotated language data for hundreds of the world's languages. LLC, 25(3):303-319.
27. Xuezhe Ma and Hai Zhao. 2012. Fourth-order dependency parsing. In Proceedings of COLING 2012: Posters, pages 785-796,Mumbai, India, December.
28. Gideon S. Mann and Andrew McCallum. 2007. Efficient computation of entropy gradient for semisupervised conditional random fields. In Proceedings of NAACL/HLT-2007, pages 109-112, Stroudsburg, PA, USA.
29. David Mareček and Milan Straka. 2013. Stopprobability estimates computed on a large corpus improve unsupervised dependency parsing. In Proceedings of ACL-2013, pages 281-290, Sofia, Bulgaria, August.
30. Ryan McDonald and Fernando Pereira. 2006. Online learning of approximate dependency parsing algorithms. In Proceedings of EACL-2006, pages 81-88, Trento, Italy, April.
31. Ryan McDonald, Koby Crammer, and Fernando Pereira. 2005a. Online large-margin training of dependency parsers. In Proceedings of ACL-2005, pages 91-98, Ann Arbor, Michigan, USA, June 25-30.
32. Ryan McDonald, Fernando Pereira, Kiril Ribarov, and Jan Hajic. 2005b. Non-projective dependency parsing using spanning tree algorithms. In Proceedings of HLT/EMNLP-2005, pages 523-530, Vancouver, Canada, October.
33. Ryan McDonald, Slav Petrov, and Keith Hall. 2011. Multi-source transfer of delexicalized dependency parsers. In Proceedings of EMNLP-2011, pages 62-72, Edinburgh, Scotland, UK., July.
34. Ryan McDonald, Joakim Nivre, Yvonne Quirmbach- Brundage, Yoav Goldberg, Dipanjan Das, Kuzman Ganchev, Keith Hall, Slav Petrov, Hao Zhang, Oscar Täckström, Claudia Bedini, Núria Bertomeu Castelló, and Jungmee Lee. 2013. Universal dependency annotation for multilingual parsing. In Proceedings of ACL-2013, pages 92-97, Sofia, Bulgaria, August.
35. Tahira Naseem, Harr Chen, Regina Barzilay, and Mark Johnson. 2010. Using universal linguistic knowledge to guide grammar induction. In Proceedings of EMNLP-2010, pages 1234-1244, Cambridge, MA, October.
36. Stephen G. Nash and Jorge Nocedal. 1991. A numerical study of the limited memory bfgs method and truncated-newton method for large scale optimization. SIAM Journal on Optimization, 1(2):358-372.
37. Truc-Vien T. Nguyen, Alessandro Moschitti, and Giuseppe Riccardi. 2009. Convolution kernels on constituent, dependency and sequential structures for relation extraction. In Proceedings of EMNLP- 2009, pages 1378-1387, Singapore, August.
38. Joakim Nivre and Mario Scholz. 2004. Deterministic dependency parsing of English text. In Proceedings of COLING-2004, pages 64-70, Geneva, Switzerland, August 23-27.
39. Joakim Nivre, Johan Hall, Sandra Kübler, Ryan Mcdonald, Jens Nilsson, Sebastian Riedel, and Deniz Yuret. 2007. The conll 2007 shared task on dependency parsing. In Proceeding of EMNLP-CoNLL 2007, pages 915-932, Prague, Czech.
40. Joakim Nivre. 2008. Algorithms for deterministic incremental dependency parsing. Comput. Linguist., 34(4):513-553, December.
41. Mark A. Paskin. 2001. Cubic-time parsing and learning algorithms for grammatical bigram models. Technical Report, UCB/CSD-01-1148.
42. Slav Petrov, Dipanjan Das, and Ryan T. McDonald. 2011. A universal part-of-speech tagset. CoRR, abs/1104.2086.
43. Yusuke Shinyama, Satoshi Sekine, and Kiyoshi Sudo. 2002. Automatic paraphrase acquisition from news articles. In Proceeding of HLT-2002, pages 313-318.
44. Noah A. Smith and Jason Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proceedings of ACL-2005, pages 354-362, Ann Arbor, Michigan, June.
45. David A. Smith and Jason Eisner. 2007. Bootstrapping feature-rich dependency parsers with entropic priors. In Proceedings of EMNLP/CoNLL-2007, pages 667-677, Prague, Czech Republic, June.
46. David A. Smith and Noah A. Smith. 2004. Bilingual parsing with factored estimation: Using English to parse Korean. In Proceedings of EMNLP- 2004, pages 49-56.
47. David A. Smith and Noah A. Smith. 2007. Probabilistic models of nonporjective dependency trees. In Proceedings of EMNLP-CONLL 2007, pages 132-140, Prague, Czech, June.
48. Valentin I. Spitkovsky, Hiyan Alshawi, and Daniel Jurafsky. 2010. From baby steps to leapfrog: How "less is more" in unsupervised dependency parsing. In Proceedings of NAACL/HLT-2010, pages 751-759, Los Angeles, California, June.
49. Valentin I. Spitkovsky, Hiyan Alshawi, and Daniel Jurafsky. 2013. Breaking out of local optima with count transforms and model recombination: A study in grammar induction. In Proceedings of EMNLP- 2013, pages 1983-1995, Seattle, Washington, USA, October.
50. Kristina Toutanova, Dan Klein, Christopher D. Manning, and Yoram Singer. 2003. Feature-rich part-ofspeech tagging with a cyclic dependency network. In Proceedings of NAACL/HLT-2003, pages 252-259.
51. Jun Xie, Haitao Mi, and Qun Liu. 2011. A novel dependency-to-string model for statistical machine translation. In Proceedings of EMNLP-2011, pages 216-226, Edinburgh, Scotland, UK., July.
52. Hao Zhang, Liang Huang, Kai Zhao, and Ryan Mc- Donald. 2013. Online learning for inexact hypergraph search. In Proceedings of EMNLP-2013, pages 908-913, Seattle,Washington, USA, October.