Viterbi training improves unsupervised dependency parsing

CoNLL 2010 - Fourteenth Conference on Computational Natural Language Learning, Proceedings of the Conference

Volumn , Issue , 2010, Pages 9-17

  Spitkovsky, Valentin I ^a   Alshawi, Hiyan ^a   Jurafsky, Daniel ^b   Manning, Christopher D ^b  

^a GOOGLE INC   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEPENDENCY MODEL; DEPENDENCY PARSING; GRAMMAR INDUCTION; STATE-OF-THE-ART PERFORMANCE; VITERBI; WALL STREET JOURNAL;

EID: 84862302923     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. H. Alshawi and S. Douglas. 2000. Learning dependency transduction models from unannotated examples. In Royal Society of London Philosophical Transactions Series A, volume 358.
2. H. Alshawi. 1996. Head automata for speech translation. In Proc. of ICSLP.
3. J. K. Baker. 1979. Trainable grammars for speech recognition. In Speech Communication Papers for the 97th Meeting of the Acoustical Society of America.
4. G. E. P. Box and N. R. Draper. 1987. Empirical Model-Building and Response Surfaces. John Wiley.
5. P. F. Brown, V. J. Della Pietra, S. A. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19.
6. E. Charniak. 1993. Statistical Language Learning. MIT Press.
7. N. Chater, M. J. Crocker, and M. J. Pickering. 1998. The rational analysis of inquiry: The case of parsing. In M. Oaksford and N. Chater, editors, Rational Models of Cognition. Oxford University Press.
8. S. Clark, J. Curran, and M. Osborne. 2003. Bootstrapping POS-taggers using unlabelled data. In Proc. of CoNLL.
9. S.B.Cohen and N. A. Smith. 2009. Shared logistic normal distributions for soft parameter tying in unsupervised grammar induction. In Proc. of NAACL-HLT.
10. S.B.Cohen and N. A. Smith. 2010. Viterbi training for PCFGs: Hardness results and competitiveness of uniform initialization. In Proc. of ACL.
11. M.Collins. 1999. Head-Driven Statistical Models for Natural Language Parsing. Ph.D. thesis, University of Pennsylvania.
12. H. Daumé, III, J. Langford, and D. Marcu. 2009. Search-based structured prediction. Machine Learning, 75(3).
13. C.de Marcken. 1995. Lexical heads, phrase structure and the induction of grammar. In WVLC.
14. D.Elworthy. 1994. Does Baum-Welch re-estimation help taggers? In Proc. of ANLP.
15. W. N. Francis and H. Kucera, 1979. Manual of Information to Accompany a Standard Corpus of Present-Day Edited American English, for use with Digital Computers. Department of Linguistic, Brown University.
16. J.Gillenwater, K. Ganchev, J. Graça, B. Taskar, and F. Pereira. 2009. Sparsity in grammar induction. In NIPS: Grammar Induction, Representation of Language and Language Learning.
17. W.P. Headden, III, M. Johnson, and D. McClosky. 2009. Improving unsupervised dependency parsing with richer contexts and smoothing. In Proc. of NAACL-HLT.
18. D. Jurafsky. 1996. A probabilistic model of lexical and syntactic access and disambiguation. Cognitive Science, 20.
19. D. Klein and C.D. Manning. 2004. Corpus-based induction of syntactic structure: Models of dependency and constituency. In Proc. of ACL.
20. R. L. Lewis and S. Vasishth. 2005. An activation-based model of sentence processing as skilled memory retrieval. Cognitive Science, 29.
21. P. Liang and D. Klein. 2008. Analyzing the errors of unsu-pervised learning. In Proc. of HLT-ACL.
22. M. P. Marcus, B. Santorini, and M. A. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2).
23. D. McClosky, E. Charniak, and M. Johnson. 2006a. Effective self-training for parsing. In Proc. of NAACL-HLT.
24. D. McClosky, E. Charniak, and M. Johnson. 2006b. Rerank-ing and self-training for parser adaptation. In Proc. of COLING-ACL.
25. B. Merialdo. 1994. Tagging English text with a probabilistic model. Computational Linguistics, 20(2).
26. V. Ng and C. Cardie. 2003. Weakly supervised natural language learning without redundant views. In Proc. of HLT-NAACL.
27. F. Pereira and Y. Schabes. 1992. Inside-outside reestimation from partially bracketed corpora. In Proc. of ACL.
28. V. I. Spitkovsky, H. Alshawi, and D. Jurafsky. 2009. Baby Steps: How "Less is More" in unsupervised dependency parsing. In NIPS: Grammar Induction, Representation of Language and Language Learning.
29. V. I. Spitkovsky, D. Jurafsky, and H. Alshawi. 2010. Profiting from mark-up: Hyper-text annotations for guided parsing. In Proc. of ACL.
30. M. J. Wainwright. 2006. Estimating the "wrong" graphical model: Benefits in the computation-limited setting. Journal of Machine Learning Research, 7.