Three dependency-and-boundary models for grammar induction

EMNLP-CoNLL 2012 - 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Proceedings of the Conference

Volumn , Issue , 2012, Pages 688-698

  Spitkovsky, Valentin I ^a   Alshawi, Hiyan ^b   Jurafsky, Daniel ^a  

^a STANFORD UNIVERSITY   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BOUNDARY MODELS; DEPENDENCY GRAMMAR; DEPENDENCY TREES; DISTRIBUTIONS OF WORDS; GRAMMAR INDUCTION; INITIALIZERS; SENTENCE BOUNDARIES; SENTENCE LENGTH;

LEARNING ALGORITHMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84883345730     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (56)

1. H. Alshawi, S. Bangalore, and S. Douglas. 2000. Learning dependency translation models as collections of finite-state head transducers. Computational Linguistics, 26.
2. H. Alshawi. 1996a. Head automata for speech translation. In ICSLP.
3. H. Alshawi. 1996b. Method and apparatus for an improved language recognition system. US Patent 1999/5870706.
4. J. K. Baker. 1979. Trainable grammars for speech recognition. In Speech Communication Papers for the 97th Meeting of the Acoustical Society of America.
5. Y. Bengio, J. Louradour, R. Collobert, and J. Weston. 2009. Curriculum learning. In ICML.
6. J. Berant, Y. Gross, M. Mussel, B. Sandbank, E. Ruppin, and S. Edelman. 2006. Boosting unsupervised grammar induction by splitting complex sentences on function words. In BUCLD.
7. T. Berg-Kirkpatrick and D. Klein. 2010. Phylogenetic grammar induction. In ACL.
8. T. Berg-Kirkpatrick, A. Bouchard-Côté, J. DeNero, and D. Klein. 2010. Painless unsupervised learning with features. In NAACL-HLT.
9. A. Bhattacharyya. 1943. On a measure of divergence between two statistical populations defined by their probability distributions. BCMS, 35.
10. D. M. Bikel. 2004. Intricacies of Collins' parsing model. Computational Linguistics, 30.
11. A. Blum and T. Mitchell. 1998. Combining labeled and unla-beled data with co-training. In COLT.
12. M. R. Brent and J. M. Siskind. 2001. The role of exposure to isolated words in early vocabulary development. Cognition, 81.
13. P. F. Brown, V. J. Della Pietra, S. A. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19.
14. S. Buchholz and E. Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In CoNLL.
15. G. Carroll and E. Charniak. 1992. Two experiments on learning probabilistic dependency grammars from corpora. Technical report, Brown University.
16. S. B. Cohen and N. A. Smith. 2009. Shared logistic normal distributions for soft parameter tying in unsupervised grammar induction. In NAACL-HLT.
17. S. B. Cohen and N. A. Smith. 2010. Viterbi training for PCFGs: Hardness results and competitiveness of uniform initialization. In ACL.
18. S. B. Cohen, D. Das, and N. A. Smith. 2011. Unsupervised structure prediction with non-parallel multilingual guidance. In EMNLP.
19. M. Collins. 1997. Three generative, lexicalised models for statistical parsing. In ACL.
20. M. Collins. 1999. Head-Driven Statistical Models for Natural Language Parsing. Ph.D. thesis, University of Pennsylvania.
21. M. Collins. 2003. Head-driven statistical models for natural language parsing. Computational Linguistics, 29.
22. J. Eisner and G. Satta. 1999. Efficient parsing for bilexical context-free grammars and head-automaton grammars. In ACL.
23. J. M. Eisner. 1996. An empirical comparison of probability models for dependency grammar. Technical report, IRCS.
24. J. Eisner. 2000. Bilexical grammars and their cubic-time parsing algorithms. In H. C. Bunt and A. Nijholt, editors, Advances in Probabilistic and Other Parsing Technologies. Kluwer Academic Publishers.
25. J. L. Elman. 1993. Learning and development in neural networks: The importance of starting small. Cognition, 48.
26. R. Frank. 2000. From regular to context-free to mildly context-sensitive tree rewriting systems: The path of child language acquisition. In A. Abeillé and O. Rambow, editors, Tree Adjoining Grammars: Formalisms, Linguistic Analysis and Processing. CSLI Publications.
27. J. Gillenwater, K. Ganchev, J. Graça, B. Taskar, and F. Pereira. 2009. Sparsity in grammar induction. In NIPS: Grammar Induction, Representation of Language and Language Learning.
28. J. Gillenwater, K. Ganchev, J. Graça, F. Pereira, and B. Taskar. 2010. Posterior sparsity in unsupervised dependency parsing. Technical report, University of Pennsylvania.
29. K. Gimpel and N. A. Smith. 2011. Concavity and initialization for unsupervised dependency grammar induction. Technical report, CMU.
30. C. Hänig. 2010. Improvements in unsupervised co-occurrence based parsing. In CoNLL.
31. W. P. Headden, III, M. Johnson, and D. McClosky. 2009. Improving unsupervised dependency parsing with richer contexts and smoothing. In NAACL-HLT.
32. D. Klein and C. D. Manning. 2004. Corpus-based induction of syntactic structure: Models of dependency and constituency. In ACL.
33. K. A. Krueger and P. Dayan. 2009. Flexible shaping: How learning in small steps helps. Cognition, 110.
34. M. P. Marcus, B. Santorini, and M. A. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19.
35. D. Mareček and Z. Zabokrtský. 2011. Gibbs sampling with treeness constraint in unsupervised dependency parsing. In ROBUS.
36. D. McClosky. 2008. Modeling valence effects in unsupervised grammar induction. Technical report, Brown University.
37. R. McDonald, S. Petrov, and K. Hall. 2011. Multi-source transfer of delexicalized dependency parsers. In EMNLP.
38. T. Naseem, H. Chen, R. Barzilay, and M. Johnson. 2010. Using universal linguistic knowledge to guide grammar induction. In EMNLP.
39. M. S. Nikulin. 2002. Hellinger distance. In M. Hazewinkel, editor, Encyclopaedia of Mathematics. Kluwer Academic Publishers.
40. J. Nivre, J. Hall, S. Kübler, R. McDonald, J. Nilsson, S. Riedel, and D. Yuret. 2007. The CoNLL 2007 shared task on dependency parsing. In EMNLP-CoNLL.
41. M. A. Paskin. 2001a. Cubic-time parsing and learning algorithms for grammatical bigram models. Technical report, UCB.
42. M. A. Paskin. 2001b. Grammatical bigrams. In NIPS.
43. F. Pereira and Y. Schabes. 1992. Inside-outside reestimation from partially bracketed corpora. In ACL.
44. E. Ponvert, J. Baldridge, and K. Erk. 2010. Simple unsuper-vised identification of low-level constituents. In ICSC.
45. M. S. Rasooli and H. Faili. 2012. Fast unsupervised dependency parsing with arc-standard transitions. In ROBUS-UNSUP.
46. R. Samdani, M.-W. Chang, and D. Roth. 2012. Unified expectation maximization. In NAACL-HLT.
47. Y. Seginer. 2007. Learning Syntactic Structure. Ph.D. thesis, University of Amsterdam.
48. A. Søgaard. 2011a. Data point selection for cross-language adaptation of dependency parsers. In ACL.
49. A. Søgaard. 2011b. From ranked words to dependency trees: two-stage unsupervised non-projective dependency parsing. In TextGraphs.
50. V. I. Spitkovsky, H. Alshawi, and D. Jurafsky. 2009. Baby Steps: How "Less is More" in unsupervised dependency parsing. In NIPS: Grammar Induction, Representation of Language and Language Learning.
51. V. I. Spitkovsky, H. Alshawi, and D. Jurafsky. 2011a. Lateen EM: Unsupervised training with multiple objectives, applied to dependency grammar induction. In EMNLP.
52. V. I. Spitkovsky, H. Alshawi, and D. Jurafsky. 2011b. Punctuation: Making a point in unsupervised dependency parsing. In CoNLL.
53. V. I. Spitkovsky, H. Alshawi, and D. Jurafsky. 2012a. Bootstrapping dependency grammar inducers from incomplete sentence fragments via austere models - the "wabi-sabi" of unsupervised parsing. In submission.
54. V. I. Spitkovsky, H. Alshawi, and D. Jurafsky. 2012b. Capitalization cues improve dependency grammar induction. In WILS.
55. K. Tu and V. Honavar. 2011. On the utility of curricula in unsupervised learning of probabilistic grammars. In IJCAI.
56. F. Xia and M. Palmer. 2001. Converting dependency structures to phrase structures. In HLT.