From baby steps to leapfrog: How "Less is more" in unsupervised dependency parsing

NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2010, Pages 751-759

  Spitkovsky, Valentin I ^a   Alshawi, Hiyan ^b   Jurafsky, Daniel ^a  

^a STANFORD UNIVERSITY   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA COMPLEXITY; DEPENDENCY MODEL; DEPENDENCY PARSING; GRAMMAR INDUCTION; ITERATED LEARNING; LOW-COMPLEXITY; TRAINING SETS; UNSUPERVISED ALGORITHMS; WALL STREET JOURNAL;

COMPUTATIONAL LINGUISTICS;

CONTEXT FREE GRAMMARS;

EID: 84858423134     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (45)

1. E. L. Allgower and K. Georg. 1990. Numerical Continuation Methods: An Introduction. Springer-Verlag.
2. H. Alshawi and S. Douglas. 2000. Learning dependency transduction models from unannotated examples. In Royal Society of London Philosophical Transactions Series A, volume 358.
3. H. Alshawi. 1996. Head automata for speech translation. In Proc. of ICSLP.
4. J. K. Baker. 1979. Trainable grammars for speech recognition. In Speech Communication Papers for the 97th Meeting of the Acoustical Society of America.
5. Y. Bengio, J. Louradour, R. Collobert, and J. Weston. 2009. Curriculum learning. In ICML.
6. P. F. Brown, V. J. Della Pietra, S. A. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19.
7. E. Charniak and M. Johnson. 2005. Coarse-to-fine n-best parsing and MaxEnt discriminative reranking. In Proc. of ACL.
8. E. Charniak, M. Johnson, M. Elsner, J. Austerweil, D. Ellis, I. Haxton, C. Hill, R. Shrivaths, J. Moore, M. Pozar, and T. Vu. 2006. Multilevel coarse-to-fine PCFG parsing. In HLT-NAACL.
9. S. B. Cohen and N. A. Smith. 2009. Shared logistic normal distributions for soft parameter tying in unsupervised grammar induction. In Proc. of NAACL-HLT.
10. S. B. Cohen, K. Gimpel, and N. A. Smith. 2008. Logistic normal priors for unsupervised probabilistic grammar induction. In NIPS.
11. M. Collins. 1999. Head-Driven Statistical Models for Natural Language Parsing. Ph.D. thesis, University of Pennsylvania.
12. M. Dorigo and M. Colombetti. 1998. Robot Shaping: An Experiment in Behavior Engineering. MIT Press/Bradford Books.
13. J. L. Elman. 1993. Learning and development in neural networks: The importance of starting small. Cognition, 48.
14. D. Elworthy. 1994. Does Baum-Welch re-estimation help taggers? In Proc. of ANLP.
15. W. N. Francis and H. Kucera, 1979. Manual of Information to Accompany a Standard Corpus of Present-Day Edited American English, for use with Digital Computers. Department of Linguistic, Brown University.
16. Y. Freund and R. E. Schapire. 1997. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1).
17. A. Halevy, P. Norvig, and F. Pereira. 2009. The unreasonable effectiveness of data. IEEE Intelligent Systems, 24(2).
18. W. P. Headden, III, M. Johnson, and D. McClosky. 2009. Improving unsupervised dependency parsing with richer contexts and smoothing. In Proc. of NAACL-HLT.
19. R. Kail. 1984. The development of memory in children. W. H. Freeman and Company, 2nd edition.
20. D. Klein and C. D. Manning. 2004. Corpus-based induction of syntactic structure: Models of dependency and constituency. In Proc. of ACL.
21. D. Klein. 2005. The Unsupervised Learning of Natural Language Structure. Ph.D. thesis, Stanford University.
22. K. A. Krueger and P. Dayan. 2009. Flexible shaping: How learning in small steps helps. Cognition, 110.
23. P. Liang and D. Klein. 2008. Analyzing the errors of unsupervised learning. In Proc. of HLT-ACL.
24. M. P. Marcus, B. Santorini, and M. A. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2).
25. D. McClosky, E. Charniak, and M. Johnson. 2006. Effective self-training for parsing. In Proc. of NAACL-HLT.
26. R. McDonald, F. Pereira, K. Ribarov, and J. Hajic. 2005. Non-projective dependency parsing using spanning tree algorithms. In Proc. of HLT-EMNLP.
27. B. Merialdo. 1994. Tagging English text with a probabilistic model. Computational Linguistics, 20(2):155-172.
28. E. L. Newport. 1988. Constraints on learning and their role in language acquisition: Studies of the acquisition of American Sign Language. Language Sciences, 10(1).
29. E. L. Newport. 1990. Maturational constraints on language learning. Cognitive Science, 14(1).
30. S. Petrov, A. Haghighi, and D. Klein. 2008. Coarse-to-fine syntactic machine translation using language projections. In Proc. of EMNLP.
31. S. O. Petrov. 2009. Coarse-to-Fine Natural Language Processing. Ph.D. thesis, University of California, Berkeley.
32. S. Ravi and K. Knight. 2009. Minimized models for unsupervised part-of-speech tagging. In Proc. of ACL-IJCNLP.
33. D. L. T. Rohde and D. C. Plaut. 1999. Language acquisition in the absence of explicit negative evidence: How important is starting small? Cognition, 72(1).
34. L. M. Saksida, S. M. Raymond, and D. S. Touretzky. 1997. Shaping robot behavior using principles from instrumental conditioning. Robotics and Autonomous Systems, 22(3).
35. S. Salvador and P. Chan. 2004. Determining the number of clusters/segments in hierarchical clustering/segmentation algorithms. In Proc. of ICTAI.
36. T. D. Sanger. 1994. Neural network learning control of robot manipulators using gradually increasing task difficulty. IEEE Trans. on Robotics and Automation, 10.
37. T. Savage. 1998. Shaping: The link between rats and robots. Connection Science, 10(3).
38. T. Savage. 2001. Shaping: A multiple contingencies analysis and its relevance to behaviour-based robotics. Connection Science, 13(3).
39. Y. Seginer. 2007. Fast unsupervised incremental parsing. In Proc. of ACL.
40. S. P. Singh. 1992. Transfer of learning by composing solutions of elemental squential tasks. Machine Learning, 8.
41. B. F. Skinner. 1938. The behavior of organisms: An experimental analysis. Appleton-Century-Crofts.
42. N. A. Smith and J. Eisner. 2004. Annealing techniques for unsupervised statistical language learning. In Proc. of ACL.
43. N. A. Smith and J. Eisner. 2005. Guiding unsupervised grammar induction using contrastive estimation. In Proc. of the IJCAI Workshop on Grammatical Inference Applications.
44. N. A. Smith and J. Eisner. 2006. Annealing structural bias in multilingual weighted grammar induction. In Proc. of COLING-ACL.
45. J. Suzuki, H. Isozaki, X. Carreras, and M. Collins. 2009. An empirical study of semi-supervised structured conditional models for dependency parsing. In Proc. of EMNLP.