Natural language grammar induction with a generative constituent-context model

Pattern Recognition

Volumn 38, Issue 9, 2005, Pages 1407-1419

  Klein, Dan ^a   Manning, Christopher D ^a  

^a Stanford University   (United States)

Author keywords

Distributional clustering; Grammar induction; Natural language; Structure learning; Unsupervised learning

Indexed keywords

LEARNING SYSTEMS; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; PROBABILITY; SYNTACTICS; TREES (MATHEMATICS);

DISTRIBUTIONAL CLUSTERING; GRAMMAR INDUCTION; STRUCTURE LEARNING; UNSUPERVISED LEARNING;

COMPUTATIONAL GRAMMARS;

EID: 19944397500     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2004.03.023     Document Type: Article

References (41)

1. S.M. Lamb, On the mechanisation of syntactic analysis, in: 1961 Conference on Machine Translation of Languages and Applied Language Analysis, vol. 2, Her Majesty's Stationery Office, London, 1961, pp. 674-685.
2. J.G. Wolff, Grammar discovery as data compression, in: D.H. Sleeman (Ed.), Proceedings of AISB/GI Conference (Proceedings of the 4th European Conference on Artificial Intelligence), Hamburg, Germany, July 1978, pp. 375-379.
3. P. Langley A production system model of first language acquisition Proceedings of the Eighth International Conference on Computational Linguistics 1980 Tokyo Japan 183 189
4. J.G. Wolff Learning syntax and meanings through optimization and distributional analysis Y. Levy I.M. Schlesinger M.D.S. Braine Categories and Processes in Language Acquisition 1988 Lawrence Erlbaum Hillsdale, NJ 179 215
5. G. Carroll, and E. Charniak Two experiments on learning probabilistic dependency grammars from corpora C. Weir S. Abney R. Grishman R. Weischedel Working Notes of the Workshop Statistically-Based NLP Techniques 1992 AAAI Press 1 13
6. F. Pereira, Y. Schabes, Inside-outside reestimation from partially bracketed corpora, in: ACL 30, 1992, pp. 128-135.
7. E. Brill, Automatic grammar induction and parsing free text: a transformation-based approach, in: ACL 31, 1993, pp. 259-265.
8. A. Stolcke, and S.M. Omohundro Inducing probabilistic grammars by Bayesian model merging Grammatical Inference and Applications Proceedings of the Second International Colloquium on Grammatical Inference 1994 Springer Berlin
9. A. Clark, Unsupervised induction of stochastic context-free grammars using distributional clustering, in: The Fifth Conference on Natural Language Learning, 2001.
10. M. Selfridge, A computer model of child language learning, in: Proceedings of the Seventh International Joint Conference on Artificial Intelligence, Vancouver, BC, 1981, pp. 92-96.
11. M. van Zaanen, ABL: Alignment-based learning, in: COLING 18, 2000, pp. 961-967. URL citeseer.nj.nec.com/432996.html.
12. J.K. Baker, Trainable grammars for speech recognition, in: D.H. Klatt, J.J. Wolf (Eds.), Speech Communication Papers for the 97th Meeting of the Acoustical Society of America, 1979, pp. 547-550.
13. S.F. Chen, Bayesian grammar induction for language modeling, in: ACL 33, 1995, pp. 228-235.
14. A. Radford Transformational Grammar 1988 Cambridge University Press Cambridge
15. Z. Harris Methods in Structural Linguistics 1951 University of Chicago Press Chicago
16. E.M. Gold Language identification in the limit Inform. Control 10 1967 447 474
17. J.J. Horning, A study of grammatical inference, Ph.D. Thesis, Stanford, 1969.
18. P. Adriaans, and E. Haas Grammar induction as substructural inductive logic programming J. Cussens Proceedings of the First Workshop on Learning Language in Logic 1999 Bled Slovenia 117 127
19. K.J. Lang, B.A. Pearlmutter, R.A. Price, Results of the Abbadingo One DFA learning competition and a new evidence-driven state merging algorithm, in: Proceedings of the Fourth International Colloquium on Grammatical Inference, of Lecture Notes in Artificial Intelligence, vol. 1433, Springer, Berlin, 1998, pp. 1-12.
20. N. Abe, M. Warmuth, On the computational complexity of approximating distributions by probabilistic automata, in: Proceedings of the Third Workshop on Computational Learning Theory, Morgan Kaufmann, 1990, pp. 52-66, URL citeseer.nj.nec.com/article/abe90computational.html.
21. M.J. Kearns, Y. Mansour, D. Ron, R. Rubinfeld, R.E. Schapire, L. Sellie, On the learnability of discrete distributions, in: Proceedings of the 25th Annual ACM Symposium on Theory of Computing, 1994, pp. 273-282.
22. E. Charniak, Tree-bank grammars, in: Proceedings of the 13th National Conference on Artificial Intelligence (AAAI '96), 1996, pp. 1031-1036.
23. M.J. Collins, Three generative, lexicalised models for statistical parsing, in: ACL 35/EACL 8, 1997, pp. 16-23.
24. P. Langley A model of early syntactic development Proceedings of the 20th Annual Conference of the Society for Computational Linguistics 1982 Toronto Canada 145 151
25. D.C. Olivier, Stochastic Grammars and language acquisition mechanisms, Ph.D. Thesis, Harvard University, 1968.
26. K. Lari, and S.J. Young The estimation of stochastic context-free grammars using the inside-outside algorithm Comput. Speech Language 4 1990 35 56
27. C. de la Higuera, J. Oncina, and E. Vidal Identification of DFA: Data-dependent versus data-independent algorithms Proceedings of the International Colloquium on Grammatical Inference (ICGI-96), Lecture Notes in Artificial Intelligence vol. 1147 1996 Springer Berlin 313 325
28. D. Klein, C.D. Manning, Distributional phrase structure induction, in: Proceedings of the Fifth Conference on Natural Language Learning (CoNLL 2001), 2001, pp. 113-120.
29. M.P. Marcus, B. Santorini, and M. Ann Marcinkiewicz Building a large annotated corpus of English The Penn treebank Comput. Linguist. 19 1993 313 330
30. S. Finch, and N. Chater Bootstrapping syntactic categories using statistical methods W. Daelemans D. Powers Background and Experiments in Machine Learning of Natural Language 1992 Tilburg University Institute for Language Technology and AI 229 235
31. H. Schütze, Distributional part-of-speech tagging, in: EACL, vol. 7, 1995, pp. 141-148.
32. A. Clark, Inducing syntactic categories by context distribution clustering, in: The Fourth Conference on Natural Language Learning, 2000.
33. G. Gazdar, and C. Mellish Natural language processing in LISP 1989 Addison-Wesley Wokingham, England
34. M. Johnson PCFG models of linguistic tree representations Comput. Linguist. 24 1998 613 632
35. D. Klein, and C.D. Manning Natural language grammar induction using a constituent-context model T.G. Dietterich S. Becker Z. Ghahramani Advances in Neural Information Processing Systems 14 (NIPS 2001) vol. 1 2001 MIT Press Cambridge, MA 35 42
36. E. Black, S. Abney, D. Flickinger, C. Gdaniec, R. Grishman, P. Harrison, D. Hindle, R. Ingria, F. Jelinek, J. Klavans, M. Liberman, M. Marcus, S. Roukos, B. Santorini, and T. Strzalkowski A procedure for quantitatively comparing the syntactic coverage of English grammars Proceedings, Speech and Natural Language Workshop 1991 Pacific Grove CA, DARPA 306 311
37. M.A.K. Halliday An Introduction to Functional Grammar second ed. 1994 Edward Arnold London
38. S.P. Abney, The English noun phrase in its sentential aspect, Ph.D. Thesis, MIT, Cambridge, MA, 1987.
39. S.P. Finch, Finding structure in language, Ph.D. Thesis, University of Edinburgh, 1993.
40. W. Skut, B. Krenn, T. Brants, H. Uszkoreit, An annotation scheme for free word order languages, in: Proceedings of the Fifth Conference on Applied Natural Language Processing (ANLP-97), 1997.
41. N. Xue, F.-D. Chiou, M. Palmer, Building a large-scale annotated Chinese corpus, in: Proceedings of the 19th International Conference on Computational Linguistics (COLING 2002), 2002.