Unsupervised grammar induction using history based approach

Computer Speech and Language

Volumn 20, Issue 4, 2006, Pages 644-658

  Feili, Heshaam ^a   Ghassem Sani, Gholamreza ^a  

^a SHARIF UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; PERSONNEL TRAINING; PROBLEM SOLVING; SPEECH ANALYSIS; STATISTICAL METHODS;

GRAMMAR INDUCTION; HISTORY-BASED INSIDE-OUTSIDE (HIO); INDUCTIVE METHODS; LEXICAL INFORMATION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 33746570159     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2005.11.001     Document Type: Article

References (64)

1. Adriaans P., and Haas E. Grammar induction as substructural inductive logic programming. In: Cussens J. (Ed). Proceedings of the 1st Workshop on Learning Language in Logic (1999), Bled, Slovenia 117-127
2. Allen J. Natural Language Understanding (1995), Benjamin/Cummings Pub
3. Amaya, F., Benedi, J.M., Sanchez, J.A., 1999. Learning of stochastic context-free grammars from bracketed corpora by means of reestimation algorithms. In: The VIII Symposium on Pattern Recognition and Image Analysis, vol. 1, pp. 19-126, Bilbao.
4. Amtrup, J.W., Rad, H.R., Megerdoomian, K., Zajac, R., 2000. Persian-English Machine Translation: An Overview of the Shiraz Project, NMSU, CRL. Memoranda in Computer and Cognitive Science MCCS-00-319.
5. Baker, J.K., 1979. Trainable grammars for speech recognition. Speech communication papers for the 97th Meeting of the Acoustical Society of America, pp. 547-550.
6. Bateni M. Tosif-e Sakhtari Zaban-e Farsi (Describing the Persian Structure) (1995), Amir-Kabir Press, Tehran, Iran (in Persian)
7. Bijankhan M. Emkansanji baraye Tarhe Modelsaziye Zabane Farsi (The feasibility study for Persian language modeling). The Journal of Literature 162-163 50-51 (2003) 81-96 (in Persian)
8. Bijankhan M. Naghshe Peykarehaye Zabani dar Neveshtane Dasture Zaban: Mo'arrefiye yek Narmafzare Rayane'i (The role of corpus in generating grammar: presenting a computational software and corpus). Iranian Linguistic Journal 2 19 (2005) 48-67 (in Persian)
9. Black, E., Abnery, S., Flickinger, D., et al., 1991. A procedure for quantitatively comparing the syntactic coverage of English grammars, In: DARPA Speech and Natural Language Workshop, pp. 306-311.
10. Black, E., Lafferty, J., Roukos, S., 1992. Development and evaluation of a broad-coverage probabilistic grammar of English-language computer manuals. In: The Proceedings of the 30th Annual Meeting of the Association for computational Linguistics, pp. 185-192.
11. Black, E., Jelinek, F., Lafferty, J., Magerman, D., Mercer, R., Roukos, S. 1992., Towards history-based grammars: using richer models for probabilistic parsing. In: The Proceedings of the 5th DARPA Speech and Natural Languages Workshop, Harriman, NY.
12. Brill, E., 1993. A corpus-based approach to language learning. Ph.D. Thesis, Department of the computer and Information Science, University of Pennsylvania.
13. Briscoe, T., Waegner, N., 1992. Robust stochastic parsing using the inside-outside algorithm. In: AAAI-92 Workshop on Statistically Based NLP Techniques.
14. Carroll, G., Charniak, E., 1992. Two experiments on learning probabilistic dependency grammars from corpora, Technical Reports CS-92-16, Department of Computer Science, Brown University, March .
15. Casacuberta F. Growth transformations for probabilistic functions of stochastic grammars. IJPRAI 10 3 (1996) 183-201
16. Charniak E. Statistical Language Learning (1993), MIT Press, Cambridge, MA
17. Charniak E. Statistical Language Learning (1996), MIT Press, Cambridge, London, UK
18. Charniak E. Statistical parsing with a context-free grammar and word statistics. Proceedings of the 14th National Conference on Artificial Intelligence (1997), AAAI Press/MIT Press, Menlo Park 598-603
19. Charniak E. Statistical techniques for natural language parsing. AI Magazine 18 4 (1997) 33-44
20. Charniak, E., 2000. A maximum-entropy-inspired parser. In: NAACL 1, pp. 132-139.
21. Chen, S.F., 1995. Bayesian grammar induction for language modeling. In: Proceedings of the Association for Computational Linguistics, pp. 228-235.
22. Church, K., 1988. A stochastic parts program and noun phrase parser for unrestricted text. In: The Proceedings of the Second Conference on Applied Natural Language Processing, pp. 136-143.
23. Clark, A., 2001., Unsupervised induction of stochastic context-free grammars using distributional clustering. In: The Fifth Conference on Natural Language Learning.
24. Clark, A., 2001. Unsupervised language acquisition: theory and practice. Ph.D. Thesis, University of Sussex.
25. Collins, M., 1996. A new statistical parser based on bigram lexical dependencies. In: The Proceedings of the 34th Annual Meeting of the ACL, Santa Cruz.
26. Collins, M.J., 1997. Three generative, lexicalized models for statistical parsing. In: ACL 35/EACL 8, pp. 16-23.
27. Feili H., and Ghassem-Sani G. An application of lexicalized grammars in English-Persian translation. Proceedings of the 16th European Conference on Artificial Intelligence (ECAI 2004) (2004), Universidad Politecnica de Valencia, Spain 596-600
28. Grune D., and Jacobs C.J.H. Parsing Techniques, a Practical Guide (1990), Ellis Horwood, Chichester, England
29. Hemphill, C.T., Godfrey, J., Doddington, G., 1990. The ATIS spoken language systems pilot corpus. In: DARPA Speech and Natural language Workshop, Hidden Valey, Pennsylvania, June.
30. Homes J.N. Speech Synthesis and Recognition (1988), Van Nostrand Reinhold
31. Jelinek, F., Laferty, J.D., Magerman, D., Mercer, R., Ratnaparakhi, A., Roukos, S., 1994. Decision-tree parsing using hidden derivation model. In: The Proceedings of the 1994 Human Language Technology Workshop, pp. 272-277.
32. Johnson, M., 1998. The effect of alternative tree representations on tree bank grammars. In: Powers, D.M.W. (Ed.) NeMLaP3/CoNLL98: New Methods in Language Processing and Computational Natural Language Learning, ACL, pp. 39-48.
33. Jurafsky D., and Martin J.H. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition (2000), Prentice-Hall Inc., New Jersey
34. Kasami, T., 1965. An efficient recognition and syntax algorithm for context-free languages. Scientific Report AFCRL-65-758, Air Force Cambridge Research Laboratory, Bedford, MA.
35. Kehler, A., Stolcke, A., 1999. Preface. In: Kehler, A. Stolcke, A. (Eds.), Unsupervised Learning in Natural Language Processing. Proceedings of the Workshop. Association for Computational Linguistics.
36. Khanlari P. Tarikh-e Zaban-e Farsi Tehran (History of Persian Language) (1995), Simorgh Press, Iran (in Persian)
37. Klein, D., Manning, C.D., 2001. Distributional phrase structure induction. In: Proceedings of the Fifth Conference on Natural Language Learning (CoNLL 2001), pp. 113-120.
38. Klein D., and Manning C.D. Natural language grammar induction using a constituent-context model. In: Dietterich T.G., Becker S., and Ghahramani Z. (Eds). Advances in Neural Information Processing Systems 14 (NIPS 2001) vol. 1 (2001), MIT Press 35-42
39. Klein, D., Manning, C.D., 2002. A generative constituent-context model for improved grammar induction. In: ACL 40, pp. 128-135.
40. Klein, D., Manning, C.D., 2004. Corpus-based induction of syntactic structure: models of dependency and constituency. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL 04).
41. Klein, D., Manning, C.D. 2005. The Unsupervised Learning of Natural Language Structure. Ph.D. Thesis, Department of Computer Science, Stanford University.
42. Lari K., and Young S.J. The estimation of stochastic context-free grammar using the inside-outside algorithm. Computer Speech and Language 4 (1990) 35-56
43. Magerman, D.M., Marcus, M.P., 1990.Parsing a natural language using mutual information statistics. In Proceedings of the Eighth National Conference on Artificial Intelligence, August.
44. Magerman, D., Marcus, M., 1991. Pearl: a probabilistic chart parser. In: The Proceedings of the 1991 European ACL conference, Berlin, Germany.
45. Magerman, D., Weir, D., 1992. Efficiency, robustness and accuracy in picky chart parsing. In: The Proceedings of the 30th Annual Meeting of the Association for Computational Linguistics, pp. 40-47.
46. Magerman, D.M., 1995. Statistical decision-tree models for parsing. In: The Proceedings of ACL Conference, June 1995.
47. Manning C., and Schutze H. Foundations of Statistical Natural Language Processing (1999), MIT Press, Cambridge, MA
48. Marcken, C., 1995. On the unsupervised induction of phrase-structure grammars. In: The Proceedings of the 3rd Workshop on Very Large Corpora.
49. Marcken, C., 1996. Unsupervised language acquisition. Ph.D. Thesis, Department of Electrical Engineering and Computer Science, MIT.
50. Marcus M.P., Santorini B., and Marcinkiewicz M.A. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics 19 (1993) 313-330
51. Megerdoomian, K., 2000. Persian Computational Morphology: A Unification-Based Approach, NMSU, CRL. Memoranda in Computer and Cognitive Science (MCCS-00-320).
52. Paskin M.A. Grammatical bigrams. In: Dietterich T.G., Becker S., and Ghahramani Z. (Eds). Advances in Neural Information Processing Systems 14 (2002), MIT Press, Cambridge, MA
53. Pereira, F., Schabes, Y., 1992. Inside-outside re-estimation from partially bracketed corpora. In: The Proceeding of 30th Annual Meeting of the ACL, pp. 128-135.
54. Sanchez, J.A., Benedi, J.M., Casacuberta, F., 1996. Comparison between the inside-outside algorithm and the Viterbi algorithm for stochastic context-free grammars. In: The Proceedings of the 6th International Workshop on Advances in Structural and Syntactical Pattern Recognition, pp. 50-59.
55. Sanchez, J.A., Benedi, J.M., 1998. Estimation of the probability distributions of stochastic context-free grammars from the K-best derivations. In: The 5th International Conference on Spoken Language Proceeding.
56. Sanchez, J.A., Benedi, J.M., 1999. Probabilistic estimation of stochastic context-free grammars from the k-best derivations. In: The VIII Symposium on Pattern Recognition and Image Analysis, vol. 2, pp. 7-8, Bilbao.
57. Schabes, Y., Roth, M., Obsorne, R., 1993. Parsing the Wall Street Journal with the inside-outside algorithm. In: The Proceedings of the 6th Conference of the European Chapter of the ACL, pp. 341-347.
58. Stolcke A., and Omohundro S.M. Inducing probabilistic grammars by Bayesian model merging. Grammatical Inference and Applications. Proceedings of the Second International Colloquium on Grammatical Inference (1994), Springer Verlag
59. Thanaruk T., and Okumaru M. Grammar acquisition and statistical parsing. Journal of Natural language Processing 2 3 (1995)
60. Van Zaanen, M., 2000. ABL: alignment-based learning. In: COLING 2000, pp. 961-967.
61. Van Zaanen, M., 2002. Bootstrapping structure into language: alignment-based learning. Ph.D. Thesis, School of Computing, University of Leeds.
62. Van Zaanen, M., Adriaans, P.W., 2001. Comparing two unsupervised grammar induction systems: alignment-based learning vs. EMILE. Technical Report: TR2001.05, School of Computing, University of Leeds.
63. 3). Information and Control 10 (1967) 189-208
64. Yuret, D., 1998. Discovery of linguistic relations using lexical attraction. Ph.D. Thesis, MIT.