A general technique to train language models on language models

Computational Linguistics

Volumn 31, Issue 2, 2005, Pages 173-185

  Nederhof, Mark Jan ^a,b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b Groningen Research School for the Study of the Humanities   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

KULLBACK-LEIBLER DISTANCE; LANGUAGE MODEL; N-GRAM MODELING; PROBABILISTIC CONTEXT FREE GRAMMARS; SECOND LANGUAGE;

CONTEXT FREE GRAMMARS;

EID: 33646401372     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/0891201054223986     Document Type: Article

References (20)

1. Aho, Alfred V. and Jeffrey D. Ullman. 1972. Parsing, volume 1 of The Theory of Parsing, Translation and Compiling. Prentice Hall, Englewood Cliffs, NJ.
2. Bar-Hillel, Yehoshua, M. Perles, and E. Shamir. 1964. On formal properties of simple phrase structure grammars. In Yehoshua Bar-Hillel, editor, Language and Information: Selected Essays on Their Theory and Application. Addison-Wesley, Reading, MA, pages 116-150.
3. Bertsch, Eberhard and Mark-Jan Nederhof. 2001. On the complexity of some extensions of RCG parsing. In Proceedings of the Seventh International Workshop on Parsing Technologies, pages 66-77, Beijing, October.
4. Booth, Taylor L. and Richard A. Thompson. 1973. Applying probabilistic measures to abstract languages. IEEE Transactions on Computers, C-22(5):442-450.
5. Boullier, Pierre. 2000. Range concatenation grammars. In Proceedings of the Sixth International Workshop on Parsing Technologies, pages 53-64, Trento, Italy, February.
6. Jurafsky, Daniel, Chuck Wooters, Gary Tajchman, Jonathan Segal, Andreas Stolcke, Eric Fosler, and Nelson Morgan. 1994. The Berkeley Restaurant Project. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-94), pages 2139-2142, Yokohama, Japan.
7. Lang, Bernard. 1994. Recognition can be harder than parsing. Computational Intelligence, 10(4):486-494.
8. Manning, Christopher D. and Hinrich Schütze. 1999. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA.
9. Mohri, Mehryar. 1997. Finite-state transducers in language and speech processing. Computational Linguistics, 23(2):269-311.
10. Mohri, Mehryar and Mark-Jan Nederhof. 2001. Regular approximation of context-free grammars through transformation. In J.-C. Junqua and G. van Noord, editors, Robustness in Language and Speech Technology. Kluwer Academic, pages 153-163.
11. Nederhof, Mark-Jan. 2000. Practical experiments with regular approximation of context-free languages. Computational Linguistics, 26(1):17-44.
12. Nederhof, Mark-Jan and Giorgio Satta. 2003. Probabilistic parsing as intersection. In Proceedings of the Eighth International Workshop on Parsing Technologies, pages 137-148, Laboratoire Lorrain de recherche en informatique et ses applications (LORIA), Nancy, France, April.
13. Paz, Azaria. 1971. Introduction to Probabilistic Automata. Academic Press, New York.
14. Rimon, Mori and J. Herz. 1991. The recognition capacity of local syntactic constraints. In Proceedings of the Fifth Conference of the European Chapter of the ACL, pages 155-160, Berlin, April.
15. Santos, Eugene S. 1972. Probabilistic grammars and automata. Information and Control, 21:27-47.
16. Seki, Hiroyuki, Takashi Matsumura, Mamoru Fujii, and Tadao Kasami. 1991. On multiple context-free grammars. Theoretical Computer Science, 88:191-229.
17. Starke, Peter H. 1972. Abstract Automata. North-Holland, Amsterdam.
18. Stolcke, Andreas and Jonathan Segal. 1994. Precise N-gram probabilities from stochastic context-free grammars. In Proceedings of the 32nd Annual Meeting of the ACL, pages 74-79, Las Cruces, NM, June.
19. Vijay-Shanker, K. and David J. Weir. 1993. The use of shared forests in tree adjoining grammar parsing. In Proceedings of the Sixth Conference of the European Chapter of the ACL, pages 384-393, Utrecht, The Netherlands, April.
20. Zue, Victor, James Glass, David Goodine, Hong Leung, Michael Phillips, Joseph Polifroni, and Stephanie Seneff. 1991. Integration of speech recognition and natural language processing in the MIT Voyager system. In Proceedings of the ICASSP-91, Toronto, volume 1, pages 713-716.