Language models based on semantic composition

EMNLP 2009 - Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: A Meeting of SIGDAT, a Special Interest Group of ACL, Held in Conjunction with ACL-IJCNLP 2009

Volumn , Issue , 2009, Pages 430-439

  Mitchell, Jeff ^a   Lapata, Mirella ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS;

COMPOSITION MODEL; N-GRAM LANGUAGE MODELS; SEMANTIC COMPOSITION; SEMANTIC DEPENDENCY; SPATIAL SEMANTICS; STATISTICAL LANGUAGE MODELING; STRUCTURED LANGUAGE; YIELD REDUCTION;

COMPUTATIONAL LINGUISTICS;

EID: 77954653781     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1699510.1699567     Document Type: Conference Paper

References (36)

1. Jerome R. Bellegarda. 2000. Exploiting latent semantic information in statistical language modeling. Proceedings of the IEEE, 88(8):1279-1296.
2. Michael W. Berry, Susan T. Dumais, and Gavin W. O'Brien. 1994. Using linear algebra for intelligent information retrieval. SIAM Review, 37(4):573-595.
3. David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. Journal of Machine Learning Research, 3:993-1022.
4. J.A. Bullinaria and J.P. Levy. 2007. Extracting semantic representations from word co-occurrence statistics: A computational study. Behavior Research Methods, 39:510-526.
5. Eugene Charniak. 2001. Immediate-head parsing for language models. In Proceedings of 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics, pages 116-123, Toulouse, France.
6. Ciprian Chelba and Frederick Jelinek. 1998. Exploiting syntactic structure for language modeling. In Proceedings of the 17th International Conference on Computational Linguistics and 36th Annual Meeting of the Association for Computational Linguistics, pages 225-231, Montréal, Canada.
7. Stephen Clark, Bob Coecke, and Mehrnoosh Sadrzadeh. 2008. A compositional distributional model of meaning. In Proceedings of the 2nd Symposium on Quantum Interaction, pages 133-140, Oxford, UK. College Publications.
8. Noah Coccaro and Daniel Jurafsky. 1998. Towards better integration of semantic predictors in satistical language modeling. In Proceedings of the 5th International Conference on Spoken Language Processing, pages 2403-2406, Sydney, Australia.
9. Yonggang Deng and Sanjeev Khundanpur. 2003. Latent semantic information in maximum entropy language models for conversational speech recognition. In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pages 56-63, Edmonton, AL.
10. Katrin Erk and Sebastian Padó. 2008. A structured vector space model for word meaning in context. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 897-906, Honolulu, Hawaii.
11. J. R. Firth. 1957. A synopsis of linguistic theory 1930-1955. In Studies in Linguistic Analysis, pages 1-32. Philological Society, Oxford.
12. Peter Foltz, Walter Kintsch, and Thomas Landauer. 1998. The measurement of textual coherence with latent semantic analysis. Discourse Process, 15:285-307.
13. Daniel Gildea and Thomas Hofmann. 1999. Topic-based language models using EM. In Proceedings of the 6th European Conference on Speech Communiation and Technology, pages 2167-2170, Budapest, Hungary.
14. Gregory Grefenstette. 1994. Explorations in Automatic Thesaurus Discovery. Kluwer Academic Publishers, Norwell, MA, USA.
15. Thomas L. Griffiths, Mark Steyvers, and Joshua B. Tenenbaum. 2007. Topics in semantic representation. Psychological Review, 114(2):211-244.
16. Zellig Harris. 1968. Mathematical Structures of Language. Wiley, New York.
17. Thomas Hofmann. 2001. Unsupervised learning by probabilistic latent semantic analysis. Machine Learning, 41(2):177-196.
18. Dharmendra Kanejiya, Arun Kumar, and Surendra Prasad. 2004. Statistical language modeling with performance benchmarks using various levels of syntactic-semantic information. In Proceedings of the 20th International Conference on Computational Linguistics, pages 1161-1167, Geneva, Switzerland.
19. Walter Kintsch. 2001. Predication. Cognitive Science, 25(2):173-202.
20. Roland Kuhn and Renato de Mori. 1992. A cache based natural language model for speech recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, (14):570-583.
21. T. K. Landauer and S. T. Dumais. 1997. A solution to Plato's problem: the latent semantic analysis theory of acquisition, induction and representation of knowledge. Psychological Review, 104(2):211-240.
22. Will Lowe. 2000. Topographic Maps of Semantic Space. Ph.D. thesis, University of Edinburgh.
23. Scott McDonald. 2000. Environmental Determinants of Lexical Processing Effort. Ph.D. thesis, University of Edinburgh.
24. Jeff Mitchell and Mirella Lapata. 2008. Vector-based models of semantic composition. In Proceedings of ACL-08: HLT, pages 236-244, Columbus, OH.
25. R. Montague. 1974. English as a formal language. In R. Montague, editor, Formal Philosophy. Yale University Press, New Haven, CT.
26. Sebastian Padó and Mirella Lapata. 2007. Dependency-based construction of semantic space models. Computational Linguistics, 33(2):161-199.
27. B. Partee. 1995. Lexical semantics and compositionality. In Lila Gleitman and Mark Liberman, editors, Invitation to Cognitive Science Part I: Language, 311-360, MIT Press, Cambridge, MA.
28. S. Pinker. 1994. The Language Instinct: How the Mind Creates Language. HarperCollins, New York
29. Tony A. Plate. 1995. Holographic reduced representations. IEEE Transactions on Neural Networks, 6(3):623-641.
30. Brian Roark. 2001. Probabilistic top-down parsing and language modeling. Computational Linguistics, 27(2):249-276.
31. Roni Rosenfeld. 1996. A maximum entropy approach to adaptive statistical language modeling. Computer Speech and Language, 10:187-228.
32. Paul Smolensky. 1990. Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial Intelligence, 46:159-216.
33. Andreas Stolcke. 2002. SRILM - an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing, pages 901-904, Denver, CO.
34. Tonio Wandmacher and Jean-Yves Antoine. 2007. Methods to integrate a language model with semantic information for a word prediction component.In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 506-513, Prague, Czech Republic.
35. Dominic Widdows. 2008. Semantic vector products: Some initial investigations. In Proceedings of the 2nd Symposium on Quantum Interaction, Oxford, UK. College Publications.
36. Rong Zhang and Alexander I. Rudnicky. 2002. Improve latent semantic analysis based language model by integrating multiple level knowldege. In Proceedings of the 7th International Conference on Spoken Language Processing, pages 893-897, Denver, CO.