Joint learning of words and meaning representations for open-text semantic parsing

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 127-135

  Bordes, Antoine ^a   Glorot, Xavier ^b   Weston, Jason ^c   Bengio, Yoshua ^b  

^a UNIVERSITÉ DE TECHNOLOGIE DE COMPIÈGNE   (France)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LARGE SCALE SYSTEMS;

FORMAL REPRESENTATIONS; JOINT LEARNING; KNOWLEDGE BASIS; NATURAL LANGUAGES; OPEN TEXT; SEMANTIC PARSING; TRAINING SCHEMES; WORD SENSE DISAMBIGUATION;

SEMANTICS;

EID: 84954213973     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (36)

1. Agirre, E., Ansa, O., Hovy, E., and Martinez, D. (2000). Enriching very large ontologies using the WWW. In ECAI'00 Ontology Learning Worskshop.
2. Baker, C., Fillmore, C., and Lowe, J. (1998). The berkeley FrameNet project. In ACL '98, pages 86-90.
3. Bengio, Y. (2008). Neural net language models. Scholar-pedia, 3(1), 3881.
4. Bengio, Y., Ducharme, R., Vincent, P., and Jauvin, C. (2003). A neural probabilistic language model. JMLR, 3, 1137-1155.
5. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pas-canu, R., Desjardins, G., Turian, J., Warde-Farley, D., and Bengio, Y. (2010). Theano: a CPU and GPU math expression compiler. In SciPy'10. Oral.
6. Bordes, A., Weston, J., Collobert, R., and Bengio, Y. (2011). Learning structured embeddings of knowledge bases. In AAAI'11, San Francisco, USA.
7. Bottou, L. (2011). From machine learning to machine reasoning. Technical report, arXiv.1102.1808.
8. Cimiano, P. (2006). Ontology Learning and Population from Text: Algorithms, Evaluation and Applications. Springer-Verlag.
9. Collobert, R. and Weston, J. (2008). A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning. In Proc. of the 25th Inter. Conf. on Mach. Learn.
10. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., and Kuksa, P. (2011). Natural language processing (almost) from scratch. JMLR, 12, 2493-2537.
11. Coppola, B. and Moschitti, A. (2010). A general purpose FrameNet-based shallow semantic parser. In Proceedings of the International Conference on Language Resources and Evaluation (LREC'10).
12. Cuadros, M. and Rigau, G. (2008). Knownet: using topic signatures acquired from the web for building automatically highly dense knowledge bases. In COLING'08.
13. Decadt, B., Hoste, V., Daeleamns, W., and van den Bosh, A. (2004). Gamble, genetic algorithm optimization of memory-based WSD. In Proceeding of ACL/SIGLEX Senseval-3.
14. Ge, R. and Mooney, R. J. (2009). Learning a Compositional Semantic Parser using an Existing Syntactic Parser. In Proc. of the 47th An. Meeting of the ACL.
15. Giuglea, A. and Moschitti, A. (2006). Shallow semantic parsing based on FrameNet, VerbNet and PropBank. In Proceeding of the 17th European Conference on Artificial Intelligence (ECAI'06), pages 563-567.
16. Harabagiu, S. and Moldovan, D. (2002). Knowledge processing on extended WordNet. In C. Fellbaum, editor, WordNet: An Electronic Lexical Database and Some of its Applications, pages 379-405. MIT Press.
17. Havasi, C., Speer, R., and Pustejovsky, J. (2010). Coarse Word-Sense Disambiguation using common sense. In AAAI Fall Symposium Series.
18. Kingsbury, P. and Palmer, M. (2002). From Treebank to PropBank. In Proc. of the 3rd International Conference on Language Resources and Evaluation.
19. Lecun, Y., Chopra, S., Hadsell, R., Ranzato, M., and Huang, F. (2006). A tutorial on Energy-Based learning. In G. Bakir, T. Hofman, B. scholkopf, A. Smola, and B. Taskar, editors, Predicting Structured Data. MIT Press.
20. Liang, P., Jordan, M. I., and Klein, D. (2011). Learning dependency-based compositional semantics. In Association for Computational Linguistics (ACL).
21. Liu, H. and Singh, P. (2004). Focusing on conceptnet's natural language knowledge representation. In Proc. of the 8th Intl Conf. on Knowledge-Based Intelligent Information and Engineering Syst.
22. Martinez, D., de Lacalle, O., and Agirre, E. (2008). On the use of automatically acquired examples for all-nouns word sense disambiguation. JAIR, 33, 79-107.
23. Miller, G. (1995). WordNet: a Lexical Database for English. Communications of the ACM, 38(11), 39-41.
24. Mooney, R. (2004). Learning Semantic Parsers: An Important But Under-Studied Problem. In Proc. of the 19th AAAI Conf. on Artif. Intel.
25. Paccanaro, A. and Hinton, G. (2001). Learning distributed representations of concepts using linear relational embedding. IEEE TKDE, 13, 232-244.
26. Poon, H. and Domingos, P. (2009). Unsupervised semantic parsing. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 1-10, Singapore.
27. Poon, H. and Domingos, P. (2010). Unsupervised ontology induction from text. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 296-305, Uppsala, Sweden.
28. Robbins, H. and Monro, S. (1951). A stochastic approximation method. Annals of Mathematical Statistics, 22, 400-407.
29. Shi, L. and Mihalcea, R. (2004). Open text semantic parsing using FrameNet and WordNet. In HLT-NAACL 2004: Demo, pages 19-22.
30. Snow, R., Jurafsky, D., and Ng, A. (2006). Semantic taxonomy induction from heterogenous evidence. In Proceedings of the 44th annual meeting of the Association for Computational Linguistics, pages 801-808.
31. Socher, R., Lin, C., Ng, A. Y., and Manning, C. (2011). Learning continuous phrase representations and syntactic parsing with recursive neural networks. In ICML 11.
32. Suchanek, F., Kasneci, G., and Weikum, G. (2008). Yago: A large ontology from Wikipedia and WordNet. Web Semant., 6, 203-217.
33. Sutskever, I., Martens, J., and Hinton, G. (2011). Generating text with recurrent neural networks. In ICML 11, pages 1017-1024.
34. Wu, F. and Weld, D. (2010). Open information extraction using Wikipedia. In ACL 10, pages 118-127, Uppsala, Sweden.
35. Yates, A., Banko, M., Broadhead, M., Cafarella, M., Et-Zioni, O., and Soderland, S. (2007). TextRunner: Open information extraction on the Web. In NAACL-HLT 07, pages 25-26.
36. Zettlemoyer, L. and Collins, M. (2009). Learning Context-Dependent Mappings from Sentences to Logical Form. In Proceedings of the 47th Annual Meeting of the ACL.