Reasoning in vector space: An exploratory study of question answering

4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings

Volumn , Issue , 2016, Pages

  Lee, Moontae ^a   He, Xiaodong ^b   Yih, Wen Tau ^b   Gao, Jianfeng ^b   Deng, Li ^b   Smolensky, Paul ^c  

^a School of Operations Research and Information Engineering   (United States)

^b MICROSOFT RESEARCH   (United States)

^c JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

END-TO-END MODELS; EXPLORATORY STUDIES; LEARNING PARADIGMS; LOGICAL REASONING; QUESTION ANSWERING; QUESTION ANSWERING TASK; VECTOR REPRESENTATIONS; VECTOR SPACE MODELS;

VECTOR SPACES;

EID: 85083951918     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Bengio, Yoshua, Ducharme, Rejean, Vincent, Pascal, and Janvin, Christian. A neural probabilistic language model. JMLR, 3:1137–1155, 2003.
2. Berant, Jonathan, Chou, Andrew, Frostig, Roy, and Liang, Percy. Semantic parsing on Freebase from question-answer pairs. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 1533–1544, Seattle, Washington, USA, October 2013. Association for Computational Linguistics. URL http://www.aclweb.org/anthology/D13-1160.
3. Bordes, Antoine, Chopra, Sumit, and Weston, Jason. Question answering with subgraph embeddings. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 615–620, Doha, Qatar, October 2014. Association for Computational Linguistics. URL http://www.aclweb.org/anthology/D14-1067.
4. Dupoux, Emmanuel. Deconstructing ai-complete question-answering: going beyond toy tasks. 2015. URL http://bootphon.blogspot.com/2015/04/deconstructing-ai-complete-question.html.
5. Grefenstette, Edward. Towards a formal distributional semantics: Simulating logical calculi with tensors. Association for Computational Linguistics, 2013.
6. Jones, Michael N. and Mewhort, Douglas J. K. Representing word meaning and order information in a composite holographic lexicon. Psychological Review, 114:1–37, 2007.
7. Kumar, Ankit, Irsoy, Ozan, Su, Jonathan, Bradbury, James, English, Robert, Pierce, Brian, Ondruska, Peter, Gulrajani, Ishaan, and Socher, Richard. Ask me anything: Dynamic memory networks for natural language processing. CoRR, abs/1506.07285, 2015. URL http://arxiv.org/abs/1506.07285.
8. Mikolov, Tomas, Sutskever, Ilya, Chen, Kai, Corrado, Greg S, and Dean, Jeff. Distributed representations of words and phrases and their compositionality. pp. 3111–3119. 2013.
9. Peng, Baolin, Lu, Zhengdong, Li, Hang, and Wong, Kam-Fai. Towards neural network-based reasoning. CoRR, abs/1508.05508, 2015. URL http://arxiv.org/abs/1508.05508.
10. Pennington, Jeffrey, Socher, Richard, and Manning, Christopher D. Glove: Global vectors for word representation. pp. 1532–1543, 2014. URL http://www.aclweb.org/anthology/D14-1162.
11. Rocktaschel, Tim, Singh, Sameer, Bosnjak, Matko, and Riedel, Sebastian. Low-dimensional embeddings of logic. 2014.
12. Smolensky, Paul. Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial Intelligence, 46(1-2), 1990.
13. Smolensky, Paul. Symbolic functions from neural computation. Philosophical Transactions of the Royal Society, 370:3543–3569, 2012.
14. Smolensky, Paul and Legendre, Geraldine. The Harmonic Mind: From Neural Computation to Optimality-Theoretic GrammarVolume I: Cognitive Architecture. The MIT Press, 2006.
15. Smolensky, Paul, Lee, Moontae, He, Xiaodong, Yih, Wen-tau, Gao, Jianfeng, and Deng, Li. Basic reasoning with tensor product representations. Technical Report, Microsoft Research, 2016. URL http://arxiv.org/abs/1601.02745.
16. Sukhbaatar, Sainbayar, Szlam, Arthur, Weston, Jason, and Fergus, Rob. End-to-end memory networks. CoRR, abs/1503.08895, 2015. URL http://arxiv.org/abs/1503.08895.
17. Ustun, Volkan, Rosenbloom, Paul S., Sagae, Kenji, and Demski, Abram. Distributed vector representations of words in the sigma cognitive architecture. 2014.
18. Weston, Jason, Chopra, Sumit, and Bordes, Antoine. Memory networks. CoRR, abs/1410.3916, 2014. URL http://arxiv.org/abs/1410.3916.
19. Weston, Jason, Bordes, Antoine, Chopra, Sumit, Mikolov, Tomas, Rush, Alexander M., and van Merrienboer, Bart. Towards ai-complete question answering: A set of prerequisite toy tasks. volume abs/1502.05698. 2015. URL http://arxiv.org/abs/1502.05698.
20. Yih, Wen-Tau, Chang, MingWei, He, Xiaodong, and Gao, Jianfeng. Semantic parsing via staged query graph generation: Question answering with knowledge base. 2015.