A neural network approach to context-sensitive generation of conversational responses

NAACL HLT 2015 - 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2015, Pages 196-205

  Sordoni, Alessandro ^a   Galley, Michel ^b   Auli, Michael ^c   Brockett, Chris ^b   Ji, Yangfeng ^d   Mitchell, Margaret ^b   Nie, Jian Yun ^a   Gao, Jianfeng ^b   Dolan, Bill ^b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b MICROSOFT RESEARCH   (United States)

^c FACEBOOK AI RESEARCH   (United States)

^d GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NETWORK ARCHITECTURE;

CONTEXT SENSITIVE; CONTEXTUAL INFORMATION; DYNAMIC CONTEXTS; END TO END; GENERATIVE MODEL; MACHINE TRANSLATIONS; RESPONSE GENERATION;

COMPUTATIONAL LINGUISTICS;

EID: 84960121226     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/n15-1020     Document Type: Conference Paper

References (30)

1. Michael Auli, Michel Galley, Chris Quirk, and Geoffrey Zweig. 2013. Joint language and translation modeling with recurrent neural networks. In Proc. of EMNLP, pages 1044-1054.
2. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proc. of ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 65-72, Ann Arbor, Jun.
3. Yoshua Bengio, Rejean Ducharme, and Pascal Vincent. 2003. A neural probabilistic language model. Journ. Mach. Learn. Res., 3:1137-1155.
4. Kyunghyun Cho, Bart van Merrienboer, Çaglar Gülçehre, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proc. of EMNLP.
5. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proc. of ICML, pages 160-167. ACM.
6. Jacob Devlin, Rabih Zbib, Zhongqiang Huang, Thomas Lamar, Richard Schwartz, and John Makhoul. 2014. Fast and robust neural network joint models for statistical machine translation. In Proc. of ACL.
7. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. Journ. Mach. Learn. Res., 12:2121-2159.
8. Jianfeng Gao, Xiaodong He, Wen tau Yih, and Li Deng. 2014a. Learning continuous phrase representations for translation modeling. In Proc. of ACL, pages 699-709.
9. Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, and Li Deng. 2014b. Modeling interestingness with deep neural networks. In Proc. of EMNLP, pages 2-13.
10. Kallirroi Georgila, James Henderson, and Oliver Lemon. 2006. User simulation for spoken dialogue systems: Learning and evaluation. In Proc. of Interspeech/ ICSLP.
11. Michael Gutmann and Aapo Hyvärinen. 2010. Noisecontrastive estimation: A new estimation principle for unnormalized statistical models. In Proc. of AISTATS, pages 297-304.
12. Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck. 2013. Learning deep structured semantic models for web search using clickthrough data. In Proc. of CIKM, pages 2333-2338.
13. Nal Kalchbrenner and Phil Blunsom. 2013. Recurrent continuous translation models. Proc. of EMNLP, pages 1700-1709.
14. Reinhard Kneser and Hermann Ney. 1995. Improved backing-off for M-gram language modeling. In Proc. of ICASSP, pages 181-184, May.
15. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In Proc. of ACL Demo and Poster Sessions, pages 177-180.
16. Tomas Mikolov and Geoffrey Zweig. 2012. Context Dependent Recurrent Neural Network Language Model.
17. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernocký, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Proc. of INTERSPEECH, pages 1045-1048.
18. Franz Josef Och and Hermann Ney. 2004. The alignment template approach to machine translation. Comput. Linguist., 30(4):417-449.
19. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proc. of ACL, pages 160-167.
20. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proc. of ACL, pages 311-318.
21. Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the difficulty of training recurrent neural networks. Proc. of ICML, pages 1310-1318.
22. Alan Ritter, Colin Cherry, and William B. Dolan. 2011. Data-driven response generation in social media. In Proc. of EMNLP, pages 583-593.
23. Stephen E Robertson, Steve Walker, Susan Jones, et al. 1995. Okapi at TREC-3.
24. David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. 1988. Learning representations by backpropagating errors. In James A. Anderson and Edward Rosenfeld, editors, Neurocomputing: Foundations of Research, pages 696-699. MIT Press, Cambridge, MA, USA.
25. Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, and Grégoire Mesnil. 2014. A latent semantic model with convolutional-pooling structure for information retrieval. In Proc. of CIKM, pages 101-110.
26. Amanda Stent and Srinivas Bangalore. 2014. Natural Language Generation in Interactive Systems. Cambridge University Press.
27. Ilya Sutskever, Oriol Vinyals, and Quoc V. V Le. 2014. Sequence to sequence learning with neural networks. Proc. of NIPS.
28. Marilyn A. Walker, Rashmi Prasad, and Amanda Stent. 2003. A trainable generator for recommendations in multimodal dialog. In Proc. of EUROSPEECH.
29. Steve Young, Milica Ga?sić, Simon Keizer, François Mairesse, Jost Schatzmann, Blaise Thomson, and Kai Yu. 2010. The hidden information state model: A practical framework for pomdp-based spoken dialogue management. Comput. Speech Lang., 24(2):150-174.
30. Steve Young. 2002. Talking to machines (statistically speaking). In Proc. of INTERSPEECH.