Multiresolution recurrent neural networks: An application to dialogue response generation

31st AAAI Conference on Artificial Intelligence, AAAI 2017

Volumn , Issue , 2017, Pages 3288-3294

  Serban, Iulian Vlad ^a   Klinger, Tim ^b   Tesauro, Gerald ^b   Talamadupula, Kartik ^b   Zhou, Bowen ^b   Bengio, Yoshua ^a   Courville, Aaron ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; HIGH LEVEL LANGUAGES; NATURAL LANGUAGE PROCESSING SYSTEMS; RANDOM PROCESSES; SEMANTICS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

AUTOMATIC EVALUATION; AUTOMATIC PROCEDURES; COMPOSITIONAL STRUCTURE; NATURAL LANGUAGE GENERATION; NATURAL LANGUAGES; RESPONSE GENERATION; SPECIFIC KNOWLEDGE; TECHNICAL SUPPORT;

RECURRENT NEURAL NETWORKS;

EID: 85030459483     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. Bahdanau, D.; Cho, K.; and Bengio, Y. 2015. Neural machine translation by jointly learning to align and translate. In ICLR.
2. Bangalore, S.; Di Fabbrizio, G.; and Stent, A. 2008. Learning the structure of task-driven human-human dialogs. IEEE Transactions on Audio, Speech, and Language Processing 16(7):1249-1259.
3. Bengio, Y.; Ducharme, R.; Vincent, P.; and Janvin, C. 2003. A neural probabilistic language model. JMLR 3:1137-1155.
4. Bowman, S. R.; Vilnis, L.; Vinyals, O.; Dai, A. M.; Jozefowicz, R.; and Bengio, S. 2016. Generating sentences from a continuous space. CoNLL.
5. Cho, K., et al. 2014. Learning phrase representations using rnn encoder-decoder for statistical machine translation. In EMNLP.
6. Chung, J.; Kastner, K.; Dinh, L.; Goel, K.; Courville, A.; and Bengio, Y. 2015. A recurrent latent variable model for sequential data. In NIPS.
7. Crook, N.; Granell, R.; and Pulman, S. 2009. Unsupervised classification of dialogue acts using a dirichlet process mixture model. In SIGDIAL.
8. Fabius, O., and van Amersfoort, J. R. 2015. Variational recurrent auto-encoders. ICLR, Workshop Papers.
9. Gorin, A. L.; Riccardi, G.; and Wright, J. H. 1997. How may i help you? Speech communication 23(1):113-127.
10. Graves, A.; Wayne, G.; and Danihelka, I. 2014. Neural turing machines. arXiv:1410.5401.
11. Graves, A. 2012. Sequence transduction with recurrent neural networks. In ICML, Representation Learning Workshop.
12. He, Z.; Liu, X.; Lv, P.; and Wu, J. 2016. Hidden softmax sequence model for dialogue structure analysis. In ACL.
13. Hinton, G., et al. 2012. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. Signal Processing Magazine, IEEE 29(6):82-97.
14. Hochreiter, S., and Schmidhuber, J. 1997. Long short-term memory. Neural computation 9(8).
15. Ji, Y.; Haffari, G.; and Eisenstein, J. 2016. A latent variable recurrent neural network for discourse relation language models. In NAACLHLT.
16. Johnson, M. J.; Duvenaud, D.; Wiltschko, A. B.; Datta, S. R.; and Adams, R. P. 2016. Structured VAEs: Composing probabilistic graphical models and variational autoencoders. arXiv:1603.06277.
17. Kannan, A.; Kurach, K.; Ravi, S.; Kaufmann, T.; Tomkins, A.; Miklos, B.; Corrado, G.; Lukács, L.; Ganea, M.; et al. 2016. Smart reply: Automated response suggestion for email. In ACM SIGKDD.
18. Kingma, D., and Ba, J. 2015. Adam: A method for stochastic optimization. In ICLR.
19. Koehn, P., and Monz, C. 2006. Manual and automatic evaluation of machine translation between european languages. In ACL, Workshop on Statistical Machine Translation, 102-121.
20. Koutnik, J.; Greff, K.; Gomez, F.; and Schmidhuber, J. 2014. A Clockwork RNN. In ICML.
21. Kumar, A.; Irsoy, O.; Su, J.; Bradbury, J.; English, R.; Pierce, B.; Ondruska, P.; Gulrajani, I.; and Socher, R. 2016. Ask me anything: Dynamic memory networks for natural language processing. In ICML.
22. Li, J.; Galley, M.; Brockett, C.; Gao, J.; and Dolan, B. 2016. A diversity-promoting objective function for neural conversation models. In NAACL.
23. Liu, C.-W.; Lowe, R.; Serban, I. V.; Noseworthy, M.; Charlin, L.; and Pineau, J. 2016. How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation. In EMNLP.
24. Lowe, R.; Pow, N.; Serban, I.; and Pineau, J. 2015. The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems. In SIGDIAL.
25. Markoff, J., and Mozur, P. 2015. For sympathetic ear, more chinese turn to smartphone program. NY Times.
26. Mikolov, T., et al. 2010. Recurrent neural network based language model. In INTERSPEECH.
27. Pascanu, R.; Mikolov, T.; and Bengio, Y. 2012. On the difficulty of training recurrent neural networks. In ICML.
28. Ritter, A.; Cherry, C.; and Dolan, W. B. 2011. Data-driven response generation in social media. In EMNLP.
29. Schatzmann, J.; Georgila, K.; and Young, S. 2005. Quantitative evaluation of user simulation techniques for spoken dialogue systems. In SIGDIAL.
30. Serban, I. V.; Sordoni, A.; Bengio, Y.; Courville, A. C.; and Pineau, J. 2016. Building end-to-end dialogue systems using generative hierarchical neural network models. In AAAI.
31. Serban, I. V.; Sordoni, A.; Lowe, R.; Charlin, L.; Pineau, J.; Courville, A.; and Bengio, Y. 2017. A hierarchical latent variable encoder-decoder model for generating dialogues. In AAAI.
32. Shang, L.; Lu, Z.; and Li, H. 2015. Neural responding machine for short-text conversation. In ACL-IJCNLP.
33. Singh, S.; Litman, D.; Kearns, M.; and Walker, M. 2002. Optimizing dialogue management with reinforcement learning: Experiments with the NJFun system. JAIR 16:105-133.
34. Sordoni, A.; Bengio, Y.; Vahabi, H.; Lioma, C.; Simonsen, J. G.; and Nie, J.-Y. 2015a. A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In CIKM.
35. Sordoni, A.; Galley, M.; Auli, M.; Brockett, C.; Ji, Y.; Mitchell, M.; Nie, J.-Y.; Gao, J.; and Dolan, B. 2015b. A neural network approach to context-sensitive generation of conversational responses. In NAACL-HLT.
36. Sutskever, I.; Vinyals, O.; and Le, Q. V. 2014. Sequence to sequence learning with neural networks. In NIPS.
37. Theano Development Team. 2016. Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints abs/1605.02688.
38. Weston, J.; Chopra, S.; and Bordes, A. 2015. Memory networks. In ICLR.
39. Young, S. 2000. Probabilistic methods in spoken-dialogue systems. Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences 358(1769).
40. Zhai, K., and Williams, J. D. 2014. Discovering latent structure in task-oriented dialogues. In ACL.