Reward function learning for dialogue management

Frontiers in Artificial Intelligence and Applications

Volumn 241, Issue , 2012, Pages 95-106

  El Asri, Layla ^a,b,c   Laroche, Romain ^a   Pietquin, Olivier ^b,c  

^a ORANGE LABS   (France)

^b CNRS   (France)

^c SUPELEC   (France)

Author keywords

[No Author keywords available]

Indexed keywords

FUNCTION EVALUATION; QUALITY CONTROL; SPEECH PROCESSING;

DIALOGUE MANAGEMENT; FUNCTION LEARNING; LEARNING PROBLEM; NATURAL LANGUAGES; REINFORCEMENT LEARNINGS; REWARD FUNCTION; SPOKEN DIALOGUE SYSTEM; STATE-SPACE; SYSTEM EVALUATION; SYSTEM STATE;

REINFORCEMENT LEARNING;

EID: 84879078248     PISSN: 09226389     EISSN: 18798314     Source Type: Book Series    
DOI: 10.3233/978-1-61499-096-3-95     Document Type: Conference Paper

References (23)

1. Abdeslam Boularias, Hamid R. Chinaei, and Brahim Chaib-draa. Learning the reward model of dialogue pomdps from data. In Twenty-Fourth Annual Conference on Neural Information Processing Systems, 2010.
2. Philippe Bretier, Romain Laroche, and Ghislain Putois. D5.3.4: Industrial self-help system ("system 3") adapted to final architecture. report d5.3.4, classic project. Technical report, 2010.
3. Senthilkumar Chandramohan, Matthieu Geist, Fabrice Lefvre, and Olivier Pietquin. User simulation in dialogue systems using inverse reinforcement learning. In Proceedings of the 12th Annual Conference of the International Speech Communication Association, 2011.
4. Usama M. Fayyad and Keki B. Irani. Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning, volume 2, pages 1022-1027. Morgan Kaufmann, 1993.
5. Valdinei Freire da Silva, Anna Helena Reali Costa, and Pedro Lima. Inverse reinforcement learning with evaluation. In IEEE International Conference on Robotics and Automation, 2006.
6. Melita Hajdinjak and France Mihelic. A dialogue-management evaluation study. Journal of Computing and Information Technology, 2007.
7. Mark A. Hall. Correlation-based feature selection for discrete and numeric class machine learning. In 17th International Conference on Machine Learning, pages 359-366. Morgan Kaufmann, 2000.
8. Srinivasan Janarthanam, Oliver Lemon, Romain Laroche, and Ghislain Putois. D4.5: Testing learned nlg and tts policies with real users, in self-help and appointment scheduling systems. report d4.5, classic project. Technical report, 2011.
9. George Konidaris and Andrew Barto. Autonomous shaping : Learning to predict reward form novel states. In 26th International Conference on Machine Learning, 2006.
10. Romain Laroche, Ghislain Putois, Philippe Bretier, Martin Aranguren, Julia Velkovska, Helen Hastie, Simon Keizer, Kai Yu, Filip Jurcicek, Oliver Lemon, and Steve Young. D6.4: Final evaluation of classic towninfo and appointment scheduling systems, report d6.4. classic project. Technical report, 2011.
11. Romain Laroche, Ghislain Putois, Philippe Bretier, and Bernadette Bouchon-Meunier. Hybridisation of expertise and reinforcement learning in dialogue systems. In Interspeech, special session: Machine Learning for Adaptivity in Spoken Dialogue, Brighton (United Kingdom), 2009.
12. Lars Bo Larsen. Issues in the evaluation of spoken dialogue systems using objective and subjective measures. In IEEE Workshop on Automatic Speech Recognition and Understanding ASRU'03, pages 209-214, 2003.
13. S. Larsson and D. Traum. Information state and dialogue management in the trindi dialogue move engine toolkit. Natural Language Engineering, 6:323-340, 2000.
14. Esther Levin, Roberto Pieraccini, and Wieland Eckert. Learning dialogue strategies within the markov decision process framework. In IEEE Workshop on Automatic Speech Recognition and Understanding, Santa Barbara, California, 1997.
15. Andrew Y. Ng, Daishi Harada, and Stuart Russell. Policy invariance under reward transformations: Theory and application to reward shaping. In Proceedings of the Sixteenth International Conference on Machine Learning, pages 278-287. Morgan Kaufmann, 1999.
16. Tim Paek. Reinforcement learning for spoken dialogue systems: Comparing strengths and weaknesses for practical deployment. In Dialog-on-Dialog Workshop, Interspeech, Pittsburgh, PA, 2006.
17. Tim Paek and Roberto Pieraccini. Automating spoken dialogue management design using machine learning : An industry perspective. Speech Communication, 50:716-729, 2008.
18. Verena Rieser and Oliver Lemon. Learning and evaluation of dialogue strategies for new applications: Empirical methods for optimization from small data sets. Computational Linguistics, 37, 2011.
19. Nicolas Roy, Joelle Pineau, and Sebastian Thrun. Spoken dialogue management using probabilistic reasoning. In 38th Annual Meeting of the Association for Computational Linguistics (ACL2000), 2000.
20. Stuart Russell. Learning agents for uncertain environments (extended abstract). In Proceedings of the 11th Annual Conference on Computational Learning Theory, 1998.
21. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning. An introduction, pages 56-57. MIT Press, 1998.
22. Marilyn A.Walker, Jeanne C. Fromer, and Shrikanth Narayanan. Learning optimal dialogue strategies: A case study of a spoken dialogue agent for email. In 36th Annual Meeting of the Association of Computational Linguistics, COLING/ACL 98, pages 1345-1352, 1998.
23. Marilyn A.Walker, Diane J. Litman, Candace A. Kamm, and Alicia Abella. Paradise: a framework for evaluating spoken dialogue agents. pages 271-280, 1997.