On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

2011 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2011, Proceedings

Volumn , Issue , 2011, Pages 312-317

  Gašić, Milica ^a   Jurčiček, Filip ^a   Thomson, Blaise ^a   Yu, Kai ^a   Young, Steve ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DEVELOPMENT COSTS; DIALOGUE MODELS; GAUSSIAN PROCESSES; HUMAN INTERACTIONS; HUMAN SUBJECTS; LEARNING STRATEGY; OPTIMISATIONS; REAL-WORLD TASK; SPOKEN DIALOGUE SYSTEM;

COMPUTER SIMULATION; REINFORCEMENT LEARNING; SPEECH PROCESSING;

BEHAVIORAL RESEARCH;

EID: 84858956984     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2011.6163950     Document Type: Conference Paper

References (21)

1. E. Levin, R. Pieraccini, and W. Eckert, "Using Markov Decision Processes for Learning Dialogue Strategies," in Proceedings of ICASSP, 1998.
2. S. Young, "Talking to Machines (Statistically Speaking)," in Proceedings of ICSLP, 2002.
3. R. Sutton and A. Barto, Reinforcement Learning: An Introduction, ser. Adaptive Computation and Machine Learning. Cambridge, Massachusetts: MIT Press, 1998.
4. E. Levin, R. Pieraccini, and W. Eckert, "A Stochastic Model of Human-Machine Interaction for Learning Dialog Strategies," IEEE Transactions on Speech and Audio Processing, vol. 8, No. 1, pp. 11-23, 2000. (Pubitemid 30540744)
5. S. Singh, D. Litman, M. Kearns, and M. Walker, "Optimizing Dialogue Management with Reinforcement Learning," Journal of Artificial Intelligence Research, vol. 16, pp. 105-133, 2002.
6. N. Roy, J. Pineau, and S. Thrun, "Spoken dialogue management using probabilistic reasoning," in Proceedings of ACL, 2000.
7. B. Zhang, Q. Cai, J. Mao, E. Chang, and B. Guo, "Spoken Dialogue Management as Planning and Acting under Uncertainty," in Proceedings of Eurospeech, 2001.
8. S. Young, M. Gasic, S. Keizer, F. Mairesse, J. Schatzmann, B. Thomson, and K. Yu, "The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management," Computer Speech and Language, vol. 24, No. 2, pp. 150-174, 2010.
9. B. Thomson and S. Young, "Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems," Computer Speech and Language, vol. 24, No. 4, pp. 562-588, 2010.
10. M. Gasic, S. Keizer, F. Mairesse, J. Schatzmann, B. Thomson, K. Yu, and S. Young, "Training and evaluation of the HIS-POMDP dialogue system in noise," in Proceedings of SIGDIAL, 2008.
11. Y Engel, S. Mannor, and R. Meir, "Bayes Meets Bellman: The Gaussian Process Approach to Temporal Difference Learning," in Proceedings of ICML, 2003.
12. M. Gasic, F. Jurčíček, S. Keizer, F. Mairesse, J. Schatzmann, B. Thomson, K. Yu, and S. Young, "Gaussian processes for fast policy optimisation of pomdp-based dialogue managers," in Proceedings of SIGDIAL, 2010.
13. L. Daubigney, M. Gasic, S. Chandramohan, M. Geist, O. Pietquin, and S. Young, "Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system," in Proceedings of Interspeech, 2011.
14. F. Jurčíček, S. Keizer, M. Gasic, F. Mairesse, B. Thomson, K. Yu, and S. Young, "Real user evaluation of spoken dialogue systems using Amazon Mechanical Turk," in Proceedings of Interspeech, 2011.
15. M. Gasic and S. Young, "Effective Handling of Dialogue State in the Hidden Information State POMDP Dialogue Manager," ACM Transactions on Speech and Language Processing, 2011.
16. C. Rasmussen and C. Williams, "Software for Gaussian Processes Regression and Classification," 2007, http://www.gaussianprocess.org/gpml/ code/matlab/doc/.
17. Y Engel, S. Mannor, and R. Meir, "Reinforcement learning with Gaussian processes," in Proceedings of ICML, 2005.
18. J. Williams, "The best of both worlds: unifying conventional dialog systems and POMDPs," in Proceedings of Interspeech, 2008.
19. C. Rasmussen and C. Williams, Gaussian Processes for Machine Learning. Cambridge, Massachusetts: MIT Press, 2005.
20. M. Gasic, "Statistical dialogue modelling," Ph.D. dissertation, University of Cambridge, 2011.
21. Amazon, "Amazon Mechanical Turk," 2011, https://www.mturk.com/ mturk/welcome.