Natural Belief-Critic: A reinforcement algorithm for parameter estimation in statistical spoken dialogue systems

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 90-93

  Jurcicek F ^a   Thomson, B ^a   Keizer, S ^a   Mairesse, F ^a   Gasic M ^a   Yu, K ^a   Young, S ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Dialogue management; POMDP; Reinforcement learning; Spoken dialogue systems

Indexed keywords

GRADIENT METHODS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MARKOV PROCESSES; REINFORCEMENT LEARNING; SPEECH COMMUNICATION; SPEECH PROCESSING; PARAMETER ESTIMATION;

DIALOGUE MANAGEMENT; INFORMATION DOMAINS; LEARNING PARAMETERS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; POLICY GRADIENT METHODS; POMDP; REINFORCEMENT ALGORITHMS; SPOKEN DIALOGUE SYSTEM; DIALOGUE MODELS; DIALOGUE SYSTEMS; MODELING PARAMETERS; PARAMETERS ESTIMATION; REINFORCEMENT LEARNINGS; REWARD FUNCTION;

PARAMETER ESTIMATION; REINFORCEMENT LEARNING;

EID: 79959813974     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. B. Thomson and S. Young, "Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems." Computer Speech and Language, vol. 24, no. 4, pp. 562 - 588, 2010.
2. R. Sutton and A. Barto, Reinforcement Learning: An Introduction, ser. Adaptive Computation and Machine Learning. Cambridge, Mass: MIT Press, 1998.
3. S. Young, M. Gašić, S. Keizer, F. Mairesse, J. Schatzmann, B. Thomson, and K. Yu, "The Hidden Information State Model: a practical framework for POMDP-based spoken dialogue management," Computer Speech and Language, In press, 2009.
4. J. Peters, S. Vijayakumar, and S. Schaal, "Natural Actor-Critic," in European Conference on Machine Learning (ECML). Springer, 2005, pp. 280-291.
5. D. Kim, H. S. Sim, K. Kim, J. H. Kim, H. Kim, and J. W. Sung, "Effects of User Modeling on POMDP-based Dialogue Systems," in Proceedings of Interspeech, 2008.
6. U. Syed and J. D. Williams, "Using automatically transcribed dialogs to learn user models in a spoken dialog system," in HLT, Morristown, USA, 2008, pp. 121-124.
7. B. Thomson, "Statistical methods for spoken dialogue management," Ph.D. dissertation, University of Cambridge, 2010.
8. C. Bishop, Pattern Recognition and Machine Learning. Springer, 2006.
9. S. Amari, "Natural gradient works efficiently in learning," Neural Computation, vol. 10, no. 2, pp. 251-276, 1998. (Pubitemid 128463152)
10. J. C. Spall, Introduction to Stochastic Search and Optimization. New York, NY, USA: John Wiley & Sons, Inc., 2003.
11. N. Hansen and A. Ostermeier, "Completely derandomized self-adaptation in evolution strategies," Evolutionary Computation, vol. 9, no. 2, pp. 159-195, 2001.