The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management

Computer Speech and Language

Volumn 24, Issue 2, 2010, Pages 150-174

  Young, Steve ^a   Gašić, Milica ^a   Keizer, Simon ^a   Mairesse, François ^a   Schatzmann, Jost ^a   Thomson, Blaise ^a   Yu, Kai ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Hidden Information State model; POMDP; Statistical dialogue systems

Indexed keywords

BASIC MATHEMATICS; HIDDEN INFORMATION; HIDDEN INFORMATION STATE MODEL; INFORMATION DOMAINS; MATHEMATICAL FRAMEWORKS; OPTIMISATIONS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; POMDP; PRACTICAL SYSTEMS; SPOKEN DIALOGUE; SPOKEN DIALOGUE SYSTEM; STATISTICAL DIALOGUE SYSTEMS; USER SIMULATION;

MARKOV PROCESSES;

SPEECH PROCESSING;

EID: 70349231178     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2009.04.001     Document Type: Article

References (42)

1. Bishop C.M. Pattern Recognition and Machine Learning (2006), Springer
2. Black, A.W., Lenzo, K., 2005. Flite: a small, fast speech synthesis engine. .
3. Bonet, B., 2002. An e-optimal grid-based algorithm for partially observable Markov decision processes. In: Proceedings of the 19th International Conference on Machine Learning(ICML 2002), Sydney, Australia.
4. Brafman, R.I., 1997. A heuristic variable grid solution method for POMDPs. In: AAAI, Cambridge, MA.
5. Bui T.H., Poel M., Nijholt A., and Zwiers J. A tractable hybrid DDN-POMDP approach to affective dialogue modeling for probabilistic frame-based dialogue systems. Natural Language Engineering (2008)
6. Cohen P.R., and Perrault C.R. Elements of a plan-based theory of speech acts. Cognitive Science 3 (1979) 177-212
7. Evermann, G., Woodland, P.C., 2000. Posterior probability decoding, confidence estimation and system combination. In: Proc. Speech Transcription Workshop, Baltimore.
8. Gašić, M., Keizer, S., Thomson, B., Mairesse, F., Schatzmann, J., Yu, K., Young, S., 2008. Training and evaluation of the HIS-POMDP dialogue system in noise. In: Proc. Ninth SIGdial, Columbus, OH.
9. Henderson, J., Lemon, O., 2008. Mixture model POMDPs for efficient handling of uncertainty in dialogue management. In: Proc. 46th Annual Meeting of the Association for Computational Linguistics (ACL'08), Columbus, OH.
10. Kaelbling L.P., Littman M.L., and Cassandra A.R. Planning and acting in partially observable stochastic domains. Artificial Intelligence 101 (1998) 99-134
11. Keizer, S., Gašić, M., Mairesse, F., Thomson, B., Yu, K., Young, S.J., 2008. Modelling user behaviour in the HIS-POMDP dialogue manager. In: IEEE SLT Workshop, Goa, India.
12. Levin, E., Pieraccini, R., Eckert, W., 1998. Using Markov decision processes for learning dialogue strategies. In: Proc. Int. Conf. Acoustics, Speech and Signal Processing, Seattle, USA.
13. Levin E., Pieraccini R., and Eckert W. A stochastic model of human-machine interaction for learning dialog strategies. IEEE Transactions on Speech and Audio Processing 8 1 (2000) 11-23
14. Littman, M.L., 1994. The witness algorithm: solving partially observable Markov decision processes. Technical report, Brown University.
15. Mangu L., Brill E., and Stolcke A. Finding consensus among words: lattice-based word error minimisation. Computer Speech and Language 14 4 (2000) 373-400
16. Paek T., and Pieraccini R. Automating spoken dialogue management design using machine learning: an industry perspective. Speech Communication 50 (2008) 716-729
17. Pineau, J., Gordon, G., Thrun, S., 2003. Point-based value iteration: an anytime algorithm for POMDPs. In: Proc. Int. Joint Conference on AI (IJCAI), Acapulco, Mexico, pp. 1025-1032.
18. Roy, N., Pineau, J., Thrun, S., 2000. Spoken dialogue management using probabilistic reasoning. In: Proceedings of the ACL 2000.
19. Schatzmann, J., 2008. Statistical User and Error Modelling for Spoken Dialogue Systems. Ph.D. Thesis, University of Cambridge.
20. Schatzmann, J., Georgila, K., Young, S.J., 2005. Quantitative evaluation of user simulation techniques for spoken dialogue systems. In: Sixth SIGdial Workshop on DISCOURSE and DIALOGUE, Lisbon.
21. Schatzmann, J., Thomson, B., Weilhammer, K., Ye, H., Young, S., 2007a. Agenda-based user simulation for bootstrapping a POMDP dialogue system. In: Proc. HLT/NAACL, Rochester, NY.
22. Schatzmann, J., Thomson, B., Young, S.J. 2007b. Error simulation for training statistical dialogue systems. In: ASRU 07, Kyoto, Japan.
23. Schegloff E., and Sacks H. Opening up closings. Semiotics 7 4 (1973) 289-327
24. Sondik, E.J. 1971. The Optimal Control of Partially Observable Markov Decision Processes. Ph.D. Thesis, Stanford University.
25. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction. Adaptive Computation and Machine Learning (1998), MIT Press, Cambridge, MA
26. Thomson, B., Gašić, M., Keizer, S., Mairesse, F., Schatzmann, J., Yu, K., Young, S.J., 2008a. User study of the Bayesian update of dialogue state approach to dialogue management. In: Interspeech 2008, Brisbane, Australia.
27. Thomson, B., Schatzmann, J., Young, S.J., 2008b. Bayesian update of dialogue state for robust dialogue systems. In: Int. Conf. Acoustics Speech and Signal Processing ICASSP, Las Vegas.
28. Thomson, B., Yu, K., Gašić, M., Keizer, S., Mairesse, F., Schatzmann, J., Young, S.J., 2008c. Evaluating semantic-level confidence scores with multiple hypotheses. In: Interspeech 2008, Brisbane, Australia.
29. Traum, D., 1999. Computational models of grounding in collaborative systems. In: Working Papers of the AAAI Fall Symposium on Psychological Models of Communication in Collaborative Systems, pp. 124-131.
30. Ward, W., 1991. Understanding spontaneous speech. In: Proc. Int. Conf. Acoustics, Speech and Signal Processing, Toronto, Canada, pp. 365-368.
31. Williams, J.D., 2007. Using particle filters to track dialogue state. In: IEEE Workshop on Automatic Speech Recognition & Understanding, Kyoto, Japan.
32. Williams, J.D., 2008. The best of both worlds: unifying conventional dialog systems and POMDPs. In: Proc. Int. Conf. on Speech and Language Processing (ICSLP), Brisbane, Australia.
33. Williams, J.D., Poupart, P., Young, S.J., 2005. Factored partially observable Markov decision processes for dialogue management. In: Fourth Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Edinburgh.
34. Williams J.D., and Young S.J. Partially observable Markov decision processes for spoken dialog systems. Computer Speech and Language 21 2 (2007) 393-422
35. Williams J.D., and Young S.J. Scaling POMDPs for spoken dialog management. IEEE Audio, Speech and Language Processing 15 7 (2007) 2116-2129
36. Young S.J. Probabilistic methods in spoken dialogue systems. Philosophical Trans Royal Society (Series A) 358 1769 (2000) 1389-1402
37. Young, S.J., 2002. Talking to machines (statistically speaking). In: Int. Conf. Spoken Language Processing, Denver, Colorado.
38. Young, S.J., 2005. ATK: an application toolkit for HTK. .
39. Young, S.J., 2006. Using POMDPs for dialog management. In: IEEE/ACL Workshop on Spoken Language Technology (SLT 2006), Aruba.
40. Young, S.J., 2007. CUED standard dialogue acts. Report, Cambridge University, Engineering Department, 14th October 2007. .
41. Young, S.J., Schatzmann, J., Weilhammer, K., Ye, H., 2007. The hidden information state approach to dialog management. In: ICASSP 2007, Honolulu, Hawaii.
42. Zhang, B., Cai, Q., Mao, J., Guo, B., 2001. Planning and acting under uncertainty: a new model for spoken dialogue system. In: Proc. 17th Conf. on Uncertainty in AI, Seattle.