Using pomdps for dialog management

2006 IEEE ACL Spoken Language Technology Workshop, SLT 2006, Proceedings

Volumn , Issue , 2006, Pages 8-13

  Young, Steve ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Hidden information state model; Partially observable markov decision processes (POMDPS); Statistical dialog modelling

Indexed keywords

HUMAN COMPUTER INTERACTION; LINGUISTICS; BEHAVIORAL RESEARCH; UNCERTAINTY ANALYSIS;

BASIC MATHEMATICS; DIALOG MANAGEMENT; DIALOG SYSTEMS; HIDDEN INFORMATION STATE (HIS) MODEL; MATHEMATICAL FRAMEWORKS; OPTIMISATION; PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES (POMDPS); PRACTICAL SYSTEMS; SPOKEN LANGUAGES;

MATHEMATICAL MODELS; MARKOV PROCESSES;

DIALOGUE MANAGEMENT; DIALOGUE MODELS; HIDDEN INFORMATION; HIDDEN INFORMATION STATE MODEL; INFORMATION STATE; MATHEMATICAL FRAMEWORKS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; STATE MODELS; STATISTICAL DIALOG MODELING;

EID: 48749099286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2006.326785     Document Type: Conference Paper

References (21)

1. S Larsson and D Traum, "Information State and Dialogue Management in the TRINDI Dialogue Move Engine Toolkit," Natural Language Engineering, pp. 323-340, 2000.
2. SJ Young, "Talking to Machines (Statistically Speaking)," in Int Conf Spoken Language Processing, Denver, Colorado, 2002.
3. E Levin, R Pieraccini, and W Eckert, "Using Markov Decision Processes For Learning Dialogue Strategies," in Proc Int Conf Acoustics, Speech and Signal Processing, Seattle,USA, 1998.
4. E Levin, R Pieraccini, and W Eckert, "A Stochastic Model of Human-Machine Interaction for Learning Dialog Strategies," IEEE Trans Speech and Audio Processing, vol. 8, no. 1, pp. 11-23, 2000.
5. SJ Young, "Probabilistic Methods in Spoken Dialogue Systems," Philosophical Trans Royal Society (Series A), vol. 358, no. 1769, pp. 1389-1402, 2000.
6. RS Sutton and AG Barto, Reinforcement Learning: An Introduction, Adaptive Computation and Machine Learning. MIT Press, Cambridge, Mass, 1998.
7. LP Kaelbling, ML Littman, and AR Cassandra, "Planning and Acting in Partially Observable Stochastic Domains," Artificial Intelligence, vol. 101, pp. 99-134, 1998.
8. EJ Sondik, The Optimal Control of Partially Observable Markov Decision Processes, Phd, Stanford University, 1971.
9. ML Littman, "The Witness Algorithm: solving partially observable Markov decision processes," Tech. Rep., Brown University, December 1994 1994.
10. RI Brafman, "A Heuristic Variable Grid Solution Method for POMDPs," in AAAI, Cambridge, MA, 1997.
11. B Bonet, "An e-Optimal Grid-based Algorithm for Partially Observable Markov Decision Processes," in Proceedings of the Nineteenth International Conference on Machine Learning(ICML 2002),, Sydney, Australia, 2002.
12. J Pineau, G Gordon, and S Thrun, "Point-based value iteration: An anytime algorithm for POMDPs," in Proc Int Joint Conference on AI (IJCAI), Acapulco, Mexico, 2003, pp. pp1025-1032.
13. MTJ Spaan and N Vlassis, "Perseus: randomized point-based value iteration for POMDPs," Tech. Rep., Universiteit van Amsterdam, 2004.
14. JD Williams, P Poupart, and SJ Young, "Factored Partially Observable Markov Decision Processes for Dialogue Management," in 4th Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Edinburgh, 2005.
15. N Roy, J Pineau, and S Thrun, "Spoken Dialogue Management Using Probabilistic Reasoning," in Proceedings of the ACL 2000, 2000.
16. B Zhang, Q Cai, J Mao, and B Guo, "Planning and Acting under Uncertainty: A New Model for Spoken Dialogue System," in Proc 17th Conf on Uncertainty in AI, Seattle, 2001.
17. D Traum, "Computational Models of Grounding in Collaborative Systems," in Working Papers of the AAAI Fall Symposium on Psychological Models of Communication in Collaborative Systems, 1999, pp. 124-131.
18. JD Williams and SJ Young, "Scaling up POMDPs for Dialogue Management: the Summary POMDP Method," in IEEE workshop on Automatic Speech Recognition and Understanding (ASRU2005), Puerto Rico, 2005.
19. JD Williams and SJ Young, "Scaling POMDPs for dialog management with composite summary point-based value iteration (CSPBVI)," in AAAI Workshop on Statistical and Empirical Approaches for Spoken Dialogue Systems, Boston, 2006.
20. K Scheffler and SJ Young, "Automatic Learning of Dialogue Strategy using Dialogue Simulation and Reinforcement Learning," in HLT 2002, San Diego, USA, 2002.
21. J Schatzmann, K Georgila, and SJ Young, "Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems," in 6th SIGdial Workshop on DISCOURSE and DIALOGUE, Lisbon, 2005.