The Markov assumption in spoken dialogue management

Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue

Volumn , Issue , 2005, Pages 35-44

  Paek, Tim ^a   Chickering, David Maxwell ^a  

^a NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; MARKOV PROCESSES; REINFORCEMENT LEARNING; SPEECH PROCESSING;

ACTION SELECTION; DIALOGUE MANAGEMENT; DIALOGUE SYSTEMS; MARKOV ASSUMPTIONS; MARKOV DECISION PROCESSES; OPTIMAL POLICIES; REINFORCEMENT LEARNING METHOD; SPOKEN DIALOGUE SYSTEM;

LEARNING SYSTEMS;

EID: 74049153470     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Bellman, R.E. 1957. Dynamic Programming. Princeton University Press.
2. Chickering, D. 2002. "The WinMine Toolkit," Microsoft Technical Report, MSR-TR-2002-103.
3. Chickering, D., Heckerman, D., and Meeks, C. 1997. "A Bayesian Approach to Learning Bayesian Networks with Local Structure," UAI-97, pp. 80-89.
4. Chickering, D. and Paek, T. 2005. "Online Adaptation of Influence Diagrams," Microsoft Technical Report, MSR-TR-2005-55.
5. Clark, H. 1997. Using Language. Cambridge University Press. Cambridge University Press.
6. Heckerman, D. 1995. "A Bayesian Approach for Learning Causal Networks," UAI-95, pp. 285-295.
7. Howard, R., and Matheson, J. 1981. "Influence Diagrams," In Readings on the Principles and Applications of Decision Analysis, vol. 2. pp. 721-17. Strategic Decisions Group, Menlo Park, CA.
8. Kearns, M., Mansour, Y., Ng, A. 1999. "A Sparse Sampling Algorithm for Near-Optimal Planning in Large Markov Decision Processes," ICJAI-99.
9. Lauritzen, S.L. and Nilsson, D. 2001. "Representing and Solving Problems with Limited Information," Management Science, 47(9):1235-1251. (Pubitemid 34192827)
10. Levin, E., Pieraccini, R. and Eckert, W. 1998. "Using Markov Decision Processes for Learning Dialogue Strategies," ICASSP-98.
11. Meuleau, N., Hauskrecht, M., Kim, K., Peshkin, L., Kaelbling, L., Dean, T. and Boutilier, C. 1998. "Solving Very Large Weakly Coupled Markov Decision Processes," AAAI-98, pp. 165-172.
12. Paek, T. and Horvitz, E. 2004. "Optimizing Automated Call Routing by Integrating Spoken Dialog Models with Queuing Models," HLT-NAACL-2004, pp. 41-48.
13. Paek, T. and Horvitz, E. 2000. "Conversation as Action Under Uncertainty," UAI-2000, pp. 445-464.
14. Roy, N., Pineau, J. and Thrun, S. 2000. "Spoken Dialogue Management Using Probabilistic Reasoning," ACL-2000.
15. Singh, S., Litman, D., Kearns, M. and Walker, M. 2002. "Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJ-Fun System," Journal of Artificial Intelligence Research, 16: 105-133. (Pubitemid 43057171)
16. Sutton, R.S. and Barto, A.G. 1998. Reinforcement Learning: An Introduction. MIT Press.
17. Tatman, J.A. and Shachter, R.D. 1990. "Dynamic Programming and Influence Diagrams," IEEE Transactions on Systems, Man and Cybernetics, 20(2):365-379.
18. Walker, M., Aberdeen, J., Boland, J., Bratt, E., Garo-folo, J., Hirschman, L., Le, A., Lee, S., Narayanan, S., Papineni, K., Pellom, B., Polifroni, B., Pota-mianos, A., Prabhu, P., Rudnicky, A., Sanders, G., Seneff, S., Stallard, D., Wittaker, S. 2001(a). "DARPA Communicator Dialog Travel Planning Systems: The June 2000 Data Collection," Eu-rospeech-2001.
19. Walker, M.A., Passonneau, R.J. and Boland, J.E. 2001(b). "Quantitative and Qualitative Evaluation of DARPA Communicator Spoken Dialogue Systems," ACL-2001, pp. 515-522.
20. Watkins, C.J.C.H. and Dayan, P. 1992. "Q-Learning," Machine Learning, 8(3):229-256.
21. Young, S. 2000. "Probabilistic Methods in Spoken Dialogue Systems," Philosophical Transactions of the Royal Society (Series A), 358(1769): 1389-1402.
22. Zhang, B., Cai, Q., Mao, J. and Guo, B. 2001. "Planning and Acting under Uncertainty: A New Model for Spoken Dialogue Systems," UAI-2001, pp. 572-579.