Challenges and opportunities for state tracking in statistical spoken dialog systems: Results from two public deployments

IEEE Journal on Selected Topics in Signal Processing

Volumn 6, Issue 8, 2012, Pages 959-970

  Williams, Jason D ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

Human computer interaction; Spoken dialog systems

Indexed keywords

CONFIDENCE SCORE; DIALOG SYSTEMS; EMPIRICAL MEASUREMENT; GENERATIVE MODEL; PARAMETER ESTIMATE; SPOKEN DIALOG SYSTEMS; STATE TRACKING; STATISTICAL TECHNIQUES;

PARAMETER ESTIMATION; SPEECH RECOGNITION;

HUMAN COMPUTER INTERACTION;

EID: 84872129735     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2012.2229691     Document Type: Article

References (26)

1. E. Levin, R. Pieraccini, and W. Eckert, "A stochastic model of human-machine interaction for learning dialogue strategies," IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 11-23, Jan. 2000. (Pubitemid 30540744)
2. T. Paek and E. Horvitz, "Conversation as action under uncertainty," in Proc. Conf. Uncertainty Artif. Intell. (UAI), Stanford, CA, 2000, pp. 455-464.
3. B. Zhang, Q. Cai, J. Mao, and B. Guo, "Planning and acting under uncertainty: A new model for spoken dialogue system," in Proc. Conf. Uncertainty Artif. Intell. (UAI), Seattle, WA, 2001, pp. 572-579.
4. N. Roy, J. Pineau, and S. Thrun, "Spoken dialog management for robots," in Proc. Associat. Computat. Linguist. (ACL), Hong Kong, 2000, pp. 93-100.
5. J. D. Williams and S. Young, "Partially observable Markov decision processes for spoken dialog systems," Comput. Speech Lang., vol. 21, no. 2, pp. 393-422, 2007. (Pubitemid 44709839)
6. T. Bui, M. Poel, A. Nijholt, and J. Zwiers, "A tractable hybrid DDN-POMDP approach to affective dialogue modeling for probabilistic frame-based dialogue systems," Natural Lang. Eng., vol. 15, no. 2, pp. 273-307, 2009.
7. J. D. Williams, "Incremental partition recombiantion for efficient tracking of multiple dialogue states," in Proc. ICASSP, Dallas, TX, 2010, pp. 5382-5385.
8. H. Higashinaka, M. Nakano, and K. Aikawa, "Corpus-based discourse understanding in spoken dialogue systems," in Proc. Assoc. for Computat. Linguist. (ACL), Sapporo, Japan, 2003.
9. J. Henderson and O. Lemon, "Mixture model POMDPs for efficient handling of uncertainty in dialogue management," in Proc. Associat. for Computat. Linguist. Human Lang. Technol. (ACL-HLT), Columbus, OH, 2008.
10. S. Young, M. Gašić, S. Keizer, F. Mairesse, J. Schatzmann, B. Thomson, and K. Yu, "The hidden information state model: A practical framework for POMDP-based spoken dialogue management," Comput. Speech Lang., vol. 24, no. 2, pp. 150-174, 2009.
11. B. Thomson and S. Young, "Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems," Comput. Speech Lang., vol. 24, no. 4, pp. 562-588, 2010.
12. A. W. Black, S. Burger, A. Conkie, H. Hastie, S. Keizer, O. Lemon, N. Merigaud, G. Parent, G. Schubiner, B. Thomson, J. D. Williams, K. Yu, S. Young, and M. Eskenazi, "Spoken dialog challenge 2010: Comparison of live and control test results," in Proc. SIGdialWorkshop Discourse and Dialogue, Portland, OR, 2011.
13. J. D.Williams, I. Arizmendi, and A. Conkie, "Demonstration of AT&T Let's Go: A production-grade statistical spoken dialog system," in Proc. Workshop Spoken Lang. Technol. (SLT), Berkeley, CA, 2010.
14. J. D. Williams, "An empirical evaluation of a statistical dialog system in public use," in Proc. SIGdial Workshop Discourse and Dialogue, Portland, OR, 2011.
15. M. Gasic and S. Young, "Effective handling of dialogue state in the hidden information state POMDP-based dialogue manager," ACM Trans. Speech Lang. Process., 2011.
16. K. Kim, C. Lee, S. Jung, and G. Lee, in A Frame-Based Probabilistic Framework for Spoken Dialog Management Using Dialog Examples, Columbus, OH, 2008, pp. 120-127.
17. N. Mehta, R. Gupta, A. Raux, D. Ramachandran, and S. Krawczyk, "Probabilistic ontology trees for belief tracking in dialog systems," in Proc. SIGdial Workshop Discourse and Dialogue, Tokyo, Japan, 2010.
18. J. D. Williams, "Using particle filters to track dialogue state," in Proc. IEEEWorkshop Autom. Speech Recognit. Understand. (ASRU), Kyoto, Japan, 2007.
19. A. W. Black, S. Burger, B. Langner, G. Parent, and M. Eskenazi, "Spoken dialog challenge 2010," in Proc. Workshop Spoken Lang. Technol. (SLT), Berkeley, CA, 2010.
20. Dialog Research Center, Carnegie Mellon Univ., [Online]. Available: dialrc.org [21] "AT&T Statistical Dialog Toolkit," [Online]. Available: http://www2.research.att.com/sw/tools/asdt/
21. J. D.Williams and S. Balakrishnan, "Estimating probability of correctness for ASR -Best lists," in Proc. SIGdial Workshop Discourse and Dialogue, London, U.K., 2009.
22. G. Parent and M. Eskenazi, "Toward better crowdsourced transcription: Transcription of a year of the let's go bus information system data," in Proc. Workshop Spoken Lang. Technol. (SLT), Berkeley, CA, 2010.
23. S. Ross, J. Pineau, B. Chaib-draa, and P. Kreitmann, "A Bayesian approach for learning and planning in partially observable Markov decision processes," J. Mach. Learn., vol. 12, pp. 1655-1696, 2011.
24. F. Jurcicek, B. Thomson, and S. Young, "Reinforcement learning for parameter estimation in statistical spoken dialogue systems," Comput. Speech Lang., pp. 168-192, 2012.
25. D. Bohus and A. Rudnicky, "A 'K hypotheses + other' belief updating model," in Proc. Amer. Assoc. Artif. Intell. (AAAI) Workshop Statist. and Empir. Approaches for Spoken Dialogue Syst., Boston, MA, 2006.
26. D. Bohus, "Error awareness and recovery in conversational spoken language interfaces," Ph.D. dissertation, Carnegie Mellon Univ., Pittsburgh, PA, 2007.