Modeling user behavior online for disambiguating user input in a spoken dialogue system

Speech Communication

Volumn 55, Issue 1, 2013, Pages 84-98

  Wang, Fangju ^a   Swegles, Kyle ^a  

^a UNIVERSITY OF GUELPH   (Canada)

Author keywords

Automatic speech recognition; Disambiguation; Natural language processing; Reinforcement learning; Spoken dialogue system; User behavior modeling

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; DISAMBIGUATION; NATURAL LANGUAGE PROCESSING; SPOKEN DIALOGUE SYSTEM; USER BEHAVIOR MODELING;

LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS; REINFORCEMENT LEARNING; SPEECH PROCESSING;

BEHAVIORAL RESEARCH;

EID: 84870302991     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2012.06.006     Document Type: Article

References (32)

1. D.M. Chickering, and T. Paek Personalizing influence diagrams: applying online learning strategies to dialogue management User Model User-Adap Inter 2007 Springer pp. 71-91 (Pubitemid 46327426)
2. Chotimongkol, A.; Rudnicky A.I.; 2001. N-best Speech Hypotheses Reordering Using Linear Regression. In: Proceedings of EuroSpeech 2001, Aalborg, Denmark, September 3-7, 2001, pp. 1829-1832.
3. C. Cifarelli, M.R. Guarracino, O. Seref, S. Cuciniello, and P.M. Pardalos Incremental classification with generalized eigenvalues J. Classific. 24 2007 205 219
4. Frampton, M.; Lemon O.; 2006. Learning more effective dialogue strategies using limited dialogue move features. In: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, Sydney, Australia, pp. 185-192.
5. M. Frampton, and O. Lemon Recent research advances in reinforcement learning in spoken dialogue systems The Knowledge Engineering Review 24 4 2009 375 408
6. Gabsdil, M.; Lemon, O.; 2004. Combining acoustic and pragmatic features to predict recognition performance in spoken dialogue systems. In: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, Barcelona, July 21-26, 2004, pp. 343-350.
7. Gasic, M.; Jurcicek, F.; Thomson, B.; Yu, K.; Young, S.; 2011. On-line policy optimisation of spoken dialogue systems via live interaction with human subjects. In: Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) 2011), Hawaii, Dec 11-15, 2011, pp. 312-317.
8. D. Griol, L. Hurtado, E. Segarra, and E. Sanchis A statistical approach to spoken dialog systems design and evaluation Speech Communication 50 8-9 2008 666 682
9. Gruenstein, A.; 2008. Response-based confidence annotation for spoken dialogue system. In: Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue, Columbus, June 2008. pp. 11-20.
10. R. Higashinaka, K. Sudoh, and M. Nakano Incorporating discourse features into confidence scoring of intention recognition results in spoken dialogue systems Speech Comm. 48 3-4 2006 417 436 (Pubitemid 43207409)
11. K. Jokinen, and M. McTear Spoken Dialogue Systems 2010 Morgan & Claypool Publishers Francisco, USA
12. Jonson, R.; 2006. Dialogue context-based re-ranking of ASR hypotheses. In: Proceedings of IEEE 2006 Workshop on Spoken Language Technology, Palm Beach, Aruba, Dec 10-13, 2006, pp. 174-177.
13. S. Jung, C. Lee, K. Kim, M. Jeong, and G.G. Lee Data-driven user simulation for automated evaluation of spoken dialog systems Comput. Speech Lang. 23 2009 479 509
14. D. Jurafsky, and J.H. Martin Speech and Language Processing second ed. 2007 Prentice Hall Upper Saddle River, NJ, USA
15. Jurcicek, F.; Thomson, B.; Keizer, S.; Gasic, M.; Mairesse, M.; Yu, K.; Young, S.; 2010. Natural belief-critic: a reinforcement algorithm for parameter estimation in statistical spoken dialogue systems. In: Proceedings of Interspeech10, September 26-30, 2010, pp. 90-93.
16. Keizer, S.; Gasic, M.; Mairesse, F.; Thomson, B.; Yu, K.; Young, S.; 2008. Modelling user behaviour in the HIS-POMDP dialogue manager. In: IEEE Spoken Language Technology Workshop 2008, Goa, India, 2008, pp. 121-124.
17. Lemon, O.; Konstas, I.; 2009. User simulation for context-sensitive speech recognition in spoken dialogue systems. In: Proceedings of the 12th Conference of the European Chapter of the ACL, Athens, Greece, 30 March-3 April, 2009, pp. 505-513.
18. Levin, E.; Pieraccini, R.; Eckert, W.; 2000. A stochastic model of human-machine interaction for learning dialog strategies. In: IEEE Transactions on Speech and Audio Processing, vol. 8, pp. 1-23.
19. G.J. Lidstone Note on the general case of the Bayes-Laplace formula for inductive or a posteriori probabilities Trans. Faculty Actuaries 8 1920 182 192
20. Litman, D.J.; Kearns, M.S.; Singh, S.; Walker, M.A.; 2000. Automatic optimization of dialogue management. In: Proceedings of the 18th conference on Computational linguistics, vol 1, Germany, 2000, pp. 502-508.
21. C.D. Manning, and H. Schutze Foundations of Statistical Natural Language Processing 1999 The MIT Press Massachusetts, USA
22. Png, S.; Pineau, J.; 2011. Bayesian Reinforcement Learning for POMDP-based dialogue systems. In: Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, May 22-27, 2011, pp. 2156-2159.
23. J. Schatzmann, K. Weilhammer, M. Stuttle, and S. Young A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies The Knowledge Engineering Review 21 2006 1 24
24. K. Scheffler, and S. Young Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning In: Proceedings of the Second International Conference on Human Language Technology Research 2002 Morgan Kaufmann Publishers Inc 12 19
25. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 2005 The MIT Press Cambridge, Massachusetts
26. J.R. Tetreault, and D.J. Litman A reinforcement learning approach to evaluating state representations in spoken dialogue systems Speech Comm 50 8-9 2008 683 696
27. B. Thomson, and S. Young Bayesian update of dialogue state: a POMDP framework for spoken dialogue systems Elsevier Comput. Speech Lang. 24 2010 562 588
28. Thomson, B.; Jurcicek, F.; Gai, M.; Keizer, Mairesse, F.; Yu, K.; Young, S.; 2010. Parameter learning for POMDP spoken dialogue models, SLT, 2010. In: Spoken Language Technology Workshop (SLT), 2010, pp. 271-276, Berkeley, USA, 2010.
29. F. Torres, E. Sanchis, and E. Segarra User simulation in a stochastic dialog system Comput. Speech Lang. 22 2008 230 255 (Pubitemid 351329451)
30. Walker, W.; Lamere, P.; Kwok, P.; Raj, B.; Singh, R.; Gouvea, E.; Wolf, P.; Woelfel, J.; 2004. Sphinx-4: a flexible open source framework for speech recognition, 2004. .
31. J.D. Williams, and S. Young Partially observable Markov decision processes for spoken dialog systems Elsevier Comput. Speech Lang. 21 2007 393 422 (Pubitemid 44709839)
32. Williams, J.; Poupart, P.; Young, S.; 2005. Factored partially observable Markov decision processes for dialogue management. In: Proceedings of Knowledge and Reasoning in Practical Dialogue Systems.