N-best error simulation for training spoken dialogue systems

2012 IEEE Workshop on Spoken Language Technology, SLT 2012 - Proceedings

Volumn , Issue , 2012, Pages 37-42

  Thomson, Blaise ^a   Gasic, Milica ^a   Henderson, Matthew ^a   Tsiakoulis, Pirros ^a   Young, Steve ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

error simulation; POMDP; reinforcement learning; Spoken dialogue systems

Indexed keywords

DIALOGUE SYSTEMS; DIRICHLET; DIRICHLET DISTRIBUTIONS; ERROR MODEL; ERROR SIMULATION; LOGISTIC MODELS; LOGISTIC REGRESSIONS; MODEL RESULTS; N-BEST LIST; POMDP; RECEIVER OPERATING CHARACTERISTICS; RECENT TRENDS; SIMULATED ENVIRONMENT; SPOKEN DIALOGUE; SPOKEN DIALOGUE SYSTEM;

ERRORS; LOGISTICS; PROBABILITY DISTRIBUTIONS; REINFORCEMENT LEARNING; SEMANTICS; SPEECH RECOGNITION;

SPEECH PROCESSING;

EID: 84874224090     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2012.6424194     Document Type: Conference Paper

References (20)

1. E. Levin, R. Pieraccini, and W. Eckert, "A stochastic model of human-machine interaction for learning dialog strategies," IEEE Transactions on Speech and Audio Processing, vol. 8, no. 1, pp. 11-23, 2000.
2. B. Thomson and S. Young, "Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems," Computer Speech and Language, vol. 24, no. 4, pp. 562-588, 2010.
3. R. Sutton and A. Barto, Reinforcement Learning: An Introduction, Adaptive Computation and Machine Learning. MIT Press, Cambridge, Mass, 1998.
4. O. Pietquin, "Consistent Goal-Directed User Model for Realistic Man-Machine Task-Oriented Spoken Dialogue Simulation," in Proceedings of the 7th IEEE International Conference on Multimedia and Expo, Toronto (Canada), July 2006, pp. 425-428.
5. S. Jung, C. Lee, K. Kim, M. Jeong, and G. Lee, "Data-driven user simulation for automated evaluation of spoken dialog systems," Computer Speech and Language, vol. 23, no. 4, pp. 479-509, 2009.
6. O. Lemon and X. Liu, "Dialogue policy learning for combinations of noise and user simulation: transfer results," in SIGDIAL, 2006.
7. O. Pietquin and S. Renals, "ASR system modeling for automatic evaluation and optimization of dialogue systems," in ICASSP, 2002, pp. 46-49.
8. J. Schatzmann, B. Thomson, and S. Young, "Error simulation for training statistical dialogue systems," in Proceedings of ASRU, 2007, pp. 526-531.
9. Y. Deng, M. Mahajan, and A. Acero, "Estimating speech recognition error rate without acoustic test data," in 8th European Conference on Speech Communication and Technology, 2003.
10. E. Fosler-Lussier, I. Amdal, and H. Kuo, "On the road to improved lexical confusability metrics," in ISCA Tutorial and Research Workshop (ITRW) on Pronunciation Modeling and Lexicon Adaptation for Spoken Language Technology, 2002.
11. O. Pietquin and T. Dutoit, "A probabilistic framework for dialog simulation and optimal strategy learning," IEEE Transactions on Audio, Speech and Language Processing, vol. 14, no. 2, 2006.
12. S. Young, M. Gasic, S. Keizer, F. Mairesse, J. Schatzmann, B. Thomson, and K. Yu, "The hidden information state model: A practical framework for POMDP-based spoken dialogue management," Computer Speech & Language, 2009.
13. J. D.Williams and S. Young, "Partially observable markov decision processes for spoken dialog systems," Computer Speech and Language, vol. 21, no. 2, pp. 231-422, 2006.
14. B. Thomson, K. Yu, S. Keizer, M. Gasic, F. Jurcicek, F. Mairesse, and S. Young, "Bayeian dialogue system for the Let's Go spoken dialogue challenge," in SLT, 2010.
15. F. Pinault, Apprentissage par renforcement pour la ǵeń eralisation des approches automatiques dans la conception des syst̀emes de dialogue oral, Ph.D. thesis, l'Universit́e d'Avignon, 2011.
16. D. R Traum, "20 questions on dialogue act taxonomies," Journal of Semantics, vol. 17, no. 1, pp. 7-30, 2000.
17. T. Minka, "A comparison of numerical optimizers for logistic regression," Tech. Rep., Microsoft Research, 2003.
18. T. Minka, "Estimating a Dirichlet distribution," Tech. Rep., MIT, 2003, http://research.microsoft.com/en-us/um/people/minka/papers/dirichlet/ .
19. F. Jurcicek, B. Thomson, and S. Young, "Reinforcement learning for parameter estimation in statistical spoken dialogue systems," Computer Speech and Language, 2011.
20. T. Fawcett, "ROC graphs: Notes and practical considerations for data mining researchers," Tech. Rep., Intelligent Enterprise Technologies Laboratory. HP Laboratories Palo Alto, 2003.