Quantitative evaluation of user simulation techniques for spoken dialogue systems

Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue

Volumn , Issue , 2005, Pages 45-54

  Schatzmann, Jost ^a   Georgila, Kallirroi ^b   Young, Steve ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DIALOGUE MANAGEMENT; HUMAN-COMPUTER DIALOGUES; MACHINE LEARNING TECHNIQUES; QUANTITATIVE EVALUATION; SIMULATION QUALITY; SPOKEN DIALOGUE SYSTEM; STOCHASTIC MODELLING; TRAINING AND TESTING; USER SIMULATION;

SPEECH PROCESSING;

EID: 84857755459     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. W. Eckert, E. Levin, and R. Pieraccini. 1997. User modelling for spoken dialogue system evaluation. In Proc. of ASRU '97, pages 80-87.
2. K. Georgila, J. Henderson, and O. Lemon. 2005a. Learning user simulations for information state update dialogue systems. Submitted to Eurospeech '05.
3. K. Georgila, O. Lemon, and J. Henderson. 2005b. Automatic annotation of COMMUNICATOR dialogue data for learning dialogue strategies and user simulations. In Proc. of DIALOR '05 (to appear).
4. E. Levin, R. Pieraccini, and W. Eckert. 2000. A stochastic model of human-machine interaction for learning dialog strategies. IEEE Trans. on Speech and Audio Processing, 8(1):11-23. (Pubitemid 30540744)
5. B.-S. Lin and L.-S. Lee. 2001. Computer-aided analysis and design for spoken dialogue systems based on quantitative simulations. IEEE Transactions on Speech and Audio Processing, 9(5):534-548. (Pubitemid 32631181)
6. R. Lopez-Cozar, A. de la Torre, J. Segura, and A. Rubio. 2003. Assessment of dialogue systems by means of a new simulation technique. Speech Communication, 40:387-407.
7. O. Pietquin. 2004. A Framework for Unsupervised Learning of Dialogue Strategies. Ph.D. thesis, Faculte Polytechnique de Mons.
8. K. Scheffler and S. J. Young. 2001. Corpus-based dialogue simulation for automatic strategy learning and evaluation. In Proc. NAACL Workshop on Adaptation in Dialogue Systems, pages 64-70.
9. K. Scheffler. 2002. Automatic design of spoken dialogue systems. Ph.D. thesis, Cambridge University.
10. T. Watanabe, M. Araki, and S. Doshita. 1998. Evaluating dialogue strategies under communication errors using computer-to-computer simulation. Trans. of IE-ICE, Info Syst., E81-D(9):1025-1033. (Pubitemid 128728540)
11. S. Young. 2002. Talking to machines (statistically speaking). In Proc. of ICSLP '02. Denver, Colorado.
12. I. Zukerman and D. Albrecht. 2001. Predictive statistical models for user modeling. User Modeling and User-Adapted Interaction, 11:129-158.