A two-tier user simulation model for reinforcement learning of adaptive referring expression generation policies

Proceedings of the SIGDIAL 2009 Conference: 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue

Volumn , Issue , 2009, Pages 120-123

  Janarthanam, Srinivasan ^a   Lemon, Oliver ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; MACHINE LEARNING; SPEECH PROCESSING;

DOMAIN EXPERTISE; KULLBACK LEIBLER DIVERGENCE; POLICY LEARNING; REFERRING EXPRESSIONS; SIMILARITY MEASURE; SPOKEN DIALOGUE SYSTEM; TWO-TIER MODELS; USER SIMULATION;

REINFORCEMENT LEARNING;

EID: 78549275561     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1708376.1708392     Document Type: Conference Paper

References (13)

1. H. Cuayahuitl, S. Renals, O. Lemon, and H. Shimodaira. 2005. Human-Computer Dialogue Simulation Using Hidden Markov Models. In Proc. of ASRU 2005.
2. H. Cuayahuitl. 2009. Hierarchical Reinforcement Learning for Spoken Dialogue Systems. Ph.D. thesis, University of Edinburgh, UK.
3. W. Eckert, E. Levin, and R. Pieraccini. 1997. User Modeling for Spoken Dialogue System Evaluation. In Proc. of ASRU97.
4. K. Georgila, J. Henderson, and O. Lemon. 2006. User Simulation for Spoken Dialogue System: Learning and Evaluation. In Proc of ICSLP 2006.
5. E. A. Issacs and H. H. Clark. 1987. References in conversations between experts and novices. Journal of Experimental Psychology: General, 116:26-37.
6. S. Janarthanam and O. Lemon. 2009a. A Wizard-of-Oz environment to study Referring Expression Generation in a Situated Spoken Dialogue Task. In Proc. ENLG'09.
7. S. Janarthanam and O. Lemon. 2009b. Learning Lexical Alignment Policies for Generating Referring Expressions for Spoken Dialogue Systems. In Proc. ENLG'09.
8. V. Rieser and O. Lemon. 2006a. Cluster-based User Simulations for Learning Dialogue Strategies. In Proc. Interspeech/ICSLP.
9. J. Schatzmann, K. Georgila, and S. J. Young. 2005. Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems. In Proc. SIG-dial workshop on Discourse and Dialogue '05.
10. J. Schatzmann, K. Weilhammer, M. N. Stuttle, and S. J. Young. 2006. A Survey of Statistical User Simulation Techniques for Reinforcement Learning of Dialogue Management Strategies. Knowledge Engineering Review, pages 97-126. (Pubitemid 44266297)
11. J. Schatzmann, B. Thomson, K. Weilhammer, H. Ye, and S. J. Young. 2007. Agenda-based User Simulation for Bootstrapping a POMDP Dialogue System. In Proc of HLT/NAACL 2007.
12. S. Whittaker, M. Walker, and J. Moore. 2002. Fish or Fowl: A Wizard of Oz Evaluation of Dialogue Strategies in the Restaurant Domain. In Language Resources and Evaluation Conference.
13. J. Williams. 2008. Evaluating User Simulations with the Cramer-von Mises Divergence. Speech Communication, 50:829-846.