Automatic learning and evaluation of user-centered objective functions for dialogue system optimisation

Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

Volumn , Issue , 2008, Pages 2356-2361

  Rieser, Verena ^a   Lemon, Oliver ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

QUALITY ASSURANCE; SPEECH PROCESSING;

ACCURATE PREDICTION; AUTOMATIC-LEARNING; DATA-DRIVEN METHODS; DIALOGUE EVALUATION; EVALUATION METRICS; EVALUATION OF USERS; NON TRIVIAL PROBLEMS; OBJECTIVE FUNCTIONS;

FUNCTION EVALUATION;

EID: 84859906764     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Herbert Clark. 1996. Using Language. Cambridge University Press.
2. Klaus-Peter Engelbrecht and Sebastian Möller. 2007. Pragmatic usage of linear regression models for the predictions of user judegments. In Proc. of SIGdial.
3. James Henderson, Oliver Lemon, and Kallirroi Georgila. 2008. Hybrid reinforcement/supervised learning of dialogue policies from fixed datasets. Computational Linguistics (to appear).
4. Jiang Hu, Andi Winterboer, Clifford Nass, Johanna D. Moore, and Rebecca Illowsky. 2007. Context & usability testing: user-modeled information presentation in easy and difficult driving condition. In Proc. CHI, pages 1343-1346.
5. Karen Sparck Jones and Julia Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Springer Verlag.
6. Oliver Lemon and Olivier Pietquin. 2007. Machine learning for spoken dialogue systems. In Proc. of Interspeech.
7. Tim Paek. 2006. Reinforcement learning for spoken dialogue systems: Comparing strengths and weaknesses for practical deployment. In Proc. Dialog-on-Dialog Workshop, Interspeech.
8. Tim Paek. 2007. Toward evaluation that leads to best practices: Reconciling dialogue evaluation in research and industry. In Proc. of the NAACL-HLT Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies.
9. Roberto Pieraccini. 2002. The art and science of spoken dialog systems. Invited talk, The Center for Language and Speech Processing, Johns Hopkins University.
10. Verena Rieser and Oliver Lemon. 2008a. Does this list contain what you were searching for? Learning adaptive dialogue strategies for interactive question answering. Natural Language Engineering (to appear).
11. Verena Rieser and Oliver Lemon. 2008b. Learning effective multimodal dialogue strategies from wizard-of-oz data: Bootstrapping and evaluation. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL/HLT-08).
12. Verena Rieser, Ivana Kruijff-Korbayová, and Oliver Lemon. 2005. A corpus collection and annotation framework for learning multimodal clarification strategies. In Proc. SIGdial.
13. Verena Rieser. 2008. Bootstrapping Reinforcement Learning-based Dialogue Strategies from Wizard-of-Oz data (to appear). Ph. D. thesis, International Research Training Group Language Technology and Cognitive Systems, Saarland University.
14. Satinder Singh, Diane Litman, Micheal Kearns, and Marilyn Walker. 2002. Optimizing dialogue management with reinforcement learning: Experiments with the NJ-Fun system. JAIR, 16.
15. Richard Sutton and Andrew Barto. 1998. Reinforcement Learning. MIT Press.
16. Marilyn Walker, Diane Litman, Candance Kamm, and Alicia Abella. 1997. PARADISE: a general framework for evaluating spoken dialogue agents. In ACL/EACL.
17. Marilyn Walker, Jeanne Fromer, and Shrikanth Narayanan. 1998. Learning optimal dialogue strategies: A case study of a spoken dialogue agent for email. In Proceedings of ACL/COLING.
18. Marilyn Walker, Candance Kamm, and Diane Litman. 2000. Towards developing general models of usability with PARADISE. Natural Language Engineering, 6 (3).
19. Marilyn Walker. 2005. Can we talk? Methods for evaluation and training of spoken dialogue system. Language Resources and Evaluation, 39(1):65-75.