A framework for evaluating contextual understanding

6th International Conference on Spoken Language Processing, ICSLP 2000

Volumn , Issue , 2000, Pages

  Bonneau Maynard, H ^a   Devillers, L ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CONTEXTUAL UNDERSTANDING; NOCV1; SPOKEN DIALOG SYSTEMS; TEST SETS; USER SATISFACTION;

EID: 84945124651     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. J. Y. Antoine & all, "Obtaining predictive results with an objective evaluation of spoken dialogue systems: experiments with the DCR assessment paradigm", LREC Athens, May 2000.
2. S. Bennacef, L. Devillers, S. Rosset, L. Lamel, "Dialog in the RAILTEL telephone-based system", ICSLP-96 and ISSD-96, October 1996.
3. H. Bonneau-Maynard, L. Devillers, S. Rosset, "Predictive performance of dialog systems", LREC 2000, Athenes, May 2000.
4. L. Devillers, H. Bonneau-Maynard "Evaluation of dialog strategies for a tourist information retrieval system", ICSLP 98, Sydney, October 1998.
5. King M. & all, "Evaluation of Natural Language Processing Systems - EAGLES Final Report, EAG-WEG-PR.2, ISBN-87-90708-00-8, October 1996, pp 1-271.
6. L. Lamel, P. Paroubek, W. Minker, "DISC, SLDS Best Practice", Natural Language Engineering, Special Issue on Best Practice in Spoken Language Dialogue Systems Engineering, in print.
7. MADCOW, "Multi-Site Data Collection for A Spoken Language Corpus", Proc. DARPA Speech and Natural Language Workshop, February 1992, pp. 7-14.
8. J. Mariani "The Aupelf-Uref Evaluation-Based Language Engineering Action and Related Projects", LREC, May 1998.
9. M. Walker & all, "Paradise: a general framework for evaluating spoken dialog agents", ACL/EACL 1997.
10. M. Walker, L. Hirchman, J. Aberdeen "Evaluation for Darpa Communicator spoken dialogue systems", LREC 2000, Athens, May 2000.