The French MEDIA/EVALDA project: The evaluation of the understanding capability of Spoken Language Dialogue Systems

Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004

Volumn , Issue , 2004, Pages 2131-2134

  Devillers, L ^a   Maynard, H ^a   Rosset, S ^a   Paroubek, P ^a   McTait, K ^b   Mostefa, D ^b   Choukri, K ^b   Charnay, L ^c   Bousquet, C ^d   Vigouroux, N ^d   Bechet F ^e   Romary, L ^f   Antoine, J Y ^g   Villaneau, J ^g   Vergnes, M ^h   Goulian, J ⁱ  

^a UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

^b ELDA/ELRA   (France)

^c ORANGE LABS   (France)

^d IRIT   (France)

^e LIA   (France)

^f LORIA   (France)

^g VALORIA   (France)

^h Vecsys   (France)

ⁱ CLIPS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CONTEXT DEPENDENT; DESIGN AND TESTS; EVALUATION METHODOLOGIES; FRANCE TELECOM; INDUSTRIAL SITES; SPOKEN LANGUAGE DIALOGUE SYSTEM;

SPEECH PROCESSING;

EID: 84956895120     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Mariani J. (1998) " The Aupelf-Uref Evaluation-Based Language Engineering Action and Related Projects", LREC 1998, vol. 1, Granada. Spain.
2. Antoine J., & all, (2002) " Predictive and objective evaluation of speech understanding: the challenge evaluation campaign of the I3 speech workgroup of the French CNRS", LREC 2002, Las Palmas, Spain.
3. Dybkjaer L. & all, (1998), " The Disc Approach to Spoken Language System Development and Evaluation", LREC 1998, Granada, May 1998, vol. 1 pp 185-189.
4. Giachin, E. and McGlashan, S. (1997). " Spoken Language Dialogue Systems". In S. Young and G.Bloothooft (Eds.) Corpus-based methods in language and speech processing. Dordrecht: Kluwer Academic Publishers, 69-117.
5. Gibbon D. Moore R. W. R., (1997), " Handbook of Standards and Resources for Spoken Language Resources", Mouton de Gruyter, New-York, 1997, ISBN 3-11-015366-1.
6. MADCOW, (1992) " Multi-Site Data Collection for a Spoken Language Corpus", DARPA Speech and Natural Language Workshop, 1992
7. Walker M., Passonneau R., Boland J. (2001), " Quantitative and Qualitative Evaluation of Darpa Communicator Spoken Dialog Systems", ACL/EACL Toulouse, 2001
8. Devillers, H. Maynard, P. Paroubek, (2002), " Méthodologies d'évaluation des systèmes de dialogue parlé: réflexions et expériences autour de la compréhension", TAL 2002
9. Maynard H., Devillers L. (2000) L., " A framework for evaluating contextual understanding", ICSLP 2000.
10. Antoine J., & all, (2000) " Obtaining predictive results with an objective evaluation of spoken dialogue systems: experiments with the DCR assessment paradigm", LREC 2000.
11. Maynard, H. Rosset. S, (2003) " A Semantic representation for spoken dialogs", EUROSPEECH 2003 FIPA Communicative Act Library Specification, SC00037J, FIPA TC Communication, December 3rd 2002, http://www.fipa.org/specs/fipa00037