Predictive and objective evaluation of speech understanding: The "challenge" evaluation campaign of the I3 speech workgroup of the French CNRS

Proceedings of the 3rd International Conference on Language Resources and Evaluation, LREC 2002

Volumn , Issue , 2002, Pages 529-536

  Antoine, Jean Yves ^a   Bousquet Vernhettes, Caroline ^b   Goulian, Jérôme ^a   Kurdi, Mohamed Zakaria ^c   Rosset, Sophie ^d   Vigouroux, Nadine ^b   Villaneau, Jeanne ^a  

^a UNIVERSITÉ BRETAGNE SUD   (France)

^b IRIT   (France)

^c CLIPS IMAG ^*  (France)

^d CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

OBJECTIVE EVALUATION; QUANTITATIVE ASSESSMENTS; RESEARCH AGENCY; SPEECH UNDERSTANDING; SPOKEN LANGUAGE UNDERSTANDING; WORKGROUPS;

SPEECH RECOGNITION;

EID: 85009229055     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Antoine J.Y. and al. 2000. Obtaining predictive results with an objective evaluation of spoken dialogue systems: Experiments with the DCR assessment paradigm. Proceedings of the 2nd International Conference on Language Resources and Evaluation, LREC'2000, Athens, Greece. [www.univubs.fr/valoria/antoine/articles/LREC.ps].
2. Antoine J.-Y., Goulian J. 2001. Word order variations and spoken man-machine dialogue in French : A corpus analysis on the ATIS domain. Proceedings of Corpus Linguistics'2001, Lancaster, UK. 22-29. [www.univubs.fr/valoria/antoine/articles/CL2001.ps].
3. Baggia P., Kellner A., Pérennou G., Popovici C., Sturm J. and Wessel F. (1999). Language Modelling and Spoken Dialogue Systems -The ARISE experience, Proceedings of the 6th Eurospean Conference on Speech Communication and Technology, Eurospeech'99. Budapest, Hungary, Vol. 4, p. 1767-1770.
4. Bousquet-Vernhettes C., Vigouroux N. 2001. Context Use to Improve the Speech Understanding Processing. Proceedings of SPECOM'2001, Moscow. 89-92.
5. Dybkjaer N.O. and al. (1998). The DISC approach to spoken language systems development and evaluation. Proceedings of the 1st International Conference on Language Resources and Evaluation, LREC'98, Granada, Spain, vol.1, 185-189.
6. Goulian J., Antoine J.-Y. 2001. Compréhension automatique de la parole combinant syntaxe locale et sémantique globale pour une CHM portant sur des tâches relativement complexes. Proceedings of TALN'99, Tours, France. 203-212. [http://www.univubs.fr/valoria/antoine/articles/TALN2001.ps].
7. Hirschman L. 1998. Evaluating spoken language interaction: Experiences from the DARPA spoken language program. In Luperfoy S. (Ed.) Spoken Language Discourse. MIT Press.
8. Hirschman L. 1998b. Language understanding evaluations: lessons learned from MUC and ATIS. Proceedings of the 1st International Conference on Language Resources and Evaluation, LREC'98, Granada, Spain, 117-122.
9. Lamel L., Rosset S., Gauvain J.-L., Bennacef S., Garnier- Rizet M., Prouts, B. 2000. The LIMSI ARISE System. Speech Communication, 31(4):339-354, Aug 2000.
10. FRACAS Project. 1996. Using the framework. Fracas project LRE 62-051. Deliverable D16. European Community.
11. Heeman P.A., Allen J. F. 1999. Speech repairs, intonational phrases and discourse markers: modeling speaker' s utterances in spoken dialogue. Proceedings of Computational Linguistics, 25(4), 527-573.
12. Koo M.-W. and al. 1995. KT-STS: A speech translation system for hotel reservation and a continuous speech recognition system for speech translation, Proceedings of the 4th Eurospean Conference on Speech Communication and Technology, Eurospeech'95, Madrid, Spain, pp. 1227-1231.
13. Kurdi M.Z. 2001. A spoken language understanding approach which combines the parsing robustness with the interpretation deepness. Proceedings of ICAI'01, Las Vegas. USA.
14. den Os E. (1999). Overview of the Arise project, Proceedings of the 6th Eurospean Conference on Speech Communication and Technology, Eurospeech'99. Budapest, Hungary.
15. Price P. 1990. Evaluation of spoken language systems : The ATIS domain. Proceedings of the 3rd DARPA Workshop on Speech and Natural Language, Hidden Valley, PA, 91-95.
16. Villaneau J., Antoine J.-Y., Ridoux O. 2001. Combining syntax et pragmatic knowledge for the understanding of spontaneous spoken utterances. Proceedings of LACL'01. In LNAI 2099, Springer-Verlag, 279-295. [www.univ-ubs.fr/valoria/antoine/articles/01lacl.ps].