DARPA communicator: Cross-system results for the 2001 evaluation

7th International Conference on Spoken Language Processing, ICSLP 2002

Volumn , Issue , 2002, Pages 269-272

  Walker, Marilyn A ^a   Rudnicky, Alex ^a   Prasad, Rashmi ^a   Aberdeen, John ^a   Bratt, Elizabeth Owen ^a   Garofolo, John ^a   Hastie, Helen ^a   Le, Audrey ^a   Pellom, Bryan ^a   Potamianos, Alex ^a   Passonneau, Rebecca ^a   Roukos, Salim ^a   Sanders, Greg ^a   Seneff, Stephanie ^a   Stallard, Dave ^a  

^a BBN TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATOR SYSTEMS; COMPLEX TASK; CROSS SYSTEMS; DATA COLLECTION; EVALUATION METHODOLOGIES; NOCV1; TRAVEL PLANNING; TRAVEL PLANS;

EID: 85009257788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (8)

1. J. Aberdeen. Darpa communicator logfile standard, 2000. http://fofoca.mitre.org/logstandard.
2. H. Bonneau-Maynard, L. Devillers, and S. Rosset. Predictive performance of dialog systems. In Language Resources and Evaluation Conference, 2000.
3. H. Wright Hastie, R. Prasad, and M. Walker. What's the trouble: automatically identifying problematic dialogues in DARPA communicator dialogue systems. In Proc. of ACL, 2002.
4. P. Price, L. Hirschman, E. Shriberg, and E. Wade. Subjectbased evaluation measures for interactive spoken language systems. In Proc. of the DARPA Speech and NL Workshop, pages 34-39, 1992.
5. M. Walker, J. Aberdeen, J. Boland, E. Bratt, J. Garofolo, L. Hirschman, A. Le, S. Lee, S. Narayanan, K. Papineni, B. Pellom, J. Polifroni, A. Potamianos, P. Prabhu, A. Rudnicky, G. Sanders, S. Seneff, D. Stallard, and S. Whittaker. DARPA Communicator dialog travel planning systems: The June 2000 data collection. In EUROSPEECH 2001, 2001.
6. M. Walker, A. Rudnicky, J. Aberdeen, E. Bratt, J. Garofolo, H. Hastie, A. Le, B. Pellom, A. Potamianos, R. Passonneau, R. Prasad, S. Roukos, G. Sanders, S. Seneff and D. Stallard. DARPA Communicator Evaluation: Progress from 2000 to 2001. In ICSLP 2002. 2002.
7. M. A. Walker, C. A. Kamm, and D J. Litman. Towards developing general models of usability with PARADISE. Natural Language Engineering: Special Issue on Best Practice in Spoken Dialogue Systems, 2000.
8. M. A. Walker, R. Passonneau, and J. E. Boland. Quantitative and qualitative evaluation of DARPA Communicator spoken dialogue systems. In Proc. of the Meeting of the Association of Computational Lingustics, ACL 2001, 2001.