Data collection and performance evaluation of spoken dialogue systems: The MIT experience

6th International Conference on Spoken Language Processing, ICSLP 2000

Volumn , Issue , 2000, Pages

  Glass, James ^a   Polifroni, Joseph ^a   Seneff, Stephanie ^a   Zue, Victor ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLIENT SERVER COMPUTER SYSTEMS; DATA HANDLING; SPEECH PROCESSING;

AIR TRAVELS; CLIENT-SERVER ARCHITECTURES; DATA COLLECTION; EVALUATION INFRASTRUCTURE; PER-UTTERANCE BASIS; SPOKEN DIALOGUE SYSTEM;

DATA ACQUISITION;

EID: 85009126825     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. J. Glass, G. Flammia, D. Goodine, M. Phillips, J. Polifroni, S. Sakai, S. Seneff, and V. Zue, "Multilingual Spoken-Language Understanding in the MIT Voyager System", Speech Communication, 17, 1-18, 1995.
2. J. Glass, T. J. Hazen, and L. Hetherington, "Real-time telephonebased speech recognition in the JUPITER domain", Proc. ICASSP, 61-64, Phoenix, 1999.
3. T. Hazen, T. Burianek, J. Polifroni, and S. Seneff, "Integrating recognition confidence scoring with language understanding and dialogue modeling", these proceedings.
4. K. Livescu and J. Glass, "Lexical modeling of non-native speech for automatic speech recognition", Proc. ICASSP, 1842-1845, Istanbul, 2000.
5. C. Pao, P. Schmid, and J. Glass, "Confidence scoring for speech understanding", Proc. ICSLP, 815-818, Sydney, 1998.
6. J. Polifroni, S. Seneff, J. Glass, and T. J. Hazen, "Evaluation Methodology for a Telephone-based Conversational System", Proc. LREC, 43-50, Granada, 1998.
7. J. Polifroni and S. Seneff, "Galaxy-ii as an architecture for spoken dialogue evaluation", Proc. LREC, 725-730, Athens, 2000.
8. S. Seneff, E. Hurley, R. Lau, C. Pao, P. Schmid, and V. Zue, "Galaxy-ii: A reference architecture for conversational system development", Proc. ICSLP, 931-934, Sydney, 1998.
9. M. Walker, D. Litman, C. Kamm, and A. Abella, "PARADISE: A General Framework for Evaluating Spoken Dialogue Agents", Proc. ACL/EACL, 271-280, 1997.
10. V. Zue, S. Seneff, J. Glass, J. Polifroni, C. Pao, T. Hazen, and L. Hetherington, "Jupiter: A telephone-based conversational interface for weather information", Proc. SAP, 88(1), 85-96, 2000.
11. V. Zue, and J. Glass, "Conversational Interfaces: Advances and Challenges", to appear, IEEE Proceedings, 2000.