Automatic evaluation tool for multimodal dialogue systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5078 LNCS, Issue , 2008, Pages 297-305

  Wesseling, Hugo ^a,b   Bezold, Matthias ^a,b   Beringer, Nicole ^a  

^a ELEKTROBIT AUTOMOTIVE GMBH   (Germany)

^b UNIVERSITY OF ULM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

GRAPHIC METHODS; SPEECH; SPEECH PROCESSING; SPREADSHEETS; TECHNOLOGY;

AUTOMATIC EVALUATION; CORRELATION ANALYSIS; EVALUATION PROCESSES; GRAPHICAL REPRESENTATIONS; INTERACTIVE TECHNOLOGIES; MICROSOFT EXCEL; MULTIMODAL DIALOGUE SYSTEMS; RECORDING DATA; SPEECH-BASED SYSTEMS; WIZARD-OF-OZ;

DATA RECORDING;

EID: 48249085675     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-69369-7_36     Document Type: Conference Paper

References (10)

1. Beringer, N., Hans, S., Louka, K., Tang, J.: How to relate User Satisfaction and System Performance in Multimodal Dialogue Situations - a Graphical Approach. In: International CLASS Workshop on Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems, pp. 8-14 (2002a)
2. Beringer, N., Kartal, U., Louka, K., Schiel, F., Türk, U.: PROMISE - A Procedure for Multimodal Interactive System Evaluation. In: 3rd International Conference on Language Resources and Evaluation (LREC), pp. 77-80 (2002b)
3. DICIT (2007), http://dicit.fbk.eu/Automatic Evaluation Tool for Multimodal Dialogue Systems 305
4. Dybkjær, L., Bernsen, N.: Usability Evaluation in Spoken Language Dialogue Systems. In: Workshop on Evaluation for Language and Dialogue Systems, pp. 1-10 (2001)
5. Fleischmann, T.: Model Based HMI Specification in an Automotive Context. In: Smith, M.J., Salvendy, G. (eds.) HCII 2007. LNCS, vol. 4557, pp. 31-39. Springer, Heidelberg (2007)
6. Goronzy, S., Mochales, R., Beringer, N.: Developing speech dialogs for multimodal HMIs using finite state machines. In: 9th International Conference on Spoken Language Processing (Interspeech), CD-ROM (2006)
7. Kipp, M.: ANVIL - A Generic Annotation Tool for Multimodal Dialogue. In: 7th European Conference on Speech Communication and Technology (Eurospeech), pp. 1367-1370 (2001)
8. Milde, J.-T., Gut, U.: The TASX-environment: an XML-based Toolset for Time Aligned Speech Corpora. In: 3rd International Conference on Language Resources and Evaluation (LREC), pp. 1922-1927 (2002)
9. Möller, S.: Parameters for Quantifying the Interaction with Spoken Dialogue Telephone Services. In: 6th SIGdial Workshop on Discourse and Dialogue, pp. 166-177 (2005)
10. Walker, M., Kamm, C., Litman, D.: Towards Developing General Models of Usability with PARADISE. Nat. Lang. Eng. 6(3-4), 363-377 (2000)