Evaluation of a dialogue system in an automotive environment

Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue

Volumn , Issue , 2005, Pages 155-165

  Hassel, Liza ^a,b   Hagen, Eli ^b  

^a UNIVERSITY OF MUNICH   (Germany)

^b BMW AG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMOTIVE ENVIRONMENT; DIALOGUE SYSTEMS; SPOKEN DIALOGUE SYSTEM;

SPEECH PROCESSING;

EID: 84857718528     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. E. J. Gómez Aguilera and N. O. Bernsen et al. 2004. Usability Evaluation Issues in Natural Interactive and Multimodal Systems - State of the Art and Current Practice (Draft Version). Technical report. Project SIMILAR SIG7 on Usability and Evaluation, Deliverable D16.
2. M. Aretoulaki and B. Ludwig. 1998. Skizzierung eines allgemeinen Szenarios für Bediendialoge. Jahres-bericht 1998 der Forschungsgruppe Wissensverar-beitung am Bayerischen Forschungszentrum für wis-sensbasierte Systeme, http://www-wv.informatik.uni-erlangen.de/fg-wv/.
3. N. Beringer, U. Kartal, K. Louka, F. Schiel, and U. Türk. 2002. PROMISE - A Procedure for Multimodal Interactive System Evaluation. Technical report, LMU München, Institut für Phonetik und sprachliche Kom-munikation. Teilprojekt 1: Modalitätsspezifische Analysatoren, Report Nr. 23.
4. N. O. Bernsen and L. Dybkjær. 2001. Exploring Natural Interaction in the Car. In International Workshop on Information Presentation and Natural Multimodal Dialogue, pages 75-79, Verona, Italy 14-15 Dec. 2001.
5. J. Carletta. 1996. Assessing Agreement on Classification Tasks: The Kappa Statistic. Computational Linguistics, 22(2):249-254.
6. H. H. Clark. 1997. Using Language. Cambridge University Press, Cambridge, New York, Melbourne.
7. A. Dix, J. Finlay, and G. Abowd. 1995. Mensch Mas-chine Methodik. Prentice Hall.
8. L. Dybkjær, N. O. Bernsen, and H. Dybkjær, 1997. Designing Co-Operativity in Spoken Human-Machine Dialogue, volume 2 of Research Reports Esprit, pages 104-124. Springer Verlag.
9. ETSI EG 202 116 V 1.2.1, 2002. Human Factors (HF); Guidelines for ICT Products and Services; Design for All. European Telecommunications Standards Institute (ETSI).
10. K. Fellbaum and M. Hampicke. 2002. Human-Computer Interaction in a Smart Home Environment. In 4th International Congress on Gerontechnology, Miami Beach, USA, pages 1-6, November 9-12.
11. E. Hagen, T. Said, and J. Eckert. 2004. Spracheingabe im neuen BMW 6er. Sonderheft ATZ/MTZ (Der neue BMW 6er), May:134-139.
12. R. Haller. 2003. The Display and Control Concept iDrive - Quick Access to All Driving and Comfort Functions. ATZ/MTZ Extra (The New BMW 5-Series), August:51-53.
13. L. Hassel and E. Hagen. 2005. Adaptation of an Automotive Dialogue System to Users's Expertise. In 6th SIGdial Workshop on Discourse and Dialogue, Lisbon, Portugal, 2-3 September 2005. Draft Version.
14. A. Hjalmarsson. 2002. Evaluating AdApt, a Multi-Modal Conversational, Dialogue System Using PARADISE. Master's thesis, Department of Speech Music and Hearing, KTH Royal Institute of Technology, Stockholm.
15. L. B. Larsen. 2003a. Evaluation Methodologies for Spoken and Multi Modal Dialogue Systems - Revision 2. May 2003 (Draft Version). Presented at the COST 278 MC-Meeting in Stockholm 2.-4. May 2003.
16. L. B. Larsen. 2003b. Issues in the Evaluation of Spoken Dialogue Systems using Objective and Subjective Measures. In Proceedings of the 8th IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), St. Thomas, U.S. Virgin Islands, Dec. 2003.
17. J. Nielsen. 1993. Usability Engineering. Academic Press Professional, Boston u. a.
18. NIST. 2001. Common Industry Format for Usability Test Reports - Version 2.0, May 18, 2001. Technical report, National Institute of Standards and Technology.
19. Donald A. Norman. 2002. The Design of Everyday Things. Basic Books, New York.
20. T. Paek. 2001. Empirical Methods for Evaluating Dialog Systems. In ACL 2001 Workshop on Evaluation Methodologies for Language and Dialogue Systems, Toulouse, France.
21. S. Siegel and N. J. Castellan. 1988. Nonparametric statistics for the behavioral sciences. McGraw-Hill International, Singapore.
22. think3. 2000. Think3: thinkdesign 6.0 Debuts To Rave Reviews. Press Releases, http://www.think3.com/en/news/.
23. M. A. Walker, D. J. Litman, C. A. Kamm, and A. Abella. 1998. Evaluating Spoken Dialogue Agents with PARADISE: Two Case Studies. Computer Speech and Language, 12(3):317-347.
24. S. Whittaker, L. Terveen, and B. A. Nardi. 2000. Let's Stop Pushing the Envelope and Start Addressing It: A Reference Task Agenda for HCI. Human Computer Interaction, 15:75-106. (Pubitemid 32251320)