New challenges in usability evaluation - Beyond task-oriented spoken dialogue systems

8th International Conference on Spoken Language Processing, ICSLP 2004

Volumn , Issue , 2004, Pages 2261-2264

  Dybkjær, Laila ^a   Bernsen, Niels Ole ^a   Minker, Wolfgang ^b  

^a UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^b UNIVERSITY OF ULM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH PROCESSING;

MULTI-MODAL; SPOKEN DIALOGUE SYSTEM; TASK-ORIENTED; UNIMODAL; USABILITY EVALUATION;

USABILITY ENGINEERING;

EID: 85009113228     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. André, E., Dybkjær, L., Minker, W. and Heisterkamp, P. (Eds.): Affective Dialogue Systems. LNAI 3068, Springer 2004.
2. Batliner, A., Fischer, K., Huber, R., Spilker, J. and Nöth, E.: Desperately Seeking Emotions: Actors, Wizards, and Human Beings. Proc. of the ISCA Workshop on Speech and Emotion: A Conceptual Framework for Research, Belfast, 2000, 195-200.
3. Beringer, N., Kartal, U., Louka, K., Schiel, F. and Türk, U.: PROMISE - a procedure for multimodal interactive system evaluation. Proc. of the LREC Workshop on Multimodal Resources and Multimodal Systems Evaluation, Las Palmas, 2002, 77-80.
4. Bernsen, N.O.: Multimodality in Language and Speech Systems - from Theory to Design Support Tool. In Granström, B., House, D., and Karlsson, I. (Eds.): Multimodality in Language and Speech Systems, Kluwer Academic Publishers, Dordrecht, 2002, 93-148.
5. Bernsen, N.O.: User Modelling in the Car. In [9], 2003, 378-382.
6. Bernsen, N.O., Charfuelàn, M., Corradini, A., Dybkjær, L., Hansen, T., Kiilerich, S., Kolodnytsky, M., Kupkin, D. and Mehta, M.: First Prototype of Conversational H. C. Andersen. Proc. of the International Working Conference on Advanced Visual Interfaces (AVI 2004), Gallipoli, Italy, 2004, 458-461.
7. Bernsen, N.O., Dybkjær, L. and Kiilerich, S.: Evaluating Conversation with Hans Christian Andersen. Proc. of LREC, Lisbon, Portugal, 2004, 1011-1014.
8. Bickmore, T. and Cassell, J.: Social Dialogue with Embodied Conversational Agents. In [32], 2004.
9. Brusilovsky, P., Corbett, A. and de Rosis, F. (Eds.): User Modeling 2003. Proc. of the 9th International Conference, UM 2003, Johnstown, PA, USA, Springer Lecture Notes in Artificial Intelligence, vol. 2702, 2003.
10. Bühler, D., Minker, W., Häussler, J., and Krüger, S.: Flexible Multimodal Human-Machine Interaction in Mobile Environments. Proc. of the ECAI Workshop on Artificial Intelligence in Mobile System (AIMS), Lyon, 2002, 66-70.
11. Cohen, I., Sebe, N., Chen, L., Garg, A. and Huang, T.: Facial Expression Recognition from Video Sequences: Temporal and Static Modeling. In Computer Vision and Image Understanding, Special Issue on Face Recognition, vol. 91, Issues 1-2, 2003, 160-187.
12. Cohen, P., McGee, D., and Clow, J.: The Efficiency of Multimodal Interaction for a Map-based Task. Proc. of the Applied Natural Language Processing Conference, Morgan Kaufmann, 2000, 331-338.
13. Cole, R., van Vuuren, S., Pellom, B., Hacioglu, K., Ma, J., Movellan, J., Schwartz, S., Wade-Stein, D., Ward, W. and Yan, J.: Perceptive Animated Interfaces: First Steps towards a New Paradigm for Human-Computer Interaction. In [32], 2004.
14. Dehn, D. and van Mulken, S.: The Impact of Animated Interface Agents: A Review of Empirical Research. Int. Journal of Human-Computer Studies 52, 2000, 1-22.
15. den Os, E., de Koning, N., Jongebloed, H. and Boves. L.: Usability of a Speech-Centric Multimodal Directory Assistance Service. Proc. of the CLASS Workshop on Information Presentation and Natural Multimodal Dialogs, Verona, Italy, 2001, 65-69.
16. Dybkjær, L. and Bernsen, N.O.: Usability Issues in Spoken Language Dialogue Systems. Natural Language Engineering, Special Issue on Best Practice in Spoken Language Dialogue System Engineering, vol. 6 Parts 3 & 4, 2000, 243-272.
17. Dybkjær, L., Bernsen, N.O. and Minker, W.: Evaluation and Usability of Multimodal Spoken Language Dialogue. Speech Communication, Elsevier, Amsterdam, 2004.
18. Elting, C, Strube, S, Möhler, G, Rapp, S. and Williams, J: The Use of Multimodality within the EMBASSI system. Proc. of M&C2002, Usability Engineering Multimodaler Interaktionsformen, Hamburg 2002.
19. Gibbon, D., Moore, R. and Winski, R. (Eds.): Handbook of Standards and Resources for Spoken Language Systems. Mouton de Gruyter, Berlin, New York, 1997.
20. Granström, B. and House, D.: Effective Interaction with Talking Animated Agents in Dialogue Systems. In [32], 2004.
21. Gustafson, J., Lindberg, N. and Lundeberg, M.: The August Spoken Dialogue System. Proc. of Eurospeech, 1999, 1151-1154.
22. Heylen, D., van Es, I., Nijholt, A. and van Dijk, B.: Controlling the Gaze of Conversational Agents. In [32], 2004.
23. Hirschberg, J., Swerts, M. and Litman, D.: Labeling Corrections and Aware Sites in Spoken Dialogue Systems. Proc. of the 2nd SIGdial Workshop on Discourse and Dialogue, Aalborg, Denmark, 2001, 72-79.
24. ISO (International Standardisation Organisation): ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs), Part 11: Guidance on usability. http://www.iso.org
25. Jameson, A. and Klöckner, K.: User Multitasking with Mobile Multimodal Systems. In [27], 2004.
26. Massaro, D. W.: The Psychology and Technology of Talking Heads: Applications in Language Learning. In [32], 2004.
27. Minker, W., Bühler, D. and Dybkjær, L. (Eds.): Spoken Multimodal Human-Computer Dialogue in Mobile Environments. Kluwer Academic Publishers, to appear, 2004.
28. Minker, W., Haiber, U., Heisterkamp P. and Scheible, S.: The Seneca Spoken Language Dialogue System. Speech Communication, Elsevier, Amsterdam, 2004.
29. Nielsen, J.: Heuristic Evaluation. In Nielsen, J. and Mack, R.L. (Eds.): Usability Inspection Methods. John Wiley & Sons, New York, 1994.
30. Sturm, J., Bakx, I., Cranen, B. and Terken, J.; Comparing the Usability of a User Driven and a Mixed Initiative Multimodal Dialogue System for Train Timetable Information. Proc. of Eurospeech, 2003, 2245-2248.
31. Sturm, J., Cranen, B., Wang, F., Terken, J. and Bakx, I: Effects of Prolonged Use on the Usability of a Multimodal Form-filling Interface. In [27], 2004.
32. van Kuppevelt, J., Dybkjær, L. and Bernsen, N.O. (Eds.): Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems. Kluwer Academic Publishers, to appear, 2004.
33. Walker, M., Litman, D., Kamm, C. and Abella, A.: PARADISE: A Framework for Evaluating Spoken Dialogue Agents. Proc. of the Association of Computational Linguistics (ACL), 1997, 271-280.