MeMo: Towards automatic usability evaluation of spoken dialogue services by user error simulations

INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP

Volumn 4, Issue , 2006, Pages 1786-1789

  Möller, Sebastian ^a   Englert, Roman ^a   Engelbrecht, Klaus ^a   Hafner, Verena ^a   Jameson, Anthony ^b   Oulasvirta, Antti ^a   Raake, Alexander ^a   Reithinger, Norbert ^b  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

Evaluation; Spoken dialogue system; Usability

Indexed keywords

SPEECH PROCESSING; SPEECH RECOGNITION; USABILITY ENGINEERING;

ERROR SIMULATION; EVALUATION; PERCEIVED USABILITY; SIMULATED ERROR; SPOKEN DIALOGUE; SPOKEN DIALOGUE SYSTEM; USABILITY; USABILITY EVALUATION;

ERRORS;

EID: 38349073645     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. ITU-T Suppl. 24 to P-Series Rec., Parameters Describing the Interaction with Spoken Dialogue Systems, International Telecommunication Union, Geneva, 2005.
2. Hone, K. S. and Graham, R., "Towards a Tool for the Subjective Assessment of Speech System Interfaces (SASSI)", Natural Language Engineering, 6(3-4):287-303, 2000.
3. ITU-T Rec. P.851, Subjective Quality Evaluation of Telephone Services Based on Spoken Dialogue Systems, International Telecommunication Union, Geneva, 2003.
4. Nielsen, J., Usability Engineering, Morgan Kaufman, San Francisco CA, 1993.
5. Möller, S., Quality of Telephone-based Spoken Dialogue Systems, Springer, New YorkNY, 2005.
6. Araki, M. and Doshita, S., "Automatic Evaluation Environment for Spoken Dialogue Systems", in: Proc. ECAI'96 Workshop, Lecture Notes in Artificial Intelligence No. 1236, 183-194, Springer, Berlin, 1997.
7. López-Cózar, R., de la Torre, A., Segura, J.C., and Rubio, A.J., "Assessment of Dialogue Systems by means of a New Simulation Technique", Speech Communication, 40: 387-407, 2003.
8. Walker, M., "Experimentally Evaluating Communicative Strategies: The Effect of the Task", in: Proc. AAAI'94, 86-93, ACM Press, New York, NY, 1994.
9. Carletta, J.C., "Risk Taking and Recovery in Task-Oriented Dialogue", PhD Thesis, University of Edinburgh, UK, 1992.
10. Kasik, D. J. and George, H. G., "Toward Automatic Generation of Novice Test User Scripts." In Proc. CHI '96, ACM Press, New York, 244-251, 1996.
11. Ivory, M.Y., and Hearst, M.A. "The State of the Art in Automating Usability Evaluation of User Interfaces", ACM Computing Surveys, 33(4): 470-516, 2001.
12. Michel, O., "Webots: Symbiosis Between Virtual and Real Mobile Robots", in: J.-C. Heudin, (ed.), Virtual Worlds, vol. 1434 of Lecture Notes in Artificial Intelligence, Springer-Verlag, Berlin, 254-263, 1998.
13. Hafner, V.V., Fend, M., König, P. and Körding, K.P., "Predicting Properties of the Rat Somatosensory System by Sparse Coding", Neural Information Processing Letters and Reviews, 4 (1): 11-18, 2004.
14. Gentner, D. and Stevens, A. L. (Ed.), Mental Models, Lawrence Erlbaum Associates, Hillsdale NJ, 1983.
15. Möller, S., Smeele, P., Boland, H., Krebber, J., "Evaluating Spoken Dialogue Systems According to De-Facto Standards: A Case Study", accepted for Computer Speech and Language, 2006.
16. Alexandersson, J. and Reithinger, N. "Learning Dialogue Structures from a Corpus", in: Proc EuroSpeech '97, Rhodes, 2231-2235, 1997.
17. Walker, M. A., Litman, D. J., Kamm, C. A. and Abella, A., "PARADISE: A Framework for Evaluating Spoken Dialogue Agents", in: Proc. ACL/EACL 35th Meeting, Madrid, 271-280, 1997.