Assessment of spoken dialogue system usability - What are we really measuring?

EUROSPEECH 2003 - 8th European Conference on Speech Communication and Technology

Volumn , Issue , 2003, Pages 1945-1948

  Larsen, Lars Bo ^a  

^a AALBORG UNIVERSITY   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH PROCESSING; USABILITY ENGINEERING;

EVALUATION SCHEME; SPEECH-BASED INTERFACES; SPOKEN DIALOGUE SYSTEM; USABILITY ATTRIBUTES; USABILITY EVALUATION;

SPEECH COMMUNICATION;

EID: 85009205135     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Hugh Cameron: "Speech at the Interface", in Proc of. The COST 249 workshop: Voice Operated Telecom Services-do they have a bright future?", Ghent, May 2000
2. The website for the DISC1 and DISC2 projects. Last Revised: 11 March, 2001: http://www.disc2.dk. Visited March 2003
3. Laila Dybkjær and Niels Ole Bernsen: "Usability issues in spoken dialogue systems", in Natural Language Engineering 6 (3{4): pp. 243-271. 2000
4. International Standardisation Organisation (ISO): "ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs)-Part 11: Guidance on usability" http://www.iso.org
5. European Telecommunications Standards Institute (ETSI): "Human Factors (HF); Guide for usability evaluations of telecommunications systems and services" (ETR 095), Sophia-Antipolis 1993
6. Jakob Nielsen: "Usability Engineering" Academic Press, Inc. San Diego, USA, 1993. ISBN 0-12-518405-0
7. Ben Shneiderman: "Designing the User Interface". 3rd edition, Addison-Wesley, Reading Massachusetts 1998. ISBN: 0-201-69497-2
8. Jennifer Preece, Y. Rogers, H. Sharp: "Interaction Design", John Wiley and Sons,. U.S, 2002. ISBN 0-471-49278-7. http://ID-Book.com
9. Chin, J. P., Diehl, V. A. and Norman, K. L. (1988). Development of an instrument measuring user satisfaction of the human-computer interface. Proceedings of SIGCHI '88, (pp. 213-218), New York: ACM/SIGCHI. Also available as: http://lap.umd.edu/quis/publications/chin1988.pdf
10. SUMI (Software Usability Measurement Inventory) Human Factors Research Group University College Cork, Ireland: http://sumi.ucc.ie/index.html. Feb. 2003
11. Jurek Kirakowski: "Background notes on the SUMI questionnaire" Human Factors Research Group University College Cork, Ireland. Originally 1994. WWW version http://www.ucc.ie/hfrg/questionnaires/sumi/sumipapp.html. Feb. 2003
12. Marilyn. A. Walker, Diane J. Litman, Candace. A. Kamm and Alicia Abella. "Evaluating Spoken Dialogue Agents with PARADISE: Two Case Studies." In Computer Speech and Language, 12-3, 1998.
13. DARPA Communicator Evaluation website: (April 2003) http://www.dcs.shef.ac.uk/~walker/paradise.html
14. Lars Bo Larsen, "Voice Controlled Home Banking-Objectives and Experiences of the Esprit Ovid Project", IVTTA-96 workshop, September, 1996.
15. Lars Bo Larsen: "Combining Objective and Subjective Data in Evaluation of Spoken Dialogues", in Proceedings of the ESCA ETRW on Interactive Dialogue Systems, Kloster Irsee, Germany, 1999
16. Kate Hone and R. Graham: "Towards a Tool for the Subjective Assessment of Speech System Interfaces (SASSI)". Natural Language Engineering, 6(3-4), 287-303. 2000.
17. S. Love, R.T. Dutton, J.C. Foster, M.A. Jack and F.W.M. Stentiford, "Identifying salient usability attributes for automated telephone services", Proc. International Conference on Spoken Language Processing (ICSLP-94), pp.1307-1310, September 1994
18. CCIR "Intelligent dialogues project" (visited April 2003) http://www.ccir.ed.ac.uk/doc/ccir-dialogues-reports.htm
19. Richard B. Darlington: "Factor Analysis". January 1997. http://comp9.psych.cornell.edu/Darlington/factor.htm (last visited April 2003)