An analysis of quality prediction models for telephone-based spoken dialogue services

Acta Acustica united with Acustica

Volumn 90, Issue 6, 2004, Pages 1112-1130

  Möller, Sebastian ^a   Skowronek, Janto ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ESTIMATION; MATHEMATICAL MODELS; OPTIMIZATION; QUALITY ASSURANCE; SPEECH COMMUNICATION; SYSTEMS ANALYSIS; TELECOMMUNICATION SERVICES; TELEPHONE;

ALGORITHMIC STRUCTURE; QUALITY PREDICTION MODELS; SPOKEN DIALOGUE SYSTEMS (SDS); TELEPHONE-BASED SPOKEN DIALOGUE SERVICES;

QUALITY OF SERVICE;

EID: 11244328653     PISSN: 16101928     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (33)

1. S. Möller: A new taxonomy for the quality of telephone services based on spoken dialogue systems. Proc. Third SIGdial Workshop on Discourse and Dialogue (2002) 142-153, USA-Philadelphia PA.
2. N. O. Bernsen, H. Dybkjær, L. Dybkjær: Principles for the design of cooperative spoken human-machine dialogue. Proc. 4th Int. Conf. on Spoken Language Processing (ICSLP'96) 2 (1996) 729-732, IEEE, USA-Piscataway NJ.
3. N. O. Bernsen, H. Dybkjær, L. Dybkjær: Designing interactive speech systems: From first ideas to user testing. Springer, D-Berlin, 1998.
4. L. Dybkjær, N. O. Bernsen: Usability issues in spoken dialogue systems. Natural Language Engineering 6 (2000) 243-271.
5. B. Suhm: Towards best practices for speech user interface design. Proc. 8th Europ. Conf. on Speech Communication and Technology (EUROSPEECH 2003 - Switzerland) 3 (2003) 2217-2220, CH-Geneva.
6. H. P. Grice: Logic and conversation. Syntax and Semantics, Vol. 3: Speech Acts (P. Cole and J. L. Morgan, eds.). Academic Press, USA-New York NY, 1975, 41-58.
7. M. A. Walker, D. J. Litman, C. A. Kamm, A. Abella: PARADISE: A framework for evaluating spoken dialogue agents. Proc. of the ACL/EACL 35th Ann. Meeting of the Assoc. for Computational Linguistics (1997) 271-280, ES-Madrid.
8. M. A. Walker, D. J. Litman, C. A. Kamm, A. Abella: Evaluating spoken dialogue agents with PARADISE: Two case studies. Computer Speech and Language 12 (1998) 317-347.
9. M. Walker, C. Kamm, D. Litman: Towards developing general models of usability with PARADISE. Natural Language Engineering 6 (2000) 363-377.
10. U. Jekosch: Sprache hören und beurteilen: Ein Ansatz zur Grundlegung der Sprachqualitätsbeurteilung [Perception and appraisal of speech: Laying the foundations of speech quality assessment and evaluation]. Habilitation thesis (unpublished), Universität/Gesamthochschule, D-Essen, 2000.
11. N. Fraser: Assessment of interactive systems. Handbook on Standards and Resources for Spoken Language Systems (D. Gibbon, R. Moore, and R. Winski, eds.) (1997) Mouton de Gruyter, D-Berlin, 564-615.
12. ETSI Technical Report ETR 095: Human Factors (HF); Guide for usability evaluations of telecommunication systems and services. European Telecommunications Standards Institute, F-Sophia Antipolis, 1993.
13. S. Möller: Quality of telephone-based spoken dialogue systems. Habilitation thesis, Institut für Kommunikationsakustik, Ruhr-Universität, D-Bochum, 2003 (to appear).
14. ITU-T Recommendation P.851: Subjective quality evaluation of telephone services based on spoken dialogue systems. International Telecommunication Union, CH-Geneva, 2003.
15. C. A. Kamm, M. A. Walker: Design and evaluation of spoken dialogue systems. Proc. 1997 IEEE Workshop on Automatic Speech Recognition and Understanding (1997) USA-Santa Barbara CA.
16. C. A. Kamm, D. J. Litman, M. A. Walker: From novice to expert: The effect of tutorials on user expertise with spoken dialogue systems. Proc. 5th Int. Conf. on Spoken Language Processing (ICSLP'98) 4 (1998) 1211-1214, AUS-Sydney.
17. M. Rajman, A. Rajman, F. Seydoux, A. Trutnev: Assessing the usability of a dialogue management system designed in the framework of a rapid dialogue prototyping methodology. Proc. ISCA Tutorial and Research Workshop on Auditory Quality of Systems (AQS 2003) (2003) 126-133.
18. S. Möller, J. Skowronek: Quantifying the impact of system characteristics on perceived quality dimensions of a spoken dialogue service. Proc. 8th Europ. Conf. on Speech Communication and Technology (EUROSPEECH 2003-Switzerland) 3 (2003) 1953-1956, CH-Geneva.
19. D. Jurafski, C. Wooters, G. Tajchman, J. Segal, A. Stolcke, E. Fosler, N. Morgan: The Berkeley restaurant project. Proc. 3rd Int. Conf. on Spoken Language Processing (ICSLP'94) 4 (1994) 2139-2142, JP-Yokohama.
20. J. Skowronek: Entwicklung von Modellierungsansätzen zur Vorhersage der Dienstequalität bei der Interaktion mit einem natürlichsprachlichen Dialogsystem [Development of models for predicting the service quality during the interaction with a spoken dialogue system]. Diploma thesis (unpublished), Institut für Kommunikationsakustik, Ruhr-Universität, D-Bochum, 2002.
21. S. Möller: Assessment and prediction of speech quality in telecommunications. Kluwer Academic Publ., USA-Boston MA, 2000.
22. S. Sutton, R. Cole, J. de Villiers, J. Schalkwyk, P. Vermeulen, M. Macon, Y. Yan, E. Kaiser, B. Rundle, K. Shobaki, P. Hosom, A. Kain, J. Wouters, M. Massaro, M. Cohen: Universal speech tools: The CSLU toolkit. Proc. 5th Int. Conf. on Spoken Language Processing (ICSLP'98) 7 (1998) 3221-3224, AUS-Sydney.
23. L. L. Beranek: Noise and vibration control. McGraw-Hill, USA-New York NY, 1971.
24. ITU-T Recommendation P.800: Methods for subjective determination of transmission quality. International Telecommunication Union, CH-Geneva, 1996.
25. M. Bodden, U. Jekosch: Entwicklung und Durchführung von Tests mit Versuchspersonen zur Verifizierung von Modellen zur Berechnung der Sprachübertragungsqualität [Development and implementation of auditory tests to verify models for predicting speech transmission quality]. Project report, Institut für Kommunikationsakustik, Ruhr-Universität, D-Bochum, 1996.
26. J. Polifroni, L. Hirschman, S. Seneff, V. Zue: Experiments in evaluating interactive spoken language systems. Proc. DARPA Speech and Natural Language Workshop (1992) 28-33, USA-Harriman CA.
27. E. Gerbino, P. Baggia, A. Ciaramella, C. Rullent: Test and evaluation of a spoken dialogue system. Proc. Int. Conf. Acoustics Speech and Signal Processing (ICASSP'93) 2 (1993) 135-138, IEEE, USA-Piscataway NJ.
28. V. Zue, S. Seneff, J. R. Glass, J. Polifroni, C. Pao, T. J. Hazen, L. Hetherington: Jupiter: A telephone-based conversational interface for weather information. IEEE Trans. Speech and Audio Processing 8 (2000) 85-96.
29. H. Strik, C. Cucchiarini, J. M. Kessens: Comparing the recognition performance of CSRs: In search of an adequate metric and statistical significance test. Proc. 6th Int. Conf. on Spoken Language Processing (ICSLP 2000) 4 (2000) 740-743, CHN-Beijing.
30. A. Böhm: Maschinelle Sprachausgabe deutschen und englischen Textes [Speech synthesis for German and English texts]. Doctoral dissertation, Institut für Kommunikationsakustik, Ruhr-Universität Bochum, Shaker Verlag, D-Aachen, 1993.
31. S. Köster: Modellierung von Sprechweisen für widrige Kommunikationsbedingungen mit Anwendung auf die Sprachsynthese [Modelling of speaking styles for adverse communication conditions and applications to speech synthesis]. Doctoral dissertation, Institut für Kommunikationsakustik, Ruhr-Universität Bochum, Shaker Verlag, D-Aachen, 2003.
32. H. Bonneau-Maynard, L. Devillers, S. Rosset: Predictive performance of dialogue systems. Proc. 2nd Int. Conf. on Language Resources and Evaluation (LREC 2000) 1 (2000) 177-181, GR-Athens.
33. D. Johnston: An overview of the EURESCOM MIVA project. Multi-Lingual Interoperability in Speech Technology (2000) NATO Research and Technology Organization, F-Neuilly-sur-Seine, 7 pages.