Evaluating the speech output component of a smart-home system

Speech Communication

Volumn 48, Issue 1, 2006, Pages 1-27

  Möller, Sebastian ^a   Krebber, Jan ^a   Smeele, Paula ^b  

^a RUHR UNIVERSITY BOCHUM   (Germany)

^b TNO   (Netherlands)

Author keywords

Evaluation; Smart home system; Speech quality; Spoken dialogue system

Indexed keywords

CONTROL SYSTEMS; ELECTRIC POWER TRANSMISSION; EVALUATION; SPURIOUS SIGNAL NOISE;

SMART-HOME SYSTEM; SPEECH QUALITY; SPOKEN DIALOGUE SYSTEM;

SPEECH PROCESSING;

EID: 28644439242     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2005.05.004     Document Type: Article

References (43)

1. Balestri, M., Foti, E., Nebbia, L., Oreglia, M., Salza, P.L., Sandri, S., 1992. Comparison of natural and synthetic speech intelligibility for a reverse telephone directory service. In: Proc. 2nd Internat. Conf. on Spoken Language Process. (ICSLP'92), CN-Banff, 1, pp. 559-562.
2. V. Bappert, and J. Blauert Auditory quality evaluation of speech-coding systems Acta Acustica 2 1994 49 58
3. Benoît, C., Emerard, F., Schnabel, B., Tseva, A., 1991. Quality comparisons of prosodic and of acoustic components of various synthesizers. In: Proc. 2nd Internat. Conf. on Speech Comm. and Technology (Eurospeech'91), IT-Genova, Vol. 2, pp. 875-878.
4. Bodden, M., Jekosch, U., 1996. Entwicklung und Durchführung von Tests mit Versuchspersonen zur Verifizierung von Modellen zur Berechnung der Sprachübertragungsqualität. Project Report, IKA, Ruhr- Universität, DE-Bochum.
5. Delogu, C., Paoloni, P., Pocci, P., Sementina, C., 1991. Quality evaluation of text-to-speech synthesizers using magnitude estimation, categorical estimation, pair comparison and reaction time methods. In: Proc. 2nd Internat. Conf. on Speech Comm. and Technology (Eurospeech'91), IT-Genova, 1, pp. 353-355.
6. C. Delogu, A. Paoloni, P. Ridolfi, and K. Vagges Intelligibility of speech produced by text-to-speech systems in good and telephonic conditions Acta Acustica 3 1995 89 96
7. C. Delogu, S. Conte, and C. Sementina Cognitive factors in the evaluation of synthetic speech Speech Comm. 24 1997 153 168
8. ETSI ETS 300 726, 1997. Digital Cellular Telecommunications System; Enhanced Full Rate (EFR) Speech Transcoding (GSM 06.60). European Telecommunication Standards Institute, FR-Sophia Antipolis.
9. N. Fraser Assessment of interactive systems D. Gibbon R. Moore R. Winski Handbook on Standards and Resources for Spoken Language Systems 1997 Mouton de Gruyter DE-Berlin 564 615
10. L. Gong, and J. Lai To mix or not to mix synthetic speech and human speech? Contrasting impact on judge-rated task performance versus self-rated performance and attitudinal responses Int. J. Speech Technol. 6 2 2003 123 131
11. K.S. Hone, and R. Graham Towards a tool for the subjective assessment of speech system interfaces (SASSI) Natural Language Eng. 6 2000 303 387
12. Howard-Jones, P., 1992. Specification of listener dimensions. Final Project Report, ESPRIT Project 2589 (SAM), Multilingual Speech Input/Output Assessment, Methodology and Standardization, University College, London.
13. ITU-T Rec. G.107, 2003. The E-Model, a Computational Model for Use in Transmission Planning. International Telecommunication Union, CH-Geneva.
14. ITU-T Rec. G.711, 1998. Pulse Code Modulation (PCM) of Voice Frequencies. International Telecommunication Union, Geneva.
15. ITU-T Rec. G.726, 1990. 40, 32, 24, 16 kbit/s Adaptive Differential Pulse Code Modulation (ADPCM). International Telecommunication Union, Geneva.
16. ITU-T Rec. G.729, 1996. Coding of Speech at 8 kbit/s Using Conjugate-Structure Algebraic-Code-Excited Linear-Prediction (CS-ACELP). International Telecommunication Union, Geneva.
17. ITU-T Rec. O.41, 1994. Psophometer for Use on Telephone-Type Circuits. International Telecommunication Union, Geneva.
18. ITU-T Rec. P.340, 2000. Transmission Characteristics and Speech Quality Parameters of Hands-Free Terminals. International Telecommunication Union, Geneva.
19. ITU-T Rec. P.48, 1988. Specification for an Intermediate Reference System. International Telecommunication Union, Geneva.
20. ITU-T Rec. P.56, 1993. Objective Measurement of Active Speech Level. International Telecommunication Union, Geneva.
21. ITU-T Rec. P.830, 1996. Subjective Performance Assessment of Telephone-Band and Wideband Digital Codecs. International Telecommunication Union, Geneva.
22. ITU-T Rec. P.85, 1994. A Method for Subjective Performance Assessment of the Quality of Speech Voice Output Devices. International Telecommunication Union, Geneva.
23. ITU-T Rec. P.851, 2003. Subjective Quality Evaluation of Telephone Services Based on Spoken Dialogue Systems. International Telecommunication Union, Geneva.
24. Jekosch, U., 2000. Sprache hören und beurteilen: Ein Ansatz zur Grundlegung der Sprachqualitätsbeurteilung. Habilitation thesis, Universität/GH, Essen.
25. H. Klaus, K. Fellbaum, and J. Sotscheck Auditive Bestimmung und Vergleich der Sprachqualität von Sprachsynthesesystemen für die deutsche Sprache Acta Acust. united with Acust. 83 1997 124 136
26. V. Kraft, and T. Portele Quality evaluation of five german speech synthesis systems Acta Acust. 3 1995 351 365
27. McInnes, F.R., Attwater, D.J., Edgington, M.D., Schmidt, M.S., Jack, M.A., 1999. User attitudes to concatenated natural speech and text-to-speech synthesis in an automated information service. In: Proc. 6th Europ. Conf. on Speech Comm. and Technology (Eurospeech'99), Vol. 2. Budapest, pp. 831-834.
28. S. Möller Assessment and Prediction of Speech Quality in Telecommunications 2000 Kluwer Academic Publishers Boston
29. Möller, S., 2002. A new taxonomy for the quality of telephone services based on spoken dialogue systems. In: Proc. 3rd SIGdial Workshop on Discourse and Dialogue, Philadelphia, pp. 142-153.
30. S. Möller Telephone transmission impact on synthesized speech: quality assessment and prediction Acta Acust. united with Acust. 90 2004 121 136
31. S. Möller Quality of Telephone-based Spoken Dialogue Systems 2005 Springer New York
32. Möller, S., Skowronek, J., 2003. Quantifying the impact of system characteristics on perceived quality dimensions of a spoken dialogue service. In: Proc. 8th European Conf. on Speech Comm. and Technology (Eurospeech 2003, Switzerland), Vol. 3. Geneva, pp. 1953-1956.
33. C. Pavlovic, C. Sorin, J.P. Roumiguiere, and J.P. Lucas Cross validation between a magnitude-estimation technique and a pair comparison technique for assessing text-to-speech synthesis systems J. d'Acoustique 3 1990 75 83
34. M. Rajman, T.H. Bui, A. Rajman, F. Seydoux, A. Trutnev, and S. Quarteroni Assessing the usability of a dialogue management system designed in the framework of a rapid dialogue prototyping methodology Acta Acust. united with Acust. 90 2004 1096 1111
35. Rehmann, S., Raake, A., Möller, S., 2002. Parametric simulation of impairments caused by telephone and voice over IP network transmission. In: Proc. 3rd European Congress on Acoustics (Forum Acusticum Sevilla 2002), ES-Sevilla, Special Issue Revista de Acústica 33, 6 pp.
36. P.L. Salza, E. Foti, L. Nebbia, and M. Oreglia MOS and pair comparison combined methods for quality evaluation of text-to-speech systems Acta Acust. united with Acust. 82 1996 650 656
37. Silverman, K., Basson, S., Levas, S., 1990. Evaluating synthesiser performance: is segmental intelligibility enough? In: Proc. 1st Internat. Conf. on Spoken Language Process. (ICSLP'90), Vol. 2. Kobe, pp. 981-984.
38. M.F. Spiegel, M.J. Altom, M.J. Macchi, and K.L. Wallace Comprehensive assessment of the telephone intelligibility of synthesized and natural speech Speech Comm. 9 1990 279 291
39. R. Sproat Multilingual Text-to-speech Synthesis: The Bell Labs Approach 1997 Kluwer Academic Publishers US-Boston
40. Sutton, S., Cole, R., de Villiers, J., Schalkwyk, J., Vermeulen, P., Macon, M., Yan, Y., Kaiser, E., Rundle, B., Shobaki, K., Hosom, P., Kain, A., Wouters, J., Massaro, M., Cohen, M., 1998. Universal speech tools: The CSLU toolkit. In: Proc. 5th Internat. Conf. on Spoken Language Process. (ICSLP'98), Vol. 7. Sydney, pp. 3221-3224.
41. R. van Bezooijen, and L.C.W. Pols Evaluating text-to-speech systems: some methodological aspects Speech Comm. 9 1990 263 270
42. R. van Bezooijen, and V. van Heuven Assessment of synthesis systems D. Gibbon R. Moore R. Winski Handbook on Standards and Resources for Spoken Language Systems 1997 Mouton de Gruyter Berlin 481 563
43. J.P.H. van Santen Perceptual experiments for diagnostic testing of text-to-speech systems Computer Speech Language 7 1993 49 100