Comparison of the ITU-T P.85 standard to other methods for the evaluation of text-to-speech systems

INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP

Volumn 3, Issue , 2006, Pages 1077-1080

  Sityaev, Dmitry ^a   Knill, Katherine ^a   Burrows, Tina ^a  

^a TOSHIBA CORPORATION   (Japan)

Author keywords

Evaluation; Speech synthesis

Indexed keywords

EVALUATION; MEAN OPINION SCORES; OVERALL QUALITY; PERFORMANCE MEASURE; SUPPLEMENTARY INFORMATION; TEXT-TO-SPEECH SYSTEM; TTS SYSTEMS;

SPEECH SYNTHESIS;

EID: 44949254265     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Gibbon, D., Moore, R., and Winski, R. Handbook of Standards and Resources for Spoken Language Systems, Mouton de Gruyter, Berlin, 1997.
2. Kamm, C., Walker, M., and Rabiner, L. "The role of speech processing in human-computer intelligent communication", Speech Communication, Vol. 23, 1997, pp 263-278.
3. Benoit, C., Grice, M. and Hazan, V. "The SUS test: a method for the assessment of text-to-speech synthesis intelligibility using semantically unpredictable sentences", Speech Communication, Vol. 18, 1996, pp 381-392.
4. CCITT "Absolute category rating (ACR) method for subjective testing of digital processors", Red Book, Vol. V (Annex A to Suppl. 14), 1984.
5. ITU-T Recommendation P.85, "A method for subjective performance assessment of the quality of speech output devices", International Telecommunications Union publication, 1994.
6. Polkosky, M. and Lewis, J. "Expanding the MOS: development and psychometric evaluation of the MOR-R and MOS-X", International Journal of Speech Technology, 6,2003, pp 161-182.
7. Viswanathan, M., and Viswanathan, M. "Measuring speech quality for text-to-speech systems: development and assessment of a modified mean opinion score (MOS) scale", Computer, Speech and Language, Vol. 19, 2005, pp 55-83.
8. Alvarez, Y. and Huckvale, M. "The reliability of the P.85 standard for the evaluation of text-to-speech systems", In Proc. of ICSLP, 2002.
9. Young, S.J., Kershaw D., Moore G., Odell J., Ollason D., Valtchev V. and Woodland P.C., The HTK Book, Cambridge University Engineering Department, URL: http://htk.eng.cam.ac.uk/, 2002.
10. rd ESCA Workshop on Speech Synthesis, 1998.