Analysis of statistical parametric and unit selection speech synthesis systems applied to emotional speech

Speech Communication

Volumn 52, Issue 5, 2010, Pages 394-404

  Barra Chicote, Roberto ^b   Yamagishi, Junichi ^a   King, Simon ^a   Montero, Juan Manuel ^b   Macias Guarasa, Javier ^c  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^c UNIVERSITY OF ALCALÁ   (Spain)

Author keywords

Emotional speech synthesis; HMM based synthesis; Unit selection

Indexed keywords

CONTEXT DEPENDENT; EMOTIONAL SPEECH; EMOTIONAL SPEECH SYNTHESIS; IDENTIFICATION RATES; PERCEPTUAL TEST; PROSODIC MODELING; SPECTRAL MODELING; SPEECH QUALITY; SYNTHETIC SPEECH; TWO-STATE; UNIT SELECTION; UNIT-SELECTION SPEECH SYNTHESIS;

SPEECH ANALYSIS; SPEECH SYNTHESIS;

QUALITY CONTROL;

EID: 77949913458     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.12.007     Document Type: Article

References (44)

1. Barra-Chicote R., Yamagishi J., Montero J., King S., Lutfi S., and Macias-Guarasa J. Generacion de una voz sintetica en Castellano basada en HSMM para la Evaluacion Albayzin 2008: conversion texto a voz. In V J. Tecnol. Habla (2008) 115-118 (in Spanish)
2. Barra-Chicote, R., Montero, J., Macias-Guarasa, J., Lufti, S., Lucas, J.M., Fernandez, F., D'haro, L., San-Segundo, R., Ferreiros, J., Cordoba, R., Pardo, J., 2008b. Spanish expressive voices: corpus for emotion research in Spanish. In: Proc. of 6th international conference on Language Resources and Evaluation.
3. Barra, R., Montero, J., Macias-Guarasa, J., D'Haro, L., San-Segundo, R., Cordoba, R., 2006. Prosodic and segmental rubrics in emotion identification. In: ICASSP 2006, pp. 1085-1088.
4. Barra, R., Montero, J., Macias-Guarasa, J., Gutierrez-Arriola, J., Ferreiros, J., Pardo, J., 2007. On the limitations of voice conversion techniques in emotion identication tasks. In: Proc. Interspeech 2007, pp. 2233-2236.
5. Bennett, C., Black, A.W., 2006. The Blizzard Challenge 2006. In: Proc. Blizzard Challenge 2006.
6. Black, A.W., 2003. Unit selection and emotional speech. In: Proc. EUROSPEECH 2003, pp. 1649-1652.
7. Black, A.W., Cambpbell, N., 1995. Optimising selection of units from speech database for concatenative synthesis. In: Proc. EUROSPEECH-95, pp. 581-584.
8. Black, A.W., Tokuda, K., 2005. The Blizzard Challenge - 2005: evaluating corpus-based speech synthesis on common datasets. In: Proc. EUROSPEECH 2005, pp.77-80.
9. Bulut, M., Narayan, S., Syrdal, A., 2002. Expressive speech synthesis using a concatenative synthesizer. In: Proc. ICSLP 2002, pp. 1265-1268.
10. Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W., Weiss, B., 2005. A database of German emotional speech. In: Proc. Interspeech 2005, pp. 1517-1520.
11. Charonnat, L., Vidal, G., Boeffard, O., 2008. Automatic phone segmentation of expressive speech. In: Proc. Language Resources and Evaluation Conference, pp. 2376-2379.
12. Clark, R., Richmond, K., Strom, V., King, S., 2006. Multisyn voice for the Blizzard Challenge 2006. In: Proc. Blizzard Challenge Workshop 2006.
13. Clark, R., Podsiadlo, M., Fraser, M., Mayo, C., King, S., 2007a. Statistical analysis of the Blizzard Challenge 2007 listening test results. In: Proc. BLZ3-2007 (in Proc. SSW6).
14. Clark R.A., Richmond K., and King S. Multisyn: open-domain unit selection for the festival speech synthesis system. Speech Comm. 49 4 (2007) 317-330
15. Donovan R., and Woodland P. A hidden Markov-model-based trainable speech synthesizer. Comput. Speech Lang. 13 3 (1999) 223-241
16. Eide, E., 2002. Preservation, identification, and use of emotion in a text-to-speech system. In: Proc. IEEE Workshop on Speech Synthesis, pp. 127-130.
17. Fraser, M., King, S., 2007. The Blizzard Challenge 2007. In: Proc. BLZ3-2007 (in Proc. SSW6).
18. Gallardo-Antolin, A., Barra, R., Schröder, M., Krstulovic, S., Montero, J., 2007. Automatic phonetic segmentation of Spanish emotional speech. In: Proc. InterSpeech 2007.
19. Gomes, C., Sellmann, M., Es, C.V., Es, H.V., 2004. The challenge of generating spatially balanced scientific experiment designs. In: CP-AI-OR'04, pp. 387-394.
20. Hamza, W., Bakis, R., Eide, E., Picheny, M., Pitrelli, J., 2004. The IBM expressive speech synthesis system. In Proc. ICSLP 2004.
21. Hofer, G., Richmond, K., Clark, R., 2005. Informed blending of databases for emotional speech synthesis. In: Proc. Interspeech 2005, pp. 501-504.
22. Hunt, A., Black, A.W., 1996. Unit selection in a concatenative speech synthesis system using a large speech database. In: Proc. ICASSP-96, pp. 373-376.
23. Karaiskos, V., King, S., Clark, R.A.J., Mayo, C., 2008. The Blizzard Challenge 2008. In: Proc. Blizzard Challenge Workshop 2008, Brisbane, Australia.
24. Kawahara H., Masuda-Katsuse I., and Cheveigné A. Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds. Speech Comm. 27 (1999) 187-207
25. Montero, J.M., Gutierrez-Arriola, J.M., Palazuelos, S., Enriquez, E., Aguilera, S., Pardo, J.M., 1998. Emotional speech synthesis: from speech database to TTS. In: Proc. ICSLP-98, pp. 923-926.
26. Moulines E., and Charpentier F. Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones. Speech Comm. 9 5-6 (1990) 453-468
27. Nose T., Yamagishi J., and Kobayashi T. A style control technique for HMM-based expressive speech synthesis. IEICE Trans. Inf. Systems E 90-D 9 (2007) 1406-1413
28. Pitrelli J., Bakis R., Eide E., Fernandez R., Hamza W., and Picheny M. The IBM expressive text-to-speech synthesis system for American English. IEEE Trans. Speech Audio Process. 14 4 (2006) 1099-1108
29. Scherer K.R. Vocal communication of emotion: a review of research paradigms. Speech Comm. 40 1-2 (2003) 227-256
30. Schröder, M., 2001. Emotional speech synthesis: a review. In: Proc. EUROSPEECH 2001, pp. 561-564.
31. Schröder, M., 2004. Speech and emotion research: an overview of research frameworks and a dimensional approach to emotional speech synthesis. Ph.D. Thesis, Saarland University, Saarland.
32. Strom, V., King, S., 2008. Investigating Festival's target cost function using perceptual experiments. In: Proc. Interspeech 2008, pp. 1873-1876.
33. Syrdal, A., Wightman, C., Conkie, A., Stylianou, Y., Beutnagel, M., Schroeter, J., Storm, V., Lee, K., Makashay, M., 2000. Corpus-based techniques in the AT& T NEXTGEN synthesis system. In: Proc. ICSLP 2000, pp. 411-416.
34. Tachibana M., Yamagishi J., Masuko T., and Kobayashi T. Speech synthesis with various emotional expressions and speaking styles by style interpolation and morphing. IEICE Trans. Inf. Systems E 88-D 11 (2005) 2484-2491
35. Tachibana M., Yamagishi J., Masuko T., and Kobayashi T. A style adaptation technique for speech synthesis using HSMM and suprasegmental features. IEICE Trans. Inf. Systems E 89-D 3 (2006) 1092-1099
36. Toda T., and Tokuda K. A speech parameter generation algorithm considering global variance for HMM-based speech synthesis. IEICE Trans. Inf. Systems E 90-D 5 (2007) 816-824
37. Tokuda, K., Zen, H., Yamagishi, J., Masuko, T., Sako, S., Black, A., Nose, T., 2008. The HMM-based speech synthesis system (HTS) Version 2.1. .
38. Yamagishi, J., Zen, H., Wu, Y.-J., Toda, T., Tokuda, K., 2008. The HTS-2008 system: yet another evaluation of the speaker-adaptive HMM-based speech synthesis system in the 2008 Blizzard Challenge. In: Proc. Blizzard Challenge 2008.
39. Yamagishi J., Nose T., Zen H., Ling Z.-H., Toda T., Tokuda K., King S., and Renals S. A robust speaker-adaptive HMM-based text-to-speech synthesis. IEEE Trans. Speech Audio Lang. Process. 17 6 (2009) 1208-1230
40. Yoshimura, T., Tokuda, K., Masuko, T., Kobayashi, T., Kitamura, T., 1999. Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis. In: Proc. EUROSPEECH-99, pp. 2374-2350.
41. Yoshimura T., Tokuda K., Masuko T., Kobayashi T., and Kitamura T. Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis. IEICE Trans. J. 83-D-II 11 (2000) 2099-2107 (in Japanese)
42. Zen H., Toda T., Nakamura M., and Tokuda K. Details of Nitech HMM based speech synthesis system for the Blizzard Challenge 2005. IEICE Trans. Inf. Systems E 90-D 1 (2007) 325-333
43. Zen H., Tokuda K., Masuko T., Kobayashi T., and Kitamura T. A hidden semi-Markov model-based speech synthesis system. IEICE Trans. Inf. Systems E 90-D 5 (2007) 825-834
44. Zen H., Tokuda K., and Black A.W. Statistical parametric speech synthesis. Speech Comm. 51 11 (2009) 1039-1064