An objective and subjective study of the role of semantics and prosodic features in building corpora for emotional TTS

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1117-1127

  Navas, Eva ^a   Hernáez, Inmaculada ^a   Luengo, Iker ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

Evaluation of expressivity; Prosody analysis; Speech corpus design

Indexed keywords

COMPUTATIONAL COMPLEXITY; DATABASE SYSTEMS; FORMAL LANGUAGES; SEMANTICS; SPEECH PROCESSING;

EVALUATION OF EXPRESSIVITY; PROSODY ANALYSIS; SEMANTICALLY EMOTIONAL TEXTS; SPEECH CORPUS DESIGN;

SPEECH SYNTHESIS;

EID: 34047248387     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.876121     Document Type: Article

References (36)

1. P. Gebhard, M. Klesen, and T. Rist, "Coloring multi-character conversations through the expression of emotions," Lecture Notes Artif. Intell., vol. 3068, pp. 128-141, Jun. 2004.
2. J. I. Hualde, J. A. Lakarra, and R. L. Trask, Eds., Toward a History of the Basque Language. Amsterdam, The Netherlands: Benjamins, 1996.
3. R. L. Trask, The History of Basque. Evanston, IL: Routledge, 1997.
4. E. Douglas-Cowie, R. Cowie, and M. Schröder, "A new emotion data-base: Considerations, sources and scope," in Proc. ISCA Workshop on Speech Emotion, Belfast, Northern Ireland, 2000, pp. 39-44.
5. N. Campbell, "Building a corpus of natural speech - And tools for the processing of expressive speech - the JST CREST ESP project," in Proc. 7th Eur. Con. Speech Commun. Technol., Aalborg, Denmark, 2001, pp. 1525-1528.
6. I. Karlsson, T. Banziger, J. Dankovicová, T. Johnstone, J. Lindberg, H. Melin, F. Nolan, and K. Scherer, "Speaker verification with elicited speaking-styles in the verivox project," Speech Commun., vol. 31, no. 2, 3, pp. 121-129, Jun. 2000.
7. N. Amir, S. Ron, and N. Laor, "Analysis of an emotional speech corpus in Hebrew based on objective criteria," in Proc. ITRW Speech Emotion, Newcastle, Northern Ireland, 2000, pp. 29-33.
8. T. Lay Nwe, S. W. Foo, and L. De Silva, "Speech emotion recognition using hidden Markov models," Speech Commun., vol. 41, no. 4, pp. 603-623, Nov. 2003.
9. A. Iida and N. Campbell, "A database design for a concatenative speech synthesis system for the disabled," in Proc. 4th ISCA Workshop Speech Synth., Edinburgh, U.K., 2001, pp. 189-194.
10. V. Makarova and V. Petrushin, "RUSLANA: A database of Russian emotional utterances," in Proc. ICSLP, Denver, CO, 2002, pp. 2041-2044.
11. T. Seppänen, J. Toivanen, and E. Väyrynen, "MediaTeam speech corpus: A first large Finnish emotional speech database," in Proc. 15th Int. Congr. Phonetic Sci., Barcelona, Spain, 2003, pp. 2469-2472.
12. J. M. Montero, J. M. Gutiérrez-Arriola, S. Palazuelos, S. Aguilera, and J. M. Pardo, "Emotional speech synthesis: From speech database to TTS," in Proc. ICSLP, vol. 3, Sydney, Australia, 1998, pp. 923-926.
13. D. Küstner, R. Tato, T. Kemp, and B. Meffert, "Toward real life applications in emotions recognition," Lecture Notes Artif. Intell., vol. 3068, pp. 25-35, Jun. 2004.
14. E. Douglas-Cowie, N. Campbell, R. Cowie, and P. Roach, "Emotional speech: Toward a new generation of databases," Speech Commun., vol. 40, no. 1, 2, pp. 33-60, Apr. 2003.
15. N. Campbell, "Getting to the heart of the matter; speech is more than just the expression of text or language (keynote speech III)," in Proc. LREC, vol. 3, Lisbon, Portugal, 2004, pp. VII-X.
16. R. Cowie and R. R. Cornelius, "Describing the emotional states that are expressed in speech," Speech Commun., vol. 40, no. 1, 2, pp. 2-32, Apr. 2003.
17. K. R. Scherer, "Vocal communication of emotion: A review of research paradigms," Speech Commun., vol. 40, no. 1, 2, pp. 227-256, Apr. 2003.
18. P. B. de Mareüil, P. Célérier, and J. Toen, "Generation of emotions by a morphing technique in English, French, and Spanish," in Proc. Speech Prosody, Aix-en Provence, France, 2002, pp. 187-190.
19. A. Iida, N. Campbell, F. Higuchi, and M. Yasumura, "A corpus-based speech synthesis system with emotion," Speech Commun., vol. 40, no. 1, 2, pp. 161-187, Apr. 2003.
20. I. S. Enberg, A. V. Hansen, O. Andersen, and P. Dalsgaard, "Design, recording, and verification of a Danish emotional speech database," in Proc. 5th Eur. Conf. Speech Commun. Technol., Grenoble, France, 1997, pp. 1695-1698.
21. V. Hozjan, Z. Kacic, A. Moreno, A. Bonafonte, and A. Nogueiras, "Interface databases: Design and collection of a multilingual emotional speech database," in Proc. 3rd Int. Conf. Language Resources Eval., Las Palmas, Spain, 2002, pp. 2019-2023.
22. A. Paeschke and W. F. Sendlmeier, "Prosodic characteristics of emotional speech; measurements of fundamental frequency movements," in Proc. ISCA Workshop Speech Emotion, Belfast, Northern Ireland, 2000, pp. 75-80.
23. F. Burkhardt and W. F. Sendlmeier, "Verification of acoustical correlates of emotional speech using formant-synthesis," in Proc. ISCA Workshop Speech Emotion, Belfast, Northern Ireland, 2000, pp. 151-156.
24. I. Iriondo, R. Guaus, A. Rodríguez, P. Lázaro, N. Montoya, J. M. Blanco, D. Bernardas, J. M. Oliver, D. Tena, and L. Ionghi, "Validation of an acoustical modeling of emotional expression in Spanish using speech synthesis techniques," in Proc. ISCA Workshop Speech Emotion, Belfast, Northern Ireland, 2000, pp. 161-166.
25. J. Ramirez, J. Segura, C. Benitez, A. de la Torre, and A. Rubio, "Efficient voice activity detection algorithms using long term speech information," Speech Commun., vol. 42, no. 3, 4, pp. 271-287, Apr. 2004.
26. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines (and Other Kernel-Based Learning Methods). Cambridge, U.K.: Cambridge Univ. Press, 2000.
27. C. Chang and C. Lin. (2005) LIBSVM: A library for support vector machines. [Online]. Available: http://www.csie.nlu.edu.tw/~cjlin/libsvm
28. P. Pudil, J. Novovicová, and P. Somol, "Feature selection toolbox software package," Pattern Recognition Lett., vol. 23, pp. 487-792, 2002.
29. S. Young, J. Odell, D. Ollason, V. Valchev, and P. Woodlans, The IITK Book. Cambridge, U.K.: Cambridge Univ. Press, 2000.
30. V. Hozjan and Z. Kacic, "Improved emotion recognition with large set of statistical features," in Proc. Eurospeech, Geneva, Switzerland, 2003, pp. 133-136.
31. V. A. Petrushin, "Emotion recognition in speech signal: Experimental study, development, and application," in Proc. ICSLP, Beijing, China, 2000, pp. 222-225.
32. T. Seppänen, E. Väyrynen, and J. Toivanen, "Prosody based classification of emotions in spoken Finnish," in Proc. Eurospeech, Geneva, Switzerland, 2003, pp. 717-720.
33. N. Nogueiras, A. Moreno, A. Bonafonte, and J. Mariño, "Speech emotion recognition using hidden markov models," in Proc. Eurospeech, Aalborg, Denmark, 2001, pp. 2679-2682.
34. P. Boersma and D. Weenink. (2005) Praat: Doing phonetics by computer (Version 4.3.16). [Online]. Available: http://www.praat.org/
35. A. D. de Ilarraza, A. Gurrutxaga, I. Hernáez, N. L. de Gereñu, and K. Sarasola, "HIZKING21 : Integrating language engineering resources and tools into systems with linguistic capabilities," in Proc. Workshop NLP Minority Languages Small Languages, Batz-sur-Mer, France, 2003.
36. M. Schroeder, "Can emotions be synthesized without controlling voice quality?," Phonus 4, pp. 35-50, 1999.