Automatic refinement of an expressive speech corpus assembling subjective perception and automatic classification

Speech Communication

Volumn 51, Issue 9, 2009, Pages 744-758

  Iriondo, Ignasi ^a   Planet, Santiago ^a   Socoró, Joan Claudi ^a   Martínez, Elisa ^a   Alías, Francesc ^a   Monzo, Carlos ^a  

^a UNIVERSITAT RAMON LLULL   (Spain)

Author keywords

Expression of emotion; Expressive speech databases; Expressive speech synthesis; Speech technology

Indexed keywords

AUTOMATIC CLASSIFICATION; AUTOMATIC REFINEMENT; AUTOMATIC SYSTEMS; EXPRESSION OF EMOTION; EXPRESSIVE SPEECH; EXPRESSIVE SPEECH DATABASES; EXPRESSIVE SPEECH SYNTHESIS; SPEECH CORPORA; SPEECH TECHNOLOGY; SUBJECTIVE EVALUATIONS; SUBJECTIVE TESTS;

AUTOMATIC INDEXING; SPEECH RECOGNITION; SPEECH SYNTHESIS;

SOFTWARE AGENTS;

EID: 67649271323     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2008.12.001     Document Type: Article

References (39)

1. Alías, F., Monzo, C., Socoró, J.C., 2006. A pitch marks filtering algorithm based on restricted dynamic programming. In: InterSpeech2006 - Internat. Conf. on Spoken Language Processing (ICSLP), Pittsburgh, PA, USA, pp. 1698-1701.
2. Bozkurt, B., Ozturk, O., Dutoit, T., 2003. Text design for TTS speech corpus building using a modified greedy selection. In: The 8th Eur. Conf. on Speech Communication and Technology (EUROSPEECH), Geneva, Switzerland, pp. 277-280.
3. Campbell, N.W., 2000. Databases of emotional speech. In: Proc. ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, UK, pp. 34-38.
4. Campbell, N.W., 2002. Recording techniques for capturing natural everyday speech. In: Proc. 3rd Internat. Conf. on Language Resources and Evaluation (LREC'02), Las Palmas de Gran Canaria, Spain.
5. Campbell N.W. Developments in corpus-based speech synthesis: approaching natural conversational speech. IEICE - Trans. Inform. Systems E88-D 3 (2005) 376-383
6. Campbell N.W., and Isard S. Segment durations in a syllable frame. J. Phonet. 19 (1991) 37-47
7. Cowie R., Douglas-Cowie E., Tsapatsoulis N., Votsis G., Kollias S., Fellenz W., and Taylor J.G. Emotion recognition in human computer interaction. IEEE Signal Process. 18 1 (2001) 33-80
8. Cowie R., Douglas-Cowie E., and Cox C. Beyond emotion archetypes: databases for emotion modelling using neural networks. Neural Networks 18 (2005) 371-388
9. Devillers L., Vidrascu L., and Lamel L. Challenges in real-life emotion annotation and machine learning based detection. Neural Networks 18 (2005) 407-422
10. Douglas-Cowie E., Campbell N., Cowie R., and Roach P. Emotional speech: towards a new generation of databases. Speech Comm. 40 (2003) 33-60
11. Drioli, C., Tisato, G., Cosi, P., Tesser, F., 2003. Emotions and voice quality: experiments with sinusoidal modeling. In: Voice Quality: Functions, Analysis and Synthesis (VOQUAL'03), ISCA Tutorial and Research Workshop, Geneva, Switzerland, pp. 127-132.
12. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley & Sons Inc., New York
13. François, H., Boëffard, O., 2002. The greedy algorithm and its application to the construction of a continuous speech database. In: Proc. 3rd Internat. Conf. on Language Resources and Evaluation (LREC'02), Las Palmas de Gran Canaria, Spain.
14. Goldberg D.E. Genetic Algorithms in Search Optimization and Machine Learning (1989), Addison Wesley, Reading, MA
15. Hozjan, V., Kacic, Z., Moreno, A., Bonafonte, A., Nogueiras, A., 2002. Interface databases: design and collection of a multilingual emotional speech database. In: Proc. 3rd Internat. Conf. on Language Resources and Evaluation (LREC'02), Las Palmas de Gran Canaria, Spain.
16. Iriondo, I., Planet, S., Alías, F., Socoró, J.C., Martínez, E., 2007a. Validation of an expressive speech corpus by mapping automatic classification to subjective evaluation. In: Comput. Ambient Intell. 9th Internat. Work-Conf. on Artificial Neural Networks, IWANN 2007, San Sebastián, Spain, June 20-22, 2007. Proceedings. Lecture Notes in Computer Science, Vol. 4507. Springer, Heidelberg, pp. 646-653.
17. Iriondo, I., Planet, S., Socoró, J.C., Alías, F., 2007b. Objective and subjective evaluation of an expressive speech corpus. In: Adv. Nonlinear Speech Proc., Internat. Conf. on Non-Linear Speech Processing, NOLISP 2007, Paris, France, May 22-25, 2007. Lecture Notes in Computer Science, Vol. 4885. Springer, Heidelberg, pp. 86-94.
18. Iriondo, I., Socoró, J., Alías, F., 2007c. Prosody modelling of Spanish for expressive speech synthesis. In: Proc. 32nd IEEE Internat. Conf. on Acoustics Speech, and Signal Processing ICASSP, Vol. 4, Honolulu, HI, USA, pp. 821-824.
19. Krstulovic, S., Hunecke, A., Schröder, M., 2007. An HMM-based speech synthesis system applied to german and its adaptation to a limited set of expressive football announcements. In: Proc. of Interspeech-2007, Antwerp, Belgium, pp. 1897-1900.
20. Michaelis D., Gramss T., and Strube H.W. Glottal to noise excitation ratio - a new measure for describing pathological voices. Acta Acustica United with Acustica 83 (1997) 700-706
21. Montero, J.M., Gutiérrez Arriola, J., Palazuelos, S., Enríquez, E., Aguilera, S., Pardo, J.M., 1998. Emotional speech synthesis: from speech database to TTS. In: The 5th Internat. Conf. on Spoken Language Processing (ICSLP), Sydney, Australia, pp. 923-926.
22. Montoya N. El papel de la voz en la publicidad audiovisual dirigida a los niños. Zer. Rev. Estudios Comunicación 4 (1998) 161-177 (in Spanish)
23. Monzo, C., Socoró, J.C., Iriondo, I., Alías, F., 2007. Discriminating expressive speech styles by voice quality parameterization. In: Proc. 16th Internat. Congress of Phonetic Sciences (ICPhS'2007), Saarbrüken, Germany, pp. 2081-2084.
24. Morrison D., Wang R., and De Silva L.C. Ensemble methods for spoken emotion recognition in call-centres. Speech Comm. 49 2 (2007) 98-112
25. Murray I.R., and Arnott J.L. Toward the simulation of emotion in synthetic speech: a review of the literature of human vocal emotion. J. Acoust. Soc. Amer. 93 2 (1993) 1097-1108
26. Navas E., Hernáez I., and Luengo I. An objective and subjective study of the role of semantics and prosodic features in building corpora for emotional TTS. IEEE Trans. Audio Speech Language Process. 14 4 (2006) 1117-1127
27. Nogueiras, A., Moreno, A., Bonafonte, A., Mariño, J.B., 2001. Speech emotion recognition using Hidden Markov models. In: Proc. 7th Eur. Conf. on Speech Communication and Technology (EUROSPEECH), Aalborg, Denmark, pp. 2679-2682.
28. Oudeyer P.Y. The production and recognition of emotions in speech: features and algorithms. Internat. J. Human Comput. Interact. 59 1-2 (2003) 157-183 (special issue on Affective Computing)
29. Pérez, E.H., 2003. Frecuencia de fonemas. eRTH Revista electrónica de Tecnología del Habla (1) (in Spanish). .
30. Pitrelli J.F., Bakis R., Eide E.M., Fernandez R., Hamza W., and Picheny M.A. The IBM expressive text-to-speech synthesis system for American English. IEEE Trans. Audio Speech Language Process. 14 4 (2006) 1099-1108
31. Planet, S., Iriondo, I., Martínez, E., Montero, J.A., 2008. TRUE: an online testing platform for multimedia evaluation. In: Proc. 2nd Internat. Workshop on EMOTION: Corpora for Research on Emotion and Affect at LREC'08, Marrakech, Morocco.
32. Scherer K.R. Vocal communication of emotion: a review of research paradigms. Speech Comm. 40 (2003) 227-256
33. Schröder, M., 2004. Speech and Emotion Research: An Overview of Research Frameworks and a Dimensional Approach to Emotional Speech Synthesis. Ph.D. Thesis, PHONUS 7, Research Report of the Institute of Phonetics, Saarland University.
34. Schweitzer, A., Möbius, B., 2003. On the structure of internal prosodic models. In: Proc. 15th Internat. Congress of Phonetic Sciences (ICPhS'2003), Barcelona, Spain, pp. 1301-1304.
35. Shami M., and Verhelst W. An evaluation of the robustness of existing supervised machine learning approaches to the classification of emotions in speech. Speech Comm. 49 3 (2007) 201-212
36. Theune M., Meijs K., Heylen D., and Ordelman R. Generating expressive speech for storytelling applications. IEEE Trans. Audio Speech Language Process. 14 4 (2006) 1137-1144
37. Ververidis D., and Kotropoulos C. Emotional speech recognition: resources, features, and methods. Speech Comm. 48 9 (2006) 1162-1181
38. Wells, J., 1993. Sampa: computer readable phonetic alphabet. .
39. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques. second ed. (2005), Morgan Kaufmann, San Francisco