Generating expressive speech for storytelling applications

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1137-1144

  Theune, Mariët ^a   Meijs, Koen ^a,b   Heylen, Dirk ^a   Ordelman, Roeland ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b Arinso Nederland BV   (Netherlands)

Author keywords

Child directed speech; Expressive prosody; Expressive speech; Speech analysis; Speech synthesis

Indexed keywords

SPEECH PROCESSING; SPEECH RECOGNITION; SPEECH SYNTHESIS;

CHILD DIRECTED SPEECH; EXPRESSIVE PROSODY; EXPRESSIVE SPEECH; STORYTELLING APPLICATIONS;

SPEECH ANALYSIS;

EID: 33847336311     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.876129     Document Type: Article

References (23)

1. M. Theune, S. Rensen, R. op den Akker, D. Heylen, and A. Nijholt, "Emotional characters for automatic plot creation," in Proc. TIDSE 2004: Technologies for Interactive Digital Story telling and Entertainment, Darmstadt, Germany, Jun. 2004, pp. 95-100. Springer LNCS 3105, 2004.
2. J. Cahn, "The generation of affect in synthesized speech," J. Amer. Voice I/O Soc., vol. 8, pp. 1-19, 1990.
3. I. R. Murray and J. L. Arnott, "Implementation and testing of a system for producing emotion-by-rule in synthetic speech," Speech Commun. 16, pp. 369-390, 1995.
4. M. Bulut, S. Narayanan, and A. Syrdal, "Expressive speech synthesis using a concatenative synthesizer," in Proc. 7th Int. Conf. Spoken Language Process. (ICSLP 2002), Denver, CO, Sep. 2002, pp. 1265-1268.
5. A. Black, "Unit selection and emotional speech," in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 1649-1652.
6. S. Mozziconacci, "Speech variability and emotion: production and perception," Ph.D. dissertation, Univ. Eindhoven, Eindhoven, The Netherlands, 1998.
7. J. M. Montero, J. Gutiérrez-Arriola, S. Palazuelos, E. Enríquez, S. Aguilera, and J. M. Pardo, "Emotional speech synthesis: From speech database to TTS," in Proc. 5th Int. Conf. Spoken Language Process. (ICSLP), vol. 3, Sydney, NSW, Australia, Nov./Dec. 1998, pp. 923-926.
8. I. Iriondo, F. Alias, J. Melenchón, and M. Angeles Lorca, "Modeling and synthesizing emotional speech for Catalan text-to-speech synthesis," in Proc. Workshop Affective Dialogue Syst., Kloster Irsee, Germany, Jun. 2004, pp. 197-208. Springer LNAI 3068, 2004.
9. M. Schröder, "Dimensional emotion representation as a basis for speech synthesis with nonextreme emotions," in Proc. Workshop Affective Dialogue Syst., Kloster Irsee, Germany, Jun. 2004, pp. 209-220. Springer LNAI 3068, 2004.
10. D. House, L. Bell, K. Gustafson, and L. Johansson, "Child-directed speech synthesis: Evaluation of prosodic variation for an educational computer program," in Proc. Eurospeech, Budapest, Hungary, Sep. 1999, pp. 1843-1846.
11. W. L. Johnson, S. Narayanan, R. Whitney, R. Das, M. Bulut, and C. LaBore, "Limited domain synthesis of expressive military speech for animated characters," in Proc. IEEE Speech Synthesis Workshop, Santa Monica, CA, Sep. 2002.
12. E. Eide, A. Aaron, R. Bakis, W. Hamza, M. Picheny, and J. Pitrelli, "A corpus-based approach to (ahem) expressive speech synthesis," in Proc. 5th ISCA Speech Synthesis Workshop, Pittsburgh, PA, Jun. 2004, pp. 79-84.
13. E. Eide, R. Bakis, W. Hamza, and J. Pitrelli, "Toward Synthetic Expressive Speech," in Text to Speech Synthesis: New Paradigms and Advances, S. Narayanan and A. Alwan, Eds. Upper Saddle River, NJ: Prentice-Hall, 2004Text to Speech Synthesis: New Paradigms and Advances, pp. 219-250.
14. J. Fackrell, H. Vereecken, J. Buhmann, J.-P. Martens, and B. Van Coile, "Prosodic variation with text type," in Proc. 6th Int. Conf. Spoken Language Process. (ICSLP), vol. 3, Beijing, China, Oct. 2000, pp. 231-234.
15. A. Silva, G. Raimundo, C. de Melo, and A. Paiva, "To tell or not to tell... Building an interactive virtual storyteller," in Proc. AISB Symp. Language, Speech and Gesture for Expressive Characters, Leeds, U.K., Mar/Apr. 2004..
16. A. Silva, M. Vala, and A. Paiva, "The Storyteller: Building a synthetic character that tells stories," in Proc. Workshop Multimodal Communication and Context in Embodied Agents. Montréal, QC, Canada, May/Jun. 2001, pp. 53-58.
17. N. Braun, T. Rieger, and M. Dietz, "VR-NaSty: VR character narrator with story-based suspense support," in Proc. 12th Int. Conf. Central Europe Comput. Graphics, Visualization, Comput. Vision (WSCG), Plzen, Czech Republic, Feb. 2004, pp. 29-32.
18. P. Boersma and D. Weenink, "Praat: Doing phonetics by computer (v. 4.3.04)," Univ. Amsterdam, Amsterdam, The Netherlands, http://www.praat. org/.
19. E. Klabbers and J. van Santen, "Clustering of foot-based pitch contours in expressive speech," in Proc. 5th ISCA Speech Synthesis Workshop, Pittsburgh, PA, Jun. 2004, pp. 73-78.
20. Speech synthesis markup language version 1.0. W3C recommendation, Sept. 2004.
21. J. van Santen, L. Black, G. Cohen, A. Kain, E. Klabbers, T. Mishra, J. de Villiers, and X. Niu, "Applications of computer generated expressive speech for communication disorders," in Proc. Eurospeech, Geneva, Switzerland, Sep. 2003, pp. 1657-1660.
22. N. Braun and T. Rieger, "Expressiveness generation for virtual characters, based on the principles of suspense progression and narrative conflict," in Proc. Int. Workshop Mobile Computing (IMC), Rostock, Germany, Jun. 2003, pp. 113-120.
23. F. Hielkema, M. Theune, and P. Hendriks, "Generating ellipsis using discourse structures," in Proc. ESSLLI Workshop Cross-Modular Approaches to Ellipsis, Edinburgh, U.K., Aug. 2005, pp. 37-44.