Developments in corpus-based speech synthesis: Approaching natural conversational speech

IEICE Transactions on Information and Systems

Volumn E88-D, Issue 3, 2005, Pages 376-383

  Campbell, Nick ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

Affect; Communication; Corpora, concatenation; Paralinguistic information; Speech synthesis

Indexed keywords

COMPUTER PROGRAMMING; SPEECH ANALYSIS; TELECOMMUNICATION SYSTEMS;

AFFECT; CORPORA, CONCATENATION; PARALINGUISTIC INFORMATION;

SPEECH SYNTHESIS;

EID: 24144437793     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: 10.1093/ietisy/e88-d.3.376     Document Type: Article

References (44)

1. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Process. Mag., vol.18, no. 1, pp.32-80, Jan. 2001.
2. M. Schroder, "Emotional speech synthesis: A review," Proc. Eurospeech, pp.561-564, Aalborg, Denmark, 2001.
3. P. Ekman, "Basic emotions," in Handbook of Cognition & Emotion, ed. T. Dalgleish and M. Power, pp.301-320, John Wiley, New York, 1999.
4. A. Iida, N. Campbell, S. Iga, Y. Higuchi, and Y. Yasumura, "A speech synthesis system with emotion for assisting communication," Proc. ISCA Workshop on Speech and Emotion, pp. 167-172, Belfast, 2000.
5. I.L. Johnson, S. Narayanan, R. Whitney, R. Das, M. Bulut, and C. LaBore, "Limited domain synthesis of expressive military speech for animated characters," Proc. ICSLP 2002, Denver, CO, 2002.
6. M. Schröder, R. Cowie, E. Douglas-Cowie, M. Westerdijk, and S. Gielen, "Acoustic correlates of emotion dimensions in view of speech synthesis," Proc. Eurospeech 2001, pp.87-90, Denmark, 2001.
7. A. Iida, N. Campbell, and M. Yasumura, "Design and evaluation of synthesised speech with emotion," J. IPSJ, vol.40, 1998.
8. I. Lehiste, Suprasegmentals, The MIT Press, Cambridge, 1970.
9. J. Allen, "Synthesis of speech from unrestricted text," Proc. IEEE, vol.64, no.4, pp.433-442, 1976.
10. J.N. Holmes, I.G. Mattingley, and J.N. Shearme, "Speech synthesis by rule," Language and Speech, vol.7, pp.127-143, 1964.
11. I.G. Mattingly, "Experimental methods for speech synthesis by rules," IEEE Trans. AU, vol.16, pp.198-202, 1968.
12. R. Carlson and B. Granstrom, "A text-to-speech system based entirely on rules," Proc. IEEE-ICASSP76, pp.686-688, 1976.
13. J. Allen, "Linguistic-based algorithms offer practical text-to-speech systems," Speech Technol., vol.1, no.l, pp.12-16, 1981.
14. J. Allen, M.S. Hunnicutt, and D.H. Klatt, From Text to Speech: The MITalk System, Cambridge University Press, Cambridge, UK, 1987.
15. G. Akers and M. Lennig, "Intonation in text-to-speech synthesis: Evaluation of algorithms," J. Acoust Soc. Amer., vol.77, pp.2157-2165, 1985.
16. L.C.W. Pols, "Does improved performance also contribute to more phonetic knowledge?," Proc. ESCA Tutorial Day on Speech Synthesis, pp.49-54, Autrans, 1990.
17. B. Ao, C. Shin, and R. Sproat, "A corpus-based mandarin text-to-speech synthesizer," International Conference on Spoken Language Processing, pp.1771-1774, 1994.
18. F. Emerard and M. Cartier, "Test d'intelligibilite de systemes de synthese a partir du texte," CNET Report NT/LAA/TSS/427, 1991.
19. V.J. van Heuven and L.C.W. Pols eds., Analysis and Synthesis of Speech. Strategic Research Towards High-Quality Text-to-Speech Generation, Speech Research, vol.11, Mouton de Gruyter, Berlin, 1993.
20. T. Dutoit, An Introduction to Text-to-Speech Synthesis, Kluwer Academic Publishers, Dordrecht, 1997.
21. D.H. Klatt, "The Klattalk text-to-speech conversion system," Proc. IEEE-ICASSP82, pp. 1589-1592, 1982.
22. N. Campbell and D. Erickson, "What do people hear? A study of the perception of non-verbal affective information in conversational speech," J. Phonetic Society of Japan, vol.7, no.4, pp.9-28, 2004.
23. N. Campbell, "Specifying affect and emotion for expressive speech synthesis," in Computational Linguistics and Intelligent Text Processing, ed. A. Gelbukh, Proc. CICLing-2004, Lecture Notes in Computer Science, Springer-Verlag, 2004.
24. N. Campbell, "Getting to the heart of the matter: Speech is more than just the expression of text or language," Keynote speech in Proc. Language Resources and Evaluation Conference (LREC-04), Lisbon, Portugal, 2004.
25. N. Campbell and P. Mokhtari, "Voice quality: The 4th prosodic dimension," Proc. 15th International Congress of Phonetic Sciences (ICPhS '03), pp.2417-2420, Barcelona, Spain, 2003.
26. K. Church, "Stress assignment in letter to sound rules for speech synthesis," ACL Proc. 23rd Annual Meeting, pp.246-253, Morris-town, NJ, 1985. Association for Computational Linguistics, 1985.
27. N. Campbell, "Listening between the lines: A study of paralinguistic information carried by tone-of-voice," Proc. International Symposium on Tonal Aspects of Languages, TAL2004, pp. 13-16, Beijing, China, 2004.
28. N. Campbell, "Extra-semantic protocols: Input requirements for the synthesis of dialogue speech," in Affective Dialogue Systems, ed. E. Andre, L. Dybkjaer, W. Minker, and P. Heisterkamp, pp.221-228, Lecture Notes in Artificial Intelligence Series, Springer, 2004.
29. N. Campbell, "Recording techniques for capturing natural everyday speech," Proc. Language Resources and Evaluation Conference (LREC-02), pp.2029-2032, Las Palmas, Spain, 2002.
30. N. Campbell, "Speech and expression: The value of a longitudinal corpus," Proc. Language Resources and Evaluation Conference (LREC-04), pp.183-186, Lisbon, Portugal, 2004.
31. J.R. Searle, Speech Acts: An Essay on the Philosophy of Language, Cambridge University Press, Cambridge, 1969.
32. J.P. Olive, "Rule synthesis of speech from dyadic units," Proc. IEEE-ICASSP77, pp.568-570, 1977.
33. J.P. Olive, "A scheme for concatenating units for speech synthesis," Proc. IEEE-ICASSP80, pp.568-571, 1980.
34. J.P. Olive and M. Liberman, "A set of concatenative units for speech synthesis," in ASA*50 Speech Communication Papers, ed. J.J. Wolff and D.H. Klatt, pp.515-518, 1979.
35. Y. Sagisaka, "Speech synthesis by rule using an optimal selection of nonuniform synthesis units," Proc. IEEE-ICASSP88, pp.679-682, 1988.
36. W.N. Campbell and C.W. Wightman, "Prosodic coding of syntactic structure in English speech," Proc. ICSLP92, pp. 1167-1170, Banff, Canada, 1992.
37. W.N. Campbell, "Synthesis units for natural English speech," IEICE Technical Report, SP 91-129, 1992.
38. W.N. Campbell, "CHATR: A high-definition speech re-sequencing system," Proc. Eurospeech '95, Madrid, Spain, 1995.
39. W.N. Campbell and A.W. Black, "CHATR a multi-lingual speech re-sequencing synthesis system," IEICE Technical Report, SP96-7, 1996.
40. CHATR Speech Synthesis: http://feast.his.atr.jp/chatr
41. S. Yamamoto, "Speech translation technologies for real-world applications," ATR Uptodate, vol.3, pp.4-6, 2002.
42. Speech Synthesis Markup Language Version 1.0 web pages at http://www.w3.org/TR/speech-synthesis/
43. N. Campbell, "Perception of affect in speech - Towards an automatic processing of paralinguistic information in spoken conversation," Proc. ICSLP 2004, pp.11881-884, 2004.
44. The Japan Science & Technology Agency, Core Research for Evolutional Science & Technology, 2000-2005.