Conversational speech synthesis and the need for some laughter

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1171-1178

  Campbell, Nick ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

Affect; Conversation; Emotion; Expression; Laughter; Nonverbal; Social interaction; Speech synthesis

Indexed keywords

INFORMATION ANALYSIS; PROBLEM SOLVING; SIGNAL PROCESSING; SPEECH ANALYSIS; SPEECH PROCESSING;

CONVERSATION; EMOTION; LAUGHTER; SOCIAL INTERACTION;

SPEECH SYNTHESIS;

EID: 34047268342     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.876131     Document Type: Article

References (39)

1. J. N. Holmes, I. G. Mattingley, and J. N. Shearme, "Speech synthesis by rule," Lang. Speech, vol. 7, pp. 127-143, 1964.
2. I. G. Mattingly, "Experimental methods for speech synthesis by rules," IEEE Trans. Audio Electroacoust., vol. 16, no. 2, pp. 198-202, Jun. 1968.
3. W. L. Chafe, "Prosodic and functional units of language," in Talking Data: Transcription and Coding in Discourse Research, J. A. Edwards and M. D. Lampert, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1993, pp. 33-43.
4. N. Campbell and D. Erickson, "What do people hear? a study of the perception of nonverbal affective information in conversational speech," J. Phonetic Soc. Jpn., vol. 7, no. 4, pp. 9-28, 2004.
5. G. Fant, "Acoustic analysis and synthesis of speech with applications to Swedish," Ericsson Technics, vol. 15, pp. 3-108, 1959.
6. R. Carlson and B. Granstrom, "A text-to-speech system based entirely on rules," in Proc. IEEE ICASSP, 1976, pp. 686-688.
7. J. Allen, M. S. Hunnicutt, and D. H. Klatt, "From text to speech," in The MITalk System. Cambridge, U.K.: Cambridge Univ. Press, 1987.
8. D. H. Klatt, "The Klattalk text-to-speech conversion system," in Proc. IEEE ICASSP, 1982, pp. 1589-1592
9. J. P. Olive, "Rule synthesis of speech from dyadic units," in Proc. IEEE ICASSP, 1977, pp. 568-570.
10. J. P. Olive, "A scheme for concatenating units for speech synthesis," in Proc. IEEE ICASSP, 1980, pp. 568-571.
11. J. P. Olive and M. Liberman, "A set of concatenative units for speech synthesis," in ASA'50 Speech Communication Papers, J. J. Wolff and D. H. Klatt, Eds., 1979, pp. 515-518.
12. Y. Sagisaka, "Speech synthesis by rule using an optimal selection of nonuniform synthesis units," in Proc. IEEE ICASSP, 1988, pp. 679-682.
13. K. Church, "Stress assignment in letter to sound rules for speech synthesis," in Proc. ACL 23rd Annu. Meeting, Morristown, NJ, 1988, pp. 2426-2426.
14. W. N. Campbell and C. W. Wightman, "Prosodic coding of syntactic structure in English speech," in Proc. ICSLP, Banff, AB, Canada, 1992, pp. 1167-1170.
15. W. N. Campbell, "Synthesis units for natural English speech," Trans. Inst. Electron., Inf. Commun. Eng., vol. SP 91-129, pp. 55-62, 1992.
16. A. W. Black and W. N. Campbell, "Optimising selection of units from speech databases for concatenative synthesis," in Proc. Eurospeech, Madrid, Spain, 1995, pp. 81-84.
17. C. Min, H. Peng, H. Y. Yang, and E. Chang, "Selecting nonuniform units from a very large corpus for concatenative speech synthesizer," in Proc. ICASSP, Salt Lake City, UT, 2001, pp. 785-788.
18. A. K. Syrdal, "Phonetic effects on listener detection of vowel concatenation," in Proc. Eurospeech, 2001, pp. 979-982.
19. E. Klabbers, K. Stober, R. Veldhuis, P. Wagner, and S. Breuer, "Speech synthesis development made easy: The Bonn open synthesis system," in Proc. Eurospeech, Aalborg, Denmark, 2001, pp. 521-524.
20. Y. Stylianou and A. K. Syrdal, "Perceptual and objective detection of discontinuities in concatenative speech synthesis," in Proc. ICASSP, 2001, pp. 837-840.
21. R. Cowie, E. Douglas-Cowie, and C. Cox, "Beyond emotion archetypes; Databases for emotion modeling using neural networks," Neural Netw., vol. 18, pp. 371-388, 2005.
22. J. Trouvain and M. Schroeder, "How (not) to add laughter to synthetic speech," in Proc. Workshop Affective Dialogue Syst., Kloster Irsee, Germany, 2004, pp. 229-232.
23. A. Iida, N. Campbell, S. Iga, Y. Higuchi, and Y. Yasumura, "A speech synthesis system with emotion for assisting communication," in Proc. ISCA Workshop Speech Emotion, Belfast, U.K., 2000, pp. 167-172.
24. M. Schroeder et al., "Acoustic correlates of emotion dimensions in view of speech synthesis," in Proc. Eurospeech, Aalborg, Denmark, 2001, pp. 87-90.
25. _, "Dimensional emotion representation as a basis for speech synthesis with nonextreme emotions," in Proc. Workshop Affective Dialogue Syst: Lecture Notes in Comput. Sci., Kloster Irsee, Germany, 2004, pp. 209-220.
26. P. Ekman, "Universals and cultural differences in facial expression of emotion," in Nebraska Symposium on Motivation, J. K. Cole, Ed., Lincoln, NB, 1972, pp. 207-282.
27. O. Turk, M. Schroeder, B. Bozkurt, and L. M Arslan, "Voice quality interpolation for emotional text-to-speech synthesis," in Proc. Interspeech, Lisbon, Portugal, 2005, pp. 797-800.
28. B. Malinowski, The Problem of Meaning in Primitive Languages. London, U.K.: Routledge and Kegan Paul, 1923, pp. 146-152.
29. Supplement to C. Ogden and I. Richards, The Meaning of Meaning.
30. R. Jakobson, "Linguistics and poetics," in Style in Language, T. A. Sebeok, Ed. Cambridge, MA: MIT Press, 1960, pp. 350-377.
31. K. R. Scherer, "Psychological models of emotion," in The Neuropsychology of Emotion, J. Borod, Ed. Oxford, U.K.: Oxford Univ. Press, 2000, pp. 137-162.
32. N. Campbell, "Recording techniques for capturing natural everyday speech," in Proc. Language Resources Evaluation Conf. (LREC), Las Palmas, Spain, 2002, pp. 2029-2032.
33. _, "Speech and expression; the value of a longitudinal corpus," in Proc. Language Resources and Evaluation Conf. (LREC), Lisbon, Portugal, 20-04 pp. 183-186.
34. _, "Getting to the heart of the matter; speech as expression of affect rather than just text or language," Language Resources and Evaluation, vol. 39, no. 1, pp. 109-118, 2005.
35. N. Campbell, "Specifying affect and emotion for expressive speech synthesis," in Computational Linguistics and Intelligent Text Processing, Proc. CICLing-2004. Lecture Notes in Computer Science, A. Gelbukh, Ed. New York: Springer-Verlag, 2004.
36. S. Deligne and F. Bimbot, "Language modeling by variable length sequences: Theoretical formulation and evaluation of multigrams," in Proc. ICASSP, 1995, pp. 169-172.
37. N. Campbell, "Extra-semantic protocols; input requirements for the synthesis of dialogue speech," in Affective Dialogue Systems, Springer Lecture Notes in Artificial Intelligence Series, E. Andre, L. Dybkjaer, W. Minker, and P. Heisterkamp, Eds. New York: Springer-Verlag, 2004, pp. 221-228.
38. P. Alku and E. Vilkman, "Amplitude domain quotient for characterization of the glottal volume velocity waveform estimated by inverse filtering," Speech Commun., vol. 18, no. 2, pp. 131-138, 1996.
39. N. Campbell, "Perception of affect in speech-toward an automatic processing of paralinguistic information in spoken conversation," in Proc. ICSLP, 2004, pp. 881-884.