Modeling stylized invariance and local variability of prosody in text-to-speech synthesis

Speech Communication

Volumn 48, Issue 6, 2006, Pages 716-726

  Chu, Min ^a   Zhao, Yong ^a   Chang, Eric ^a  

^a MICROSOFT RESEARCH ASIA   (China)

Author keywords

Local variability; Prosody; Soft prediction; Stylized invariance; Text to speech; Unit selection

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; DATABASE SYSTEMS; MATHEMATICAL MODELS; STATISTICAL METHODS;

LOCAL VARIABILITY; PROSODY; SOFT PREDICTION; STYLIZED INVARIANCE; TEXT-TO-SPEECH; UNIT SELECTION;

SPEECH SYNTHESIS;

EID: 33646469069     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2005.10.003     Document Type: Article

References (33)

1. Beckman, M., Ayers Elam, G., 1997. Guidelines for ToBI Labeling, Version 3, March 1997.
2. Carlson R., and Granström B. Perception of segmental duration. In: Cohen A., and Nooteboom S. (Eds). Structure and Process in Speech Perception (1975), Springer 90-106
3. Chen S., Hwang S., and Wang Y. An RNN-based prosodic information synthesizer for Mandarin text-to-speech. IEEE Trans. Speech Audio Process. 6 3 (1998) 226-239
4. Chu M., and Qian Y. Locating boundaries for prosodic constituents in unrestricted Mandarin texts. Comput. Linguistics Chinese Lang. Process. 6 1 (2001) 61-82
5. Chu, M., Peng, H., Yang, H.Y., Chang, E., 2001a. Selecting non-uniform units from a very large corpus for concatenative speech synthesizer. In: Proc. ICASSP'01, Salt Lake City.
6. Chu, M., Peng, H., Chang, E., 2001b. A concatenative Mandarin TTS system without prosody model and prosody modification. In: Proc. 4th ISCA Workshop on Speech Synthesis, Scotland.
7. Chu, M., Peng, H., Zhao, Y., Niu, Z.Y., Chang, E., 2003. Microsoft Mulan-a bilingual TTS system. In: Proc. ICASSP'03, Hong Kong.
8. Dogil, G., Möbius, B., 2001. Towards a model of target oriented production of prosody. In: Proc. Eurospeech 2001, Copenhagen.
9. Donovan, R.E., Eide, E.M., 1998. The IBM trainable speech synthesis system. In: Proc. ICSLP'98, Sydney.
10. Fant, G., Kruckenberg, A., 1996. On the quantal nature of speech timing. In: Proc. ICSLP'96, Philadelphia.
11. Fujisaki, H., Hirose, K., Takahashi, N., Morikawa, H., 1986. Acoustic characteristics and the underlying rules of intonation of the common Japanese used by radio and TV announcers. In: Proc. ICASSP'86, pp. 2039-2042.
12. Guenther, F.H., 1995. A modeling framework for speech motor development and kinematic articulator contral. In: Proc. 13th International Congress of Phonetic Sciences, Stockholm 2, pp. 92-99.
13. Hirschberg J., and Prieto P. Training intonational phrasing rules automatically for English and Spanish text-to-speech. Speech Commun. 18 (1996) 281-290
14. Huang, X.D., Acero, A., Adcock, J., et al., 1996. Whistler: a trainable text-to-speech system. In: Proc. ICSLP'96, Philadelphia.
15. Huggins A.W.F. Just noticeable differences for segment duration in natural speech. J. Acoust. Soc. Am. 51 4 (1972) 1270-1278
16. Kato, H., Tsuzaki, M., Sagisaka, Y., 1998. Effects of phonetic quality and duration on perceptual acceptability of temporal changes in speech. In: Proc. ICSLP'98, Sydney.
17. Klatt, D.H., 1982. The Klattalk text-to-speech conversion system. In: Proc. ICASSP'82, pp. 1589-1592.
18. Kochanski G., and Shih C. Prosody modeling with soft templates. Speech Commun. 39 (2003) 311-352
19. Markel J., and Gray J. Linear prediction of speech. Communication and Cybernetics vol. 12 (1976), Springer
20. Mayer, J., Wildgruber, D., Riecker, A., Dogil, G., Ackermann, H., Grodd, W., 2002. Prosody production and perception: converging evidence from fMRI studies. In: Proc. Speech Prosody 2002, Aix-en-Provence, pp. 487-490.
21. Moulines E., and Charpentier F. Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones. Speech Commun. 9 (1990) 453-467
22. Möbius, B., Dogil, G., 2002, Phonemic and postural effects on the production of prosody. In: Proc. Speech Prosody 2002, Aix-en-Provence.
23. Ostendorf M., and Veilleux N. A hierarchical stochastic model for automatic prediction of prosodic boundary location. Comput. Linguistics 20 1 (1994) 27-54
24. Perkell J.S., Guenther F.H., Lane H., Matthies M.L., Perrier P., Vick J., Wilhelms-Tricarico R., and Zandipour M. A theory of speech motor control and supporting data from speakers with normal hearing and with profound hearing loss. J. Phonetics 28 3 (2000) 233-272
25. Ross K.N., and Ostendorf M. A dynamical system model for generating fundamental frequency for speech synthesis. IEEE Trans. Speech Audio Process. 7 3 (1999) 295-309
26. Shadle, C.H., Damper, R.I., 2001. Prospects for articulatory synthesis: a position paper. In: Proc. 4th ISCA Tutorial and Research Workshop on Speech Synthesis, Perthshire.
27. Stevens K.N. On the quantal nature of speech. J. Phonetics 17 (1989) 3-45
28. Stylianou, Y., Dutoit, T., Schroeter, J., 1997. Diphone concatenation using a harmonic plus noise model of speech. In: Proc. Eurospeech, Rhodes, pp. 613-616.
29. Taylor P., and Black A.W. Assigning phrase breaks from part-of-speech sequences. Computer Speech Lang. 12 (1998) 99-117
30. Taylor P.A. Analysis and synthesis of intonation using the Tilt model. J. Acoust. Soc. Am. 107 3 (2000) 1697-1714
31. Wang, M.Q., Hirschberg, J., 1991. Predicting intonational phrasing from text. In: Proc. Association for Computational Linguistics 29th annual meeting, pp. 285-292.
32. Wightman C.W., and Ostendorf M. Automatic labeling of prosodic patterns. IEEE Trans. Speech Audio Process. 2 4 (1994) 469-481
33. Young, S., Kershaw, D., Odell, J., Ollason, D., Valtchev, V., Woodland, P., 2000. The HTK Book (for HTK version 3.0).