Toward spontaneous speech synthesis - Utilizing language model information in TTS

IEEE Transactions on Speech and Audio Processing

Volumn 12, Issue 4, 2004, Pages 436-445

  Werner, Steffen ^a   Eichner, Matthias ^a   Wolff, Matthias ^a   Hoffmann, Ruediger ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Duration control; Pronunciation variants; Speech synthesis; Spontaneous speech processing

Indexed keywords

ALGORITHMS; CORRELATION METHODS; DATABASE SYSTEMS; FORMAL LANGUAGES; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; PROBABILITY;

DURATION CONTROL; LANGUAGE MODELS (LM); PRONUNCIATION VARIANTS; SPONTANEOUS SPEECH PROCESSING;

SPEECH SYNTHESIS;

EID: 3042741062     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2004.828635     Document Type: Conference Paper

References (30)

1. R. Hoffmann, D. Hirschfeld, O. Jokisch, U. Kordon, H. Mixdorff, and D. Mehnert, "Evaluation of a multilingual ITS system with respect to the prosodic quality," in Proc. Int. Congr. Phonetic Sciences, San Francisco, CA, 2000, pp. 2307-2310.
2. A. Bell, M. L. Gregory, J. M. Brenier, D. Jurafsky, A. Ikeno, and C. Girand, "Which predictability measures affect content word duration?," in Proc, ISCA Tutorial and Research Workshop on Pronunciation Modeling and Lexicon Adaptation (PMLA), Estes Park, CO, Sept. 2002, pp. 1-5.
3. D. Jurafsky, A. Bell, M. L. Gregory, and W. D. Raymond, "The effect of language model probability on pronunciation reduction," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Salt Lake City, UT, May 2001, pp. 801-804.
4. R. Hoffmann, A multilingual text-to-speech system, in The Phonetician 80 (1999/II), pp. 5-10, 1999.
5. M. Eichner, M. Wolff, and R. Hoffmann, "Improved duration control for speech synthesis using a multigram language model," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Orlando, FL, Apr. 2002, pp. 417-420.
6. M. Eichner, S. Werner, M. Wolff, and R. Hoffmann, "Toward spontaneous speech synthesis - LM based selection of pronunciation variants," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Hong Kong, Apr. 2003, pp. I:248-I:251.
7. M. Eichner, M. Wolff, and R. Hoffmann, "A unified approach for speech synthesis and speech recognition using stochastic Markov graphs," in Proc. Int. Conf. Spoken Language Processing (ICSLP), Beijing, China, Oct. 2000, pp. I:701-I:704.
8. M. Ostendorf and I. Bulyko, "The impact of speech recognition on speech synthesis," in Proc. IEEE Workshop on Speech Synthesis, Santa Monica, CA, Sept. 2002.
9. S. Deligne, F. Yvon, and F. Bimbot, "Introducing statistical dependencies and structural constraints in variable-length sequence models," in Proc. Grammatical Inference: Learning Syntax From Sentences, 3rd International Colloquium, ICGI-96, vol. 1147, Montpellier, France, Sept. 1996, pp. 156-167.
10. F. Bimbot, R. Pieraccini, E. Levin, and B. Atal, "Variable length sequence modeling: multigrams," IEEE Signal Processing Lett., vol. 2, pp. 111-113, June 1995.
11. W. Wahlster, Ed., Verbmobil: Foundations of Speech-to-Speech Translation. Berlin, Germany: Springer, 2000.
12. J. L. Gauvain, L. F. Lamel, G. Adda, and M. Adda-Decker, "The LIMSI continuous speech dictation system: evaluation on the ARPA Wall Street journal task," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Adelaide, Australia, 1994, pp. I:557-I:560.
13. T. Imai, A. Ando, and E. Miyasaka, "A new method for automatic generation of speaker-dependent phonological rules," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Detroit, MI, May 1995, pp. I:864-I:867.
14. M. Eichner and M. Wolff, "Data driven generation of pronunciation dictionaries in the German Verbmobil project - discussion of the experimental results," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Istanbul, Turkey, June 2000, pp. 1687-1690.
15. C. M. Westendorf and J. Jelitto, ''Learning pronunciation dictionary from speech data," in Proc. Int. Conf. Spoken Language Processing (ICSLP), Philadelphia, PA, Oct. 1996, pp. II:1045-II:1048.
16. M. Wolff, M. Eichner, and R. Hoffmann, "Automatic learning and optimization of pronunciation dictionaries," in ISCA ITR Workshop on Adaptation Methods for Speech Recognition, Sophia-Antipolis, France, Aug. 2001.
17. _, "Improved data-driven generation of pronunciation dictionaries using an adapted word list," in Proc. Eurospeech, Aalborg, Denmark, Sept. 2001, pp. III:1433-III:1436.
18. _, "Measuring the quality of pronunciation dictionaries," in Proc. ISCA Tutorial and Research Workshop on Pronunciation Modeling and Lexicon Adaptation (PMLA), Estes Park, CO, Sept. 2002, pp. 117-122.
19. H. R. Pfitzinger, "10 years of PhonDat-II: a reassessment," in Proc. Int. Conf. Spoken Language Processing (ICSLP), Denver, CO, Sept. 2002, pp. I:369-I:372.
20. E. G. Schukat-Talamazzini, Automatische Spracherkennung. Braunschweig/Wiesbaen, Germany: Vieweg Verlag, 1995, p. 221f.
21. D. H. Klatt, "Review of text to speech conversion for English," J. Acoust. Soc. Amer., no. 88, pp. 737-793, 1987.
22. W. N. Campbell and S. D. Isard, "Segment durations in a syllable frame," J. Phonetics, vol. 19, pp. 37-47, 1991.
23. F. Wolfertstetter and G. Ruske, "Discriminative training of stochastic Markov graphs for speech recognition," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Atlanta, GA, May 1996, pp. II:581-II:584.
24. H. Fujisaki, S. Ohno, and C. Wang, "A command-response model for F0 contour generation in multilingual speech synthesis," in Proc. ESCA Workshop on Speech Synthesis, Jenolan, Australia, 1998.
25. A. Bell, D. Jurafsky, E. Fosler-Lussier, C. Girand, M. Gregory, and D. Gildea, "Form variation of English function words in conversation," J. Acoust. Soc. America, no. 113:2, pp. 1001-1024, 2003.
26. H. Mixdorff and O. Jokisch, "Building an integrated prosodic model of German," in Proc. Eurospeech, Aalborg, Denmark, Sept. 2001, pp. II:947-II:950.
27. _, "Evaluating the quality of an integrated model of german prosody," Int. J. Speech Technol., vol. 6, no. 1, pp. 45-55, Jan. 2003.
28. Proc. ESCA Workshop on Modeling Pronunciation Variation for Automatic Speech Recognition, H. Strik, J. M. Ressens, and M. Wester, Eds., A2RT, University of Nijmegen, Rolduc, Kerkrade, The Netherlands, 1998.
29. T. Sloboda and A. Waibel, "Dictionary learning for spontaneous speech recognition," in Proc. Int. Conf. Spoken Language Processing (ICSLP), Philadelphia, PA, 1996, pp. IV:2328-IV:2331.
30. H. Strik, "Pronunciation adaptation at the lexical level," in ISCA ITR Workshop on Adaptation Methods for Speech Recognition, Sophia-Antipolis, France, Aug. 2001.