Prosody modeling with soft templates

Speech Communication

Volumn 39, Issue 3-4, 2003, Pages 311-352

  Kochanski, Greg ^a   Shih, Chilin ^a  

^a LUCENT TECHNOLOGIES   (United States)

Author keywords

Algorithm; Communication; Computer language; Dynamics; Intonation; Mark up language; Modeling; Physiology; Pitch; Prosody; Speech; Text to speech; Tone; XML

Indexed keywords

ALGORITHMS; COMPUTER PROGRAMMING LANGUAGES; LINGUISTICS; PHYSIOLOGY; SPEECH SYNTHESIS; XML;

INTONATION;

SPEECH COMMUNICATION;

EID: 0037290439     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-6393(02)00047-X     Document Type: Article

References (90)

1. Abry, C., Badin, P., Boë, L.-J., Perrier, P., Schwartz, J.-L., 1998. Les Cahiers de l'I.C.P. Bulletin de la Communication Parlée, No. 4. Université Stendhal, Grenoble, France.
2. Anderson M., Pierrehumbert J., Liberman M. Synthesis by rule of English intonation patterns. Proceedings of ICASSP 1, San Diego, CA. 1984;2.8.1-2.8.4.
3. Atkinson J.E. Correlation analysis of the physiological factors controlling fundamental voice frequency. J. Acoust. Soc. Amer. 63:1978;211-222.
4. Beckman, M.E., Ayers, G., 1997. Guidelines for ToBI labeling (version 3, March 1997). Available from 〈http://www.ling.ohio-state.edu/phonetics/ToBI/ToBI.0.html〉.
5. Berry D.A., Herzel H., Titze I.R., Story B.H. Bifurcations in excised Larynx Experiments. J. Voice. 10:1996;129-138.
6. 0 contours from ToBI labels using linear regression. In: Proceedings of ICSLP 96, Philadelphia, PA, USA.
7. Bolinger D.L. A theory of pitch accent in English. Word. 14:1958;109-149.
8. Browman C.P., Goldstein L. Tiers in articulatory phonology with some implications for casual speech. Kingston J., Beckman M. Papers in Laboratory Phonology I: Between the Grammar and Physics of Speech. 1990;341-376 Cambridge University Press, Cambridge.
9. Chen S.H., Hwang S.H., Tsai C.Y. A first study on neural net based generation of prosodic and spectral information for Mandarin text-to-speech. Proceedings of IEEE ICASSP. vol. 2:1992;45-48.
10. de Pijper J.R. Modelling British English Intonation. 1983;Foris Publications, Dordrecht-Holland. ISBN 90-6765-004-8.
11. 0 contours. In: Proceedings of the Sixth European Conference on Speech Communication and Technology (Eurospeech '99), 5-9 September 1999, Budapest, Hungary.
12. Erickson D. Effects of contrastive emphasis on jaw opening. Phonetica 55:1998;147-169.
13. Fry D.B. Duration and intensity as physical correlates of linguistic stress. J. Acoust. Soc. Amer. 30:1955;765-769.
14. Fry D.B. Experiments in the perception of stress. Language and Speech. 1:1958;126-152.
15. Fujimura O. The C/D model and prosodic control of articulatory behavior. Phonetica. 57:2000;128-138.
16. Fujisaki H. Dynamic characteristics of voice fundamental frequency in speech and singing. MacNeilage P.F. The Production of Speech. 1983;39-55 Springer-Verlag, Berlin.
17. Fujisaki H. A note on the physiological and physical basis for the phrase and accent components in the voice fundamental frequency contour. Fujimura O. Vocal Fold Physiology: Voice Production, Mechanisms and Functions. 1988;347-355 Raven, New York, NY.
18. Gårding E., Fujimura O., Hirose H. Laryngeal control of Swedish word tones. Ann. Bull. Res. Inst. Logoped. Phoniatr. 27:1970;135-149.
19. Grønnum N. The Groundworks of Danish Intonation - An Introduction. 1992;Museum Tusculanum Press, Copenhagen.
20. Hadding-Koch K. Acoustico-Phonetic Studies in the Intonation of Southern Swedish. 1961;C.W.K. Gleerup, Lund, Sweden.
21. Haggard M., Ambler S., Callow M. Pitch as a voicing cue. J. Acoust. Soc. Amer. 47:1970;613-617.
22. Herzel H. Non-linear dynamics of voiced speech. Awrejcewicz J. Nonlinear Dynamics: New Theoretical and Applied Results. 1995;Akademie Verlag, Berlin.
23. 0 of and amplitude in the perception of intervocalic glottal stops J. Speech Hear. Res. 39:1996;1182-1190.
24. Hirst D.J., Di Cristo A., Espesser R. Levels of representation and levels of analysis for the description of intonation systems. Horne M. Prosody: Theory and Experiment Studies. 2000;Kluwer Academic Publishers, Dordrecht. (Studies Presented to Gösta Bruce).
25. Hombert J.-M. Consonant types, vowel quality and tone. Fromkin C. Tone: A Linguistic Survey. 1978;Academic Press, New York.
26. Kehoe M., Stoel-Gammon C., Buder E.H. Acoustic correlates of stress in young children's speech. J. Speech Hear. Res. 38:1995;338-350.
27. Keating P.A. The window model of coarticulation: articulatory evidence. Kingston, Beckman Papers in Laboratory Phonology I. Between the Grammar and Physics of Speech. 1990;451-470 Cambridge University Press, Cambridge.
28. Kochanski, G.P., Shih, C., 2000. Stem-ML: language-independent prosody description. In: Proceedings of the International Conference on Spoken Language Processing 2000, Beijing, China.
29. Kochanski G.P., Shih C. Automatic modelling of Chinese intonation in continuous speech. Eurospeech, Aalborg, Denmark. 2001;911-914.
30. Kochanski, G.P., Shih, C., Jing, H., 2001. Hierarchical structure and word strength prediction in Mandarin prosody. In: 4th ISCA Tutorial and Research Workshop on Speech Synthesis, Perthshire, Scotland.
31. Ladd D.R. Intonational Phonology. 1996;Cambridge University Press, Cambridge. ISBN 0521-47575-9.
32. Ladefoged P. Subglottal activity during speech. Proceedings of the 4th International Congress of Phonetic Sciences. 1962;247-265.
33. Levitt H., Rabiner L.R. Analysis of fundamental frequency coutours in speech. J. Acoust. Soc. Amer. 49(2, part 2):1970;570.
34. Liberman M.Y., Pierrehumbert J.B. Intonational invariance under changes in pitch range and length. Aronoff M., Oehrle R. Language Sound Structure. 1984;157-233 MIT Press, Cambridge, MA.
35. Lieberman P. Some acoustic correlates of word stress in American-English. J. Acoust. Soc. Amer. 32:1960;451-454.
36. 0 with respect to subglottal air pressure during sustained phonation J. Acoust. Soc. Amer. 45:1969;1537-1543.
37. Löfqvist A., Baer T., McGarr N.S., Story R.S. The cricothyroid muscle in voicing control. J. Acoust. Soc. Amer. 85:1989;1314-1321.
38. Maekawa, K., 1998. Phonetic and phonological characteristics of paralinguistic information in spoken Japanese. In: Proceedings of the International Conference on Spoken Language Processing 98, Sydney, Australia, paper 997.
39. Malfrère, F., Dutoit, T., Mertens, P., 1998. Fully automatic prosody generator for text-to-speech. In: Proceedings of the International Conference on Spoken Language Processing 98, Sydney, Australia, paper 355.
40. Massaro D.W., Cohen M.M. The contribution of fundamental frequency and voice onset time to the /zi/-/si/ distinction. J. Acoust. Soc. Amer. 60:1976;704-717.
41. McFarland D.H., Smith A. Effects of vocal task and respiratory phase on prephonatory chest wall movements. J. Speech Hear. Res. 35(5):1992;971-982.
42. Monsen R.B., Engebretson A.M., Vemula N.R. Indirect assessment of the contribution of subglottal air pressure and vocal fold tension to changes in the fundamental frequency in English. J. Acoust. Soc. Amer. 64(1):1978;65-80.
43. Moon F.C. Chaotic Vibrations: An Introduction for Applied Scientists and Engineers. 1987;Wiley-Interscience, New York.
44. Moon S.-J., Lindblom B. Interaction between duration, context, and speaking style in English stressed vowels. J. Acoust. Soc. Amer. 90:1994;40-55.
45. Moore B.C.J. An Introduction to the Psychology of Hearing. 1989;Academic Press, New York.
46. Munhall K., Löfqvist A. Gestural aggregation in speech: laryngeal gestures. J. Phonetics. 20:1992;111-126.
47. Ogorzałek M.J. Chaos and Complexity in Nonlinear Electronic Circuits. 1997;World Scientific, Singapore.
48. Ohala J.J. The segment, primitive or derived. Docherty G.J., Ladd D.R. Papers in Laboratory Phonology II: Gesture, Segment, Prosody. 1992;166-183 Cambridge University Press, Cambridge. ISBN 0-521-40127-5.
49. Ohala, J., Hirano, M., 1967. Studies of pitch change in speech. UCLA, Working papers on phonetics, pp. 80-84.
50. Ohala, J., Ladefoged, P., 1970. Further investigation of pitch regulation in speech. UCLA, Working Papers on Phonetics, 14, pp. 12-24.
51. Öhman S. Word and Sentence Intonation, A Quantitative Model. 1967;Department of Speech Communication, Royal Institute of Technology (KTH). pp. 20-54.
52. Olive J.P. Fundamental frequency rules for the synthesis of simple declarative English sentences. J. Acoust. Soc. Amer. 57:1975;476-482.
53. Perrier P., Ostry D.J., Laboissière R. The equilibrium point hypothesis and its application to speech motor control. J. Speech Hear. Res. 39:1996;365-378.
54. Pierrehumbert, J., 1980. The phonology and phonetics of English intonation. Ph.D. dissertation, MIT.
55. Pierrehumbert J.B., Beckman M.E. Japanese Tone Structure. 1988;The MIT Press, Cambridge, MA.
56. Pipes L.A. Applied Mechanics for Engineers and Physicists. third ed. 1970;McGraw Hill, New York.
57. Plato, 366 BCE. The Republic. Book 7.514-7.521, Athens.
58. Pollock K.E., Brammer D.M., Hageman C.F. An acoustic analysis of young children's productions of word stress. J. Phonetics. 21:1990;183-203.
59. Ross K.N., Ostendorf M. A dynamical system model for generating fundamental frequency for speech synthesis. IEEE Trans. Speech Audio Proces. 7(3):1999;295-309.
60. Shih, C., 1986. The prosodic domain of tone sandhi in Chinese. Ph.D. dissertation, University of California, San Diego.
61. Shih C. A declination model of Mandarin Chinese. Botinis A. Intonation: Analysis Modeling and Technology. 2000;243-268 Kluwer Academic Publishers, Dordrecht.
62. Shih, C., Kochanski, G.P., 2000. Chinese tone modeling with Stem-ML. In: Proceedings of the International Conference on Spoken Language Processing 2000, Beijing, China.
63. Shih, C., Sproat, R., 1992. Variations of the Mandarin rising tone. In: Proceedings of the IRCS Workshop on Prosody in Natural Speech, Technical Report IRCS, University of Pennsylvania, pp. 193-200.
64. Silverman K., Beckman M., Pitrelli J., Ostendorf M., Wightman C., Price P., Pierrehumbert J., Hirschberg J. ToBI: A standard for labeling English prosody. Proceedings of the International Conference on Spoken Language Processing 92. vol. 2:1992;867-870.
65. Simada Z.B., Hirose H. Physiological correlates of Japanese accent patterns. Annu. Bull. Res. Inst. Logoped. Phoniatr. 5:1978;41-49.
66. Sluijter A.M.C., van Heuven V.J. Spectral balance as an acoustic correlate of linguistic stress. J. Acoust. Soc. Amer. 100(4):1996;2471-2485.
67. Sluijter A.M.C., van Heuven V.J., Pacilly J.J.A. Spectral balance as a cue in the perception of linguistic stress. J. Acoust. Soc. Amer. 101(1):1997;503-513.
68. Sproat R. Multilingual Text-to-Speech Synthesis: The Bell Labs Approach. 1998;Kluwer Academic Publishers, Dordrecht.
69. Sproat R., Hunt A., Ostendorf M., Taylor P., Black A., Lenzo K. SABLE: A standard for TTS markup. Proceedings of the International Conference on Spoken Language Processing 98, Sydney, Australia. 1998;1719-1724.
70. Stevens K. Acoustic Phonetics. 1998;The MIT Press, Cambridge, MA. ISBN 0-262-19404-X.
71. 0 online documentation, ESPS/Waves release 5.31. Entropic Research Laboratory, 1996. (Entropics was purchased by Microsoft in 2000.) Algorithm based on Talkin, D., A robust algorithm for pitch tracking. In: Kleijn, W.B., Paliwal, K.K. (Eds.), Speech Coding and Synthesis. Elsevier, New York.
72. Taylor, P.A., 1998. The Tilt intonation model. In: Proceedings of the International Conference on Spoken Language Processing 98, Sydney, Australia, paper 827.
73. Taylor P.A. Analysis and synthesis of intonation using the Tilt model. J. Acoust. Soc. Amer. 107(3):2000;1697-1714.
74. Taylor P., Isard A. SSML: A speech synthesis markup language. Speech Communication. 21:1997;123-133.
75. Titze I.R. The physics of small amplitude oscillation of the vocal folds. J. Acoust. Soc. Amer. 83(4):1988;1536-1552.
76. Titze I.R. On the relation between subglottal pressure and fundamental frequency in phonation. J. Acoust. Soc. Amer. 85(2):1989;901-906.
77. Titze I.R. Principles of Voice Production. 1993a;Prentice-Hall, Englewood Cliffs, NJ. pp. 36-42, 91-102, 192-213, ISBN 0-13-717893-X.
78. Titze I.R. Principles of Voice Production. 1993b;Prentice-Hall, Englewood Cliffs, NJ. p. 205 (figure 8.7), p. 208 (figure 8.9), p. 210 (figure 8.11), p. 212 (figure 8.12).
79. Turk A.E., Sawusch J.R. The processing of duration and intensity cues to prominence. J. Acoust. Soc. Amer. 99(6):1996;3782-3790.
80. Tyson J.A., Kochanski G., Dell'Antonio I. A detailed mass map of CL0024+1654 from strong lensing. Astrophys. J. Lett. 498(2):1998;107.
81. van Santen J.P.H., Möbius B. Modeling pitch accent curves. Intonation: Theory, Models, and Applications. Proceedings of ESCA Workshop, Athens, Greece. 1997;321-324.
82. 0 generation and alignment Botinis A. Intonation: Analysis Modeling and Technology. 2000;Kluwer Academic Publishers, Dordrecht.
83. van Santen J.P.H., Shih C., Möbius B. Intonation. Sproat R. Multilingual Text-to- Speech Synthesis: The Bell Labs Approach. 1998;141-190 Kluwer Academic Publishers, Dordrecht.
84. Whalen D.H., Kinsella-Shaw J.M. Exploring the relationship of inspiration duration to utterance duration. Phonetica. 54:1997;138-152.
85. Wier C.C., Jesteadt W., Green D.M. Frequency discrimination as a function of frequency and sensation level. J. Acoust. Soc. Amer. 61:1977;178-184.
86. Winkworth A.L., Davis P.J., Ellis E., Adams R.D. Variability and consistency in speech breathing during reading - lung-volumes speech intensity, and linguistic factors. J. Speech Hear. Res. 37(3):1994;535-556.
87. Winkworth A.L., Davis P.J., Adams R.D., Ellis E. Breathing patterns during spontaneous speech. J. Speech Hear. Res. 38(1):1995;124-144.
88. 0 contours in Mandarin Proceedings of the 14th International Congress of Phonetic Sciences, San Francisco. 1999;2359-2362.
89. Xu, Y., 1993. Contextual tonal variation in Mandarin Chinese. Ph.D. dissertation. The University of Connecticut.
90. Xu, Y., Sun, X.J., 2000. How fast can we really change pitch? Maximum speed of pitch change revisited. In: Proceedings of the International Conference on Spoken Language Processing 2000, Beijing, China.