A gesture-based concept for speech movement control in articulatory speech synthesis

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4775 LNAI, Issue , 2007, Pages 174-189

  Kröger, Bernd J ^a   Birkholz, Peter ^b  

^a UNIVERSITY HOSPITAL RWTH AACHEN   (Germany)

^b UNIVERSITY OF ROSTOCK   (Germany)

Author keywords

Articulation; Gesture; Speech production; Speech synthesis

Indexed keywords

FEEDBACK CONTROL; LEARNING SYSTEMS; SPEECH SYNTHESIS; THREE DIMENSIONAL;

CONTROL MODULE; SPEECH SIGNALS; VISUAL INFORMATION;

GESTURE RECOGNITION;

EID: 38149075376     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-76442-7_16     Document Type: Conference Paper

References (42)

1. Abry, C., Boë, L.J.: Laws for lips. Speech Communication 5, 97-104 (1986)
2. Birkholz, P.: 3D-Artikulatorische Sprachsynthese. Unpublished PhD thesis. University Rostock (2005)
3. Birkholz, P.: Control of an articulatory speech synthesizer based on dynamic approximation of spatial articulatory targets. In: Proceedings of the Interspeech 2007 - Eurospeech. Antwerp, Belgium (2007c)
4. Birkholz, P., Jackèl, D.: Influence of temporal discretization schemes on formant frequencies and bandwidths in time domain simulations of the vocal tract system. In: Proceedings of Interspeech 2004-ICSLP. Jeju, Korea, pp. 1125-1128 (2004)
5. Birkholz, P., Kröger, B.J.: Vocal tract model adaptation using magnetic resonance imaging. In: Proceedings of the 7th International Seminar on Speech Production, pp. 493-500. Belo Horizonte, Brazil (2006)
6. Birkholz, P., Jackèl, D., Kröger, B.J.: Construction and control of a three-dimensional vocal tract model. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2006), Toulouse, France, pp. 873-876 (2006)
7. Birkholz, P., Jackèl, D., Kröger, B.J.: Simulation of losses due to turbulence in the time-varying vocal system. IEEE Transactions on Audio, Speech, and Language Processing 15, 1218-1225 (2007a)
8. Birkholz, P., Steiner, I., Breuer, S.: Control concepts for articulatory speech synthesis. In: Proceedings of the 6th ISCA Speech Synthesis Research Workshop. Universität Bonn (2007b)
9. Browman, C.P., Goldstein, L.: Articulatory gestures as phonological units. Phonology 6, 201-251 (1989)
10. Browman, C.P., Goldstein, L.: Tiers in articulatory phonology, with some implications for casual speech. In: Kingston, J., Beckman, M.E. (eds.) Papers in Laboratory Phonology I: Between the Grammar and Physics of Speech, pp. 341-376. Cambridge University Press, Cambridge (1990a)
11. Browman, C.P., Goldstein, L.: Gestural specification using dynamically-defined articulatory structures. Journal of Phonetics 18, 299-320 (1990b)
12. Browman, C.P., Goldstein, L.: Articulatory phonology: An overview. Phonetica 49, 155-180 (1992)
13. Cranen, B., Schroeter, J.: Modeling a leaky glottis. Journal of Phonetics 23, 165-177 (1995)
14. Dang, J., Honda, K.: Morphological and acoustical analysis of the nasal and the paranasal cavities. Journal of the Acoustical Society of America 96, 2088-2100 (1994)
15. Fadiga, L., Crahighero, L.: Electrophysiology of action representation. Journal of clinical Neurophysiology 21, 157-169 (2004)
16. Flanagan, J.L.: Speech Analysis, Synthesis and Perception. Springer, Berlin (1965)
17. Guenther, F.H., Perkell, J.S.: A neural model of speech production and its application to studies of the role of auditory feedback in speech. In: Maassen, B., Kent, R., Peters, H., van Lieshout, P., Hulstijn, W. (eds.) Speech motor control in normal and disordered speech, pp. 29-49. Oxford University Press, Oxford (2004)
18. Guenther, F.H., Hampson, M., Johnson, D.: A theoretical investigation of reference frames for the planning of speech movements. Psychological Review 105, 611-633 (1998)
19. Guenther, F.H.: Cortical interactions underlying the production of speech sounds. Journal of Communication Disorders 39, 350-365 (2006)
20. Guenther, F.H., Ghosh, S.S., Tourville, J.A.: Neural modeling and imaging of the cortical interactions underlying syllable production. Brain and Language 96, 280-301 (2006)
21. Ito, T., Gomi, H., Honda, M.: Dynamic simulation of speech cooperative articulation by muscle linkages. Biological Cybernetics 91, 275-282 (2004)
22. Kent, R.D.: Research on speech motor control and its disorders: A review and prospective. Journal of Communication disorders 33, 391-428 (2000)
23. Kohler, K.J.: Gestural reorganization in connected speech: A functional viewpoint on 'articulatory phonology'. Phonetica 49, 205-211 (1992)
24. Kröger, B.J.: A gestural production model and its application to reduction in German. Phonetica 50, 213-233 (1993)
25. Kröger, B.J.: Ein phonetisches Modell der Sprachproduktion. Niemeyer Verlag, Tübingen (1998)
26. Kröger, B.J., Birkholz, P., Kannampuzha, J., Neuschaefer-Rube, C.: Modeling sensory-to-motor mappings using neural nets and a 3D articulatory speech synthesizer. In: Proceedings of the 9th International Conference on Spoken Language Processing, Interspeech 2006, ICSLP, pp. 565-568 (2006a)
27. Kröger, B.J., Birkholz, P., Kannampuzha, J., Neuschaefer-Rube, C.: Learning to associate speech-like sensory and motor states during babbling. In: Proceedings of the 7th International Seminar on Speech Production. Belo Horizonte, Brazil, pp. 67-74 (2006b)
28. Kröger, B.J., Birkholz, P., Kannampuzha, J., Neuschaefer-Rube, C.: Spatial-to-joint coordinate mapping in a neural model of speech production. In: DAGA-Proceedings of the Annual Meeting of the German Acoustical Society. Braunschweig, Germany, pp. 561-562 (2006c)
29. Kröger, B.J., Birkholz, P., Kannampuzha, J., Neuschaefer-Rube, C.: Modeling the perceptual magnet effect and categorical perception using self-organizing neural networks. In: Proceedings of the International Congress of Phonetic Sciences. Saarbrücken, Germany (2007)
30. Kröger, B.J., Schröder, G., Opgen-Rhein, C.: A gesture-based dynamic model describing articulatory movement data. Journal of the Acoustical Society of America 98, 1878-1889 (1995)
31. Lindblom, B.: Spectrographic study of vowel reduction. Journal of the Acoustical Society of America 35, 1773-1781 (1963)
32. Mermelstein, P.: Articulatory model for the study of speech production. Journal of the Acoustical Society of America 53, 1070-1082 (1973)
33. Ogata, K., Sonoda, Y.: Evaluation of articulatory dynamics and timing based on cascaded first-order systems. In: Proceedings of the 5th Seminar on Speech Production, Kloster Seeon, Germany, pp. 321-324 (2000)
34. Paine, R.W., Tani, J.: Motor primitive and sequence self-organization in a hierarchical recurrent neural network. Neural Networks 17, 1291-1309 (2004)
35. Perkell, J.S., Matthies, M., Lane, H., Guenther, F., Wilhelms-Tricarico, R., Wozniak, J., Guiod, P.: Speech motor control: Acoustic goals, saturaltion effects, auditory feedback and internal models. Speech communication 22, 227-250 (1997)
36. Saltzman, E.L., Munhall, K.G.: A dynamic approach to gestural patterning in speech production. Ecological Psychology 1, 333-382 (1989)
37. Smith, C.L., Browman, C.P., Kay, B., McGowan, R.S.: Extracting dynamic parameters from speech movement data. Journal of the Acoustical Society of America 93, 1580-1588 (1993)
38. Sober, S.J., Sabes, P.N.: Multisensory integration during motor planning. The Journal of Neuroscience 23, 6982-6992 (2003)
39. Stevens, K.N.: On the quantal nature of speech. Journal of Phonetics 17, 3-45 (1989)
40. Strange, W.: Dynamic specification of coarticulated vowels spoken in sentence context. Journal of the Acoustical Society of America 85, 2135-2153 (1989)
41. Titze, L.R.: Parameterization of the glottal area, glottal flow, and vocal fold contact area. Journal of the Acoustical Society of America 75, 570-580 (1984)
42. Todorov, E.: Optimality principles in sensorimotro control. Nature Neuroscience 7, 907-915 (2004)