Real-time control of a 2D animation model of the vocal tract using optopalatography

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 997-1001

  Preuß, Simon ^a   Neuschaefer Rube, Christiane ^a   Birkholz, Peter ^a  

^a UNIVERSITY HOSPITAL RWTH AACHEN   (Germany)

Author keywords

Animated vocal tract model; Biofeedback; Glossometry; Linear prediction; Optopalatography

Indexed keywords

ANIMATION; BIOFEEDBACK; FORECASTING; REAL TIME CONTROL;

2D ANIMATION; GLOSSOMETRY; LINEAR PREDICTION; MEASUREMENT SYSTEM; MEASUREMENTS OF; OPTOPALATOGRAPHY; SPATIAL RESOLUTION; VOCAL TRACT MODELS;

PHYSIOLOGICAL MODELS;

EID: 84897527971     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. D. M. Ruscello, "Visual feedback in treatment of residual phonological disorders, " Journal of Communication Disorders, vol. 28, no. 4, pp. 279 - 302, 1995.
2. P. Badin, A. B. Youssef, G. Bailly, F. Elisei, and T. Hueber, "Visual articulatory feedback for phonetic correction in second language learning, " in L2SW, Workshop on Second Language Studies: Acquisition, Learning, Education and Technology, 2010, pp. P1-10.
3. H. Yehia, P. Rubin, and E. Vatikiotis-Bateson, "Quantitative association of vocal-tract and facial behavior, " Speech Communication, vol. 26, no. 1, pp. 23-43, 1998.
4. J. Jiang, A. Alwan, L. E. Bernstein, P. Keating et al., "On the correlation between facial movements, tongue movements and speech acoustics, " in The 6th International Conference on Spoken Language Processing, 2000, pp. 42-45.
5. H. Kjellstrom and O. Engwall, "Audiovisual-to-articulatory inversion, " Speech Communication, vol. 51, no. 3, pp. 195-209, 2009.
6. S. Dusan and L. Deng, "Acoustic-to-articulatory inversion using dynamical and phonological constraints, " in Proc. 5th Seminar on Speech Production, 2000, pp. 237-240.
7. S. Dusan, "Methods for integrating phonetic and phonological knowledge in speech inversion, " Proceedings of the International Conferense on Speech, Signal and Image Processing, Malta, 2001.
8. B. Potard, Y. Laprie, and S. Ouni, "Incorporation of phonetic constraints in acoustic-to-articulatory inversion, " The Journal of the Acoustical Society of America, vol. 123, p. 2310, 2008.
9. M. M. Earnest and L. Max, "En route to the three-dimensional registration and analysis of speech movements: instrumental techniques for the study of articulatory kinematics, " Contemporary Issues in Communication Science and Disorders, vol. 30, pp. 2-25, 2003.
10. I. Steiner and S. Ouni, "Progress in animation of an EMA controlled tongue model for acoustic-visual speech synthesis, " in Elektronische Sprachsignalverarbeitung. TUD press, 2011, pp. 245-252.
11. K. Richmond and S. Renals, "Ultrax: An animated midsagittal vocal tract display for speech therapy, " in Proc. Interspeech, Portland, Oregon, USA, 2012.
12. C.-K. Chuang and W. S. Wang, "Use of optical distance sensing to track tongue motion, " Journal of Speech and Hearing Research, vol. 21, pp. 482-496, 1978.
13. S. G. Fletcher, M. J. McCutcheon, S. C. Smith, and W. H. Smith, "Glossometric measurements in vowel production and modification, " Clinical Linguistics and Phonetics, vol. 3, no. 4, pp. 359- 375, 1989.
14. A. A. Wrench, A. D. McIntosh, and W. J. Hardcastle, "Optopalatograph (opg): A new apparatus for speech production analysis, " in 4th International Conference on Spoken Language Processing (ICSLP 1996), Philadelphia, PA, USA, 1996, pp. 1589- 1592.
15. A. A. Wrench, A. D. McIntosh, and W. J. Hardcastle, " Optopalatograph: Development of a device for measuring tongue movement in 3d, " in EUROSPEECH '97, Rhodes, Greece, 1997, pp. 1055-1058.
16. P. Birkholz and C. Neuschaefer-Rube, "A new artificial palate design for the optical measurement of tongue and lip movements, " in Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2012, M. Wolff, Ed. Dresden, Germany: TUD Press, 2012, pp. 89-95.
17. P. Birkholz and C. Neuschaefer-Rube, "Combined optical distance sensing and electropalatography to measure articulation, " in Interspeech 2011, Florence, Italy, 2011, pp. 285-288.
18. P. Birkholz, P. Dachert, and C. Neuschaefer-Rube, "Advances in combined electro-optical palatography, " in Proc. of Interspeech 2012, Portland, Oregon, USA, 2012.
19. P. Birkholz, "Modeling consonant-vowel coarticulation for articulatory speech synthesis, " PLoS ONE, vol. 8, no. 4, p. e60603, 2013.
20. B. J. Kroger, R. Winkler, C. Mooshammer, and B. Pompino- Marschall, "Estimation of vocal tract area function from magnetic resonance imaging: Preliminary results, " in 5th Seminar on Speech Production: Models and Data, Kloster Seeon, Bavaria, 2000, pp. 333-336.
21. S. Preuß, P. Birkholz, and C. Neuschaefer-Rube, "Prospects of EPG and OPG sensor fusion in pursuit of a 3D real-time representation of the oral cavity, " in Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2013, P. Wagner, Ed. TUD Press, Dresden, 2013, pp. 144-151.