A semi-automatic method for extracting vocal tract movements from X-ray films

Speech Communication

Volumn 51, Issue 2, 2009, Pages 97-115

  Fontecave Jallon, Julie ^a   Berthommier, Frédéric ^a  

^a GIPSA LAB   (France)

Author keywords

Cineradiography; Contour extraction; Low frequency DCT components; Vocal tract movements

Indexed keywords

AUTOMATIC INDEXING; CLUTCHES; DISCRETE COSINE TRANSFORMS; IMAGE ENHANCEMENT; IMAGING TECHNIQUES; RADIOGRAPHY; SPEECH; VIDEO RECORDING;

2D DATUMS; CINERADIOGRAPHY; CONTINUOUS SPEECHES; CONTOUR ESTIMATIONS; CONTOUR EXTRACTION; GEOMETRICAL DATUMS; HUMAN EXPERTISES; LOW-FREQUENCY DCT COMPONENTS; NEIGHBORHOOD AVERAGING; POST-PROCESSING; RECONSTRUCTION ERRORS; SEMI AUTOMATICS; SIMILARITY MEASURES; SPEECH PRODUCTIONS; VIDEO DATUMS; VOCAL TRACT MOVEMENTS; VOCAL TRACTS;

COSINE TRANSFORMS;

EID: 56949108412     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2008.06.005     Document Type: Article

References (31)

1. Akgul Y.S., Kambhamettu C., and Stone M. Automatic extraction and tracking of the tongue contours. IEEE Trans. Med. Imaging 18 (1999) 1035-1045
2. èmes Journées d'Etudes sur la Parole, Aussois, France.
3. Badin, P., Gabioud, B., Beautemps, D., Lallouache, T., Bailly, G., Maeda, S., Zerling, J.-P., Brock, G., 1995. Cineradiography of VCV sequences: articulatory-acoustic data for a speech production model. In: Proc. Internat. Conf. on Acoustics, Trondheim, Norway.
4. Badin, P., Bailly, G., Raybaudi, M., Segebarth, C., 1998. A three-dimensional linear articulatory model based on MRI data. In: Proc. Internat. Conf. on Spoken Language Processing, Sydney, Australia.
5. Berthommier, F., 2004. Characterization and extraction of mouth opening parameters available for audiovisual speech enhancement. In: Proc. Internat. Conf. on Acoustics, Speech and Signal Processing, Montreal, Quebec, Canada.
6. Bothorel, A., Simon, P., Wioland, F. Zerling, J.-P., 1986. Cinéradiographie des voyelles et consonnes du français. Travaux de l'Institut de Phonétique de Strasbourg.
7. De Paula H., Yehia H.C., Shiller D., Jozan G., Munhall K.G., and Vatikiotis-Bateson E. Analysis of audiovisual speech intelligibility based on spatial and temporal filtering of visible speech information. In: Harrington, and Tabain (Eds). Speech Production: Models, Phonetic Processes and Techniques (2006), Psychology Press
8. Fant G. Acoustic Theory of Speech Production (1960), Mouton, The Hague
9. Fontecave, J., Berthommier, F., 2005. Quasi-automatic extraction method of tongue movement from a large existing speech cineradiographic database. In: Proc. Eur. Conf. on Speech Communication and Technology, Lisboa, Portugal.
10. Guiard-Marigny T., Adjoudani A., and Benoît C. A 3D model of the lips for speech synthesis. Progress of Speech Synthesis (1996), Springer-Verlag
11. Hardcastle W.J. The use of electropalatography in phonetic research. Phonetica 25 (1972) 197-215
12. Heckmann, M., Berthommier, F., Savariaux, C., Kroschel, K., 2000. Labeling audio-visual speech corpora and training an ANN/HMM audio-visual speech recognition system. In: Proc. Internat. Conf. on Spoken Language Processing, Beijing, China.
13. Heckmann, M., Berthommier, F., Savariaux, C., Kroschel, K., 2003. Effects of image distorsions on audio-visual speech recognition. In: Proc. Audio Visual Speech Processing, St. Jorioz, France.
14. Heinz J.M., and Stevens K.N. On the derivation of area functions and acoustic spectra from cineradiographic films of speech. J. Acoust. Soc. Amer. (1964) 36
15. Kass M., Witkin A., and Terzopoulos D. Snakes: active contour models. Internat. J. Comput. Vision 4 (1987) 321-331
16. Laprie, Y., Berger, M.-O., 1996. Extraction of tongue contours in X-ray images with minimal user interaction. In: Proc. Internat. Conf. on Spoken Language Processing, Philadelphia, USA, pp. 268-271.
17. èmesJournées d'Etude sur la Parole, Grenoble, France, pp. 152-164.
18. Mermelstein P. Articulatory model for the study of speech production. J. Acoust. Soc. Amer. 53 (1973) 1070-1082
19. Munhall K.G., Vatikiotis-Bateson E., and Tohkura Y. X-ray Film database for speech research. J. Acoust. Soc. Amer. 98 (1995) 1222-1224
20. Narayanan S., Nayak K., Lee S., Sethy A., and Byrd D. An approach to real-time magnetic resonance imaging for speech production. J. Acoust. Soc. Amer. 115 (2004) 1771-1776
21. Perkell J. Physiology of Speech Production (1969), MIT Press, Cambridge, MA
22. Perkell J., Cohen M., Svirsky M., Matthies M., Garabieta I., and Jackson M. Electromagnetic midsagittal articulometer systems for transducing speech articulatory movements. J. Acoust. Soc. Amer. 92 6 (1972) 3078-3096
23. Potamianos, G., Graf, H.P., Cosatto, E., 1998. An image transform approach for HMM based automatic lipreading. In: Proc. Internat. Conf. on Image Processing, Chicago, USA, Vol. 3, pp. 173-177.
24. Rao K.R., and Yip P. Discrete Cosine Transform: Algorithms, Advantages, Applications (1990), Academic Press, Boston
25. Roy, J.-P., 2003. INTRIC, une interface de traitement d'images cinéradiographiques. Travaux de l'Institut de Phonétique de Strasbourg, pp. 163-177.
26. Rubin, P., Saltzman, E., Goldstein, L., McGowan, R., Tiede, M., Browman, C., 1996. Casy and extensions to the task-dynamic model. In: Proc. 4th Internat. Semin. on Speech Production, Grenoble, France.
27. Stevens K.N., and Öhman S. Cineradiographic studies of speech. STL-QPSR 4 2 (1963) 009-011
28. Thimm, G., Luettin, J., 1998. Illumination-robust pattern matching using distorted histograms. IDIAP Research Report, Martigny, Suisse.
29. Thimm, G., Luettin, J., 1999. Extraction of articulators in X-ray image sequences. In: Proc. Eur. Conf. on Speech Communication and Technology, Budapest, Hungary, pp. 157-160.
30. Tiede, M.K., Vatikiotis-Bateson, E., 1994. Extracting articulator movement parameters from a videodisc-based cineradiographic database. In: Proc. Internat. Conf. on Spoken Language Processing.
31. Wood S. A radiographic examination of constriction location for vowels. J. Phonetics 7 (1979) 25-43