Estimation of articulatory gesture patterns from speech acoustics

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2009, Pages 2803-2806

  Ghosh, Prasanta Kumar ^a   Narayanan, Shrikanth ^a   Divenyi, Pierre ^b   Goldstein, Louis ^c   Saltzman, Elliot ^d  

^a University of Southern California   (United States)

^b EBIRE   (United States)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^d HASKINS LABORATORIES   (United States)

Author keywords

Acoustic to gesture inversion; Gestural patterns

Indexed keywords

ARTICULATORY GESTURES; IDENTIFICATION ACCURACY; PATTERN VECTORS; SPEECH ACOUSTICS; SPEECH PERCEPTION;

ACOUSTICS; DYNAMIC POSITIONING; PERCOLATION (SOLID STATE); SYSTEMS ENGINEERING;

SPEECH COMMUNICATION;

EID: 70450214496     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Liberman, A.M., "Some results of research in speech perception", J. Acoust. Soc. Am., vol 29, pp 117-123, 1957.
2. Liberman, A. M., and Mattingly, I. G., "The motor theory of speech revisited", Cognition, vol 21, pp 1-36, 1985.
3. Galantucci, B., Fowler, C. A., and Turvey, M. T., "The motor theory of speech perception reviewed", Psychonomic Bulletin and Review, 13(3), pp 361-377, 2006.
4. Halle, M., and Stevens, K. N., "Analysis by synthesis", Proceedings on the seminar on speech compression and processing, W. Wathen-Dunn and L. E. Woods, Eds., vol 2, paper D7, Cambridge MA: USAF Cambridge Research Center, December 1959.
5. Galantucci, B., Fowler, C. A., and Goldstein, L., "Perceptuo-motor compatibility effects in speech", Attention, Perception, and Psychophysics, 71(5), pp 1138-1149, 2009.
6. Wilson, S. M., Saygin, A. P., Sereno, M. I., and Iacoboni, M., "Linstening to speech activates motor areas involved in speech production", Nature Neuroscience, vol 7, issue 7, pp 701-702, 2004.
7. Pulvermuller, F., Hauk, O., Nikulin, V. V., and Ilmoniemi, R. J., "Functional links between motor and language systems", European Journal of Neuroscience, 21(3), pp 793-797, 2005.
8. Coker, C., "Speech synthesis with parametric articulatory model", Proc. of the Speech Symposium, Kyoto, 1968.
9. Coker, C. H., and Fujimura, O., "A model for specification of vocal tract area function", J. Acoust. Soc. Am., vol 40, pp 1271, 1966.
10. Coker, C. H., Umeda, N., and Browman, C. P., "Automatic synthesis from ordinary English text", IEEE Trans. Audio Electroacoust., vol AU-21, pp 293-297, 1973.
11. Olive, J. P., "Rule synthesis of speech from diadic units", Proc. Int. Conf. Acoust. Speech Signal Procss., vol 2, pp 568- 570, May 1977.
12. Fant, C. G. M., "Acoustic theory of speech production", The Hague: Mouton, 1960.
13. Ladefoged, P., and Harshman, R., "Formant frequencies and movements of the tongue", UCLA, vol 45, pp 39-52, 1979.
14. Atal, B. S., Chang, J. J., Mathews, M. V., and Tukey, J.W. "Inversion of articulatory-to-acoustic transformation in the vocal tract by a computer-sorting technique", J. Acoust. Soc. Am., vol 63, pp 1535-1555, 1978.
15. Ladefoged, P., Harshman, R., Goldstein, L., and Rice, L., "Generating vocal tract shapes from formant frequencies", J. Acoust. Soc. Am., vol 64, pp 1027-1035, 1978.
16. Wakita, H., "Direct estimation of the vocal tract shape by inverse filtering of acoustic speech waveforms", IEEE Transactions on Audio and Electroacoustics, vol 21, issue 5, pp 417-427, 1973.
17. Hogden, J., Rubin, P.,McDermott, E., Katagiri, S., and Goldstein, L., "Inverting mappings from smooth paths through Rn to paths through Rm: A technique applied to recovering articulation from acoustics", Speech Communication, vol 49, pp 361-383, 2007.
18. Lammert A., Ellis D. P. W., Divenyi P., "Data-driven articulatory inversion incorporating articulator priors", ISCA Tutorial and Research Workshop on Statistical And Perceptual Audition, SAPA 2008, 21 September 2008, Brisbane, Australia.
19. Richards, H. B., Mason, J. S., Hunt, M. J., and Bridle, J. S., "Deriving articulatory representations of speech with various excitation modes", Proc. ICSLP, pp 1233-1236, 1996.
20. Papcun, G., Hochberg, J., Thomas, T. R., Laroche, F., Zacks, J., and Levy, S., "Inferring articulation and recognizing gestures from acoustics with a neural network trained on x-ray microbeam data", J. Acoust. Soc. Am., vol, 92, issue 2.1, pp 688-700, 1992.
21. Dusan S. and Deng L., "Acoustic-to-articulatory inversion using dynamical and phonological constraints", Proc. 5th Seminar on Speech Production, pp 237-240, May 2000.
22. Nam H., Goldstein L., Saltzman E., and Byrd D., "Tada: An enhanced, portable task dynamics model in matlab", J. Acoust. Soc. Am., vol 115, issue 5, pp 2430, 2004.
23. Browman C. P. and Goldstein L., "Tiers in articulatory phonology with some implications for causual speech", Papers in Laboratory Phonogy I: Between and Grammar and the Physics of Speech, Kingston, J., and Beckman, M.E. [Eds], Cambridge U Press, pp 341-376, 1991.
24. Browman C. P. and Goldstein L., "Articulatory phonology: An overview", Phonetica, vol 49, pp 155-180, 1992.
25. Zhuang X., Nam H., Johnson M. H., Goldstein L., and Saltzman E., "The Entropy of Articulatory Phonological Code: Recognizing Gestures from Tract Variables", Proc. Interspeech, pp 1489-1492, 2008.
26. Saltzman, E., Nam, H., Krivokapic, J., and Goldstein, L., "A task-dynamic toolkit for modeling the effects of prosodic structure on articulation", In P. A. Barbosa, S. Madureira, and C. Reis, (Eds.), Proceedings of the 4th International Conference on Speech Prosody (Speech Prosody 2008), Campinas, Brazil, 2008.
27. Hanson, H.M. and Stevens, K.N., "A quasiarticulatory approach to controlling acoustic source parameters in a Klatt-type formant synthesizer using HLsyn", J. Acoust. Soc. Am., vol 112, pp 1158-1182, 2002.
28. Ellis D. P. W., "PLP and RASTA (and MFCC, and inversion) in Matlab," 2005, online web resource. [Online]. Available: www.ee.columbia.edu/ dpwe/resources/matlab/rastamat/.