A procedure for estimating gestural scores from speech acoustics

Journal of the Acoustical Society of America

Volumn 132, Issue 6, 2012, Pages 3980-3989

  Nam, Hosung ^a   Mitra, Vikramjit ^b   Tiede, Mark ^a   Hasegawa Johnson, Mark ^c   Espy Wilson, Carol ^d   Saltzman, Elliot ^e   Goldstein, Louis ^f  

^a HASKINS LABORATORIES   (United States)

^b SRI INTERNATIONAL   (United States)

^c University of Illinois at Urbana Champaign   (United States)

^d UNIVERSITY OF MARYLAND   (United States)

^e BOSTON UNIVERSITY   (United States)

^f UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC DISTANCE; ANALYSIS BY SYNTHESIS; DATA SETS; ITERATIVE APPROACH; NATURAL SPEECH; SPEECH ACOUSTICS; TEMPORAL PATTERNING; VOCAL-TRACTS;

ACOUSTICS; PHYSICS;

SPEECH;

ACOUSTICS; ARTICLE; BIOMECHANICS; COMPARATIVE STUDY; FEMALE; GESTURE; GLOTTIS; HUMAN; MALE; METHODOLOGY; MOUTH; PHYSIOLOGY; SIGNAL PROCESSING; SOUND DETECTION; SPEECH; SPEECH ANALYSIS; THEORETICAL MODEL; TIME; VOICE;

ACOUSTICS; BIOMECHANICS; FEMALE; GESTURES; GLOTTIS; HUMANS; MALE; MODELS, THEORETICAL; MOUTH; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH PRODUCTION MEASUREMENT; TIME FACTORS; VOICE QUALITY;

EID: 84870896880     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4763545     Document Type: Article

References (48)

1. Atal, B. S. (1983). Efficient coding of LPC parameters by temporal decomposition., in Proceedings of ICASSP, Boston, MA, pp. 81-84.
2. Browman, C., and Goldstein, L. (1992). Articulatory phonology: An overview., Phonetica 49, 155-180. 10.1159/000261913
3. Browman, C. P., and Goldstein, L. (1990). Gestural specification using dynamically-defined articulatory structures., J. Phonetics 18 (3), 299-320.
4. Browman, C. P., and Goldstein, L. (1995). Gestural syllable position effects in American English., in Producing Speech: Contemporary Issues (for Katherine Safford Harris), edited by, F. Bell-Berti, and, L. J. Raphael, (AIP Press, Woodbury, NY), pp. 19-33.
5. Byrd, D. (1995). C-centers revisited., Phonetica 52, 285-306. 10.1159/000262183
6. Byrd, D., and Saltzman, E. (1998). Intragestural dynamics of multiple phrasal boundaries., J. Phonetics 26, 173-199. 10.1006/jpho.1998.0071
7. Byrd, D., and Saltzman, E. (2003). The elastic phrase: Modeling the dynamics of boundary-adjacent lengthening., J. Phonetics 31 (2), 149-180. 10.1016/S0095-4470(02)00085-2
8. Byrd, D., Tobin, S., Bresch, E., and Narayanan, S. (2009). Timing effects of syllable structure and stress on nasals: A real-time MRI examination., J. Phonetics 37, 97-110. 10.1016/j.wocn.2008.10.002
9. Cho, T. (2005). Prosodic strengthening and featural enhancement: Evidence from acoustic and articulatory realizations of /,i/ in English., J. Acoust. Soc. Am. 117 (6), 3867-3878. 10.1121/1.1861893
10. Cho, T. (2006). Manifestation of prosodic structure in articulatory variation: Evidence from lip movement kinematics in English., in Laboratory Phonology 8 (Phonology and Phonetics), edited by, L. Goldstein, D. H. Whalen, and, C. Best, (Walter de Gruyter, Berlin), pp. 519-548.
11. de Jong, K. J. (1995). The supraglottal articulation of prominence in English: Linguistic stress as localized hyperarticulation., J. Acoust. Soc. Am. 97 (1), 491-504. 10.1121/1.412275
12. Fougeron, C., and Keating, P. A. (1997). Articulatory strengthening at edges of prosodic domains., J. Acoust. Soc. Am. 101, 3728-3740. 10.1121/1.418332
13. Fowler, C. (1980). Coarticulation and theories of extrinsic timing., J. Phonetics 8, 113-133.
14. Furui, S. (1986). On the role of speech transition for speech perception., J. Acoust. Soc. Am. 80 (4), 1016-1025. 10.1121/1.393842
15. Goldstein, L., Byrd, D., and Saltzman, E. (2006). The role of vocal tract gestural action units in understanding the evolution of phonology., in From Action to Language: The Mirror Neuron System, edited by, M. Arbib, (Cambridge University, Cambridge), pp. 215-249.
16. Goldwater, S., and Johnson, M. (2005). Representational bias in unsupervised learning of syllable structure., in Proceedings of Computational Natural Language Learning, pp. 112-119.
17. Hanson, H. M., and Stevens, K. N. (2002). A quasiarticulatory approach to controlling acoustic source parameters in a Klatt-type formant synthesizer using HLsyn., J. Acoust. Soc. Am. 112 (3), 1158-1182. 10.1121/1.1498851
18. Howitt, A. W. (2000). Vowel landmark detection., in Proceedings of Interspeech, International Speech Communication Association, Beijing, China, pp. 628-631.
19. Hu, C., Zhuang, X., and Hasegawa-Johnson, M. (2010). FSM-based pronunciation modeling using articulatory phonological code., in Proceedings of Interspeech, pp. 2274-2277.
20. Juneja, A., and Espy-Wilson, C. (2008). Probabilistic landmark detection for automatic speech recognition using acoustic-phonetic information., J. Acoust. Soc. Am. 123 (2), 1154-1168. 10.1121/1.2823754
21. Jung, T. P., Krishnamurthy, A. K., Ahalt, S. C., Beckman, M. E., and Lee, S. H. (1996). Deriving gestural scores from articulator-movement records using weighted temporal decomposition., IEEE Trans. Speech Audio Process. 4 (1), 2-18. 10.1109/TSA.1996.481448
22. Jusczyk, P. (1993). From general to language-specific capacities: The WRAPSA model of how speech perception develops., J. Phonetics 21, 3-28.
23. Kochetov, A. (2006). Syllable position effects and gestural organization: Articulatory evidence from Russian., in Papers in Laboratory Phonology 8, edited by, L. Goldstein, D. Whalen, and, C. Best, (Mouton deGruyter, Berlin), pp. 565-588.
24. Krakow, R. A. (1999). Physiological organization of syllables: A review., J. Phonetics 27, 23-54. 10.1006/jpho.1999.0089
25. Mehler, J., Jusczyk, P. W., Lambertz, G., Halstead, N., Bertoncini, J., and Amiel-Tison, C. (1988). A precursor of language acquisition in young infants., Cognition 29, 143-178. 10.1016/0010-0277(88)90035-2
26. Mermelstein, P. (1975). Automatic segmentation of speech into syllabic units., J. Acoust. Soc. Am. 58, 880-883. 10.1121/1.380738
27. Mitra, V., Nam, H., Espy-Wilson, C., Saltzman, E., and Goldstein, L. (2010a). Retrieving tract variables from acoustics: A comparison of different machine learning strategies., IEEE J. Sel. Top. Signal Process. 4 (6), 1027-1045. 10.1109/JSTSP.2010.2076013
28. Mitra, V., Nam, H., Espy-Wilson, C., Saltzman, E., and Goldstein, L. (2010b). Robust word recognition using articulatory trajectories and gestures., in Proceedings of Interspeech, Makuhari, Japan, pp. 2038-2041.
29. Mitra, V., Nam, H., Espy-Wilson, C., Saltzman, E., and Goldstein, L. (2011). Gesture-based dynamic Bayesian network for noise robust speech recognition., in Proceedings of ICASSP, Prague, Czech Republic, pp. 5172-5175.
30. Mooshammer, C., Goldstein, L., Nam, H., McClure, S., Saltzman, E., and Tiede, M. (2012). Temporal planning in speech: Syllable structure as coupling graph., J. Phonetics 40 (3), 374-389. 10.1016/j.wocn.2012.02.002
31. Nam, H. (2007). Syllable-level intergestural timing model: Split-gesture dynamics focusing on positional asymmetry and moraic structure., in Laboratory Phonology 9 (Phonology and Phonetics), edited by, J. Cole, and, J. I. Hualde, (Walter de Gruyter, Berlin), pp. 483-506.
32. Nam, H., Goldstein, L., Saltzman, E., and Byrd, D. (2004). TADA: An enhanced, portable task dynamics model in Matlab., J. Acoust. Soc. Am. 115 (5), 2430.
33. Perkell, J. (1969). Physiology of Speech Production: Results and Implications of a Quantitative Cineradiographic Study (Maple Press, York, PA), 104 pp.
34. Qin, C., and Carreira-Perpiñán, M. (2010). Reconstructing the full tongue contour from EMA/X-Ray microbeam., in Proceedings of ICASSP, pp. 4190-4193.
35. Rubin, P., Saltzman, E., Goldstein, L., McGowan, M., Tiede, M., and Browman, C. (1996). CASY and extensions to the task-dynamic model., in Proceedings of the First ESCA ETRW on Speech Production Modeling-4th Speech Production Seminar: Models and Data, Autrans, France, pp. 125-128.
36. Sakoe, H., and Chiba, S. (1978). Dynamic programming algorithm optimization for spoken word recognition., IEEE Trans. Acoust., Speech, Signal Process. 26 (1), 43-49. 10.1109/TASSP.1978.1163055
37. Saltzman, E., and Munhall, K. (1989). A dynamical approach to gestural patterning in speech production., Ecological Psychol. 1 (4), 332-382. 10.1207/s15326969eco0104-2
38. Saltzman, E., Nam, H., Krivokapic, J., and Goldstein, L. (2008). A task-dynamic toolkit for modeling the effects of prosodic structure on articulation., in Proceedings of Speech Prosody, Campinas, Brazil, pp. 175-184.
39. Shannon, C. E., and Bode, H. (1950). A simplified derivation of linear least square smoothing and prediction theory., Proc. IRE 38, 417-425. 10.1109/JRPROC.1950.231821
40. Stevens, K. N. (1985). Evidence for the role of acoustic boundaries in the perception of speech sounds., in Phonetic Linguistics: Essays in Honor of Peter Ladefoged, edited by, V. A. Fromkin, (Academic Press, Orlando, FL), pp. 243-255.
41. Stevens, K. N., Manuel, S. Y., Shattuck-Hufnagel, S., and Liu, S. (1992). Implementation of a model for lexical access based on features., in International Conference on Spoken Language Processing, International Speech Communication Association, Banff, Alberta, pp. 499-502.
42. Sun, J. P., and Deng, L. (2002). An overlapping-feature-based phonological model incorporating linguistic constraints: Applications to speech recognition., J. Acoust. Soc. Am. 111 (2), 1086-1101. 10.1121/1.1420380
43. Sun, J. P., Jing, X., and Deng, L. (2000). Annotation and use of speech production corpus for building language universal speech recognizers., in Proceedings of International Symposium on Chinese Spoken Language Processing, Beijing, China, Vol. 3, pp. 31-34.
44. Tepperman, J., Goldstein, L., Lee, S., and Narayanan, S. (2009). Automatically rating pronunciation through articulatory phonology., Proceedings of Interspeech, pp. 2771-2774.
45. Turk, A. E., and Sawusch, J. R. (1997). The domain of accentual lengthening in American English., J. Phonetics 25, 25-41. 10.1006/jpho.1996.0032
46. Westbury, J. (1994). X-ray Microbeam Speech Production Database Users Handbook (University of Wisconsin, Madison, WI), pp. 1-135.
47. Yuan, J., and Liberman, M. (2008). Speaker identification on the SCOTUS corpus., J. Acoust. Soc. Am. 123 (5), 3878. 10.1121/1.2935783
48. Zhuang, X., Nam, H., Hasegawa-Johnson, M., Goldstein, L., and Saltzman, E. (2009). Articulatory phonological code for word classification., in Proceedings of Interspeech, Brighton, UK, pp. 2763-2766.