A neural network model of the articulatory-acoustic forward mapping trained on recordings of articulatory parameters

Journal of the Acoustical Society of America

Volumn 116, Issue 4 I, 2004, Pages 2354-2364

  Kello, Christopher T ^a   Plaut, David C ^b  

^a GEORGE MASON UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; INFORMATION ANALYSIS; MATHEMATICAL MODELS; SIGNAL PROCESSING; SPEECH;

ARTICULATORY SYNTHESIZERS; PHONETIC INFORMATION; SPEECH DATABASE;

NEURAL NETWORKS;

ACOUSTICS; ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; INTELLIGENCE TEST; MOLECULAR MODEL; NORMAL HUMAN; PHONETICS; PRIORITY JOURNAL; SPEECH; SPEECH ARTICULATION; SYNTHESIS;

ADULT; COMPUTER SIMULATION; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PHONATION; SOUND SPECTROGRAPHY; SPEECH; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PRODUCTION MEASUREMENT;

DATA; MATHEMATICAL MODELS; NEURAL NETWORKS;

EID: 6344254321     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.1715112     Document Type: Article

References (39)

1. Badin, P., Bailly, G., Reveret, L., Baciu, M., Segebarth, C., and Savariaux, C. (2002). "Three-dimensional linear articulatory modeling of tongue, lips, and face, based on MRI and video images," J. Phonetics 30, 533-553.
2. Baer, T., Gore, J. C., Gracco, L. C., and Nye, P. W. (1991). "Analysis of vocal-tract shape and dimensions using magnetic-resonance- imaging-vowels," J. Acoust. Soc. Am. 90, 799-828.
3. Bailly, G. (1997). "Learning to speak. Sensori-motor control of speech movements," Speech Commun. 22, 251-267.
4. Beautemps, D., Badin, P., and Bailly, G. (2001). "Linear degrees of freedom in speech production: Analysis of cineradio- and labio-film data and articulatory-acoustic modeling," J. Acoust. Soc. Am. 109, 2165-2180.
5. Beautemps, D., Badin, P., and Laboissiere, R. (1995). "Deriving vocal-tract area functions from midsagittal profiles and formant frequencies - A new model for vowels and fricative consonants based on experimental-data," Speech Commun. 16, 27-47.
6. Bernhardt, B. H., and Stemberger, J. P. (1998). Handbook of Phonological Development: From the Perspective of Constraint-based Nonlinear Phonology (Academic, San Diego).
7. Bernstein, L. E., Demorest, M. E., and Tucker, P. E. (2000). "Speech perception without hearing," Percept. Psychophys. 62, 233-252.
8. Blackburn, C. S., and Young, S. J. (2000). "A self-learning predictive model of articulator movements during speech production," J. Acoust. Soc. Am. 107, 1659-1670.
9. Blackburn, C. S., and Young, S. (2000a). "Enhanced speech recognition using an articulatory production model trained on X-ray data," Comput. Speech Lang. 15, 195-215.
10. Blackburn, C. S., and Young, S. (2000b). "A self-learning predictive model of articulator movements during speech production," J. Acoust. Soc. Am. 107, 1659-1670.
11. Chappell, D. T., and Hansen, J. H. L. (2002). "A comparison of spectral smoothing methods for segment concatenation based speech synthesis," Speech Commun. 36, 343-374.
12. Cybenko, G. (1989). "Approximation by superpositions of a sigmoid function," Math. Control, Signals, Syst. 2, 303-314.
13. Goodyear, C. C. (2000). "Incorporating lip protrusion and larynx lowering into a time domain model for articulatory speech synthesis," Comput. Speech Lang. 14, 211-226.
14. Greenwood, A. R., Goodyear, C. C., and Martin, P. A. (1992). "Measurements of vocal-tract shapes using magnetic-resonance-imaging," IEEE Proc.-I: Commun. Speech Vision 139, 553-560.
15. Guenther, F. H. (1994). "A neural-network model of speech acquisition and motor equivalent speech production," Biol. Cybern. 72, 43-53.
16. Guenther, F. H. (1995). "Speech sound acquisition, coarticulation, and rate effects in a neural-network model of speech production," Psychol. Rev. 102, 594-621.
17. Guenther, F. H., Hampson, M., and Johnson, D. (1998). "A theoretical investigation of reference frames for the planning of speech movements," Psychol. Rev. 105, 611-633.
18. Hickok, G. (2001). "Functional anatomy of speech perception and speech production: Psycholinguistic implications," J. Psycholinguist. Res. 30, 225-235.
19. Hirsch, H. G., and Ehrlicher, C. (1995). "Noise estimation techniques for robust speech recognition," Paper presented at the Proc. ICASSP.
20. Jacobs, R. A. (1988). "Increased rates of convergence through learning rate adaptation," Neural Networks 1, 295-307.
21. Jiang, J. T., Alwan, A., Keating, P. A., Auer, E. T., and Bernstein, L. E. (2002). "On the relationship between face movements, tongue movements, and speech acoustics," Eurasip J. Appl. Signal Process. 2002, 1174-1188.
22. Jordan, M. I., and Rumelhart, D. E. (1992). "Forward models - Supervised learning with a distal teacher," Cogn. Sci. 16, 307-354.
23. Jusczyk, P. W. (1997). The Discovery of Spoken Language (MIT, Cambridge).
24. Kaburagi, T., and Honda, M. (2001). "Dynamic articulatory model based on multidimensional invariant-feature task representation," J. Acoust. Soc. Am. 110, 441-452.
25. Kelly, J. L., and Lochbaum, C. C. (1962). "Speech Synthesis," Proceedings of the Fourth International Congress of Acoustics, paper G42, 1-4, in Speech Synthesis, edited by J. L. Flanagan and L. R. Rabiner (Dowden, Hutchinson & Ross, Stroudsburg, PA), pp. 127-130.
26. Ladefoged, P. (1993). A Course in Phonetics (Harcourt Brace, Orlando, FL).
27. Mermelstein, P. (1973). "Articulatory model for the study of speech production," J. Acoust. Soc. Am. 53, 1070-1082.
28. Perkell, J., and Klatt, D. (Eds.). (1986). Invariance and Variability in Speech Processes. (Lawrence Erlbaum, Hillsdale, NJ).
29. Perkell, J. Matthies, M., Lane, H., Guenther, F., Wilhelms-Tricarico, R., Wozniak, J., et al. (1997). "Speech motor control: Acoustic goals, saturation effects, auditory feedback, and internal models," Speech Commun. 22, 227-250.
30. Perkell, J. S., Guenther, F. H., Lane, H., Matthies, M. L., Perrier, P., Vick, J. et al. (2000). "A theory of speech motor control and supporting data from speakers with normal hearing and with profound hearing loss," J. Phonetics 28, 233-272.
31. Pisoni, D. B. (1981). "Some current theoretical issues in speech perception," Cognition 10, 249-259.
32. Plaut, D. C., and Kello, C. T. (1999). "The emergence of phonology from the interplay of speech comprehension and production: A distributed connectionist approach," in The Emergence of Language, edited by B. MacWhinney (Erlbaum, Mahweh, NJ), pp. 381-415.
33. Plaut, D. C., McClelland, J. L., Seidenberg, M. S., and Patterson, K. (1996). "Understanding normal and impaired word reading: Computational principles in quasi-regular domains," Psychol. Rev. 103, 56-115.
34. Roweis, S. (1999). "Data driven production models for speech processing," Ph.D. thesis, University of Toronto, Toronto.
35. Rubin, P., Baer, T., and Mermelstein, P. (1981). "An articulatory synthesizer for perceptual research," J. Acoust. Soc. Am. 70, 321-328.
36. Rumelhart, D. E., Durbin, R., Golden, R., and Chauvin, Y. (1995). "Backpropagation: The basic theory," in Backpropagation: Theory, Architectures, and Applications Developments in Connectionist Theory, edited by Y. Chauvin and D. E. Rumelhart (Erlbaum, Hillsdale, NJ), pp. 1-34.
37. Rumelhart, D. E., Hinton, G. E., and Williams, R. J. (1986). "Learning representations by back-propagating errors," Nature (London) 323, 533-536.
38. Shiga, Y., and King, S. (2003). "Estimation of voice source and vocal tract characteristics based on multi-frame analysis." Paper presented at Eurospeech.
39. Wrench, A., and Hardcastle, W. (2000). "A multichannel articulatory speech database and its application for automatic speech recognition," Paper presented at the Proceedings of the 5th Seminar on Speech Production.