Prespeech motor learning in a neural network using reinforcement

Neural Networks

Volumn 38, Issue , 2013, Pages 64-75

  Warlaumont, Anne S ^a   Westermann, Gert ^b   Buder, Eugene H ^c   Oller, D Kimbrough ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b LANCASTER UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF MEMPHIS   (United States)

Author keywords

Articulatory speech synthesis; Infant vocalization; Motor development; Neural network; Neuromuscular control; Reinforcement

Indexed keywords

ENGLISH VOWELS; INFANT VOCALIZATION; LANGUAGE DEVELOPMENT; MOTOR LEARNING; MUSCLE ACTIVATION; NEURAL NETWORK MODEL; NEUROMUSCULAR CONTROL; SOCIAL REINFORCEMENT;

COMPUTER SIMULATION; CONFORMAL MAPPING; LINGUISTICS; MUSCLE; NEURAL NETWORKS; REINFORCEMENT; SPEECH SYNTHESIS;

REINFORCEMENT LEARNING;

ARTICLE; AUDITORY FEEDBACK; ENGLISH AS A SECOND LANGUAGE; HUMAN; KOREA; LARYNX MUSCLE; MUSCLE CONTRACTION; NERVE CELL NETWORK; NEUROMUSCULAR FUNCTION; PHONATION; PITCH; PRIORITY JOURNAL; REINFORCEMENT; SIMULATION; SOUND INTENSITY; SPEECH ARTICULATION; SPEECH DEVELOPMENT; VOCALIZATION; VOWEL;

HUMANS; INFANT; LANGUAGE DEVELOPMENT; LEARNING; MOTOR CORTEX; MOTOR NEURONS; NEURAL NETWORKS (COMPUTER); REINFORCEMENT (PSYCHOLOGY);

EID: 84871643738     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2012.11.012     Document Type: Article

References (49)

1. Barto A.G. Adaptive critics and the basal ganglia. Models of information processing in the basal ganglia 1995, 215-232. MIT Press, Cambridge, MA. J.C. Houk, J. Davis, D. Beiser (Eds.).
2. Blakemore S.-J. The developing social brain: implications for education. Neuron 2010, 65:744-747.
3. Boersma P. Functional phonology: formalizing the interactions between articulatory and perceptual drives 1998, Holland Academic Graphics, The Hague.
4. Boersma, P., & Wennink, D. (2010). Praat: Doing phonetics by computer (Version 5.1.31) [Software]. Available from http://www.praat.org.
5. Buder E., Chorna L., Oller D.K., Robinson R. Vibratory regime classification of infant phonation. Journal of Voice 2008, 22:553-564.
6. Callan D.E., Kent R.D., Guenther F.H., Vorperian H.K. An auditory-feedback-based neural network model of speech production that is robust to developmental changes in the size and shape of the articulatory system. Journal of Speech, Language, and Hearing Research 2000, 43:721-736.
7. de Boysson-Bardies B., Halle P., Sagart L., Durand C. A crosslinguistic investigation of vowel formants in babbling. Journal of Child Language 1989, 16:1-17.
8. de Boysson-Bardies B., Vihman M. Adaptation to language: evidence from babbling and first words in four languages. Language 1991, 67:297-319.
9. Domjan M. The principles of learning and behavior 2010, Wadsworth, Belmont Calif. 6th ed.
10. Ellis, D.P.W. (2007). PLP and RASTA (and MFCC, and inversion) in MATLAB. Retrieved from http://www.ee.columbia.edu/~dpwe/resources/matlab/rastamat/.
11. Fagan M.K., Iverson J.M. The influence of mouthing on infant vocalization. Infancy 2007, 11:191-202.
12. Goldstein M.H., King A.P., West M.J. Social interaction shapes babbling: testing parallels between birdsong and speech. Proceedings of the National Academy of Sciences of the United States of America 2003, 100:8030-8035.
13. Goldstein M.H., Schwade J.A. Social feedback to infants' babbling facilitates rapid phonological learning. Psychological Science 2008, 19:515-523.
14. Gros-Louis J., West M.J., Goldstein M.H., King A.P. Mothers provide differential feedback to infants' prelinguistic sounds. International Journal of Behavioral Development 2006, 30:509-516.
15. Grossmann T., Johnson M.H. The development of the social brain in human infancy. The European Journal of Neuroscience 2007, 25:909-919.
16. Guenther F.H., Ghosh S.S., Tourville J.A. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain and Language 2006, 96:280-301.
17. Guenther F.H., Hampson M., Johnson D. A theoretical investigation of reference frames for the planning of speech movements. Psychological Review 1998, 105:611-633.
18. Harmegnies B., Poch-Olivé D. A study of style-induced vowel variability: Laboratory versus spontaneous speech in Spanish. Speech Communication 1992, 11:429-437.
19. Heintz, I., Beckman, M., Fosler-Lussier, E., & Ménard, L. (2009). Evaluating parameters for mapping adult vowels to imitative babbling. In Proceedings of the 10th annual conference of the international speech communication association, INTERSPEECH. Brighton, UK.
20. Ishizuka K., Mugitani R., Kato H., Amano S. Longitudinal developmental changes in spectral peaks of vowels produced by Japanese infants. The Journal of the Acoustical Society of America 2007, 121:2272-2282.
21. Ito M., Tsuchida J., Yano M. On the effectiveness of whole spectral shape for vowel perception. The Journal of the Acoustical Society of America 2001, 110:1141-1149.
22. Izhikevich E.M. Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral Cortex 2007, 17:2443-2452.
23. Johnson K. Speaker normalization in speech perception. The handbook of speech perception 2005, 363-389. Blackwell Publishers, Oxford. D.B. Pisoni, R. Remez (Eds.).
24. Kanda, H., Ogata, T., Takahashi, T., Komatani, K., & Okuno, H. (2009). Continuous vocal imitation with self-organized vowel spaces in recurrent neural network. In 2009 IEEE international conference on robotics and automation (pp. 4438-4443). Kobe.
25. Kent R., Murray A. Acoustic features of infant vocalic utterances at 3, 6, and 9 months. The Journal of the Acoustical Society of America 1982, 72:353-365.
26. Kohonen T. The self-organizing map. Proceedings of the IEEE 1990, 78:1464-1480.
27. Koopmans-van Beinum F.J., van der Stelt J.M. Early stages in the development of speech movements. Precursors of early speech 1986, 37-50. Stockton Press, New York. B. Lindblom, R. Zetterström (Eds.).
28. Kuhl P.K., Meltzoff A.N. Infant vocalizations in response to speech: vocal imitation and developmental change. The Journal of the Acoustical Society of America 1996, 100:2425-2438.
29. Lewis J.M., Deák G.O., Jasso H., Triesch J. Building a model of infant social interaction. Proceedings of the 32nd annual conference of the cognitive science society 2010, 278-283. Cognitive Science Society, Austin, TX. S. Ohlsson, R. Catrambone (Eds.).
30. Liberman A.M., Mattingly I.G. The motor theory of speech perception revised. Cognition 1985, 21:1-36.
31. Max L., Guenther F., Gracco V., Ghosh S., Wallace M. Unstable or insufficiently activated internal models and feedback-biased motor control as sources of dysfluency: a theoretical model of stuttering. Contemporary Issues in Communication Science and Disorders 2004, 31:105-122.
32. Molina-Luna K., Pekanovic A., Röhrich S., Hertler B., Schubring-Giese M., Rioult-Pedotti M.-S., et al. Dopamine in motor cortex is necessary for skill learning and synaptic plasticity. PLoS ONE 2009, 4:e7082.
33. Nicolaidis, K. (2003). Acoustic variability of vowels in greek spontaneous speech. In Proceedings of the 15th international congress of phonetic sciences (pp.3221-3224).
34. Oller D.K. The emergence of the speech capacity 2000, Lawrence Erlbaum Associates, Mahwah, NJ.
35. Oller D.K., Lynch M.P. Infant vocalizations and innovations in infraphonology: toward a broader theory of development and disorders. Phonological development: models, research, implications 1992, 509-536. York Press, Timonium, MD. C.A. Ferguson, L. Menn, C. Stoel-Gammon (Eds.).
36. Oudeyer P.-Y. The self-organization of speech sounds. Journal of Theoretical Biology 2005, 233:435-449.
37. Papoušek M., Papoušek H. Forms and functions of vocal matching in interactions between mothers and their precanonical infants. First Language 1989, 9:137-157.
38. Perkell J.S., Guenther F.H., Lane H., Matthies M.L., Perrier P., Vick J., et al. A theory of speech motor control and supporting data from speakers with normal hearing and with profound hearing loss. Journal of Phonentics 2007, 28:233-272.
39. Rost G.C., McMurray B. Speaker variability augments phonological processing in early word learning. Developmental Science 2009, 12:339-349.
40. Stark R.E. Stages of speech development in the first year of life. Child phonology, vol. 1: production 1980, 73-92. Academic Press. G.H. Yeni-Komshian, J.F. Kavanagh, C.A. Ferguson (Eds.).
41. Sutton R.S., Barto A.G. Reinforcement learning: an introduction 1998, MIT Press, Cambridge, MA.
42. Titze I.R. Principles of voice production 1994, Prentice Hall, Englewood Cliffs, NJ.
43. Titze I.R. Nonlinear source-filter coupling in phonation: theory. The Journal of the Acoustical Society of America 2008, 123:2733.
44. Vihman M.M. Variable paths to early word production. Journal of Phonentics 1993, 21:61-82.
45. Warlaumont A.S., Westermann G., Oller D.K. Self-production facilitates and adult input interferes in a neural network model of infant vowel imitation. AISB 2011 Computational models of cognitive development 2011, 8-12. Society for the Study of Artificial Intelligence and the Simulation of Behaviour, York, UK. D. Kazakov, G. Tsoulas (Eds.).
46. Westermann G., Miranda E.R. A new model of sensorimotor coupling in the development of speech. Brain and Language 2004, 89:393-400.
47. Yang B. A comparative study of American English and Korean vowels produced by male and female speakers. Journal of Phonentics 1996, 24:245-261.
48. Yoshikawa Y., Asada M., Hosoda K., Koga J. A constructivist approach to infants vowel acquisition through mother-infant interaction. Connection Science 2003, 15:245-258.
49. Zahorian S.A., Jagharghi A.J. Spectral-shape features versus formants as acoustic correlates for vowels. The Journal of the Acoustical Society of America 1993, 94:1966-1982.