From Birdsong to Human Speech Recognition: Bayesian Inference on a Hierarchy of Nonlinear Dynamical Systems

PLoS Computational Biology

Volumn 9, Issue 9, 2013, Pages

  Yildiz, Izzet B ^a,b   von Kriegstein, Katharina ^a,c   Kiebel, Stefan J ^a,d  

^a MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^b ECOLE NORMALE SUPÉRIEURE   (France)

^c HUMBOLDT UNIVERSITY   (Germany)

^d JENA UNIVERSITY HOSPITAL   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; DYNAMICAL SYSTEMS; INFERENCE ENGINES; SPEECH RECOGNITION;

ANIMAL MODEL; BAYESIAN INFERENCE; HUMAN LEARNING; HUMAN RECOGNITION; HUMAN SPEECH; LEARN+; MICROSCOPIC LEVELS; NEURAL RECOGNITION; ON-LINE FASHION; RECOGNITION MODELS;

NONLINEAR DYNAMICAL SYSTEMS;

ANIMAL EXPERIMENT; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUDITORY SYSTEM; BAYES THEOREM; COCHLEA; COMPREHENSION; CONTROLLED STUDY; FUZZY SYSTEM; HOPFIELD NETWORK; LEARNING; NONHUMAN; NONLINEAR SYSTEM; POPULATION BIOLOGY; PREDICTION; QUALITATIVE ANALYSIS; SONGBIRD; SOUND INTENSITY; SPEECH DISCRIMINATION; VOCALIZATION; WORD RECOGNITION;

ANIMALIA; PASSERI;

ANIMAL COMMUNICATION; ANIMALS; BAYES THEOREM; BIRDS; HUMANS; SPEECH;

EID: 84884688824     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003219     Document Type: Article

References (111)

1. Bolhuis JJ, Okanoya K, Scharff C, (2010) Twitter evolution: converging mechanisms in birdsong and human speech. Nature Reviews Neuroscience 11: 747-759.
2. Doupe AJ, Kuhl PK, (1999) Birdsong and human speech: Common themes and mechanisms. Annual Review of Neuroscience 22: 567-631.
3. Creutzfeldt O, Ojemann G, Lettich E, (1989) Neuronal-Activity in the Human Lateral Temporal-Lobe. 1. Responses to Speech. Experimental Brain Research 77: 451-475.
4. Pasley BN, David SV, Mesgarani N, Flinker A, Shamma SA, et al. (2012) Reconstructing Speech from Human Auditory Cortex. Plos Biology 10 (1) (): e1001251.
5. Berwick RC, Okanoya K, Beckers GJL, Bolhuis JJ, (2011) Songs to syntax: the linguistics of birdsong. Trends in Cognitive Sciences 15: 113-121.
6. Prather JF, Peters S, Nowicki S, Mooney R, (2008) Precise auditory-vocal mirroring in neurons for learned vocal communication. Nature 451: 305-U302.
7. Jarvis ED, (2004) Learned birdsong and the neurobiology of human language. Behavioral Neurobiology of Birdsong 1016: 749-777.
8. Okada K, Rong F, Venezia J, Matchin W, Hsieh IH, et al. (2010) Hierarchical Organization of Human Auditory Cortex: Evidence from Acoustic Invariance in the Response to Intelligible Speech. Cerebral Cortex 20: 2486-2495.
9. Scott SK, Johnsrude IS, (2003) The neuroanatomical and functional organization of speech perception. Trends in Neurosciences 26: 100-107.
10. Theunissen FE, Amin N, Shaevitz SS, Woolley SMN, Fremouw T, et al. (2004) Song selectivity in the song system and in the auditory forebrain. Behavioral Neurobiology of Birdsong 1016: 222-245.
11. DeWitt I, Rauschecker JP, (2012) Phoneme and word recognition in the auditory ventral stream. Proceedings of the National Academy of Sciences of the United States of America 109: E505-E514.
12. Lewicki MS, Arthur BJ, (1996) Hierarchical organization of auditory temporal context sensitivity. Journal of Neuroscience 16: 6987-6998.
13. Fee MS, Kozhevnikov AA, Hahnloser RHR, (2004) Neural mechanisms of vocal sequence generation in the songbird. Ann N Y Acad Sci 1016: 153-170.
14. Yildiz IB, Kiebel SJ, (2011) A Hierarchical Neuronal Model for Generation and Online Recognition of Birdsongs. Plos Computational Biology 7 (12) (): e1002303.
15. Friston K, Kiebel S, (2009) Predictive coding under the free-energy principle. Philosophical Transactions of the Royal Society B-Biological Sciences 364: 1211-1221.
16. Bilmes JA, (2006) What HMMs can do. Ieice Transactions on Information and Systems E89d: 869-891.
17. Mohamed AR, Dahl GE, Hinton G, (2012) Acoustic Modeling Using Deep Belief Networks. IEEE Transactions on Audio Speech and Language Processing 20: 14-22.
18. Verstraeten D, Schrauwen B, Stroobandt D, (2006) Reservoir-based techniques for speech recognition. 2006 Ieee International Joint Conference on Neural Network Proceedings Vols 1-10: 1050-1053.
19. Mcclelland JL, Elman JL, (1986) The Trace Model of Speech-Perception. Cognitive Psychology 18: 1-86.
20. Norris D, (1994) Shortlist- A Connectionist Model of Continuous Speech Recognition. Cognition 52: 189-234.
21. Norris D, McQueen JM, (2008) Shortlist B: A Bayesian model of continuous speech recognition. Psychological Review 115: 357-395.
22. Hahnloser RHR, Kozhevnikov AA, Fee MS, (2002) An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature 419: 65-70.
23. Yu AC, Margoliash D, (1996) Temporal hierarchical control of singing in birds. Science 273: 1871-1875.
24. Rabinovich MI, Varona P, Selverston AI, Abarbanel HDI, (2006) Dynamical principles in neuroscience. Reviews of Modern Physics 78: 1213-1265.
25. Barton B, Venezia JH, Saberi K, Hickok G, Brewer AA, (2012) Orthogonal acoustic dimensions define auditory field maps in human cortex. Proceedings of the National Academy of Sciences 109 (50) (): 20738-20743.
26. Afraimovich VS, Rabinovich MI, Varona P, (2004) Heteroclinic contours in neural ensembles and the winnerless competition principle. International Journal of Bifurcation and Chaos 14: 1195-1208.
27. Rabinovich M, Volkovskii A, Lecanda P, Huerta R, Abarbanel HD, et al. (2001) Dynamical encoding by networks of competing neuron groups: winnerless competition. Physical Review Letters 87: 068102.
28. Varona P, Rabinovich MI, Selverston AI, Arshavsky YI, (2002) Winnerless competition between sensory neurons generates chaos: A possible mechanism for molluscan hunting behavior. Chaos 12: 672-677.
29. Afraimovich VS, Zhigulin VP, Rabinovich MI, (2004) On the origin of reproducible sequential activity in neural circuits. Chaos 14: 1123-1129.
30. Rabinovich MI, Huerta R, Varona P, Afraimovich VS, (2008) Transient cognitive dynamics, metastability, and decision making. Plos Computational Biology 4 (5) (): e1000072.
31. Fukai T, Tanaka S, (1997) A simple neural network exhibiting selective activation of neuronal ensembles: From winner-take-all to winners-share-all. Neural Computation 9: 77-97.
32. Hopfield JJ, (1982) Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proc Natl Acad Sci U S A 79: 2554-2558.
33. Zheng PS, Tang WS, Zhang JX, (2010) Efficient Continuous-Time Asymmetric Hopfield Networks for Memory Retrieval. Neural Computation 22: 1597-1614.
34. Robles L, Ruggero MA, (2001) Mechanics of the mammalian cochlea. Physiological Reviews 81: 1305-1352.
35. Lyon RF, (1982) A Computational Model of Filtering, Detection, and Compression in the Cochlea. Proceedings IEEE International Conference on Acoustics, Speech, and Signal Processing 7: 1282-1285.
36. Vanimmerseel LM, Martens JP, (1992) Pitch and Voiced Unvoiced Determination with an Auditory Model. Journal of the Acoustical Society of America 91: 3511-3526.
37. Givelberg E, Bunn J, (2003) A comprehensive three-dimensional model of the cochlea. Journal of Computational Physics 191: 377-391.
38. Beyer RP, (1992) A Computational Model of the Cochlea Using the Immersed Boundary Method. Journal of Computational Physics 98: 145-162.
39. Patterson RD, Allerhand MH, Giguere C, (1995) Time-Domain Modeling of Peripheral Auditory Processing- a Modular Architecture and a Software Platform. Journal of the Acoustical Society of America 98: 1890-1894.
40. Sumner CJ, Lopez-Poveda EA, O'Mard LP, Meddis R, (2002) A revised model of the inner-hair cell and auditory-nerve complex. Journal of the Acoustical Society of America 111: 2178-2188.
41. Slaney M (1998) Auditory Toolbox. Interval Research Corporation, Palo Alto, CA.
42. Friston KJ, Trujillo-Barreto N, Daunizeau J, (2008) DEM: A variational treatment of dynamic systems. Neuroimage 41: 849-885.
43. Friston K, (2008) Hierarchical Models in the Brain. Plos Computational Biology 4: e1000211 doi:1000210.1001371/journal.pcbi.1000211.
44. Mumford D, (1992) ON THE COMPUTATIONAL ARCHITECTURE OF THE NEOCORTEX. 2. THE ROLE OF CORTICOCORTICAL LOOPS. Biological Cybernetics 66: 241-251.
45. Fiser J, Berkes P, Orban G, Lengyel M, (2010) Statistically optimal perception and learning: from behavior to neural representations. Trends in Cognitive Sciences 14: 119-130.
46. Friston K, (2005) A theory of cortical responses. Philosophical Transactions of the Royal Society B-Biological Sciences 360: 815-836.
47. Bitzer S, Kiebel SJ, (2012) Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks. Biological Cybernetics 106: 201-217.
48. Beauchemin M, Gonzalez-Frankenberger B, Tremblay J, Vannasing P, Martinez-Montes E, et al. (2011) Mother and Stranger: An Electrophysiological Study of Voice Processing in Newborns. Cerebral cortex 21: 1705-1711.
49. Kuhl PK, (2000) A new view of language acquisition. Proceedings of the National Academy of Sciences of the United States of America 97: 11850-11857.
50. Hopfield IJ, Brody CD, (2000) What is a moment? "Cortical" sensory integration over a brief interval. Proceedings of the National Academy of Sciences of the United States of America 97: 13919-13924.
51. Verstraeten D, Schrauwen B, Stroobandt D, Van Campenhout J, (2005) Isolated word recognition with the Liquid State Machine: a case study. Information Processing Letters 95: 521-528.
52. Adank P, Devlin JT, (2010) On-line plasticity in spoken sentence comprehension: Adapting to time-compressed speech. Neuroimage 49: 1124-1132.
53. Miller JL, Grosjean F, Lomanto C, (1984) Articulation Rate and Its Variability in Spontaneous Speech- a Reanalysis and Some Implications. Phonetica 41: 215-225.
54. Gutig R, Sompolinsky H, (2009) Time-warp-invariant neuronal processing. Plos Biology 7: e1000141.
55. Hemmen JL, Sejnowski TJ (2006) How is time represented in the brain? Oxford; New York: Oxford University Press. xvi, 514 p. p.
56. Bronkhorst AW, (2000) The cocktail party phenomenon: A review of research on speech intelligibility in multiple-talker conditions. Acustica 86: 117-128.
57. Cherry EC, (1953) Some Experiments on the Recognition of Speech, with One and with 2 Ears. Journal of the Acoustical Society of America 25: 975-979.
58. McDermott JH, (2009) The cocktail party problem. Current Biology 19: R1024-R1027.
59. Mesgarani N, Chang EF, (2012) Selective cortical representation of attended speaker in multi-talker speech perception. Nature 485: 233-U118.
60. Munro MJ, Derwing TM, (1995) Foreign Accent, Comprehensibility, and Intelligibility in the Speech of 2nd-Language Learners. Language Learning 45: 73-97.
61. Munro MJ, Derwing TM, (1995) Processing time, accent, and comprehensibility in the perception of native and foreign-accented speech. Language and Speech 38: 289-306.
62. Bradlow AR, Bent T, (2008) Perceptual adaptation to non-native speech. Cognition 106: 707-729.
63. Clarke CM, Garrett MF, (2004) Rapid adaptation to foreign-accented English. Journal of the Acoustical Society of America 116: 3647-3658.
64. Birdsong D (1999) Second language acquisition and the critical period hypothesis. Mahwah, N.J.: Erlbaum. ix, 191 p. p.
65. Singleton DM, Ryan L (2004) Language acquisition: the age factor. Clevedon; Buffalo: Multilingual Matters. viii, 289 p. p.
66. Mayo LH, Florentine M, Buus S, (1997) Age of second-language acquisition and perception of speech in noise. Journal of Speech Language and Hearing Research 40: 686-693.
67. Meador D, Flege JE, Mackay IRA, (2000) Factors affecting the recognition of words in a second language. Bilingualism: Language and Cognition 3: 55-67.
68. Jia G, Strange W, Wu Y, Collado J, Guan Q, (2006) Perception and production of English vowels by Mandarin speakers: Age-related differences vary with amount of L2 exposure. The Journal of the Acoustical Society of America 119: 1118.
69. Best CT, Tyler MD, (2007) Nonnative and second-language speech perception: Commonalities and complementarities. Language experience in second language speech learning: In honor of James Emil Flege pp. 13-34.
70. Flege J, MacKay I, Imai S, (2010) What accounts for "age" effects on overall degree foreign accent? Wrembel, M Kul and K DziubalskaKolaczyk (eds) Achievements and Perspectives in SLA of Speech: New Sounds 2: 65.
71. Flege JE, MacKay IR, (2004) Perceiving vowels in a second language. Studies in second language acquisition 26: 1-34.
72. Okanoya K, Merker B (2006) Neural substrates for string-context mutual segmentation: a path to human language. In: Nehaniv CL, Cangelosi A, Lyon C, editors. Emergence of Communication and Language: Springer-Verlag. pp. 421-434.
73. Price CJ, (2010) The anatomy of language: a review of 100 fMRI studies published in 2009. Year in Cognitive Neuroscience 2010 1191: 62-88.
74. Abeles M (1982) Local Cortical Circuits: An Electrophysiological study: Springer, Berlin.
75. Long MA, Jin DZZ, Fee MS, (2010) Support for a synaptic chain model of neuronal sequence generation. Nature 468: 394-399.
76. MacDonald CJ, Lepage KQ, Eden UT, Eichenbaum H, (2011) Hippocampal "Time Cells" Bridge the Gap in Memory for Discontiguous Events. Neuron 71: 737-749.
77. Prut Y, Vaadia E, Bergman H, Haalman I, Slovin H, et al. (1998) Spatiotemporal structure of cortical activity: Properties and behavioral relevance. Journal of Neurophysiology 79: 2857-2874.
78. Pulvermuller F, Shtyrov Y, (2009) Spatiotemporal Signatures of Large-Scale Synfire Chains for Speech Processing as Revealed by MEG. Cerebral cortex 19: 79-88.
79. Amador A, Sanz Perl Y, Mindlin GB, Margoliash D, (2013) Elemental gesture dynamics are encoded by song premotor cortical neurons. Nature 495: 59-64.
80. Laje R, Gardner TJ, Mindlin GB, (2002) Neuromuscular control of vocalizations in birdsong: A model. Physical Review E 65 (5; PART 1): 051921-051921.
81. Gaskell MG, Marslen-Wilson WD, (1997) Integrating form and meaning: A distributed model of speech perception. Language and Cognitive Processes 12: 613-656.
82. Kroger BJ, Kannampuzha J, Neuschaefer-Rube C, (2009) Towards a neurocomputational model of speech production and perception. Speech Communication 51: 793-809.
83. Luce PA, Goldinger SD, Auer ET, Vitevitch MS, (2000) Phonetic priming, neighborhood activation, and PARSYN. Perception & Psychophysics 62: 615-625.
84. Grossberg S, (2003) Resonant neural dynamics of speech perception. Journal of Phonetics 31: 423-445.
85. Elhilali M, Shamma SA, (2008) A cocktail party with a cortical twist: How cortical mechanisms contribute to sound segregation. Journal of the Acoustical Society of America 124: 3751-3771.
86. Kawamoto AH, (1993) NONLINEAR DYNAMICS IN THE RESOLUTION OF LEXICAL AMBIGUITY- A PARALLEL DISTRIBUTED-PROCESSING ACCOUNT. Journal of Memory and Language 32: 474-516.
87. Seidenberg MS, McClelland JL, (1989) A DISTRIBUTED, DEVELOPMENTAL MODEL OF WORD RECOGNITION AND NAMING. Psychological Review 96: 523-568.
88. McClelland JL, Mirman D, Holt LL, (2006) Are there interactive processes in speech perception? Trends in Cognitive Sciences 10: 363-369.
89. Schrauwen B, Buesing L, (2009) A hierarchy of recurrent networks for speech recognition.
90. Jaegera H, Lukosevicius M, Popovici D, Siewert U, (2007) Optimization and applications of echo state networks with leaky-integrator neurons. Neural Networks 20: 335-352.
91. Buonomano DV, Maass W, (2009) State-dependent computations: spatiotemporal processing in cortical networks. Nature Reviews Neuroscience 10: 113-125.
92. Maass W, Natschlager T, Markram H, (2002) Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation 14: 2531-2560.
93. Herrero JL, Roberts MJ, Delicato LS, Gieselmann MA, Dayan P, et al. (2008) Acetylcholine contributes through muscarinic receptors to attentional modulation in V1. Nature 454: 1110-1114.
94. Hirayama J, Yoshimoto J, Ishii S, (2004) Bayesian representation learning in the cortex regulated by acetylcholine. Neural Networks 17: 1391-1400.
95. Yu AJ, Dayan P (2003) Expected and unexpected uncertainty: ACh and NE in the neocortex. Advances in Neural Information Processing Systems 15MIT Press, Cambridge, MA.
96. Hasselmo ME, McGaughy J, (2004) High acetylcholine levels set circuit dynamics for attention and encoding and low acetylcholine levels set dynamics for consolidation. Acetylcholine in the Cerebral Cortex 145: 207-231.
97. Poeppel D, Emmorey K, Hickok G, Pylkkanen L, (2012) Towards a New Neurobiology of Language. Journal of Neuroscience 32: 14125-14131.
98. Gagnepain P, Henson RN, Davis MH, (2012) Temporal Predictive Codes for Spoken Words in Auditory Cortex. Current Biology 22: 615-621.
99. Friston KJ, Harrison L, Penny W, (2003) Dynamic causal modelling. Neuroimage 19: 1273-1302.
100. Kiebel SJ, Garrido MI, Moran R, Chen CC, Friston KJ, (2009) Dynamic Causal Modeling for EEG and MEG. Human Brain Mapping 30: 1866-1876.
101. Wacongne C, Labyt E, van Wassenhove V, Bekinschtein T, Naccache L, et al. (2011) Evidence for a hierarchy of predictions and prediction errors in human cortex. Proceedings of the National Academy of Sciences of the United States of America 108: 20754-20759.
102. Friesen LM, Shannon RV, Baskent D, Wang X, (2001) Speech recognition in noise as a function of the number of spectral channels: Comparison of acoustic hearing and cochlear implants. Journal of the Acoustical Society of America 110: 1150-1163.
103. Zavaglia M, Canolty RT, Schofield TM, Leff AP, Ursino M, et al. (2012) A dynamical pattern recognition model of gamma activity in auditory cortex. Neural Networks 28: 1-14.
104. Hanuschkin A, Diesmann M, Morrison A, (2011) A reafferent and feed-forward model of song syntax generation in the Bengalese finch. Journal of Computational Neuroscience 31: 509-532.
105. Kiebel SJ, von Kriegstein K, Daunizeau J, Friston KJ, (2009) Recognizing Sequences of Sequences. Plos Computational Biology 5 (8) (): e1000464.
106. Perdikis D, Huys R, Jirsa VK, (2011) Time Scale Hierarchies in the Functional Organization of Complex Behaviors. Plos Computational Biology 7 (9) (): e1002198.
107. Beim Graben PPR. (2012) A dynamic field account to language-related brain potentials. In: Rabinovich MI, Friston KJ, Varona P, editors. Principles of Brain Dynamics: Global State Interactions, MIT Press, Cambridge (MA).
108. Winkler I, Denham S, Mill R, Bohm TM, Bendixen A, (2012) Multistability in auditory stream segregation: a predictive coding view. Philosophical Transactions of the Royal Society B-Biological Sciences 367: 1001-1012.
109. Feldman H, Friston KJ, (2010) Attention, uncertainty, and free-energy. Frontiers in Human Neuroscience 4: 215.
110. Friston K, (2008) Hierarchical models in the brain. PLoS Comput Biol 4: e1000211.
111. Graves A, Eck D, Beringer N, Schmidhuber J, (2004) Biologically plausible speech recognition with LSTM neural nets. Biologically Inspired Approaches to Advanced Information Technology 3141: 127-136.