Recognizing sequences of sequences

PLoS Computational Biology

Volumn 5, Issue 8, 2009, Pages

  Kiebel, Stefan J ^a,b   Von Kriegstein, Katharina ^a,b   Daunizeau, Jean ^a   Friston, Karl J ^a  

^a WELLCOME TRUST CENTRE FOR NEUROIMAGING   (United Kingdom)

^b MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMICS; SPEECH RECOGNITION;

ARTIFICIAL AGENTS; BAYESIAN FRAMEWORKS; BRAIN DECODING; CONTINUOUS DYNAMICS; GENERATIVE MODEL; INTERNAL MODELS; ON-LINE RECOGNITION; ROBUST SPEECH RECOGNITION; SENSORY INPUT; SPEECH RECOGNITION SYSTEMS;

DECODING;

ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATIC SPEECH RECOGNITION; BAYES THEOREM; INFORMATION PROCESSING; ONLINE SYSTEM; PHONEME; COMPUTER SIMULATION; NERVE CELL NETWORK; PATTERN RECOGNITION; THEORETICAL MODEL; THERMODYNAMICS;

BAYES THEOREM; COMPUTER SIMULATION; MODELS, THEORETICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, PHYSIOLOGICAL; SPEECH RECOGNITION SOFTWARE; THERMODYNAMICS;

EID: 70049088829     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1000464     Document Type: Article

References (93)

1. Poeppel D, Idsardi WJ, van WV (2008) Speech perception at the interface of neurobiology and linguistics. PhilosTransRSocLond B BiolSci 363: 1071-1086. (Pubitemid 351158935)
2. Zatorre RJ, Belin P, Penhune VB (2002) Structure and function of auditory cortex: music and speech. Trends Cogn Sci 6: 37-46. (Pubitemid 34081845)
3. Simon D, Craig KD, Miltner WH, Rainville P (2006) Brain responses to dynamic facial expressions of pain. Pain 126: 309-318. (Pubitemid 44751979)
4. Thompson JC, Hardee JE, Panayiotou A, Crewther D, Puce A (2007) Common and distinct brain activation to viewing dynamic sequences of face and hand movements. Neuroimage 37: 966-973. (Pubitemid 47248320)
5. Deng L, Yu D, Acero A (2006) Structured speech modeling. Ieee Transactions on Audio Speech and Language Processing 14: 1492-1504.
6. Kiebel SJ, Daunizeau J, Friston KJ (2008) A hierarchy of time-scales and the brain. PLoS ComputBiol 4: e1000209.
7. Long MA, Fee MS (2008) Using temperature to analyse temporal dynamics in the songbird motor pathway. Nature 456: 189-194.
8. Sen K, Theunissen FE, Doupe AJ (2001) Feature analysis of natural sounds in the songbird auditory forebrain. JNeurophysiol 86: 1445-1458. (Pubitemid 32847788)
9. Davis MH, Johnsrude IS (2003) Hierarchical processing in spoken language comprehension. JNeurosci 23: 3423-3431. (Pubitemid 36531984)
10. Giraud AL, Lorenzi C, Ashburner J, Wable J, Johnsrude I, et al. (2000) Representation of the temporal envelope of sounds in the human brain. JNeurophysiol 84: 1588-1598. (Pubitemid 30688179)
11. Overath T, Kumar S, von Kriegstein K, Griffiths TD (2008) Encoding of spectral correlation over time in auditory cortex. JNeurosci 28: 13268-13273.
12. von Kriegstein K, Patterson RD, Griffiths TD (2008) Task-dependent modulation of medial geniculate body is behaviorally relevant for speech recognition. CurrBiol 18: 1855-1859.
13. Wolpert DM, Ghahramani Z, Jordan MI (1995) An internal model for sensorimotor integration. Science 269: 1880-1882.
14. Kersten D, Mamassian P, Yuille A (2004) Object perception as Bayesian inference. Annual Review of Psychology 55: 271-304.
15. Yuille A, Kersten D (2006) Vision as Bayesian inference: analysis by synthesis? Trends in Cognitive Sciences 10: 301-308.
16. Lee TS, Mumford D (2003) Hierarchical Bayesian inference in the visual cortex. Journal of the Optical Society of America a-Optics Image Science and Vision 20: 1434-1448.
17. Kording KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427: 244-247.
18. Friston K, Kilner J, Harrison L (2006) A free energy principle for the brain. JPhysiol Paris 100: 70-87.
19. Rabinovich M, Huerta R, Laurent G (2008) Neuroscience - Transient dynamics for neural processing. Science 321: 48-50. (Pubitemid 351956234)
20. Friston K (2008) Hierarchical models in the brain. PLoS ComputBiol 4: e1000211.
21. Fukai T, Tanaka S (1997) A simple neural network exhibiting selective activation of neuronal ensembles: from winner-take-all to winners-share-all. Neural Comput 9: 77-97. (Pubitemid 127622527)
22. Rabinovich MI, Varona P, Selverston AI, Abarbanel HDI (2006) Dynamical principles in neuroscience. Reviews of Modern Physics 78: 1213-1265.
23. Rabinovich MI, Huerta R, Varona P, Afraimovich VS (2008) Transient cognitive dynamics, metastability, and decision making. Plos Computational Biology 4. (Pubitemid 351811559)
24. Afraimovich VS, Zhigulin VP, Rabinovich MI (2004) On the origin of reproducible sequential activity in neural circuits. Chaos 14: 1123-1129. (Pubitemid 40382397)
25. Rabinovich M, Volkovskii A, Lecanda P, Huerta R, Abarbanel HDI, et al. (2001) Dynamical encoding by networks of competing neuron groups: Winnerless competition. Physical Review Letters 8706.
26. Friston KJ (1997) Transients, metastability, and neuronal dynamics. Neuroimage 5: 164-171.
27. Varona P, Rabinovich MI, Selverston AI, Arshavsky YI (2002) Winnerless competition between sensory neurons generates chaos: A possible mechanism for molluscan hunting behavior. Chaos 12: 672-677.
28. Afraimovich VS, Rabinovich MI, Varona P (2004) Heteroclinic contours in neural ensembles and the winnerless competition principle. International Journal of Bifurcation and Chaos 14: 1195-1208.
29. Breakspear M, Terry JR, Friston KJ (2003) Modulation of excitatory synaptic coupling facilitates synchronization and complex dynamics in a nonlinear model of neuronal dynamics. Neurocomputing 52-4: 151-158. (Pubitemid 36700509)
30. Durstewitz D, Deco G (2008) Computational significance of transient dynamics in cortical networks. European Journal of Neuroscience 27: 217-227.
31. Buonomano DV, Maass W (2009) State-dependent computations: spatiotemporal processing in cortical networks. NatRevNeurosci 10: 113-125.
32. Ivanchenko MV, Nowotny T, Selverston AI, Rabinovich MI (2008) Pacemaker and network mechanisms of rhythm generation: Cooperation and competition. Journal of Theoretical Biology 253: 452-461.
33. Beal MJ (2003) Variational algorithms for approximate Bayesian inference [PhD]: University of London.
34. Friston KJ, Trujillo-Barreto N, Daunizeau J (2008) DEM: a variational treatment of dynamic systems. Neuroimage 41: 849-885.
35. Friston K (2005) A theory of cortical responses. Philosophical Transactions of the Royal Society B-Biological Sciences 360: 815-836.
36. Creutzfeldt O, Hellweg FC, Schreiner C (1980) Thalamocortical Transformation of Responses to Complex Auditory-Stimuli. Experimental Brain Research 39: 87-104. (Pubitemid 10122722)
37. Wang X, Lu T, Bendor D, Bartlett E (2008) Neural coding of temporal information in auditory thalamus and cortex. Neuroscience 154: 294-303. (Pubitemid 351794406)
38. Nahum M, Nelken I, Ahissar M (2008) Low-level information and high-level perception: The case of speech in noise. Plos Biology 6: 978-991. (Pubitemid 351824736)
39. Holmberg M, Gelbart D, Hemmert W (2007) Speech encoding in a model of peripheral auditory processing: Quantitative assessment by means of automatic speech recognition. Speech Communication 49: 917-932. (Pubitemid 47488514)
40. Sumner CJ, Lopez-Poveda EA, O'Mard LP, Meddis R (2002) A revised model of the inner-hair cell and auditory-nerve complex. Journal of the Acoustical Society of America 111: 2178-2188.
41. Dehaene-Lambertz G, Dupoux E, Gout A (2000) Electrophysiological correlates of phonological processing: A cross-linguistic study. Journal of Cognitive Neuroscience 12: 635-647. (Pubitemid 30609389)
42. Eulitz C, Lahiri A (2004) Neurobiological evidence for abstract phonological representations in the mental lexicon during speech recognition. Journal of Cognitive Neuroscience 16: 577-583. (Pubitemid 38639605)
43. Friedrich M, Friederici AD (2005) Phonotactic knowledge and lexical-semantic processing in one-year-olds: Brain responses to words and nonsense words in picture contexts. Journal of Cognitive Neuroscience 17: 1785-1802.
44. Friederici AD (2002) Towards a neural basis of auditory sentence processing. Trends in Cognitive Sciences 6: 78-84. (Pubitemid 34119178)
45. Lau EF, Phillips C, Poeppel D (2008) A cortical network for semantics: (de)constructing the N400. Nature Reviews Neuroscience 9: 920-933.
46. Friedman D, Cycowicz YM, Gaeta H (2001) The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty. Neuroscience and Biobehavioral Reviews 25: 355-373. (Pubitemid 32624376)
47. Foulke E, Sticht TG (1969) Review of Research on Intelligibility and Comprehension of Accelerated Speech. Psychological Bulletin 72: 50-&.
48. Versfeld NJ, Dreschler WA (2002) The relationship between the intelligibility of time-compressed speech and speech in noise in young and elderly listeners. Journal of the Acoustical Society of America 111: 401-408. (Pubitemid 34093334)
49. Pisoni DB (1993) Long-Term-Memory in Speech-Perception - Some New Findings on Talker Variability, Speaking Rate and Perceptual-Learning. Speech Communication 13: 109-125.
50. Vaughan N, Storzbach D, Furukawa I (2006) Sequencing versus nonsequencing working memory in understanding of rapid speech by older listeners. Journal of the American Academy of Audiology 17: 506-518. (Pubitemid 44822770)
51. Budhiraja A, Chen LJ, Lee C (2007) A survey of numerical methods for nonlinear filtering problems. Physica D-Nonlinear Phenomena 230: 27-36. (Pubitemid 46776906)
52. Judd K, Smith LA (2004) Indistinguishable states II - The imperfect model scenario. Physica D-Nonlinear Phenomena 196: 224-242.
53. Nowak MA, Krakauer DC, Dress A (1999) An error limit for the evolution of language. ProcBiolSci 266: 2131-2136.
54. Kumar S, Stephan KE,Warren JD, Friston KJ, Griffiths TD (2007) Hierarchical processing of auditory objects in humans. PLoSComputBiol 3: e100. (Pubitemid 47015834)
55. Boemio A, Fromm S, Braun A, Poeppel D (2005) Hierarchical and asymmetric temporal sensitivity in human auditory cortices. NatNeurosci 8: 389-395. (Pubitemid 40300197)
56. Denham SL, Winkler I (2006) The role of predictive models in the formation of auditory streams. Journal of Physiology-Paris 100: 154-170.
57. Badre D (2008) Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends Cogn Sci.
58. Botvinick MM (2008) Hierarchical models of behavior and prefrontal function. Trends Cogn Sci.
59. Koechlin E, Summerfield C (2007) An information theoretical approach to prefrontal executive function. Trends Cogn Sci 11: 229-235. (Pubitemid 46809561)
60. Todorov E, Li W, Pan X (2005) From task parameters to motor synergies: A hierarchical framework for approximately-optimal control of redundant manipulators. JRobotSyst 22: 691-710.
61. Chechik G, Anderson MJ, Bar-Yosef O, Young ED, Tishby N, et al. (2006) Reduction of information redundancy in the ascending auditory pathway. Neuron 51: 359-368. (Pubitemid 44118713)
62. Nelken I (2008) Processing of complex sounds in the auditory system. Current Opinion in Neurobiology 18: 413-417.
63. Nunez PL, Silberstein RB (2000) On the relationship of synaptic activity to macroscopic measurements: Does co-registration of EEG with fMRI make sense? Brain Topography 13: 79-96.
64. Garrido MI, Friston KJ, Kiebel SJ, Stephan KE, Baldeweg T, et al. (2008) The functional anatomy of the MMN: A DCM study of the roving paradigm. Neuroimage 42: 936-944.
65. Maess B, Herrmann CS, Hahne A, Nakamura A, Friederici AD (2006) Localizing the distributed language network responsible for the N400 measured by MEG during auditory sentence processing. Brain Research 1096: 163-172. (Pubitemid 43928916)
66. Van Petten C, Luka BJ (2006) Neural localization of semantic context effects in electromagnetic and hemodynamic studies. Brain and Language 97: 279-293.
67. Marslen-Wilson WD, Bouma H, Bouwhuis D (1984) Function and process in spoken word recognition. Attention and Performance X: Control of Language Processes 125-150, Hillsdale, N.J.: Erlbaum.
68. McClelland JL, Elman JL (1986) The Trace Model of Speech-Perception. Cognitive Psychology 18: 1-86.
69. Norris D (1994) Shortlist - A Connectionist Model of Continuous Speech Recognition. Cognition 52: 189-234.
70. Norris D, McQueen JM (2008) Shortlist B: A Bayesian model of continuous speech recognition. Psychological Review 115: 357-395.
71. Botvinick MM, Plaut DC (2006) Short-term memory for serial order: a recurrent neural network model. PsycholRev 113: 201-233. (Pubitemid 43815196)
72. Broome BM, Jayaraman V, Laurent G (2006) Encoding and decoding of overlapping odor sequences. Neuron 51: 467-482. (Pubitemid 44189805)
73. Davis MH, Johnsrude IS (2007) Hearing speech sounds: top-down influences on the interface between audition and speech perception. HearRes 229: 132-147.
74. Fee MS, Kozhevnikov AA, Hahnloser RH (2004) Neural mechanisms of vocal sequence generation in the songbird. AnnNYAcadSci 1016: 153-170. (Pubitemid 38951465)
75. Ji D, Wilson MA (2008) Firing rate dynamics in the hippocampus induced by trajectory learning. JNeurosci 28: 4679-4689.
76. Koechlin E, Jubault T (2006) Broca's area and the hierarchical organization of human behavior. Neuron 50: 963-974. (Pubitemid 43850692)
77. Kumaran D, Maguire EA (2007) Match mismatch processes underlie human hippocampal responses to associative novelty. JNeurosci 27: 8517-8524. (Pubitemid 47254262)
78. Nadasdy Z, Hirase H, Czurko A, Csicsvari J, Buzsaki G (1999) Replay and time compression of recurring spike sequences in the hippocampus. JNeurosci 19: 9497-9507. (Pubitemid 30228101)
79. Redcay E (2008) The superior temporal sulcus performs a common function for social and speech perception: implications for the emergence of autism. NeurosciBiobehavRev 32: 123-142.
80. Berns GS, Sejnowski TJ (1998) A computational model of how the basal ganglia produce sequences. Journal of Cognitive Neuroscience 10: 108-121.
81. Elman JL (1990) Finding Structure in Time. Cognitive Science 14: 179-211.
82. Jensen O, Lisman JE (1996) Theta/gamma networks with slow NMDA channels learn sequences and encode episodic memory: Role of NMDA channels in recall. Learning & Memory 3: 264-278. (Pubitemid 26357751)
83. Kulvicius T, Porr B, Worgotter F (2007) Chained learning architectures in a simple closed-loop behavioural context. Biological Cybernetics 97: 363-378.
84. Namikawa J, Tani J (2008) A model for learning to segment temporal sequences, utilizing a mixture of RNN experts together with adaptive variance. Neural Netw 21: 1466-1475.
85. Tani J (2003) Learning to generate articulated behavior through the bottom-up and the top-down interaction processes. Neural Netw 16: 11-23.
86. Wyss R, Konig P, Verschure PFMJ (2006) A model of the ventral visual system based on temporal stability and local memory. Plos Biology 4: 836-843. (Pubitemid 43748230)
87. Cleeremans A, McClelland JL (1991) Learning the Structure of Event Sequences. Journal of Experimental Psychology-General 120: 235-253.
88. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Computation 9: 1735-1780.
89. Berniker M, Kording K (2008) Estimating the sources of motor errors for adaptation and generalization. Nature Neuroscience 11: 1454-1461.
90. Sakata JT, Brainard MS (2008) Online Contributions of Auditory Feedback to Neural Activity in Avian Song Control Circuitry. Journal of Neuroscience 28: 11378-11390.
91. Tani J (2007) On the interactions between top-down anticipation and bottom-up regression. Front Neurorobotics 1: 2.
92. Yamashita Y, Tani J (2008) Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment. Plos Computational Biology 4.
93. George D (2008) How the brain might work: A hierarchical and temporal model for learning and recognition [Ph.D.]: Stanford University.