Reinforcement learning of recurrent neural network for temporal coding

Neurocomputing

Volumn 71, Issue 16-18, 2008, Pages 3379-3386

  Kimura, Daichi ^a   Hayakawa, Yoshinori ^a  

^a TOHOKU UNIVERSITY   (Japan)

Author keywords

Hodgkin Huxley neuron; Order coding; Phase coding; Reinforcement learning; Temporal coding

Indexed keywords

EDUCATION; IMAGE CLASSIFICATION; MILITARY OPERATIONS; NEURONS; PROGRAMMING THEORY; RECURRENT NEURAL NETWORKS; REINFORCEMENT; REINFORCEMENT LEARNING; TIME MEASUREMENT; VEGETATION;

HODGKIN-HUXLEY NEURON; LEARNING EFFICIENCIES; LEARNING RULES; NEURONAL FIRINGS; ORDER CODING; PHASE CODING; PHASE DIFFERENCES; SPIKING NEURONS; SYSTEM SIZE DEPENDENCES; TEMPORAL CODING;

NEURAL NETWORKS;

ARTIFICIAL NEURAL NETWORK; CONFERENCE PAPER; CONTROLLED STUDY; HODGKIN HUXLEY EQUATION; INFORMATION PROCESSING; LEARNING; NEUROTRANSMISSION; PRIORITY JOURNAL; REINFORCEMENT; STOCHASTIC MODEL; SYNAPTIC TRANSMISSION;

EID: 56549089270     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2007.11.014     Document Type: Conference Paper

References (28)

1. T. Aoyagi Network of neural oscillators for retrieving phase information Phys. Rev. Lett. 74 1995 4075
2. G.-q. Bi, and M.-m. Poo Distributed synaptic modification in neural networks induced by patterned stimulation Nature 401 1999 792
3. K.J. Cios, W. Swiercz, and W. Jackson Networks of spiking neurons in modeling and problem solving Neurocomputing 61 2004 99
4. A. Delorme, and S.J. Thorpe Face identification using one spike per neuron: resistance to image degradations Neural Networks 14 2001 795
5. A. Destexhe, Z.F. Mainen, and T.J. Seijnowski An efficient method for computing synaptic conductances based on a kinetic model of receptor binding Neural Comput. 6 1994 14
6. I.R. Fiete, and H.S. Seung Gradient learning in spiking neural networks by dynamic perturbation of conductances Phys. Rev. Lett. 97 2006 048104
7. C.M. Gray, P. König, A.K. Engel, and W. Singer Oscillatory responses in cat visual-cortex exhibit inter-columnar synchronization which reflects global stimulus properties Nature 338 1989 334
8. H. Hasegawa An associative memory of Hodgkin Huxley neuron networks with Willshaw-type synaptic couplings J. Phys. Soc. Jpn. 70 2001 2210
9. Y. Hayakawa Reinforcement learning for stochastic neural networks Proceedings of 2001 International Symposium on Nonlinear Theory and its Applications vol. 2 2001 493
10. A.L. Hodgkin, and A.F. Huxley A quantitative description of membrane current and its application to conduction and excitation in nerve J. Physiol. (London) 117 1952 500
11. F.C. Hoppensteadt, and E.M. Izhikevich Oscillatory neurocomputers with dynamic connectivity Phys. Rev. Lett. 82 1999 2983
12. R.S. Johansson, and I. Birznieks First spikes in ensembles of human tactile afferents code complex spatial fingertip events Nat. Neurosci. 7 2004 179
13. T. Kanamaru, and Y. Okabe Associative memory retrieval induced by fluctuations in a pulsed neural network Phys. Rev. E 62 2000 2629
14. L.F. Lago-Fernández, R. Huerta, F. Corbacho, and J.A. Sigüenza Fast response and temporal coherent oscillations in small-world networks Phys. Rev. Lett. 84 2000 2758
15. G. Lee, and N.H. Farhat The bifurcating neuron network 1 Neural Networks 14 2001 115
16. G. Lee, and N.H. Farhat The bifurcating neuron network 2: an analog associative memory Neural Networks 15 2002 69
17. A.D. Reyes Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro Nat. Neurosci. 6 2003 593
18. A. Roxin, H. Riecke, and S.A. Solla Self-sustained activity in a small-world network of excitable neurons Phys. Rev. Lett. 92 2004 198101
19. D.E. Rumelhart, G.E. Hinton, and R.J. Williams Learning representations by back-propagating errors Nature 323 1986 533
20. H.S. Seung Learning in spiking neural networks by reinforcement of stochastic synaptic transmission Neuron 40 2003 1063
21. D. Simard, L. Nadeau, and H. Kröger Fastest learning in small-world neural networks Phys. Lett. A 336 2005 8
22. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 MIT Press Cambridge, MA
23. S. Thorpe, A. Delorme, and R.V. Rullen Spike-based strategies for rapid processing Neural Networks 14 2001 715
24. F. Varela, J.P. Lachaux, E. Rodriguez, and J. Martinerie The brainweb: phase synchronization and large-scale integration Nat. Rev. Neurosci. 2 2001 229
25. D.J. Watts, and S.H. Strogatz Collective dynamics of 'small-world' networks Nature 393 1998 440
26. R.J. Williams, and D. Zipser A learning algorithm for continually running fully recurrent neural networks Neural Comput. 1 1989 270
27. X. Xie, and H.S. Seung Learning in neural networks by reinforcement of irregular spiking Phys. Rev. E 69 2004 041909
28. M. Yoshioka, and M. Shiino Associative memory based on synchronized firing of spiking neurons with time-delayed interactions Phys. Rev. E 58 1998 3628