메뉴 건너뛰기




Volumn 70, Issue 1-3, 2006, Pages 14-20

Reinforcement learning of a simple control task using the spike response model

Author keywords

Reinforcement learning; Spike response model; Spiking neuron

Indexed keywords

APPROXIMATION THEORY; FUNCTIONAL NEURAL STIMULATION; MATHEMATICAL MODELS; NEURAL NETWORKS; SET THEORY;

EID: 33750301362     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2006.07.002     Document Type: Article
Times cited : (12)

References (28)
  • 1
    • 0020970738 scopus 로고
    • Neuronlike adaptive elements that can solve difficult learning control problems
    • Andrew R.S.S., Barto G., and Anderson C.W. Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Trans. Syst. Man Cybern. SMC-13 (1983) 834-846
    • (1983) IEEE Trans. Syst. Man Cybern. , vol.SMC-13 , pp. 834-846
    • Andrew, R.S.S.1    Barto, G.2    Anderson, C.W.3
  • 2
    • 33750301425 scopus 로고    scopus 로고
    • P.L. Bartlett, J. Baxter, Hebbian synaptic modifications in spiking neurons that learn, Technical Report, Australian National University, November 1999.
  • 3
    • 33750379949 scopus 로고    scopus 로고
    • J. Baxter, P.L. Bartlett, Direct gradient-based reinforcement learning: I. gradient estimation algorithms, Technical Report, Research School of Information Sciences and Engineering, Australian National University, July 1999.
  • 4
    • 33750381008 scopus 로고    scopus 로고
    • J. Baxter, P. Bartlett, Direct gradient-based reinforcement learning: I. Gradient estimation algorithms, Technical Report, Research School of Information Sciences and Engineering, Australian National University, July 1999.
  • 5
    • 33750379514 scopus 로고    scopus 로고
    • L.W.J. Baxter, P.L. Bartlett, Direct gradient-based reinforcement learning: Ii. gradient descent algorithms and experiments, Technical Report, Research School of Information Sciences and Engineering, Australian National University, September 1999.
  • 6
    • 0036505590 scopus 로고    scopus 로고
    • S.M. Bohte, H.L. Poutré, J.N. Kok, Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks, IEEE Trans. Neural Networks 13 (2).
  • 7
    • 0036755131 scopus 로고    scopus 로고
    • A spiking neuron model: applications and learning
    • Chris Christodolou G.B., and Clarkson T.G. A spiking neuron model: applications and learning. Neural Networks 15 (2002) 891-908
    • (2002) Neural Networks , vol.15 , pp. 891-908
    • Chris Christodolou, G.B.1    Clarkson, T.G.2
  • 8
    • 0034767171 scopus 로고    scopus 로고
    • Face identification using spike per neuron: resistance to image degradations
    • Delorme A., and Thorpe S.J. Face identification using spike per neuron: resistance to image degradations. Neural Networks 14 6-7 (2001) 795-803
    • (2001) Neural Networks , vol.14 , Issue.6-7 , pp. 795-803
    • Delorme, A.1    Thorpe, S.J.2
  • 9
    • 33750352555 scopus 로고    scopus 로고
    • W. Gerstner, The spike response model, mNN4, September 1999.
  • 10
    • 0040744515 scopus 로고    scopus 로고
    • Mathematical formulations of Hebbian learning
    • Gerstner W., and Kistler W.M. Mathematical formulations of Hebbian learning. Biol. Cybern. 87 (2002) 404-415
    • (2002) Biol. Cybern. , vol.87 , pp. 404-415
    • Gerstner, W.1    Kistler, W.M.2
  • 12
    • 84898994882 scopus 로고    scopus 로고
    • A spike based learning neuron in analog vlsi
    • Mozer M.I.J.M.C., and Petsche T. (Eds), MIT Press, Cambridge
    • Häfliger M.M.P., and Watts L. A spike based learning neuron in analog vlsi. In: Mozer M.I.J.M.C., and Petsche T. (Eds). Advances in Neural Information Processing Systems (1997), MIT Press, Cambridge 692-698
    • (1997) Advances in Neural Information Processing Systems , pp. 692-698
    • Häfliger, M.M.P.1    Watts, L.2
  • 13
    • 35649001607 scopus 로고
    • A quantitative description of ion currents and its applications to conduction and excitation in nerve membranes
    • Hodgkin A.L., and Huxley A.F. A quantitative description of ion currents and its applications to conduction and excitation in nerve membranes. J. Physiol. (London) 117 (1952) 500-544
    • (1952) J. Physiol. (London) , vol.117 , pp. 500-544
    • Hodgkin, A.L.1    Huxley, A.F.2
  • 14
    • 0033561842 scopus 로고    scopus 로고
    • Dynamic stochastic synapses as computational units
    • Maass W., and Zador A.M. Dynamic stochastic synapses as computational units. Neural Comput. 11 4 (1999) 903-917
    • (1999) Neural Comput. , vol.11 , Issue.4 , pp. 903-917
    • Maass, W.1    Zador, A.M.2
  • 15
    • 33750310204 scopus 로고    scopus 로고
    • W. Maass, Computing with spikes, Technical Report, Institut fuer Grundlagen der Informationsverarbeitung - Technische Universitaet Graz, 2002.
  • 16
    • 0033717363 scopus 로고    scopus 로고
    • R. Malaka, S. Buck, Solving nonlinear optimization problems using networks of spiking neurons, in: IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks, vol. 6, 2000, pp. 486-491.
  • 17
    • 51249194645 scopus 로고
    • A logical calculus of the ideas imminent in nervous activity
    • McCulloch W.S., and Pitts W.A. A logical calculus of the ideas imminent in nervous activity. Bull. Math. Biophys. 5 (1943) 115-133
    • (1943) Bull. Math. Biophys. , vol.5 , pp. 115-133
    • McCulloch, W.S.1    Pitts, W.A.2
  • 18
    • 26444486505 scopus 로고    scopus 로고
    • Spatial and temporal pattern analysis via spiking neurons
    • Natschläger T., and Ruf B. Spatial and temporal pattern analysis via spiking neurons. Network: Comput. in Neural Syst. 9 (1998) 319-332
    • (1998) Network: Comput. in Neural Syst. , vol.9 , pp. 319-332
    • Natschläger, T.1    Ruf, B.2
  • 19
    • 0012468888 scopus 로고    scopus 로고
    • Efficient temporal processing with biologically realistic dynamic synapses
    • Natschläger T., Maass W., and Zador A. Efficient temporal processing with biologically realistic dynamic synapses. Network Comput. in Neural Syst. 12 (2001) 75-87
    • (2001) Network Comput. in Neural Syst. , vol.12 , pp. 75-87
    • Natschläger, T.1    Maass, W.2    Zador, A.3
  • 20
    • 0022425176 scopus 로고
    • Temporal hiperacuity in the electric sense of fish
    • Rose G., and Heiligenberg W.W. Temporal hiperacuity in the electric sense of fish. Nature 318 (1985) 178-180
    • (1985) Nature , vol.318 , pp. 178-180
    • Rose, G.1    Heiligenberg, W.W.2
  • 21
    • 18044404268 scopus 로고    scopus 로고
    • Equilibrium properties of temporally asymmetric hebbian plasticity
    • Rubin D.D.L.J., and Sompolinsky H. Equilibrium properties of temporally asymmetric hebbian plasticity. Phys. Rev. Lett. 86 (2001) 364-367
    • (2001) Phys. Rev. Lett. , vol.86 , pp. 364-367
    • Rubin, D.D.L.J.1    Sompolinsky, H.2
  • 22
    • 0347362917 scopus 로고    scopus 로고
    • Learning in spiking neural networks by reinforcement of stochastic synaptic transmission
    • Seung H.S. Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40 (2003) 1063-1073
    • (2003) Neuron , vol.40 , pp. 1063-1073
    • Seung, H.S.1
  • 23
    • 0024759606 scopus 로고
    • A view of the world through the bat's ear: the formation of acoustic images in echolocation
    • Simmons J.A. A view of the world through the bat's ear: the formation of acoustic images in echolocation. Cognition 33 (1989) 155-199
    • (1989) Cognition , vol.33 , pp. 155-199
    • Simmons, J.A.1
  • 24
    • 33750293637 scopus 로고    scopus 로고
    • R. de Ruyter van Steveninck, F. Rieke, D. Warland, W. Bialek, Spikes: Exploring the Neural Code, MIT Press, Cambridge, 1997.
  • 27
    • 0032530898 scopus 로고    scopus 로고
    • Non-linear summation of excitatory sinaptic inputs to small neurones: a case study in spinal motoneurones of the young Xenopus tadpole
    • Wolf E., Zhao F.-Y., and Roberts A. Non-linear summation of excitatory sinaptic inputs to small neurones: a case study in spinal motoneurones of the young Xenopus tadpole. J. Physiol. 511 3 (1998) 871-886
    • (1998) J. Physiol. , vol.511 , Issue.3 , pp. 871-886
    • Wolf, E.1    Zhao, F.-Y.2    Roberts, A.3
  • 28
    • 37649027755 scopus 로고    scopus 로고
    • X. Xie, H.S. Seung, Learning in neural networks by reinforcement learning of irregular spiking, Physics Review E 69, 041909.


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.