Learning spike-based population codes by reward and population feedback

Neural Computation

Volumn 22, Issue 7, 2010, Pages 1698-1717

  Friedrich, Johannes ^a   Urbanczik, Robert ^a   Senn, Walter ^a  

^a UNIVERSITY OF BERN   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ANIMAL; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; DECISION MAKING; FEEDBACK SYSTEM; HUMAN; LEARNING; LETTER; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY; REACTION TIME; REWARD;

ACTION POTENTIALS; ANIMALS; ARTIFICIAL INTELLIGENCE; DECISION MAKING; FEEDBACK, PHYSIOLOGICAL; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; REACTION TIME; REWARD;

EID: 77955988359     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2010.05-09-1010     Document Type: Letter

References (23)

1. Averbeck, B., Latham, P., & Pouget, A. (2006). Neural correlations, population coding and computation. Nature Rev. Neurosci., 7, 358-366.
2. Centonze, D., Gubellini, P., Pisani, A., Bernardi, G., & Calabresi, P. (2003). Dopamine, acetylcholine and nitric oxide systems interact to induce corticostriatal synaptic plasticity. Rev. Neurosci., 14, 207-216.
3. Durstewitz, D. (2004). Neural representation of interval time. Neuroreport, 15, 745-749.
4. Fiete, I., & Seung, H. (2006). Gradient learning in spiking neural networks by dynamic perturbation of conductances. Phys. Rev. Letts., 97, 048104.
5. Florian, R. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Computation, 19, 1468-1502.
6. Foehring, R., & Lorenzon, N. (1999). Neuromodulation, development and synaptic plasticity. Can. J. Exp. Psychol., 53, 45-61.
7. Fusi, S., Asaad, W., Miller, E., & Wang, X.-J. (2007). A neural circuit model of flexible sensori-motor mapping, learning and forgetting on multiple timescales. Neuron, 54, 319-333.
8. Gütig, R., & Sompolinsky, H. (2006). The tempotron, a neuron that learns spike timing-based decision. Nature Neurosci., 9, 420-428.
9. Harris, K. (2008). Stability of the fittest, organizing learning through retroaxonal signals. Trends in Neurosci., 31, 130-136.
10. Izhikevich, E. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral Cortex, 17, 2443-2452.
11. Major, G., & Tank, D. (2004). Persistent neural activity, prevalence and mechanisms. Curr. Opin. Neurobiol., 14, 675-684.
12. Matsuda, Y., Marzo, A., & Otani, S. (2006). The presence of background dopamine signal converts long-term synaptic depression to potentiation in rat prefrontal cortex. J. Neurosci., 26, 4803-4810.
13. Monasson, R., & Zecchina, R. (1996). Learning and generalization theories of large committee machines. Mod. Phys. Lett. B, 9, 1887-1897.
14. Pfister, J., Toyoizumi, T., Barber, D., & Gerstner, W. (2006). Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning. Neural Computation, 18, 1318-1348.
15. Pouget, A., Dayan, P., & Zemel, R. (2000). Information processing with population codes. Nature Rev. Neurosci., 1, 125-132.
16. Reutimann, J., Yakovlev, V., Fusi, S., & Senn, W. (2004). Climbing neuronal activity as an event-based cortical representation of time. J. Neurosci., 24(13), 3295-330.
17. Seol, G., Ziburkus, J., Huang, S., Song, L., Kim, I., Takamiya, K., et al. (2007). Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity. Neuron, 55, 919-929. Erratum in, Neuron 56, 754.
18. Seung, H. (2003). Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron, 40, 1063-1073.
19. Urbanczik, R. (1997). Storage capacity of the fully connected committee machine. J. Phys. A, 30, L387-L391.
20. Urbanczik, R., & Senn, W. (2009). Reinforcement learning in populations of spiking neurons. Nature Neurosci., 12, 250-252.
21. Wang, X. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron, 36, 955-968.
22. Werfel, J., Xie, X., & Seung, H. S. (2005). Learning curves for stochastic gradient descent in linear feedforward networks. Neural Computation, 17, 2699-2718.
23. Williams, R. (1992). Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8, 229-256.