Enabling functional neural circuit simulations with distributed computing of neuromodulated plasticity

Frontiers in Computational Neuroscience

Volumn 4, Issue , 2010, Pages

  Potjans, Wiebke ^a   Morrison, Abigail ^a   Diesmann, Markus ^a  

^a NONE

Author keywords

Computational neuroscience; Distributed computing; Integrate and fire neurons; Large scale simulations; Modeling; Neuromodulator; Spiking networks; Synaptic plasticity

Indexed keywords

COMPUTATIONAL NEUROSCIENCE; INTEGRATE-AND-FIRE NEURONS; LARGE SCALE SIMULATIONS; NEUROMODULATOR; SPIKING NETWORKS; SYNAPTIC PLASTICITY;

CIRCUIT SIMULATION; DISTRIBUTED COMPUTER SYSTEMS; MODELS; NEURONS; NEUROLOGY;

COMPUTER SIMULATION;

ACCURACY; ALGORITHM; ARTICLE; CONTROLLED STUDY; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE CELL STIMULATION; NERVE CONDUCTION; NEUROMODULATED PLASTICITY; NEUROMODULATION; POSTSYNAPTIC POTENTIAL; PRESYNAPTIC POTENTIAL; PROCESS DEVELOPMENT; PROCESS MODEL; PROCESS OPTIMIZATION; SIGNAL TRANSDUCTION; SPIKE WAVE; SYNAPTIC TRANSMISSION;

EID: 79958093750     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2010.00141     Document Type: Article

References (55)

1. Agnati L., Zoli M., Strömberg I., Fuxe K. (1995). Intercellular communication in the brain: wiring versus volume transmission. Neuroscience 69, 711-726. doi: 10.1016/0306-4522(95)00308-6. [PubMed] [Cross Ref]
2. Ananthanarayanan R., Modha D. S. (2007). "Anatomy of a cortical simulator," in Supercomputing 2007: Proceedings of the ACM/IEEE SC2007 Conference on High Performance Networking and Computing (New York, NY: Association for Computing Machinery).
3. Antonov I., Antonova I., Kandel E. R., Hawkins R. D. (2003). Activity-dependent presynaptic facilitation and hebbian LTP are both required and interact during classical conditioning in aplysia. Neuron 37, 135-147. doi: 10.1016/S0896-6273(02)01129-7. [PubMed] [Cross Ref]
4. Arbuthnott G., Wickens J. (2007). Space, time and dopamine. Trends Neuroscience 30, 62-69. doi: 10.1016/j.tins.2006.12.003. [Cross Ref]
5. Baras D., Meir R. (2007). Reinforcement learning, spike-time-dependent plasticity, and the BCM rule. Neural Comput. 19, 2245-2279. doi: 10.1162/neco.2007.19.8.2245. [PubMed] [Cross Ref]
6. Berridge C. W., Waterhouse B. D. (2003). The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res. Brain Res. Rev. 42, 33-84. doi: 10.1016/S0165-0173(03)00143-7. [PubMed] [Cross Ref]
7. Bi G., Poo M. (2001). Synaptic modification by correlated activity: Hebb's postulate revisited. Annu. Rev. Neurosci. 24, 139-66. doi: 10.1146/annurev.neuro.24.1.139. [PubMed] [Cross Ref]
8. Bi G.-Q., Poo M.-M. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464-10472. [PubMed]
9. Braitenberg V., Schüz A. (1998). Cortex: Statistics and Geometry of Neuronal Connectivity, 2nd Edn.Berlin: Springer-Verlag.
10. Brette R., Rudolph M., Carnevale T., Hines M., Beeman D., Bower J. M., Diesmann M., Morrison A., Goodman P. H., Harris F. C., Jr., Zirpe M., Natschläger T., Pecevski D., Ermentrout B., Djurfeldt M., Lansner A., Rochel O., Vieville T., Muller E., Davison A. P., El Boustani S., Destexhe A. (2007). Simulation of networks of spiking neurons: a review of tools and strategies. J. Comput. Neurosci. 23, 349-398. doi: 10.1007/s10827-007-0038-6. [PMC free article] [PubMed] [Cross Ref]
11. Cooper J., Bloom F., Roth R. (2002). The Biochemical Basis of Neuropharmacology. New York, Oxford: Oxford University Press.
12. Deco G., Thiele A. (2009). Attention: oscillations and neuropharmacology. Eur. J. Neurosci. 30, 347-354. doi: 10.1111/j.1460-9568.2009.06833.x. [PMC free article] [PubMed] [Cross Ref]
13. Eppler J. M., Helias M., Muller E., Diesmann M., Gewaltig M. (2009). PyNEST: a convenient interface to the NEST simulator. Front. Neuroinformatics 2, 12. [PMC free article] [PubMed]
14. Florian R. V. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Comput. 19, 1468-1502. doi: 10.1162/neco.2007.19.6.1468. [PubMed] [Cross Ref]
15. Garris P. A., Ciolkowski E. L., Pastore P., Wightman R. M. (1994). Efflux of dopamine from the synaptic cleft in the nucleus accumbens of the rat brain. J. Neurosci. 14, 6084-6093. [PubMed]
16. Gerstner W., Kempter R., van Hemmen J. L., Wagner H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature 383, 76-78. doi: 10.1038/383076a0. [PubMed] [Cross Ref]
17. Gewaltig M.-O., Diesmann M. (2007). NEST (Neural Simulation Tool). Scholarpedia J. 2, 1430. doi: 10.4249/scholarpedia.1430. [Cross Ref]
18. Hammarlund P., Ekeberg O. (1998). Large neural network simulations on multiple hardware platforms. J. Comput. Neurosci. 5, 443-459. doi: 10.1023/A:1008893429695. [PubMed] [Cross Ref]
19. Hanuschkin A., Kunkel S., Helias M., Morrison A., Diesmann M. (2010). A general and efficient method for incorporating precise spike times in globally time-driven simulations. Front. Neuroinform. 4133. doi: 10.3389/fninf.2010.00113. [Cross Ref]
20. Harris J., Baurick J., Frye J., King J., Ballew M., Goodman P., Drewes R. (2003). A novel parallel hardware and software solution for a large-scale biologically realistic cortical simulation. Technical Report, University of Nevada, Reno, NV.
21. Hasselmo M., McGaughy J. (2004). High acetylcholine levels set circuit dynamics for attention and encoding and low acetylcholine levels set dynamics for consolidation. Prog. Brain Res. 145, 207-231. doi: 10.1016/S0079-6123(03)45015-2. [PubMed] [Cross Ref]
22. Hebb D. O. (1949). The Organization of Behavior: A Neuropsychological Theory. New York: John Wiley and Sons.
23. Herrero J. L., Roberts M. J., Delicato L. S., Gieselmann M. A., Dayan P., Thiele A. (2008). Acetylcholine contributes through muscarinic receptors to attentional modulation in v1. Nature 454, 1110-1113. doi: 10.1038/nature07141. [PMC free article] [PubMed] [Cross Ref]
24. Izhikevich E. M. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb. Cortex 17, 2443-2452. doi: 10.1093/cercor/bhl152. [PubMed] [Cross Ref]
25. Lamport L. (1978). Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21, 558-565. doi: 10.1145/359545.359563. [Cross Ref]
26. Legenstein R., Pecevski D., Maass W. (2008). A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS Comput. Biol. 4, e1000180. doi: 10.1371/journal.pcbi.1000180. [PMC free article] [PubMed] [Cross Ref]
27. Markram H., Lübke J., Frotscher M., Sakmann B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213-215. doi: 10.1126/science.275.5297.213. [PubMed] [Cross Ref]
28. Markram H., Tsodyks M. (1996). Redistribution of synaptic efficacy between neocortical pyramidal neurons. Nature 382, 807-810. doi: 10.1038/382807a0. [PubMed] [Cross Ref]
29. Montague P. R., McClure S. M., Baldwin P., Phillips P. E., Budygin E. A., Stuber G. D., Kilpatrick M. R., Wightman R. M. (2004). Dynamic gain control of dopamine delivery in freely moving animals. J. Neurosci. 24, 1754-1759. doi: 10.1523/JNEUROSCI.4279-03.2004. [PubMed] [Cross Ref]
30. Moreau A., Amar M., Le Roux N., Morel N., Fossier P. (2010). Serotoninergic fine-tuning of the excitation-inhibition balance in rat visual cortical networks. Cereb. Cortex 20, 456-467. doi: 10.1093/cercor/bhp114. [PubMed] [Cross Ref]
31. Morrison A., Aertsen A., Diesmann M. (2007). Spike-timing dependent plasticity in balanced random networks. Neural Comput. 19, 1437-1467. doi: 10.1162/neco.2007.19.6.1437. [PubMed] [Cross Ref]
32. Morrison A., Diesmann M. (2006). "Maintaining causality in discrete time neuronal network simulations," in Proceedings of the Potsdam Supercomputer School 2005, Germany.
33. Morrison A., Diesmann M. (2008). "Maintaining causality in discrete time neuronal network simulations," in Lectures in Supercomputational Neuroscience: Dynamics in Complex Brain Networks, Understanding Complex Systems, eds Beim Graben P., Zhou C., Thiel M., Kurths J., editors. (Springer, Verlag: Berlin Heidelberg;), 267-278.
34. Morrison A., Diesmann M., Gerstner W. (2008). Phenomenological models of synaptic plasticity based on spike-timing. Biol. Cybern. 98, 459-478. doi: 10.1007/s00422-008-0233-1. [PMC free article] [PubMed] [Cross Ref]
35. Morrison A., Mehring C., Geisel T., Aertsen A., Diesmann M. (2005). Advancing the boundaries of high connectivity network simulation with distributed computing. Neural Comput. 17, 1776-1801. doi: 10.1162/0899766054026648. [PubMed] [Cross Ref]
36. Morrison A., Straube S., Plesser H. E., Diesmann M. (2007). Exact subthreshold integration with continuous spike times in discrete time neural network simulations. Neural Comput. 19, 47-79. doi: 10.1162/neco.2007.19.1.47. [PubMed] [Cross Ref]
37. Nordlie E., Gewaltig M.-O., Plesser H. E. (2009). Towards reproducible descriptions of neuronal network models. PLoS Comput. Biol. 5, e1000456. doi: 10.1371/journal.pcbi.1000456. [PMC free article] [PubMed] [Cross Ref]
38. Pawlak V., Wickens J. R., Kirkwood A., Kerr J. N. D. (2010). Timing is not everything: neuromodulation opens the STDP gate. Front. Syn. Neurosci. 2146. doi: 10.3389/fnsyn.2010.00146. [Cross Ref]
39. Pecevski D., Natschläger T., Schuch K. (2009). PCSIM: a parallel simulation environment for neural circuits fully integrated with python. Front. Neuroinformatics 311. doi: 10.3389/neuro.11.011.2009. [PMC free article] [PubMed] [Cross Ref]
40. Plesser H. E., Eppler J. M., Morrison A., Diesmann M., Gewaltig M.-O. (2007). "Efficient parallel simulation of large-scale neuronal networks on clusters of multiprocessor computers," in Euro-Par 2007: Parallel Processing, volume 4641 of Lecture Notes in Computer Science, eds Kermarrec A.-M., Bougé L., Priol T., editors. (Berlin: Springer-Verlag;), 672-681.
41. Potjans W., Morrison A., Diesmann M. (2009a). Implementing neuromodulated plasticity in distributed simulations. Front. Neuroinformatics Conference Abstract: 2nd INCF Congress of Neuroinformatics. doi: 10.3389/conf.neuro.11.2009.08.043. [Cross Ref]
42. Potjans W., Morrison A., Diesmann M. (2009b). A spiking neural network model of an actor-critic learning agent. Neural Comput. 21, 301-339. doi: 10.1162/neco.2008.08-07-593. [PubMed] [Cross Ref]
43. Potjans W., Morrison A., Diesmann M. (2009c). A spiking temporal-difference learning model based on dopamine-modulated plasticity. BMC Neurosci. 10(Supp 1), 140. doi: 10.1186/1471-2202-10-S1-P140. [Cross Ref]
44. Reynolds J. N. J., Hyland B. I., Wickens J. R. (2001). A cellular mechanism of reward-related learning. Nature 413, 67-70. doi: 10.1038/35092560. [PubMed] [Cross Ref]
45. Schultz W., Dayan P., Montague P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599. doi: 10.1126/science.275.5306.1593. [PubMed] [Cross Ref]
46. Seung H. S. (2003). Learning spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40, 1063-1073. doi: 10.1016/S0896-6273(03)00761-X. [PubMed] [Cross Ref]
47. Song S., Abbott L. F. (2001). Cortical development and remapping through spike timing-dependent plasticity. Neuron 32, 339-350. doi: 10.1016/S0896-6273(01)00451-2. [PubMed] [Cross Ref]
48. Song S., Miller K. D., Abbott L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3, 919-926. doi: 10.1038/78829. [PubMed] [Cross Ref]
49. Thomson A. M., Deuchars J. (1994). Temporal and spatial properties of local circuits in neocortex. Trends Neurosci. 17, 119-126. doi: 10.1016/0166-2236(94)90121-X. [PubMed] [Cross Ref]
50. Vasilaki E., Frémaux N., Urbanczik R., Senn W., Gerstner W. (2009). Spike-based reinforcement learning in continuous state and action space: When policy gradient methods fail. PLoS Comput. Biol. 5, e1000586. doi: 10.1371/journal.pcbi.1000586. [PMC free article] [PubMed] [Cross Ref]
51. Wilkinson B., Allen M. (2004). Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers (2 ed.). Prentice Hall.
52. Xie X., Seung H. S. (2004). Learning in neural networks by reinforcement of irregular spiking. Phys. Rev. E 69, 41909. doi: 10.1103/PhysRevE.69.041909. [Cross Ref]
53. Zoli M., Agnati L. F. (1996). Wiring and volume transmission in the central nervous system: The concept of closed and open synapses. Prog. Neurobiol. 49, 363-380. [PubMed]
54. Zoli M., Jansson A., Syková E., Agnati L. F., Fuxe K. (1999). Volume transmission in the cns and its relevance for neuropsychopharmacology. Trends Pharmacol. Sci. 20, 142-150. doi: 10.1016/S0165-6147(99)01343-7. [PubMed] [Cross Ref]
55. Zubler F., Douglas R. (2009). A framework for modeling the growth and development of neurons and networks. Front. Comput. Neurosci. 325. doi: 10.3389/neuro.10.025.2009. [PMC free article] [PubMed] [Cross Ref]