Spike-timing-dependent plasticity with weight dependence evoked from physical constraints

IEEE Transactions on Biomedical Circuits and Systems

Volumn 6, Issue 4, 2012, Pages 385-398

  Bamford, Simeon A ^a,b   Murray, Alan F ^a   Willshaw, David J ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b ISTITUTO SUPERIORE DI SANITÀ   (Italy)

Author keywords

Hebbian learning; neural learning; neural networks; neuromorphic VLSI; Spike Timing Dependent Plasticity (STDP); synaptic learning rule; weight dependence

Indexed keywords

HEBBIAN LEARNING; LEARNING RULES; NEURAL LEARNING; NEUROMORPHIC VLSI; SPIKE-TIMING-DEPENDENT PLASTICITY; WEIGHT DEPENDENCE;

ELECTRICAL ENGINEERING; NETWORKS (CIRCUITS); NEURAL NETWORKS;

VLSI CIRCUITS;

SILICON;

ACTION POTENTIAL; ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; CHEMISTRY; COMPUTER SYSTEM; DENDRITE; EQUIPMENT DESIGN; HOMEOSTASIS; HUMAN; METABOLISM; NERVE CELL; PHYSIOLOGY; SEMICONDUCTOR; SYNAPSE;

ACTION POTENTIALS; ANIMALS; COMPUTER SYSTEMS; DENDRITES; EQUIPMENT DESIGN; HOMEOSTASIS; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; SEMICONDUCTORS; SILICON; SYNAPSES; TRANSISTORS, ELECTRONIC;

EID: 84864561413     PISSN: 19324545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBCAS.2012.2184285     Document Type: Article

References (56)

1. T. Aihara, Y. Abiru, Y. Yamazaki, H. Watanabe, Y. Fukushima, and M. Tsukada, "The relation between iespike-timing-dependent plasticity and Ca2+ dynamics in the hippocampal CA1 network," Neurosci., vol. 145, pp. 80-87, 2007.
2. J. V. Arthur and K. Boahen, "Learning in silicon: Timing is everything," Adv. Neural Inf. Process. Syst., vol. 18, pp. 75-82, 2005.
3. D. Badoni, M. Giulioni, and V. Dante, "An aVLSI recurrent network of spiking neurons with reconfigurable and plastic synapses," in Proc. Int. Symp. Circuits and Systems, 2006.
4. S. A. Bamford, "Synaptic rewiring in neuromorphic VLSI for topographic map formation" Ph.D. dissertation, Univ. Edinburgh, Edinburgh, Scotland, U.K., 2009 [Online]. Available: http://www.sim.me.uk/neural/thesis.pdf
5. S. A. Bamford, A. F. Murray, and D. J. Willshaw, "Synaptic rewiring for topographic map formation and receptive field development," Neural Netw., vol. 23, pp. 517-527, 2010.
6. S. A. Bamford, A. F. Murray, and D. J. Willshaw, "Large developing receptive fields using a distributed and locally reprogrammable address-event receiver," IEEE Trans. Neural Netw., vol. 21, pp. 286-304, 2010.
7. C. C. Bell, V. Z. Han, Y. Sugawara, and K. Grant, "Synaptic plasticity in a cerebellum-like structure depends on temporal order," Nature, vol. 387, pp. 278-281, 1997.
8. G. Q. Bi and M. M. Poo, "Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, postsynaptic cell type," J. Neurosci., vol. 18, pp. 10464-10472, 1998.
9. G. Billings and M. C. W. van Rossum, "Memory retention and spike-timing-dependent plasticity," J. Neurophys., vol. 101, pp. 2775-2788, 2009.
10. A. Bofilli Petit, "An analogue VLSI study of temporally-asymmetric Hebbian learning," Ph.D. dissertation, Univ. Edinburgh, Edinburgh, Scotland, U.K., 2005.
11. A. Bofilli Petit and A. F. Murray, "Synchrony detection and amplification by silicon neurons with STDP synapses," IEEE Trans. Neural Netw. Trans., vol. 15, pp. 1296-1304, 2004.
12. J. M. Brader, W. Senn, and S. Fusi, "Learning real world stimuli in a neural network with spike-driven synaptic dynamics," Neural Comput., vol. 19, no. 11, pp. 2881-2912, 2007.
13. K. Cameron, V. Boonsobhak, A. Murray, and D. Renshaw, "Spike timing dependent plasticity (STDP) can ameliorate process variations in neuromorphic VLSI," IEEE Trans. Neural Netw., vol. 16, pp. 1626-1637, 2005.
14. A. Cassidy, A. G. Andreou, and J. Georgiou, "A combinational digital logic approach to STDP," in Proc. IEEE Int. Symp. Circuits and Systems, 2011, pp. 673-676.
15. C. Clopath and W. Gerstner, "Voltage and spike timing interact in STDP - A unified model," in Front. Synap. Neurosci., 2010, vol. 2, DOI: 10.3389/fnsyn.2010.00025.
16. A. P. Davison and Y. Fregnac, "Learning cross-modal spatial transformations through spike-timing-dependent plasticity," J. Neurosci., vol. 26, pp. 5604-5615, 2006.
17. S. Eberhardt, T. Duong, and A. Thakoor, "Design of parallel hardware neural network systems from custom analog VLSI building block chips," in Proc. Int. Joint Conf. Artificial Neural Networks, 1989, vol. 2, pp. 183-190.
18. S. Fusi, M. Annunziato, D. Badoni, A. Salamon, and D. J. Amit, "Spike-driven synaptic plasticity: Theory, simulation, VLSI implementation," Neural Comput., vol. 12, pp. 2227-2258, 2000.
19. W. Gerstner, R. Kempter, J. L. van Hemmen, and H. Wagner, "A neuronal learning rule for sub-millisecond temporal coding," Nature, vol. 383, pp. 76-78, 1996.
20. D. H. Goldberg, G. Cauwenberghs, and A. G. Andreou, "Probabilistic synaptic weighting in a reconfigurable network of VLSI integrate-and-fire neurons," Neural Netw., vol. 14, pp. 781-793, 2001.
21. C. Gordon and P. Hasler, "Biological learning modeled in an adaptive floating-gate system," in Proc. IEEE Int. Symp. Circuits and Systems, 2002.
22. R. Gutig, R. Aharonov, S. Rotter, and H. Sompolinsky, "Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity," J. Neurosci., vol. 23, no. 9, pp. 3697-3714, 2003.
23. R. Guyonneau, R. Van Rullen, and S. J. Thorpe, "Neurons tune to the earliest spikes through STDP," Neural Comput., vol. 17, pp. 859-879, 2005.
24. P. Häfliger, "Adaptive WTA with an analog VLSI neuromorphic learning chip," IEEE Trans. Neural Netw., vol. 18, no. 2, pp. 551-572, 2007.
25. P. Häfliger and H. K. Riis, "A multi-level static memory cell," in Proc. IEEE Int. Symp. Circuits and Systems, 2003.
26. P. Häfliger, M. Mahowald, and L. Watts, M. C. Mozer, M. I. Jordan, and T. Petsche, Eds., "A spike-based learning neuron in analog VLSI," Adv. Neural Inf. Process. Syst., vol. 9, p. 692, 1997.
27. G. Indiveri, E. Chicca, and R. Douglas, "A VLSI array of low-power spiking neurons and bistable synapses with spike-timing-dependent plasticity," IEEE Trans. Neural Netw., vol. 17, pp. 211-221, 2006.
28. S. H. Jo, T. Chang, I. Ebong, B. B. Bhadviya, P. Mazumder, and W. Lu, "Nanoscale memristor device as synapse in neuromorphic systems," Nano Lett., vol. 10, pp. 1297-1301, 2010.
29. J. K. Jun and D. Z. Jin, "Development of neural circuitry for precise temporal sequences through spontaneous activity, axon remodeling, synaptic plasticity," PLoS One, vol. 8, 2007.
30. W. M. Kistler and J. L. Van Hemmen, "Modeling synaptic plasticity in conjunction with the timing of pre- and postsynaptic action potentials," Neural Comput., vol. 12, pp. 385-405, 2000.
31. T. J. Koickal, A. Hamilton, S. L. Tan, J. A. Covington, J. W. Gardner, and T. C. Pearce, "Analog VLSI circuit implementation of an adaptive neuromorphic olfaction chip," IEEE Trans. Circuits Syst., vol. 54, no. 1, pp. 60-73, 2007.
32. J. J. Letzkus, B. M. Kampa, and G. J. Stuart, "Learning rules for spike-timing-dependent plasticity depend on dendritic synapse location," J. Neurosci., vol. 26, pp. 10420-10429, 2006.
33. B. Linares-Barranco and T. Serrano-Gotarredona, "On the design and characterization of femtoampere currentmode circuits," IEEE J. Solid-State Circuits, vol. 38, no. 8, pp. 1353-1363, 2003.
34. S. Liu and R. Mockel, "Temporally learning floating-gate VLSI synapses," in Proc. Int. Symp. Circuits and Systems, 2008, pp. 2154-2157.
35. R. C. Malenka and M. F. Bear, "LTP and LTD: An embarrassment of riches," Neuron, vol. 44, pp. 5-21, 2004.
36. H. Markram, J. Lubke, M. Frotscher, and B. Sakmann, "Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs," Science, vol. 275, pp. 213-215, 1997.
37. H. Markram, W. Gerstner, and P. J. Sjöström, "A history of spike-timing-dependent plasticity," Front. Synap. Neurosci., vol. 3, 2011, DOI: 10.3389/fnsyn.2011.00004.
38. T. Masquelier and S. J. Thorpe, "Unsupervised learning of visual features through spike-timing-dependent plasticity," PLoS Computat. Biol., vol. 3, no. e31, 2007.
39. S. Mitra, S. Fusi, and G. Indiveri, "Real-time classification of complex patterns using spike-based learning in neuromorphic VLSI," IEEE Trans. Biomed. Circuits Syst., vol. 3, no. 1, pp. 32-42, 2009.
40. A. Morrison, M. Diesmann, and W. Gerstner, "Phenomenological models of synaptic plasticity based on spike timing," Biol. Cybern., vol. 98, pp. 459-478, 2008.
41. J. Pfister and W. Gerstner, "Triplets of spikes in a model of spike timing dependent plasticity," J. Neurosci., vol. 26, pp. 9673-9682, 2006.
42. S. Ramakrishnan, P. E. Hasler, and C. Gordon, "Floating gate synapses with spike-time-dependent plasticity," IEEE Trans. Biomed. Circuits Syst., vol. 5, pp. 244-252, 2011.
43. P. D. Roberts and C. C. Bell, "Spike-timing-dependent synaptic plasticity in biological systems," Biol. Cybern., vol. 87, pp. 392-403, 2002.
44. J. Schemmel, A. Grubl, K. Meier, and E. Mueller, "Implementing synaptic plasticity in a VLSI spiking neural network model," in Proc. Int. Joint Conf. Neural Networks, 2006.
45. W. Senn, H. Markram, and M. Tsodyks, "An algorithm formodifying neurotransmitter release probability based on pre- and postsynaptic spike timing," Neural Comput., vol. 13, pp. 35-67, 2001.
46. S. Song and L. F. Abbott, "Cortical development and remapping through spike-timing-dependent plasticity," Neuron, vol. 32, pp. 339-350, Oct. 2001.
47. S. Song, K. D. Miller, and L. F. Abbott, "Competitive Hebbian learning through spike-timing-dependent synaptic plasticity," Nature, vol. 3, pp. 919-926, Sep. 2000.
48. H. Tanaka, T. Morie, and K. Aihara, "A CMOS spiking neural network circuit with symmetric/asymmetric STDP function," IEICE Trans. Fund. Electr., Commun. Comput. Sciences, vol. 92, pp. 1690-1698, 2009.
49. M. C. W. Van Rossum, G. Q. Bi, and G. G. Turrigiano, "Stable Hebbian learning from spike-timing-dependent plasticity," J. Neurosci., vol. 20, pp. 8812-8821, 2000.
50. E. Vittoz, H. Oguey, M. A. Maher, O. Nys, E. Dijkstra, and M. Chevroulet, "Analog storage of adjustable synaptic weights," in Introduction to VLSI-Design of Neural Networks. Norwell, MA: Kluwer, 1991, pp. 47-63.
51. R. J. Vogelstein, F. Tenore, R. Philipp, M. S. Adlerstein, D. H. Goldberg, and G. Cauwenberghs, "Spike-timingdependent plasticity in the address domain," in Advances in Neural Information Processing Systems, S. Thrun, S. Becker, and K. Obermayer, Eds. Cambridge, MA: MIT Press, 2003.
52. R. J. Vogelstein, U. Mallik, J. T. Vogelstein, and G. Cauwenberghs, "Dynamically reconfigurable silicon array of spiking neurons with conductance-based synapses," IEEE Trans. Neural Netw., vol. 18, pp. 253-265, 2007.
53. J. M. Young, W. J. Waleszczyk, C. Wang, M. B. Calford, B. Dreher, and K. Obermayer, "Cortical reorganisation consistent with spike timing-but not correlation-dependent plasticity," Nature Neurosci., vol. 10, pp. 887-895, July 2007.
54. C. Zamarreno-Ramos, L. A. Camunas-Mesa, J. A. Perez-Carrasco, T. Masquelier, T. Serrano-Gotarredona, and B. Linares-Barranco, "On spike-timing-dependent plasticity, memristive devices, building a self-learning visual cortex," Front. Neurosci., vol. 5, 2011.
55. L. Zhang, Q. Lai, and Y. Chen, "Configurable neural phase shifter with spike-timing-dependent plasticity," IEEE Electron Device Lett., vol. 31, pp. 716-718, 2010.
56. L. I. Zhang, H. W. Tao, C. E. Holt, W. A. Harris, and M. M. Poo, "A critical window for cooperation and competition among developing retinotectal synapses," Nature, vol. 395, pp. 37-44, 1998.