Tunable low energy, compact and high performance neuromorphic circuit for spike-based synaptic plasticity

PLoS ONE

Volumn 9, Issue 2, 2014, Pages

  Azghadi, Mostafa Rahimi ^a   Iannella, Nicolangelo ^a   Al Sarawi, Said ^a   Abbott, Derek ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARTICLE; COMPARATIVE STUDY; COMPUTER MODEL; ENERGY CONSUMPTION; EQUIPMENT DESIGN; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; MONTE CARLO METHOD; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NEUROMORPHIC CIRCUIT; SEMICONDUCTOR;

ACTION POTENTIALS; COMPUTER SIMULATION; HIPPOCAMPUS; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; NEURONS; SYNAPSES; SYNAPTIC TRANSMISSION; VISUAL CORTEX;

EID: 84895835403     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0088326     Document Type: Article

References (52)

1. Hodgkin AL, Huxley AF (1952) A quantitative description of membrane current and its application to conduction and excitation in nerve. The Journal of Physiology 117: 500-544.
2. Izhikevich EM (2004) Which model to use for cortical spiking neurons? IEEE Transactions on Neural Networks 15: 1063-1070.
3. Indiveri G, Linares-Barranco B, Hamilton TJ, van Schaik A, Etienne-Cummings R, et al. (2011) Neuromorphic silicon neuron circuits. Frontiers in Neuroscience 5.
4. Sjöström PJ, Rancz EA, Roth A, Häusser M (2008) Dendritic excitability and synaptic plasticity. Physiological Reviews 88: 769-840.
5. Mayr C, Partzsch J (2010) Rate and pulse based plasticity governed by local synaptic state variables. Frontiers in Synaptic Neuroscience 2, art. no.33.
6. Zucker RS, Regehr WG (2002) Short-term synaptic plasticity. Annual review of physiology 64: 355-405. (Pubitemid 34259234)
7. Bartolozzi C, Indiveri G (2007) Synaptic dynamics in analog VLSI. Neural Computation 19: 2581-2603.
8. Wijekoon JH, Dudek P (2012) Vlsi circuits implementing computational models of neocortical circuits. Journal of Neuroscience Methods 210: 93-109.
9. Cooper L, Intrator N, Blais B, Shouval H (2004) Theory of Cortical Plasticity. World Scientific Pub Co Inc.
10. Pfister J, Gerstner W (2006) Triplets of spikes in a model of spike timing-dependent plasticity. The Journal of Neuroscience 26: 9673-9682. (Pubitemid 44427706)
11. Bi G, Poo M (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of Neuroscience 18: 10464-10472. (Pubitemid 29016566)
12. Iannella N, Launey T, Tanaka S (2010) Spike timing-dependent plasticity as the origin of the formation of clustered synaptic effcacy engrams. Frontiers in Computational Neuroscience 4, art. no.20.
13. Froemke R, Dan Y (2002) Spike-timing-dependent synaptic modification induced by natural spike trains. Nature 416: 433-438. (Pubitemid 34272878)
14. Wang H, Gerkin R, Nauen D, Bi G (2005) Coactivation and timing-dependent integration of synaptic potentiation and depression. Nature Neuroscience 8: 187-193. (Pubitemid 40194049)
15. Bofill-I-Petit A, Murray A (2004) Synchrony detection and amplification by silicon neurons with STDP synapses. IEEE Transaction on Neural Networks 15: 1296-1304.
16. Indiveri G, Chicca E, Douglas R (2006) A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity. IEEE Transactions on Neural Networks 17: 211-221. (Pubitemid 43272460)
17. Azghadi MR, Al-Sarawi S, Abbott D, Iannella N (2013) A neuromorphic VLSI design for spike timing and rate based synaptic plasticity. Neural Networks 45: 70-82.
18. Sjöström P, Turrigiano G, Nelson S (2001) Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron 32: 1149-1164. (Pubitemid 34075403)
19. Song S, Miller K, Abbott L (2000) Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience 3: 919-926.
20. Iannella N, Tanaka S (2006) Synaptic effcacy cluster formation across the dendrite via STDP. Neuroscience Letters 403: 24-29. (Pubitemid 43963230)
21. Cameron K, Boonsobhak V, Murray A, Renshaw D (2005) Spike timing dependent plasticity (STDP) can ameliorate process variations in neuromorphic VLSI. IEEE Transactions on Neural Networks 16: 1626-1637. (Pubitemid 41709658)
22. Tanaka H, Morie T, Aihara K (2009) A CMOS spiking neural network circuit with symmetric/asymmetric STDP function. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences E92-A: 1690-1698.
23. Mayr C, Noack M, Partzsch J, Schuffny R (2010) Replicating experimental spike and rate based neural learning in CMOS. In: Proceedings of IEEE International Symposium on Circuits and Systems (ISCAS). 105-108.
24. Meng Y, Zhou K, Monzon J, Poon C (2011) Iono-neuromorphic implementation of spike-timingdependent synaptic plasticity. In: 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC. 7274-7277.
25. Bamford S, Murray A, Willshaw D (2012) Spike-timing dependent plasticity with weight dependence evoked from physical constraints. IEEE Transactions on Biomedical Circuits and Systems 6: 385-398.
26. Dudek SM, Bear MF (1992) Homosynaptic long-term depression in area ca1 of hippocampus and effects of n-methyl-d-aspartate receptor blockade. Proceedings of the National Academy of Sciences 89: 4363-4367.
27. Wang H, Wagner JJ (1999) Priming-induced shift in synaptic plasticity in the rat hippocampus. Journal of Neurophysiology 82: 2024-2028. (Pubitemid 29471294)
28. Bienenstock E, Cooper L, Munro P (1982) Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. The Journal of Neuroscience 2: 32.
29. Liu SC, Delbruck T, Kramer J, Indiveri G, Douglas R (2002) Analog VLSI: Circuits and Principles. MIT Press, Cambridge, MA.
30. Schemmel J, Grubl A, Meier K, Mueller E (2006) Implementing synaptic plasticity in a VLSI spiking neural network model. In: The 2006 International Joint Conference on Neural Networks. 1-6.
31. Schemmel J, Bruderle D, Grubl A, Hock M, Meier K, et al. (2010) A wafer-scale neuromorphic hardware system for large-scale neural modeling. In: Proceedings of IEEE International Symposium on Circuits and Systems (ISCAS). 1947-1950.
32. Azghadi MR, Al-Sarawi S, Iannella N, Abbott D (2011) Novel VLSI implementation for tripletbased spike-timing dependent plasticity. In: Proceedings of the 7th International Conference on Intelligent Sensors, Sensor Networks and Information Processing. 158-162.
33. Froemke R, Tsay I, Raad M, Long J, Dan Y (2006) Contribution of individual spikes in burstinduced long-term synaptic modification. Journal of neurophysiology 95: 1620-1629.
34. Kirkwood A, Rioult M, Bear M (1996) Experience-dependent modification of synaptic plasticity in visual cortex. Nature 381: 526-528. (Pubitemid 26170931)
35. Azghadi MR, Al-Sarawi S, Iannella N, Abbott D (2012) Design and implementation of BCM rule based on spike-timing dependent plasticity. In: The 2012 International Joint Conference on Neural Networks (IJCNN). doi:10.1109/IJCNN.2012.6252778.
36. Mitra S, Fusi S, Indiveri G (2009) Real-time classification of complex patterns using spike-based learning in neuromorphic VLSI. IEEE Transactions on Biomedical Circuits and Systems, 3: 32-42.
37. Rachmuth G, Shouval H, Bear M, Poon C (2011) A biophysically-based neuromorphic model of spike rate- and timing-dependent plasticity. Proceedings of the National Academy of Sciences 108: E1266-E1274.
38. Azghadi MR, Al-Sarawi S, Iannella N, Abbott D (2012) Efficient design of triplet based spiketiming dependent plasticity. In: The 2012 International Joint Conference on Neural Networks (IJCNN). doi:10.1109/IJCNN.2012.6252820.
39. Cruz-Albrecht JM, Yung MW, Srinivasa N (2012) Energy-efficient neuron, synapse and STDP integrated circuits. IEEE Transactions on Biomedical Circuits and Systems 6: 246-256.
40. Poon C, Zhou K (2011) Neuromorphic silicon neurons and large-scale neural networks: challenges and opportunities. Frontiers in Neuroscience 5, art. no.108.
41. Azghadi MR, Moradi S, Indiveri G (2013) Programmable neuromorphic circuits for spike-based neural dynamics. In: 11th IEEE International New Circuit and Systems (NEWCAS) conference. 1-4.
42. Bamford SA, Murray AF, Willshaw DJ (2012) Silicon synapses self-correct for both mismatch and design inhomogeneities. Electronics Letters 48: 360-361.
43. Sheik S, Chicca E, Indiveri G (2012) Exploiting device mismatch in neuromorphic VLSI systems to implement axonal delays. In: The 2012 International Joint Conference on Neural Networks (IJCNN). doi:10.1109/IJCNN.2012.6252636.
44. Vitale SA, Kedzierski J, Healey P, Wyatt PW, Keast CL (2011)Work-function-tuned tin metal gate fdsoi transistors for subthreshold operation. IEEE Transactions on Electron Devices 58: 419-426.
45. Rachmuth G, Poon CS (2008) Transistor analogs of emergent iono-neuronal dynamics. HFSP Journal 2: 156-166.
46. Douglas R, Mahowald M, Mead C (1995) Neuromorphic analogue VLSI. Annual review of neuroscience 18: 255-281.
47. Koickal T, Hamilton A, Tan S, Covington J, Gardner J, et al. (2007) Analog VLSI circuit implementation of an adaptive neuromorphic olfaction chip. IEEE Transactions on Circuits and Systems I 54: 60-73. (Pubitemid 46351019)
48. Azghadi M, Al-Sarawi S, Iannella N, Abbott D (2013) A new compact analog vlsi model for spike timing dependent plasticity. In: 2013 IFIP/IEEE 21st International Conference on Very Large Scale Integration (VLSI-SoC). 7-12. doi:10.1109/VLSI-SoC.2013.6673236.
49. Ramakrishnan S, Hasler P, Gordon C (2011) Floating gate synapses with spike-time-dependent plasticity. IEEE Transactions on Biomedical Circuits and Systems 5: 244-252.
50. Zamarreño-Ramos C, Camuñas-Mesa LA, Pérez-Carrasco JA, Masquelier T, Serrano-Gotarredona T, et al. (2011) On spike-timing-dependent- plasticity, memristive devices, and building a selflearning visual cortex. Frontiers in neuroscience 5.
51. Arthur J, Boahen K (2006) Learning in silicon: timing is everything. In: Advances in Neural Information Processing Systems. MIT; 1998, volume 18, 75-82.
52. Cassidy A, Andreou AG, Georgiou J (2011) A combinational digital logic approach to STDP. In: The 2011 International Symposium on Circuits and Systems. 673-676.