A two-dimensional configurable active silicon dendritic neuron array

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 58, Issue 9, 2011, Pages 2159-2171

  Wang, Yingxue ^a   Liu, Shih Chii ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Active mechanisms; analog digital integrated circuits; biological neural networks; dendrite; hardware; multi layer neural network; spatiotemporal processing

Indexed keywords

COMPUTER HARDWARE; DENDRITES (METALLOGRAPHY); DIGITAL INTEGRATED CIRCUITS; NETWORK LAYERS; NEURONS; SILICON;

ACTIVE MECHANISM; ADDRESS-EVENT REPRESENTATION; ANALOG-DIGITAL INTEGRATED CIRCUITS; BIOLOGICAL NEURAL NETWORKS; COEFFICIENT OF VARIATION; DENDRITIC MORPHOLOGY; RESPONSE AMPLITUDES; SPATIO-TEMPORAL PROCESSING;

MULTILAYER NEURAL NETWORKS;

EID: 80052904851     PISSN: 15498328     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2011.2112570     Document Type: Article

References (48)

1. R. Silver, K. Boahen, S. Grillner, N. Kopell, and K. L. Olsen, "Neu-rotech for neuroscience: Unifying concepts, organizing principles, and emerging tools," J. Neurosci., vol. 27, pp. 11807-11819, 2007. (Pubitemid 350072090)
2. G. Indiveri, S.-C. Liu, T. Delbruck, and R. J. Douglas, "Neuromorphic systems," in Encyclopedia of Neuroscience. New York: Academic, 2009, pp. 521-528, L. e. i. c. Squire.
3. A. Basu, S. Ramakrishnan, and P. Hasler, "Neural dynamics in recon-figurable silicon," inProc. 2010 IEEE Int. Symp. Circuits Syst. (ISCAS), 2010, pp. 1943-1946.
4. J. Schemmel, D. Brüderle, A. Grübl, M. Hock, K. Meier, and S. Millner, "A wafer-scale neuromorphic hardware system for large-scale neural modeling," in Proc. 2010 IEEE Int. Symp. Circuits Syst. (ISCAS), 2010, pp. 1947-1950.
5. Y. Fujita, "Activity of dendrites of single purkinje cells and its relationship to so-called inactivation response in rabbit cerebellum," J. Neuro-phys., vol. 31, pp. 131-141, 1968.
6. R. Llinas, C. Nicholson, J. A. Freeman, and D. E. Hillman, "Dendritic spikes and their inhibition in alligator purkinje cells," Science, vol. 160, pp. 1132-1135, 1968.
7. R. Llinas and R. Hess, "Tetrodotoxin-resistant dendritic spikes in avian purkinje cells," Proc. Nat. Acad. Sci., vol. 73, pp. 2520-2523, 1976.
8. R. K. Wong and D. A. Prince, "Participation of calcium spikes during intrinsic burst firing in hippocampal neurons," Brain Res., vol. 159, pp. 385-390, 1979. (Pubitemid 9033716)
9. J. C.Magee, "Voltage-gated ion channels indendrites," in Dendrites, G. Stuart, N. Spruston, and M. Häusser, Eds. New York: Oxford Univ. Press, 1999, pp. 139-160.
10. I. Segev and M. London, "Untangling dendrites with quantitative models," Science, vol. 290, pp. 744-750, 2000.
11. B. W. Mel, "Information processing in dendritic trees," Neural Comput., vol. 6, pp. 1031-1085, 1994.
12. R. L. de Nó and G. A. Condouris, "Decremental conduction in peripheral nerve. Integration of stimuli in the neuron," Proc. Nat. Acad. Sci., vol. 45, pp. 592-617, 1959.
13. R. Llinás and C. Nicholson, "Electrophysiological properties of den-drites and somata in alligator purkinje cells," J. Neurophysiol., vol. 34, pp. 534-551, 1971.
14. T. Poggio and V. Torre, "A new approach to synaptic interaction," in Lecture Notes in Biomathematics. Theoretical Approaches to Computer Systems, H. Heim and G. Palm, Eds. Berlin, Germany: Springer, 1977, vol. 21, pp. 89-115.
15. C. Koch, T. Poggio, and V. Torre, "Retinal ganglion cells: A functional interpretation of dendritic morphology," Phil. Trans. R. Soc. Lond. B., vol. 298, pp. 227-264, 1982.
16. B. W. Mel and C. Koch, "Sigma-pi learning: On radial basis functions and cortical associative learning," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1990, vol. 2, pp. 474-481.
17. P. Poirazi, T. Brannon, and B. Mel, "Pyramidal neuron as two-layer neural network," Neuron, vol. 37, pp. 989-999, 2003. (Pubitemid 36398303)
18. C. Rasche and R. J. Douglas, "Forward-and backpropagation in a silicon dendrite," IEEE Trans. Neural Netw., vol. 12, pp. 386-393, 2001.
19. J. G. Elias and D. P. M. Northmore, "Building silicon nervous systems with dendritic tree neuromorphs," in Pulsed Neural Networks, W. Maass and C. M. Bishop, Eds. Boston, MA: MIT Press, 1999, ch. 5, pp. 135-156.
20. J. V. Arthur and K. A. Boahen, "Recurrently connected silicon neurons with active dendrites for one-shot learning," in Proc. Int. Joint Conf. Neural Networks (IJCNN), 2004, pp. 1699-1704. (Pubitemid 40006516)
21. P. Hasler, S. Kozoil, E. Farquhar, and A. Basu, "Transistor channel dendrites implementing HMM classifiers," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2007, pp. 3359-3362. (Pubitemid 47449269)
22. E. Farquhar, D. Abramson, and P. Hasler, "A reconfigurable bidirectional active 2 dimensional dendrite model," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2004, vol. 5, pp. 313-316.
23. Y.-X. Wang and S. C. Liu, "Input evoked nonlinearities in silicon dendritic circuits," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2009, pp. 2894-2897.
24. Y.-X. Wang and S. C. Liu, "Multilayer processing of spatiotemporal spike patterns in a neuron with active dendrites," Neural Comput., vol. 22, pp. 2086-2112, 2010.
25. G. Stuart, N. Spruston, B. Sakmann, and M. Häusser, "Action potential initiation and backpropagation in neurons of the mammalian CNS," Trends Neurosci., vol. 20, pp. 125-131, 1997. (Pubitemid 27086728)
26. J. V. Arthur and K. A. Boahen, "Silicon-neuron design: A dynamical systems approach," IEEE Trans. Circuits Syst. I, Reg. Papers 2011 [Online]. Available: http://ieeexplore.ieee.org/xpl/tocresult.jsp?is-number=4358591
27. K. A. Boahen, "Point-to-point connectivity between neuromorphic chips using address events," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 47, pp. 416-434, 2000.
28. M. Oster, Y.Wang, R. Douglas, and S. C. Liu, "Quantification of spike-based winner-take-all VLSI network," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 55, pp. 3160-3169, 2008.
29. N. Savić, A. Lüthi, B. H. Gähwiler, and R. A. McKinney, "N-methyl-D-aspartate receptor blockade during development lowers long-term potentiation threshold without affecting dynamic range of CA3-CA1 synapses," Proc. Nat. Acad. Sci., vol. 100, pp. 5503-5508, 2003. (Pubitemid 36542734)
30. W. Rall, "Theoretical significance of dendritic trees for neuronal input-output relations," in Neural Theory and Modeling, R. F. Reiss, Ed. Stanford, CA: Stanford Univ. Press, 1964, pp. 73-97.
31. C. Mead, Analog VLSI and Neural System. New York: Ad-dison-Wesley Longman, 1989.
32. A. Andreou and K. Boahen, "Translinear circuits in subthreshold MOS," J. Analog Integr. Circuits Signal Process., vol. 9, pp. 141-166, 1996. (Pubitemid 126708257)
33. K. H. Wee, J. Sit, and R. Sarpeshkar, "Biasing techniques for sub-threshold MOS resistive grids," in Proc. 2007 IEEE Int. Symp. Circuits Syst. (ISCAS), 2007, pp. 2164-2167.
34. H. B. Barlow, R. M. Hill, and W. R. Levick, "Retinal ganglion cells responding selectively to direction and speed of image motion in the rabbit," J. Physiol., vol. 173, pp. 377-407, 1964.
35. S. Single and A. Borst, "Dendritic integration and its role in computing image velocity," Science, vol. 281, pp. 1848-1850, 1998. (Pubitemid 28450504)
36. T. Euler, P. B. Detwiler, and W. Denk, "Directionally selective calcium signals in dendrites of starburst amacrine cells," Nature, vol. 418, pp. 845-852, 2002. (Pubitemid 34966298)
37. G. A. Orban, H. Kennedy, and J. Bullier, "Velocity sensitivity and direction selectivity of neurons in areas V1 and V2 of the monkey: Influence of eccentricity," J. Neurophysiol., vol. 56, pp. 462-480, 1986. (Pubitemid 16012460)
38. J. Costas-Sanos, T. Serrano-Gotarredona, and B. Linares-Barranco, "A contrast retina with on-chip calibration for neuromorphic spike-based AER vision systems," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, pp. 1444-1458, 2007. (Pubitemid 47104011)
39. J. A. Lenero-Bardallo, T. Serrano-Gotarredona, and B. Linares-Barranco, "A five-decade dynamic-range ambient-light-independent calibrated signed-spatial-contrast AER retina with 0.1-ms latency and optional time-to-first-spike mode," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 57, pp. 2632-2643, 2010.
40. V. Chan, S.-C. Liu, and A. van Schaik, "AER EAR: A matched silicon cochlea pair with address event representation interface," IEEE Trans. Circuits Syst. I, Reg. Papers (Special Issue on Smart Sensors), vol. 54, pp. 48-59, 2007. (Pubitemid 46351018)
41. P. Lichtsteiner, C. Posch, and T. Delbrück, "A 128 X 128 120 dB 15 (is latency asynchronous temporal contrast vision sensor," IEEE J. Solid-State Circuits, vol. 43, pp. 566-576, 2008. (Pubitemid 351190224)
42. T. Y. W. Choi, T. Yu, B. E. Shi, and K. A. Boahen, "An ON-OFF orientation selective address event representation image transceiver chip," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, pp. 342-353, 2004.
43. E. Chicca, A. M. Whatley, P. Lichtsteiner, V. Dante, T. Delbrüuck, P. Del Giudice, R. J. Douglas, and G. Indiveri, "A multi-chip pulse-based neuromorphic infrastructure and its application to a model of orientation selectivity," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, pp. 981-993, 2007. (Pubitemid 46773770)
44. E. Farquhar and P. Hasler, "Bio-physically inspired silicon neuron," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 52, pp. 477-488, 2005.
45. R. Serrano-Gotarredona, T. Serrano-Gotarredona, A. Acosta-Jimenez, and B. Linares-Barranco, "A neuromorphic cortical-layer microchip for spike-based event processing vision systems," IEEE Trans. Circuits Syst. I Reg. Papers, vol. 53, pp. 2548-2566, 2006. (Pubitemid 46002253)
46. T. Y. W. Choi, P. Merolla, J. Arthur, K. A. Boahen, and B. E. Shi, "Neuromorphic implementation of orientation hypercolumns," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 52, pp. 1049-1060, Jun. 2005. (Pubitemid 40970277)
47. R. Serrano-Gotarredona, M. Oster, P. Lichtsteiner, A. Linares-Barranco, R. Paz-Vicente, F. Gomez-Rodriguez, L. Camunas-Mesa, R. Berner, M. Rivas-Perez, T. Delbruck, S.-C. Liu, R. Douglas, P. Hafliger, G. Jimenez-Moreno, A. C. Ballcels, T. Serrano-Gotarredona, A. J. Acosta-Jimenez, and B. Linares-Barranco, "CAVIAR: A 45 k neuron, 5 M synapse, 12 G connects/s AER hardware senso-ryprocessing learningactuating system for high-speed visual object recognition and tracking," IEEE Trans. Neural Netw., vol. 20, pp. 1417-1438, 2009.
48. A. Cassidy and A. G. Andreou, "Dynamical digital silicon neurons," in Proc. 2008 IEEE Biomed. Circuits Syst. (BioCAS), 2008, pp. 289-292.