Synthesizing cognition in neuromorphic electronic systems

Proceedings of the National Academy of Sciences of the United States of America

Volumn 110, Issue 37, 2013, Pages

  Neftci, Emre ^a   Binas, Jonathan ^a   Rutishauser, Ueli ^b   Chicca, Elisabetta ^a,c   Indiveri, Giacomo ^a   Douglas, Rodney J ^a  

^a Institute of Neuroinformatics Zurich   (Switzerland)

^b MAX PLANCK INSTITUTE FOR BRAIN RESEARCH   (Germany)

^c BIELEFELD UNIVERSITY   (Germany)

Author keywords

Analog very large scale integration; Artificial neural systems; Decision making; Sensorimotor; Working memory

Indexed keywords

SILICON;

ANALYTIC METHOD; ARTICLE; BRAIN MAPPING; COGNITION; COGNITIVE SYNTHESIS; COMPUTATIONAL FLUID DYNAMICS; CONTROLLED STUDY; FEEDBACK SYSTEM; HUMAN; INTERPERSONAL COMMUNICATION; NERVE CELL; NERVE CELL NETWORK; NEUROMORPHIC ELECTRONIC SYSTEM; PRIORITY JOURNAL; SELECTIVE ATTENTION; SIGNAL TRANSDUCTION; SPIKE; STEADY STATE; SWTA NETWORK; WORKING MEMORY;

ANALOG VERY LARGE-SCALE INTEGRATION; ARTIFICIAL NEURAL SYSTEMS; DECISION MAKING; SENSORIMOTOR; WORKING MEMORY;

ANIMALS; ARTIFICIAL INTELLIGENCE; COGNITION; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PRIMATES; SEMICONDUCTORS;

EID: 84883772282     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1212083110     Document Type: Article

References (73)

1. Mead CA (1989) Analog VLSI and Neural Systems (Addison-Wesley, Reading, MA).
2. von Neumann J (1958) The Computer and the Brain (Yale Univ Press, New Haven, CT).
3. Sarpeshkar R (1998) Analog versus digital: Extrapolating from electronics to neurobiology. Neural Comput 10(7):1601-1638.
4. Indiveri G, Horiuchi TK (2011) Frontiers: Frontiers in neuromorphic engineering. Front Neurosci 5, 10.3389/fnins.2011.00118.
5. Seo J, et al. (2011) A 45nm cmos neuromorphic chip with a scalable architecture for learning in networks of spiking neurons. Custom Integrated Circuits Conference (CICC) (Institute of Electrical and Electronic Engineers, New York), pp 1-4.
6. Silver R, Boahen K, Grillner S, Kopell N, Olsen KL (2007)Neurotech for neuroscience: Unifying concepts, organizing principles, and emerging tools. J Neurosci 27(44):11807-11819. (Pubitemid 350072090)
7. Schemmel J, et al. (2010) A wafer-scale neuromorphic hardware system for large-scale neural modeling. International Symposium on Circuits and Systems, ISCAS 2010 (Institute of Electrical and Electronic Engineers), pp 1947-1950.
8. Furber S, et al. (2012) Overview of the spinnaker system architecture. IEEE Trans Comput 99:1.
9. Dayan P (2008) Simple substrates for complex cognition. Front Neurosci 2(2):255-263.
10. Asaad WF, Rainer G, Miller EK (2000) Task-specific neural activity in the primate prefrontal cortex. J Neurophysiol 84(1):451-459. (Pubitemid 30490064)
11. Mansouri FA, Matsumoto K, Tanaka K (2006) Prefrontal cell activities related to monkeys' success and failure in adapting to rule changes in a Wisconsin Card Sorting Test analog. J Neurosci 26(10):2745-2756. (Pubitemid 43357858)
12. Douglas RJ, Martin KAC (2004) Neuronal circuits of the neocortex. Annu Rev Neurosci 27:419-451. (Pubitemid 39050409)
13. Bousquet O, Elisseeff A (2002) Stability and generalization. J Mach Learn Res 2:499-526. (Pubitemid 135712570)
14. Yuille AL, Geiger D (2003) Winner-Take-All Networks (MIT Press, Cambridge, MA), pp 1228-1231.
15. Amari S, Arbib MA (1977) Competition and cooperation in neural nets. Systems Neuroscience, ed Metzler J (Academic, London), pp 119-165.
16. Rutishauser U, Douglas RJ (2009) State-dependent computation using coupled recurrent networks. Neural Comput 21(2):478-509.
17. Douglas RJ, Mahowald MA, Martin KAC (1994) Hybrid analog-digital architectures for neuromorphic systems. Proceedings of the IEEE World Congress on Computational Intelligence (Institute of Electrical and Electronic Engineers, New York), Vol 3, pp 1848-1853.
18. Rutishauser U, Douglas RJ, Slotine JJ (2010) Collective stability of networks of winner-take- all circuits. Neural Comput 23(3):735-773.
19. Neftci E, Chicca E, Indiveri G, Douglas R (2011) A systematic method for configuring VLSI networks of spiking neurons. Neural Comput 23(10):2457-2497.
20. Indiveri G, Chicca E (2011) A VLSI neuromorphic device for implementing spike-based neural networks. Neural Nets WIRN11 - Proceedings of the 21st Italian Workshop on Neural Nets, eds Bassis S, Esposito A, Morabito CF, Apolloni B (IOS Press, Amsterdam), Vol 234, pp 305-316.
21. Bartolozzi C, Indiveri G (2009) Selective attention in multi-chip address-event systems. Sensors (Basel) 9(7):5076-8098.
22. Lichtsteiner P, Posch C, Delbruck T (2006) A 128x128 120dB 30mW asynchronous vision sensor that responds to relative intensity change. IEEE ISSCC Digest of Technical Papers (IEEE International, New York), pp 508-509.
23. Deiss SR, Douglas RJ, Whatley AM (1998) A pulse-coded communications infrastructure for neuromorphic systems. Pulsed Neural Networks, eds MaassW, Bishop CM (MIT Press, Cambridge, MA), pp 157-178.
24. The jAER open source project (2006) SourceForge web-site. Available at http://sourceforge.net/projects/jaer. Accessed July 3, 2013.
25. Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosci 18:193-222.
26. Kohavi Z (1979) Switching and Finite Automata Theory (Cambridge Univ Press, Cambridge, UK), 3rd Ed.
27. Krueger KA (2011) Sequential learning in the form of shaping as a source of cognitive flexibility. PhD thesis (University College London, London).
28. Koechlin E, Basso G, Pietrini P, Panzer S, Grafman J (1999) The role of the anterior prefrontal cortex in human cognition. Nature 399(6732):148-151.
29. Fusi S, Asaad WF, Miller EK, Wang XJ (2007) A neural circuit model of flexible sensorimotor mapping: Learning and forgetting on multiple timescales. Neuron 54(2):319-333. (Pubitemid 46561200)
30. O'Reilly RC, Frank MJ (2006) Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput 18(2):283-328. (Pubitemid 43543839)
31. Rigotti M, Ben Dayan Rubin DD, Wang X-J, Fusi S (2010) Internal representation of task rules by recurrent dynamics: The importance of the diversity of neural responses. Front Comput Neurosci, 10.3389/fncom.2010.00024.
32. Amit DJ, Brunel N (1997) Dynamics of a recurrent network of spiking neurons before and following learning. Network 8(4):373-404. (Pubitemid 127717691)
33. Martí D, Deco G, Mattia M, Gigante G, Del Giudice P (2008) A fluctuation-driven mechanism for slow decision processes in reverberant networks. PLoS ONE 3(7):e2534.
34. Bishop CM (2006) Pattern Recognition and Machine Learning (Springer, Secaucus, NJ).
35. Asaad WF, Rainer G, Miller EK (1998) Neural activity in the primate prefrontal cortex during associative learning. Neuron 21(6):1399-1407. (Pubitemid 29022541)
36. Frank MJ, Loughry B, O'Reilly RC (2001) Interactions between frontal cortex and basal ganglia in working memory: A computational model. Cogn Affect Behav Neurosci 1(2):137-160 10.3758/CABN.1.2.137. (Pubitemid 38392490)
37. Dayan P (2007) Bilinearity, rules, and prefrontal cortex. Front Comput Neurosci, 10.3389/neuro.10.001.2007.
38. Heinzle J, Hepp K, Martin KAC (2007) A microcircuit model of the frontal eye fields. J Neurosci 27(35):9341-9353. (Pubitemid 47358213)
39. Eliasmith C, et al. (2012) A large-scale model of the functioning brain. Science 338 (6111):1202-1205.
40. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8(12):1704-1711. (Pubitemid 41683198)
41. Liu S-C, Kramer J, Indiveri G, Delbrück T, Douglas R (2002) Analog VLSI: Circuits and Principles (MIT Press, Cambridge, MA).
42. Indiveri G, et al. (2011) Neuromorphic silicon neuron circuits. Front Neurosci 5:73.
43. Preissl R, et al. (2012) Compass: A scalable simulator for an architecture for cognitive computing. Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 2012), ed Hollingsworth JK (IEEE Computer Society Press Los Alamitos, CA), pp 1-11.
44. Choudhary S, et al. (2012) Silicon neurons that compute. ICANN 2012:121-128.
45. Hahnloser R, Sarpeshkar R, Mahowald MA, Douglas RJ, Seung S (2000) Digital selection and analog amplification co-exist in an electronic circuit inspired by neocortex. Nature 405(6789):947-951. (Pubitemid 30435050)
46. Feldman JA, Ballard DH (1982) Connectionist models and their properties. Cogn Sci 6(3):205-254.
47. Grossberg S (1973) Contour enhancement, short term memory, and constancies in reverberating neural networks. Stud Appl Math 52(3):213-257.
48. Binzegger T, Douglas RJ, Martin KA (2004) A quantitative map of the circuit of cat primary visual cortex. J Neurosci 24(39):8441-8453. (Pubitemid 39313766)
49. Mitra S, Fusi S, Indiveri G (2009) Real-time classification of complex patterns using spike-based learning in neuromorphic VLSI. IEEE Trans Biomed Circuits Syst 3(1):32-42.
50. Giulioni M, Pannunzi M, Badoni D, Dante V, Del Giudice P (2009) Classification of correlated patterns with a configurable analog VLSI neural network of spiking neurons and self-regulating plastic synapses. Neural Comput 21(11):3106-3129.
51. Vapnik VN (1982) Estimation of Dependences Based on Empirical Data (Springer, New York).
52. Kearns M, Ron D (1999) Algorithmic stability and sanity-check bounds for leave-oneout cross-validation. Neural Comput 11(6):1427-1453.
53. Gigante G, Mattia M, Braun J, Del Giudice P (2009) Bistable perception modeled as competing stochastic integrations at two levels. PLoS Comput Biol 5(7):e1000430.
54. Sreenivasan S, Fiete I (2011) Grid cells generate an analog error-correcting code for singularly precise neural computation. Nat Neurosci 14(10):1330-1337.
55. Jones LM, Fontanini A, Sadacca BF, Miller P, Katz DB (2007) Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles. Proc Natl Acad Sci USA 104(47):18772-18777. (Pubitemid 350210772)
56. Bartolozzi C, et al. (2011) Embedded neuromorphic vision for humanoid robots. The Seventh IEEE Workshop on Embedded Computer Vision, ECVW 2011 (Institute of Electrical and Electronic Engineers, New York), pp 1-7.
57. Delbruck T (2008) Frame-free dynamic digital vision. Proceedings of the International Symposium on Secure-Life Electronics, ed Hotate K (Univ of Tokyo, Tokyo) Vol 1, pp 21-26.
58. Chicca E, Lichtsteiner P, Delbruck T, Indiveri G, Douglas RJ (2006) Modeling orientation selectivity using a neuromorphic multi-chip system. International Symposium on Circuits and Systems, ISCAS 2006 (Institute of Electrical and Electronic Engineers, New York), pp 1235- 1238.
59. Vogelstein RJ, Mallik U, Vogelstein JT, Cauwenberghs G (2007) Dynamically reconfigurable silicon array of spiking neurons with conductance-based synapses. IEEE Trans Neural Netw 18(1):253-265. (Pubitemid 46062931)
60. Camunas-Mesa L, et al. (2012) An event-driven multi-kernel convolution processor module for event-driven vision sensors. Solid-State Circuits IEEE Jf 47(2):504-517.
61. Arthur JV, et al. (2012) Building block of a programmable neuromorphic substrate: A digital neurosynaptic core. International Joint Conference on Neural Networks, IJCNN 2012 (Institute of Electrical and Electronic Engineers), pp 1946-1953.
62. Wang XJ (1999) Synaptic basis of cortical persistent activity: The importance of NMDA receptors to working memory. J Neurosci 19(21):9587-9603.
63. Fusi S, Mattia M (1999) Collective behavior of networks with linear (VLSI) integrate-and- fire neurons. Neural Comput 11(3):633- 652.
64. Brunel N (2000) Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci 8(3):183-208.
65. Neftci E, Chicca E, Cook M, Indiveri G, Douglas RJ (2010) State-dependent sensory processing in networks of vlsi spiking neurons. International Symposium on Circuits and Systems, ISCAS 2010 (Institute of Electrical and Electronic Engineers, New York), pp 2789-2792.
66. Lazzaro J, Wawrzynek J, Mahowald M, Sivilotti M, Gillespie D (1993) Silicon auditory processors as computer peripherals. IEEE Trans Neural Netw 4(3):523-528. (Pubitemid 23684030)
67. Fasnacht DB, Indiveri G (2011) A PCI based high-fanout AER mapper with 2 GiB RAM look-up table, 0.8 μs latency and 66 mhz output event-rate. Conference on Information Sciences and Systems, CISS 2011 (Johns Hopkins University, Baltimore), pp 1-6.
68. Bartolozzi C, Indiveri G (2007) Synaptic dynamics in analog VLSI. Neural Comput 19 (10):2581-2603.
69. Chicca E, Indiveri G, Douglas RJ (2007) Context dependent amplification of both rate and event-correlation in a VLSI network of spiking neurons. Advances in Neural Information Processing Systems, eds Schölkopf B, Platt JC, Hofmann T (Neural Information Processing Systems Foundation, MIT Press, Cambridge, MA), Vol 19, pp 257-264.
70. Rodger SH, Finley TW (2006) JFLAP - An Interactive Formal Languages and Automata Package (Jones & Bartlett Learning, Sudbury, MA).
71. Sheik S, Stefanini F, Neftci E, Chicca E, Indiveri G (2011) Systematic configuration and automatic tuning of neuromorphic systems. International Symposium on Circuits and Systems, ISCAS 2011 (Institute of Electrical and Electronic Engineers, New York), pp 873-876.
72. Neftci E, Indiveri G (2010) A device mismatch reduction method for VLSI spiking neural networks. Biomedical Circuits and Systems Conference BIOCAS 2010 (Institute of Electrical and Electronic Engineers, New York), pp 262-265.
73. Straw AD (2008) Vision egg: An open-source library for realtime visual stimulus generation. Front Neuroinform 2:4.