Memristor-based neural networks

Journal of Physics D: Applied Physics

Volumn 46, Issue 9, 2013, Pages

  Thomas, Andy ^a,b  

^a BIELEFELD UNIVERSITY   (Germany)

^b UNIVERSITY OF HAMBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL NEURAL NETWORKS; COMPLEX MECHANISMS; EXPERIMENTAL REALIZATIONS; LONG-TERM POTENTIATIONS; MEMRISTIVE SYSTEMS; MODEL SYSTEM; RECENT PROGRESS; SYNAPTIC CONNECTIONS; TIME-DEPENDENT;

BIOLOGICAL SYSTEMS; NEURAL NETWORKS; PASSIVE FILTERS; RESISTORS;

MEMRISTORS;

EID: 84874057890     PISSN: 00223727     EISSN: 13616463     Source Type: Journal    
DOI: 10.1088/0022-3727/46/9/093001     Document Type: Review

References (127)

1. Chua L 1971 Memristor - the missing circuit element IEEE Trans. Circuit Theory 18 507-19
2. Di Ventra M, Pershin Y V and Chua L O 2009 Circuit elements with memory: memristors, memcapacitors, and meminductors Proc. IEEE 97 1717-24
3. Di Ventra M, Pershin Y V and Chua L O 2009 Putting memory into circuit elements: memristors, memcapacitors, and meminductors Proc. IEEE 97 1371-2
4. Chua L and Kang S M 1976 Memristive devices and systems Proc. IEEE 64 209-23
5. Pershin Y V and Di Ventra M 2011 Memory effects in complex materials and nanoscale systems Adv. Phys. 60 145-227
6. Collier C P, Wong E W, Belohradsky M, Raymo F M, Stoddart J F, Kuekes P J, Williams R S and Heath J R 1999 Electronically configurable molecular-based logic gates Science 285 391-4 (Pubitemid 29343957)
7. Snider G, Kuekes P and Williams R S 2004 CMOS-like logic in defective, nanoscale crossbars Nanotechnology 15 881-91
8. Snider G 2005 Computing with hysteretic resistor crossbars Appl. Phys. A 80 1165-72 (Pubitemid 40454134)
9. Snider G S 2007 Self-organized computation with unreliable, memristive nanodevices Nanotechnology 18 365202 (Pubitemid 47413703)
10. Yang J J, Miao F, Pickett M D, Ohlberg D A A, Stewart D R, Lau C N and Williams R S 2009 The mechanism of electroforming of metal oxide memristive switches Nanotechnology 20 215201
11. x memristive devices Appl. Phys. Lett. 97 232102
12. Waser R and Aono M 2007 Nanoionics-based resistive switching memories Nature Mater. 6 833-40 (Pubitemid 350064191)
13. Despotuli A L and Nikolaichik V I 1993 A step towards nanoionics Solid State Ion. 60 275-8
14. Strukov D B, Snider G S, Stewart D R and Williams R S 2008 The missing memristor found Nature 453 80-3 (Pubitemid 351630336)
15. Krzysteczko P, Münchenberger J, Schäfers M, Reiss G and Thomas A 2012 The memristive magnetic tunnel junction as a nanoscopic synapse-neuron system Adv. Mater. 24 762-6
16. Borghetti J, Snider G S, Kuekes P J, Yang J J, Stewart D R and Williams R S 2010 'Memristive' switches enable 'stateful' logic operations via material implication Nature 464 873-6
17. Borghetti J, Li Z, Straznicky J, Li X, Ohlberg D A A, Wu W, Stewart D R and Williams R S 2009 A hybrid nanomemristor/transistor logic circuit capable of self-programming Proc. Natl Acad. Sci. 106 1699-703
18. Xia Q et al 2009 Memristor-CMOS hybrid integrated circuits for reconfigurable logic Nano Lett. 9 3640-5
19. Yan H, Choe H S, Nam S W, Hu Y and Das S 2011 Programmable nanowire circuits for nanoprocessors Nature 470 240-4
20. Muenchenberger J, Krzysteczko P, Reiss G and Thomas A 2011 Improved reliability of magnetic field programmable gate arrays through the use of memristive tunnel junctions J. Appl. Phys. 110 096105
21. Linn E, Rosezin R, Kuegeler C and Waser R 2010 Complementary resistive switches for passive nanocrossbar memories Nature Mater. 9 403-6
22. 2x bilayer structures Nature Mater. 10 625-30
23. Chen X, Wu G and Dinghua B 2008 Resistive switching behaviour of Pt/Mg0.2Zn0.8O/Pt devices for nonvolatile memory applications Appl. Phys. Lett. 93 093501
24. Biolek Z, Biolek D and Biolkova V 2009 SPICE model of memristor with nonlinear dopant drift Radioengineering 18 210-4
25. Rak A and Cserey G 2010 Macromodeling of the memristor in SPICE IEEE Trans. Comput. Aided Des. 29 632-6
26. Shin S and Kim K 2010 Compact models for memristors based an charge-flux constitutive relationships IEEE Trans. Comput. Aided Des. 29 590-8
27. Kavehei O, Iqbal A, Kim Y S, Eshraghian K, Al-Sarawi S F and Abbott D 2010 The fourth element: characteristics, modelling and electromagnetic theory of the memristor Proc. R. Soc. A 466 2175-202
28. Batas D and Fiedler H 2011 A memristor SPICE implementation and a new approach for magnetic flux-controlled memristor modeling IEEE Trans. Nanotechnol. 10 250-5
29. Hebb D O 1949 The Organization of Behavior (New York: Wiley) A Neuropsychological Theory
30. Cantley K D, Subramaniam A, Stiegler H J, Chapman R A and Vogel E M 2011 Hebbian learning in spiking neural networks with nanocrystalline silicon TFTs and memristive synapses IEEE Trans. Nanotechnol. 10 1066-73
31. Bichler O, Zhao W, Alibart F, Pleutin S, Vuillaume D and Gamrat C 2010 Functional model of a nanoparticle organic memory transistor for use as a spiking synapse IEEE Trans. Electron Dev. 57 3115-22
32. Rachmuth G, Shouval H Z, Bear M F and Poon C-S 2011 A biophysically-based neuromorphic model of spike rate- and timing-dependent plasticity Proc. Natl Acad. Sci. 108 E1266-74
33. Kim H, Sah M Pd, Yang C, Roska T and Chua L O 2012 Neural synaptic weighting with a pulse-based memristor circuit IEEE Trans. Circuits-I 59 148-58
34. Eccles J C and McIntyre A K 1951 Plasticity of mammalian monosynaptic reflexes Nature 167 466-8
35. Cajal S R 1995 Histology of the Nervous System of Man and Vertebrates (Oxford: Oxford University Press)
36. Konorski J 1948 Conditioned Reflexes and Neuron Organization (Cambridge: Cambridge University Press)
37. Hyman S E and Nestler E J 1993 The Molecular Foundations of Psychiatry
38. Deuchars J, West D C and Thomson A M 1994 Relationships between morphology and physiology of pyramid-pyramid single axon connections in rat neocortex in vitro J. Physiol. 478 423-35 (Pubitemid 24243212)
39. Daumas S, Ceccom J, Halley H, Frances B and Lassalle J M 2009 Activation of metabotropic glutamate receptor type 2/3 supports the involvement of the hippocampal mossy fiber pathway on contextual fear memory consolidation Learning Mem. 16 504-7
40. Curtis D R and Eccles J C 1959 The time courses of excitatory and inhibitory synaptic actions J. Physiol. 145 529-46
41. Doyere V and Laroche S 1992 Linear relationship between the maintenance of hippocampal long-term potentiation and retention of an associative memory Hippocampus 2 39-48
42. Morris R G M, Davis S and Butcher S P 1990 Hippocampal synaptic plasticity and nmda receptors - a role in information-storage Phil. Trans. R. Soc. B 329 187-204
43. Bliss T V P and Collingridge G L 1993 A synaptic model of memory - long-term potentiation in the hippocampus Nature 361 31-9 (Pubitemid 23020772)
44. Bliss T V P and Lømo T 1973 Long-lasting potentiation of synaptic transmission in dentate area of anesthetized rabbit following stimulation of perforant path J. Physiol. 232 331-56
45. Bliss T V P and Gardner-Medwin A R 1973 Long-lasting potentiation of synaptic transmission in dentate area of unanesthetized rabbit following stimulation of perforant path J. Physiol. 232 357-74
46. McNaughton B L, Douglas R M and Goddardd G V 1978 Synaptic enhancement in fascia dentata - cooperativity among coactive afferents Brain Res. 157 277-93 (Pubitemid 9037711)
47. Malenka R C 1991 Postsynaptic factors control the duration of synaptic enhancement in area ca1 of the hippocampus Neuron 6 53-60
48. Barrionuevo G and Brown T H 1983 Associative long-term potentiation in hippocampal slices Proc. Natl Acad. Sci. 80 7347-51 (Pubitemid 14208855)
49. Levy W B and Steward O 1979 Synapses as associative memory elements in the Hippocampal-formation Brain Res. 175 233-45 (Pubitemid 9229461)
50. Lynch G S, Dunwiddie T and Gribkoff V 1977 Heterosynaptic depression - postsynaptic correlate of long-term potentiation Nature 266 737-9 (Pubitemid 8073808)
51. Andersen P, Sundberg S H, Sveen O and Wigström H 1977 Specific long-lasting potentiation of synaptic transmission in hippocampal slices Nature 266 736-7 (Pubitemid 8073807)
52. Goda Y and Stevens C F 1996 Long-term depression properties in a simple system Neuron 16 103-11 (Pubitemid 26044733)
53. Rubin D C and Wenzel A E 1996 One hundred years of forgetting: A quantitative description of retention Psychol. Rev. 103 734-60
54. Diamond D M, Fleshner M and Rose G M 1994 Psychological stress repeatedly blocks hippocampal primed burst potentiation inbehaving rats Behav. Brain Res. 62 1-9 (Pubitemid 24171555)
55. Xu L, Anwyl R and Rowan M J 1998 Spatial exploration induces a persistent reversal of long-term potentiation in rat hippocampus Nature 394 891-4 (Pubitemid 28410910)
56. Manahan-Vaughan D and Braunewell K H 1999 Novelty acquisition is associated with induction of hippocampal long-term depression Proc. Natl Acad. Sci. 96 8739-44 (Pubitemid 29354861)
57. Ge Y, Dong Z, Bagot R C, Howland J G, Phillips A G, Wong T P and Wang Y T 2010 Hippocampal long-term depression is required for the consolidation of spatial memory Proc. Natl Acad. Sci. 107 16697-702
58. Chang T, Jo S H and Lu W 2011 Short-term memory to long-term memory transition in a nanoscale memristor ACS Nano. 5 7669-76
59. Bi G-q and Poo M-m 1998 synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type J. Neurosci. 18 10464-72
60. Hopfield J J 1995 Pattern-recognition computation using action-potential timing for stimulus representation Nature 376 33-6
61. Mainen Z F and Sejnowski T J 1995 Reliability of spike timing in neocortical neurons Science 268 1503-6
62. de Ruyter van Steveninck R R, Lewen G D, Strong S P, Koberle R and Bialek W 1997 Reproducibility and variability in neural spike trains Science 275 1805-8 (Pubitemid 27136720)
63. Gerstner W and Abbott L F 1997 Learning navigational maps through potentiation and modulation of hippocampal place cells J. Comput. Neurosci. 4 79-94 (Pubitemid 27078021)
64. Mehta M R, Barnes C A and McNaughton B L 1997 Experience-dependent, asymmetric expansion of hippocampal placefields Proc. Natl Acad. Sci. 94 8918-21 (Pubitemid 27335140)
65. Cassenaer S and Laurent G 2007 Hebbian STDP in mushroom bodies facilitates the synchronous flow of olfactory information in locusts Nature 448 709-12 (Pubitemid 47236855)
66. Lapicque L 1907 Lapicque: Recherches quantitatives sur l'excitation des nerfs traitée comme une polarisation J. Physiol. Pathol. Gen. 9 620-35
67. Lapicque L 1926 L'excitabilit en fonction du temps (Paris: Presses Universitaires de France)
68. Stein R B 1967 Frequency of nerve action potentials generated by applied currents Proc. R. Soc. Lond. B 167 64-86
69. Knight B W 1972 Dynamics of encoding in a population of neurons J. Gen. Physiol. 59 734
70. Jack J J B, Noble D and Tsien R W 1983 Electric Current Flow in Excitable Cells (New York: Oxford)
71. Tuckwell H C 2008 Introduction to Theoretical Neurobiology (Cambridge: Cambridge University Press)
72. Koch C 1999 Biophysics of Computation (Oxford: Oxford University Press)
73. Aziz P M, Sorensen H V and van der Spiegel J 1996 An overview of sigma-delta converters IEEE Signal Proc. Mag. 13 61-84
74. Wong P W and Gray R M 1990 Sigma-delta modulation with I.I.D. Gaussian inputs IEEE Trans. Inform. Theory 36 784-98 (Pubitemid 20725143)
75. Mead C 1990 Neuromorphic electronic systems Proc. IEEE 78 1629-36
76. Snider G S 2008 Spike-timing-dependent learning in memristive nanodevices IEEE Int. Symp. Nanoscale Architectures (NANOARCH 2008) (Washington, DC, 12-13 June 2008) pp 85-92
77. Carpenter G A, Milenova B L and Noeske B W 1998 Distributed ARTMAP: a neural network for fast distributed supervised learning Neural Networks 11 793-813 (Pubitemid 28430553)
78. Fusi S and Abbott L F 2007 Limits on the memory storage capacity of bounded synapses Nature Neurosci. 10 485-93 (Pubitemid 46494580)
79. Pershin Y V and Di Ventra M 2010 Experimental demonstration of associative memory with memristive neural networks Neural Networks 23 881-6
80. Pershin Y V and Di Ventra M 2010 Neuromorphic, digital, and quantum computation with memory circuit elements Proc. IEEE 100 2071-80
81. Pavlov I 1927 Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex (Oxford: Oxford University Press)
82. Cantley K D, Subramaniam A, Stiegler H J, Chapman R A and Vogel E M 2012 Neural learning circuits utilizing nano-crystalline silicon transistors and memristors IEEE Trans. Neur. Net. Lear 23 565-73
83. Afifi A, Ayatollahi A and Raissi F 2009 STDP implementation using memristive nanodevice in CMOS-Nano neuromorphic networks Ieice. Electron. Expr. 6 148-53
84. Turel O, Lee J H, Ma X L and Likharev K K 2004 Neuromorphic architectures for nanoelectronic circuits Int. J. Circ. Theor. App. 32 277-302
85. Indiveri G, Chicca E and Douglas R 2006 A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity IEEE Trans. Neural. Netw. 17 211-21 (Pubitemid 43272460)
86. Jo S H, Chang T, Ebong I, Bhadviya B B, Mazumder P and Lu W 2010 Nanoscale memristor device as synapse in neuromorphic systems Nano Lett. 10 1297-301
87. Chang T, Jo S H, Kim K-H, Sheridan P, Gaba S and Lu W 2011 Synaptic behaviors and modeling of a metal oxide memristive device Appl. Phys. A 102 857-63
88. Gray C M and McCormick D A 1996 Chattering cells: superficial pyramidal neurons contributing to the generation of synchronous oscillations in the visual cortex Science 274 109-13 (Pubitemid 26332736)
89. Myers E, Ralph D, Katine J and Louie R 1999 Current-induced switching of domains in magnetic multilayer devices Science 285 867-70 (Pubitemid 29381982)
90. Huai Y, Albert F, Nguyen P, Pakala M and Valet T 2004 Observation of spin-transfer switching in deep submicron-sized and low-resistance magnetic tunnel junctions Appl. Phys. Lett. 84 3118
91. Hayakawa J, Ikeda S, Lee Y M, Sasaki R, Meguro T, Matsukura F, Takahashi H and Ohno H 2005 Current- driven magnetization switching in CoFeB/MgO/CoFeB magnetic tunnel junctions Japanese J. Appl. Phys. 44 L1267-70 (Pubitemid 43200691)
92. Sun J, Gaidis M, Hu G, O'Sullivan E and Brown S 2009 High-bias backhopping in nanosecond time-domain spin-torque switches of MgO-based magnetic tunnel junctions J. Appl. Phys. 105 07D109
93. Min T, Sun J, Beach R, Tang D and Wang P 2009 Back-hopping after spin torque transfer induced magnetization switching in magnetic tunneling junction cells J. Appl. Phys. 105 07D126
94. Krzysteczko P, Reiss G and Thomas A 2009 Memristive switching of MgO based magnetic tunnel junctions Appl. Phys. Lett. 95 112508
95. Krzysteczko P, Kou X, Rott K, Thomas A and Reiss G 2009 Current induced resistance change of magnetic tunnel junctions with ultra-thin MgO tunnel barriers J. Magn. Magn. Mater. 321 144-7
96. Josephson B D 1962 Possible new effects in superconductive tunneling Phys. Lett. 1 251-3
97. Meservey R and Tedrow P M 1994 Spin-polarized electron-tunneling Phys. Rep. 238 173-243
98. Moodera J S and Mathon G 1999 Spin polarized tunneling in ferromagnetic junctions J. Magn. Magn. Mater. 200 248-73 (Pubitemid 32077516)
99. Wrona J, Langer J, Ocker B, Maass W, Kanak J, Stobiecki T and Powroźnik W 2010 Low resistance magnetic tunnel junctions with MgO wedge barrier J. Phys.: Conf. Ser. 200 052032
100. Prinz G 1998 Magnetoelectronics Science 282 1660-3 (Pubitemid 28549273)
101. Likharev K K 2011 Cross nets: neuromorphic hybrid cmos/nanoelectronic networks Sci. Adv. Mater. 3 322-31
102. Snider G et al 2011 From synapses to circuitry: using memristive memory to explore the electronic brain Computer 44 21-8
103. Berzina T, Smerieri A, Bernabo M, Pucci A, Ruggeri G, Erokhin V and Fontana M P 2009 Optimization of an organic memristor as an adaptive memory element J. Appl. Phys. 105 124515
104. Erokhin V, Schuez A and Fontana M P 2010 Organic memristor and bio-inspired information processing Int. J. Unconv. Comput. 6 15-32
105. Pershin Y V and Di Ventra M 2012 Teaching memory circuit elements via experiment-based learning IEEE Circut. Syst. Mag. 12 64-74
106. Carpenter G A 1989 Neural network models for pattern recognition and associative memory Neural Networks 2 243-57
107. Snider G 2011 Instar and outstar learning with memristive nanodevices Nanotechnol. 22 015201
108. Itoh M and Chua L O 2009 Memristor cellular automata and memristor discrete-time cellular neural networks Int. J. Bifurcat. Chaos 19 3605-56
109. Pershin Y V and Di Ventra M 2011 Solving mazes with memristors: A massively parallel approach Phys. Rev. E 84 046703
110. Nakagaki T, Yamada H and Toth A 2000 Maze-solving by an amoeboid organism Nature 407 470-470
111. Steels L, Babloyantz and Sepulchre J A 1991 Path finding with nonlinear waves Proc. Int. Conf. on Artificial Neural Networks (Espoo, Finland,)
112. Sepulchre J A and Babloyantz A 1993 Motions of spiral waves in oscillatory media and in the presence of obstacles Phys. Rev. E 48 187-95
113. Steinbock O, Toth A and Showalter K 1995 Navigating complex labyrinths: optimal paths from chemical waves Science 267 868-71
114. Williams G, Showalter K and Steinbock O 1995 Minimal path algorithms - reply Science 269 418-8
115. Pershin Y, Fontaine S L and Di Ventra M 2009 Memristive model of amoeba learning Phys. Rev. E 80 021926
116. Lindsten J 1998 Nobel Lectures in Physiology or Medicine 1971-80 (Singapore: World Scientific)
117. Hodgkin A L and Huxley A F 1952 A quantitative description of membrane current and its application to conduction and excitation in nerve J. Physiol. 117 500-44
118. Young J Z 1936 The structure of nerve fibres in Cephalopods and Crustacea Proc. R. Soc. Lond. B 121 319-37
119. Chua L O 1998 CNN: A Paradigm for Complexity (Singapore: World Scientific)
120. Chua L, Sbitnev V and Kim H 2012 Hodgkin-Huxley axon is made of memristors Int. J. Bifurcat. Chaos 22 1230011
121. Chua L O 1969 Introduction to Nonlinear Network Theory (New York: McGraw-Hill)
122. Chua L O, Desoer C A and Kuh E S 1987 Linear and Nonlinear Circuits (New York: McGraw-Hill)
123. Mauro A 1961 Anomalous impedance, a phenomenological property of time-variant resistance - an analytic review Biophys. J. 1 353-72
124. Cole K S 1941 Rectification and inductance in the squid giant axon J. Gen. Physiol. 25 29-51
125. Cole K S and Baker R F 1941 Longitudinal impedance of the squid giant axon J. Gen. Physiol. 24 771-88
126. Cole K 1972 Membranes, Ions and Impulses (Berkeley, CA: University of California Press)
127. Chua L, Sbitnev V and Kim H 2012 Neurons are poised near the edge of chaos Int. J. Bifurcat. Chaos 22 1250098