A theoretical and experimental study of neuromorphic atomic switch networks for reservoir computing

Nanotechnology

Volumn 24, Issue 38, 2013, Pages

  Sillin, Henry O ^a   Aguilera, Renato ^b   Shieh, Hsien Hang ^b   Avizienis, Audrius V ^a   Aono, Masakazu ^c   Stieg, Adam Z ^b,c   Gimzewski, James K ^a,b,c,d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CALIFORNIA NANOSYSTEMS INSTITUTE   (United States)

^c NATIONAL INSTITUTE FOR MATERIALS SCIENCE   (Japan)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ATOMIC SWITCHES; BIOLOGICAL NEURAL NETWORKS; NETWORK PLASTICITY; NEUROMORPHIC COMPUTING; RESERVOIR COMPUTING; SIMULATED NETWORKS; SPECIFIC TASKS; UNIFIED APPROACH;

ATOMS; HARMONIC GENERATION; NEURAL NETWORKS;

SWITCHING CIRCUITS;

SILVER;

BIOLOGICAL MODEL; CHEMISTRY; COMPUTER SIMULATION; DEVICES; ELECTRONICS; MOLECULAR COMPUTER; NANOTECHNOLOGY; SYNAPSE; ARTICLE; EQUIPMENT;

COMPUTER SIMULATION; COMPUTERS, MOLECULAR; ELECTRONICS; MODELS, NEUROLOGICAL; NANOTECHNOLOGY; SILVER; SYNAPSES;

EID: 84883540461     PISSN: 09574484     EISSN: 13616528     Source Type: Journal    
DOI: 10.1088/0957-4484/24/38/384004     Document Type: Article

References (61)

1. - 2011 International Technology Roadmap for Semiconductors: Emerging Research Devices (San Jose: Semiconductor Industry Association)
2. Mead C 1990 Neuromorphic electronic systems Proc. IEEE 78 1629-36
3. Mahowald M and Douglas R 1991 A silicon neuron Nature 354 515-8 (Pubitemid 21896829)
4. Indiveri G et al 2011 Neuromorphic silicon circuits Front. Neurosci. 5 1-23
5. Jeong D S, Kim I, Ziegler M and Kohlstedt H 2013 Towards artificial neurons and synapses: materials point of view RSC Adv. 3 3169-83
6. Likharev K K and Strukov D B 2005 CMOL: devices, circuits, and architectures Introducing Molecular Electronics vol 680 pp 447-77 (Pubitemid 44445609)
7. Borghetti J, Li Z, Straznicky J, Li X, Ohlberg D A A, Wu W, Stewart D R and Williams R S 2008 A hybrid nanomemristor/transistor logic circuit capable of self programming Proc. Natl Acad. Sci. 106 1699-703
8. Xia Q et al 2009 Memristor - CMOS hybrid integrated circuits for reconfigurable logic Nano Lett. 9 3640-5
9. Zhao W S, Agnus G, Derycke V, Filoramo A, Bourgoin J-P and Gamrat C 2010 Nanotube devices based crossbar architecture: toward neuromorphic computing Nanotechnology 21 175202
10. Chang T, Jo S, Kim K, Sheridan P, Gaba S and Lu W 2011 Synaptic behaviors and modeling of a metal oxide memristive device Appl. Phys. A 102 857-63
11. Kugeler C, Rosezin R, Linn E, Bruchhaus R and Waser R 2011 Materials, technologies, and circuit concepts for nanocrossbar-based bipolar RRAM Appl. Phys. A 102 791-809
12. Seo K et al 2011 Analog memory and spike-timing-dependent plasticity characteristics of a nanoscale titanium oxide bilayer resistive switching device Nanotechnology 22 254023
13. Cruz-Albrecht J M, Yung M W and Srinivasa N 2012 Energy-efficient neuron, synapse and STDP integrated circuits IEEE Trans. Biomed. Circuits Syst. 6 246-56
14. Kim K-H, Gaba S, Wheeler D, Cruz-Albrecht J M, Hussain T, Srinivasa N and Lu W 2012 A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications Nano Lett. 12 389-95
15. Kuzum D, Jeyasingh R G D, Yu S and Wong H S P 2012 Low-energy robust neuromorphic computation using synaptic devices IEEE Trans. Electron Devices 59 3489-94
16. Simons H 1962 The architecture of complexity Proc. Am. Phil. Soc. 106 467-82
17. Strogatz S 2001 Exploring complex networks Nature 410 268-76 (Pubitemid 32216604)
18. Beggs J M and Plenz D 2003 Neuronal avalanches in neocortical circuits J. Neurosci. 23 11167-77 (Pubitemid 37548953)
19. Levina A, Herrmann J M and Geisel T 2007 Dynamical synapses causing self-organized criticality in neural networks Nature Phys. 3 857-60
20. Murphy B K and Miller K D 2009 Balanced amplification: a new mechanism of selective amplification of neural activity patterns Neuron 61 635-48
21. Chialvo D R 2010 Emergent complex neural dynamics Nature Phys. 6 744-50
22. Shew W L, Yang H, Yu S, Roy R and Plenz D 2011 Information capacity and transmission are maximized in balanced cortical networks with neuronal avalanches J. Neurosci. 31 55-63
23. Jensen H J 1998 Self-Organized Criticality: Emergent Complex Behavior in Physical and Biological Systems vol 10 (Cambridge: Cambridge university press)
24. Sporns O, Chialvo D R, Kaiser M and Hilgetag C C 2004 Organization, development and function of complex brain networks Trends Cogn. Sci. 8 418-25 (Pubitemid 39179905)
25. Buonomano D V and Maass W 2009 State-dependent computations: spatiotemporal processing in cortical networks Nature Rev. Neurosci. 10 113-25
26. Hebb D O 1949 The Organization of Behavior; A Neuropsychological Theory (New York: Wiley)
27. Freeman W J, Burke B C and Holmes M D 2003 Aperiodic phase re-setting in scalp EEG of beta-gamma oscillations by state transitions at alpha-theta rates Hum. Brain Mapp. 19 248-72 (Pubitemid 36959352)
28. Chklovskii D B, Mel B W and Svoboda K 2004 Cortical rewiring and information storage Nature 431 782-8 (Pubitemid 39434067)
29. Kozma R, Puljic M, Balister P, Bollobas B and Freeman W J 2005 Phase transitions in the neuropercolation model of neural populations with mixed local and non-local interactions Biol. Cybern. 92 367-79 (Pubitemid 40834167)
30. Avizienis A V, Sillin H O, Martin-Olmos C, Shieh H H, Aono M, Stieg A Z and Gimzewski J K 2012 Neuromorphic atomic switch networks PLoS One 7 e42772
31. Stieg A Z, Avizienis A V, Sillin H O, Martin-Olmos C, Aono M and Gimzewski J K 2012 Emergent criticality in complex turing B-type atomic switch networks Adv. Mater. 24 286-93
32. Hasegawa T, Ohno T, Terabe K, Tsuruoka T, Nakayama T, Gimzewski J K and Aono M 2010 Learning abilities achieved by a single solid-state atomic switch Adv. Mater. 22 1831-4
33. Ohno T, Hasegawa T, Tsuruoka T, Terabe K, Gimzewski J K and Aono M 2011 Short-term plasticity and long-term potentiation mimicked in single inorganic synapses Nature Mater. 10 591-5
34. Yang R, Terabe K, Liu G, Tsuruoka T, Hasegawa T, Gimzewski J K and Aono M 2012 On-demand nanodevice with electrical and neuromorphic multifunction realized by local ion migration ACS Nano 6 9515-21
35. Terabe K, Hasegawa T, Nakayama T and Aono M 2005 Quantized conductance atomic switch Nature 433 47-50 (Pubitemid 40101138)
36. Hopfield J J and Tank D W 1985 'Neural' computation of decision in optimization problems Biol. Cybern. 52 141-52 (Pubitemid 15007505)
37. Jaeger H 2002 Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the' echo state network' approach GMD-Forschungszentrum Informationstechnik
38. Jaeger H 2001 The 'echo state' approach to analysing and training recurrent neural networks German National Research Center for Information Technology (GMD Report) vol 148 pp 1-47
39. Maass W, Natschlager T and Markram H 2002 Real-time computing without stable states: a new framework for neural computation based on perturbations Neural Comput. 14 2531-60
40. Schrauwen B, Verstraeten D and Van Campenhout J 2007 An overview of reservoir computing: theory, applications and implementations Proc. 15th European Symp. on Artificial Neural Networks pp 471-82
41. Verstraeten D, Schrauwen B, D'Haene M and Stroobandt D 2007 2007 Special issue: an experimental unification of reservoir computing methods Neural Netw. 20 391-403 (Pubitemid 46856109)
42. Lukosevicius M and Jaeger H 2009 Reservoir computing approaches to recurrent neural network training Comput. Sci. Rev. 3 127-49
43. Büsing L, Schrauwen B and Legenstein R 2010 Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons Neural Comput. 22 1272-311
44. Fernando C and Sojakka S 2003 Pattern recognition in a bucket Advances in Artificial Life vol 2801 ed W Banzhaf, J C Ziegler, T P Dittrich and J Kim (Berlin: Springer)
45. Schürmann F, Meier K and Schemmel J 2004 Edge of chaos computation in mixed-mode VLSI-a hard liquid Advances in Neural Information Processing Systems vol 17 (Cambridge, MA: MIT Press) pp 1201-8
46. Paquot Y, Duport F, Smerieri A, Dambre J, Schrauwen B, Haelterman M and Massar S 2012 Optoelectronic reservoir computing Sci. Rep. 2 1-6
47. Cohen G Z, Pershin Y V and Di Ventra M 2012 Second and higher harmonics generation with memristive systems Appl. Phys. Lett. 100 133109
48. Oskoee E N and Sahimi M 2011 Electric currents in networks of interconnected memristors Phy. Rev. E 83 031105
49. Kuhn A, Argoul F, Muzy J F and Arneodo A 1994 Structural analysis of electroless deposits in the diffusion-limited regime Phys. Rev. Lett. 73 2998-3001 (Pubitemid 24976144)
50. Shochet O and Ben-jacob E 1993 Coexistence of morphologies in diffusive patterning Phys. Rev. E 48 R4168-71
51. Avizienis A V, Martin-Olmos C, Sillin H O, Aono M, Gimzewski J K and Stieg A Z 2013 Morphological transitions from dendrites to nanowires in the electroless deposition of silver Cryst. Growth Des. 13 465-9
52. Kundu M, Terabe K, Hasegawa T and Aono M 2006 Effect of sulfurization conditions and post-deposition annealing treatment on structural and electrical properties of silver sulfide films J. Appl. Phys. 99 103501 (Pubitemid 43838523)
53. 2S nanoscale ionic conductor ACS Nano 4 2515-22
54. Chua L 1971 Memristor - the missing circuit element IEEE Trans. Circuits Syst. 18 507-19
55. Strukov D B, Snider G S, Stewart D R and Williams R S 2008 The missing memristor found Nature 453 80-3 (Pubitemid 351630336)
56. Keshner M S 1982 1/f noise Proc. IEEE 70 212-8
57. Lazar A, Pipa G and Triesch J 2009 SORN: a self-organizing recurrent neural network Front. Comput. Neurosci. 3 1-9
58. Langton C G 1990 Computation at the edge of chaos: phase transitions and emergent computation Physica D 42 12-37
59. Friston K 2008 Hierarchical models in the brain PLoS Comput. Biol. 4 e1000211
60. Meunier D, Lambiotte R, Fornito A, Ersche K D and Bullmore E T 2009 Hierarchical modularity in human brain functional networks Front. Neuroinform. 3 1-12
61. Gleiser P M and Spoormaker V I 2010 Modelling heirarchical structure in functional brain networks Phil. Trans. A Math. Phys. Eng. Sci. 368 5633-44