Gradient-descent-based learning in memristive crossbar arrays

Proceedings of the International Joint Conference on Neural Networks

Volumn 2015-September, Issue , 2015, Pages

  Nair, Manu V ^a   Dudek, Piotr ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

back propagation; crossbar arrays; deep learning; gradient descent; machine learning; memristor; neural networks

Indexed keywords

ALGORITHMS; APPROXIMATION ALGORITHMS; ARTIFICIAL INTELLIGENCE; BACKPROPAGATION; COMPLEX NETWORKS; HARDWARE; LEARNING SYSTEMS; MEMRISTORS; NEURAL NETWORKS; PARAMETER ESTIMATION; PASSIVE FILTERS;

CROSSBAR ARRAYS; DEEP LEARNING; DEVICE PARAMETERS; GRADIENT DESCENT; HARDWARE IMPLEMENTATIONS; MEMRISTOR; REAL-WORLD DATASETS; STEEPEST DESCENT ALGORITHM;

LEARNING ALGORITHMS;

EID: 84951192180     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2015.7280658     Document Type: Conference Paper

References (26)

1. D B Slrukov, et al. "The missing memristor found. " Nature 453. 7191 (2008)
2. J. Joshua Yang, Dmitri B. Strukov, and Duncan R. Stewart. "Melmistive devices for computing" Nature nanotechnology 8. 1 (2013): 13-24.
3. E Lehtonen, J. H. Poikonen, and M ika Laiho. "Two memristors suffice to compute all Boolean functions. " Electronics letters 46. 3 (2010): 230.
4. Medeiros-Ribeiro G et aL "Lognormal switching times for titanium dioxide bipolar memristors: origin and resolution", Nanotechnology. 2011 Mar 4
5. W y et al. "Feedback write scheme for memristive switching devices. " Applied Physics A 102. 4 (2011): 973-982.
6. Manem, Harika, and Garrett S. Rose. "A read-monitored write circuit for ITIM multi-level memristor memories. " ISCAS, 2011.
7. R. Berdan, T. Prodromakis, F. P. Diaz, E. Vasilak A. Khiat, I. Salaoru and C. Toumazou, 'Temporal Processing with Volatile Memristors", IEEE International Symposium on Circuits and Systems, May 2013
8. G. Snider, "Self-organized computation with unreliable, memristive nanodevices," Nanotechnology 18, 10 August 2007
9. C. Zamarreno-Ramos et al. "On spike-timing-dependent-plasticity, memristive devices, and building a self-learning visual cortex", Front. Neurosci., vol. 5, no. 26, pp. 1-36 2011
10. SH Jo et al. "Nanoscale memristor device as synapse in neuromorphic systems. " Nano letters 10. 4 (2010): 1297-1301.
11. D Querlioz, 0 Bichler, and Christian Gamrat. "Simulation of a memristor-based spiking neural network immune to device variations. " Neural Networks (IJCNN), 2011.
12. Snider, Greg S. "Spike-timing-dependent learning in melmistive nanodevices. "Nanoscale Architectures, 2008. NANOARCH 2008. IEEE International Symposium on. IEEE, 2008.
13. Linares-Barranco, Bernabe, and Teresa Serrano-Gotarredona. "Memristance can explain spike-time-dependent-plasticity in neural synapses. " Nature precedings (2009): 1-4.
14. Alibart, Fabien, Elham Zamanidoost, and Dmitri B. Strukov. "Pattern classification by memristive crossbar circuits using ex situ and in situ training. "Nature communications 4 (2013).
15. Guan, Ximeng, Shimeng Yu, and H-SP Wong. "On the switching parameter variation of metal-oxide RRAM-Part I: Physical modeling and simulation methodology. " Electron Devices, IEEE Transactions on 59. 4 (2012): 1172-1182.
16. F Corinto;A Ascol "A Boundary Condition-Based Approach to the Modeling of Memristor Nanostructures," Circuits and Systems I: Regular Papers, IEEE Transactions on, vo1. 59, no. ll, pp. 2713,2726, Nov. 2012
17. A Ascoli et al. "Memristor model comparison. " Circuits and Systems Magazine, IEEE 13. 2 (2013): 89-105
18. T Serrano-Gotarredona et ai, "SIDP and STDP Variations with Memristors for Spiking Neuromorphic Learning Systems, ''Front. in Neuroscience", Vo17, 2013,2
19. Abu Sebastian, Manuel Le Gallo, and Daniel Krebs. "Crystal growth within a phase change memory cell. " Nature communications 5 (2014).
20. Freund, Yoav, Robert Schapire, and N. Abe. "A short introduction to boosting. "Journal-Japanese Society For Artificial Intelligence 14. 771-780 (1999) 1612.
21. MNIST handwritten digits database. http://yann. lecun. com/exdb/mnistl
22. Y So "A tutorial on logistic regression. " SAS White Papers (1995).
23. Peter U. Dieh Matthew Cook, "Unsupervised Learning of Digit Recognition Using Spike-Timing-Dependent Plasticity", Neural networks and learning systems, IEEE Transactions on 59. 4 (2012)
24. Merkel Cory E., et al. "Reconfigurable n-Ievel memristor memory design. " Neural Networks (lJCNN), The 2011 International Joint Conference on. IEEE, 2011.
25. Cauwenberghs, Gert. "A fust stochastic error-descent algorithm for supervised learning and optimization. " Advances in neural information processing systems (/993): 244-244.
26. Alspector, Joshua, et al. "A parallel gradient descent method for learning in analog VLSI neural networks. " Advances in neural information processing systems. 1993..