Modeling and experimental demonstration of a hopfield network analog-to-digital converter with hybrid CMOS/memristor circuits

Frontiers in Neuroscience

Volumn 9, Issue DEC, 2015, Pages

  Guo, Xinjie ^a   Merrikh Bayat, Farnood ^a   Gao, Ligang ^a   Hoskins, Brian D ^a   Alibart, Fabien ^b   Linares Barranco, Bernabe ^c   Theogarajan, Luke ^a   Teuscher, Christof ^d   Strukov, Dmitri B ^a  

^a University of California   (United States)

^b CNRS   (France)

^c INSTITUTO DE MICROELECTRÓNICA DE SEVILLA   (Spain)

^d Portland State University   (United States)

Author keywords

Analog to digital conversion; Hopfield network; Hybrid circuits; Memristor; Recurrent neural network; Resistive switching

Indexed keywords

ACCURACY; ANALOG DIGITAL CONVERTER; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPLEMENTARY METAL OXIDE SEMICONDUCTOR; CONDUCTANCE; HOPFIELD NETWORK; MATHEMATICAL MODEL; MEMRISTOR CIRCUIT; SEMICONDUCTOR; SIMULATION; SYNAPSE;

EID: 84954478070     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2015.00488     Document Type: Article

References (29)

1. Alibart, F., Gao, L., Hoskins, B. D., and Strukov, D. B. (2012). High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm. Nanotechnology 23:075201. doi: 10.1088/0957-4484/23/7/075201.
2. Alibart, F., Zamanidoost, E., and Strukov, D. B. (2013). Pattern classification by memristive crossbar circuits using ex situ and in situ training. Nat. Commun. 4, 2072. doi: 10.1038/ncomms3072.
3. Chigusa, Y., and Tanaka, M. (1990). "A neural-like feed-forward ADC," in Proc. ISCAS'90 (New Orleans, LA), 2959-2962.
4. Eryilmaz, S. B., Kuzum, D., Jeyasingh, R., Kim, S., BrightSky, M., Lam, C., et al. (2014). Brain-like associative learning using a nanoscale non-volatile phase change synaptic device array. Front. Neurosci. 8:205. doi: 10.3389/fnins.2014.00205.
5. Gao, L., Merrikh-Bayat, F., Alibart, F., Guo, X., Hoskins, B. D., Cheng, K.-T., et al. (2013a). "Digital-to-analog and analog-to-digital conversion with metal oxide memristors for ultra-low power computing," in Proc. NanoArch'13 (New York, NY), 19-22.
6. Gao, L., Alibart, F., and Strukov, D. (2013b). Programmable CMOS/memristor threshold logic. IEEE Trans. Nanotechnol. 12, 115-119. doi: 10.1109/TNANO.2013.2241075.
7. Gao, L., Alibart, F., Strukov, D., and B. (2013c). "A high resolution nonvolatile analog memory ionic devices," in Proc. Non-Volatile Memories Workshop (San Diego, CA).
8. Gao, L., Alibart, F., and Strukov, D. B. (2012). "Analog-input analog-weight dot-product operation with Ag/a-Si/Pt memristive devices," in Proc. VLSI-SoC'12 (Santa Cruz, CA), 88-93.
9. Graf, H. P., Jackel, L. D., Howard, R. E., Straughn, B., Denker, J. S., Hubbard, W., et al. (1986). VLSI implemetnation of a nerual network memory with several hundreds of neurons. AIP Conf. Proc. 151, 182-187. doi: 10.1063/1.36253.
10. Hopfield, J. J. (1984). Neurons with graded response have collective computational properties like those of two-state neruons. Proc. Natl. Acad. Sci. U.S.A. 81, 3088-3092. doi: 10.1073/pnas.81.10.3088.
11. Hu, S. G., Liu, Y., Liu, Z., Chen, T. P., Wang, J. J., Yu, Q., et al. (2015). Associative memory realized by a configurable memristive Hopfiled neural network. Nat. Commun. 6, 7522. doi: 10.1038/ncomms8522.
12. Indiveri, G., Linares-Barranco, B., Hamilton, T. J., van Schaik, A., Etienne-Cummings, R., Delbruck, T., et al. (2011). Neuromorphic silicon neuron circuits. Front. Neurosci. 5:73. doi: 10.3389/fnins.2011.00073.
13. Jackel, L. D., Graf, H. P., and Howard, R. E. (1987). Electronic neural network chips. Appl. Opt. 26, 5077-5080. doi: 10.1364/AO.26.005077.
14. Lee, B. W., and Sheu, B. J. (1989). Design of a neural-based A/D converter using modified Hopfield network. IEEE J. Solid-State Circ. 24, 1129-1135. doi: 10.1109/4.34101.
15. Lehtonen, E., Poikonen, J. H., Laiho, M., and Kanerva, P. (2014). Large-scale memristive associative memories. IEEE Trans. VLSI 22, 562-574. doi: 10.1109/TVLSI.2013.2250319.
16. Merrikh-Bayat, F., Alibart, F., Gao, L., and Strukov, D. B. (2014). "A reconfigurable FIR filter with memristor-based weights," in: Proc. ISCAS'15 (Melbourne, VIC).
17. Moopenn, A., Duong, T., and Thakoor, A. P. (1990). Adv. Neural Inofmra Digital-analog hybrid synapse chips for electronic nerual networks t. Proces. Syst. 2, 769-776.
18. Prezioso, M., Kataeva, I., Merrikh-Bayat, F., Hoskins, B., Adam, G., Sota, T., et al. (2015b). "Modeling and implementation of firing-rate neuromorphic-network classifiers with bilayer Pt/Al2O3/TiO2-x/Pt memristors," in IEDM'15. (Washington, DC).
19. Prezioso, M., Merrikh Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., and Strukov, D. B. (2015a). Training and operation of an integrated neuromorphic network based on metal-oxide memristors. Nature 521, 61-64. doi: 10.1038/nature14441.
20. Rakkiyappan, R., Chandrasekar, A., Laksmanan, S., and Ju Park, H. (2014). State estimation of memristor-based recurrent neural networks with time-varying delays based on passivity theory. Complexity 19, 32-43. doi: 10.1002/cplx.21482.
21. Schwartz, D. B., Howard, R. E., Denker, J. S., Epworth, R. W., Graf, H. P., Hubbard, W., et al. (1987). Dynamics of microfabriacted eletronic neural networks. Appl. Phys. Lett. 50, 1110-1112.
22. Smith, M. J. S., and Portmann, C. L. (1989). Practical design and analysis of a simple "neural" optimization circuit. IEEE Trans. Circ. Syst. 36, 42-50. doi: 10.1109/31.16562.
23. Strukov, D. B., and Kohlstedt, H. (2012). Resistive switching phenomena in thin films: Materials, devices, and applications. MRS Bull. 37, 108-114. doi: 10.1557/mrs.2012.2.
24. Tank, D. W., and Hopfield, J. J. (1986). Simple neural optimization networks-an A/D converter, signal decision circuit, and a linear-programming circuit. IEEE Trans. Circ. Syst. 33, 533-541. doi: 10.1109/TCS.1986.1085953.
25. van de Plassche, R. J. (2003). CMOS Integrated Analog-to-Digital and Digital-to-Analog Converters, 2nd Edn. Norwell, MA: Kluwer Academic Publishers.
26. Walls, T. J., and Likharev, K. K. (2014). Self-organization in autonomous, recurrent, firing-rate CrossNets with quasi-hebbian plasticity. IEEE Trans. Neural Netw. Learn. Syst. 25, 819-824. doi: 10.1109/TNNLS.2013.2280904.
27. Waser, R., Dittmann, R., Staikov, G., and Szot, K. (2009). Redox-based resistive switching memories-nanoionic mechanisms, prospects, and challenges. Adv. Mat. 21, 2632-2663. doi: 10.1002/adma.200900375.
28. Wu, A., Wen, S., and Zeng, Z. (2012). Synchronization control of a class of memristor-based recurrent neural networks. Inform. Sci. 183, 106-116. doi: 10.1016/j.ins.2011.07.044.
29. Zhang, G., Shen, Y., and Sun, J. (2012). Global exponential stability of a class of memristor-based recurrent neural networks with time-varying delays. Neurocomputing 97, 149-154. doi: 10.1016/j.neucom.2012.05.002.