A building block for hardware belief networks

Scientific Reports

Volumn 6, Issue , 2016, Pages

  Behin Aein, Behtash ^a   Diep, Vinh ^b   Datta, Supriyo ^b  

^a IBM MICROELECTRONICS   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84979201285     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep29893     Document Type: Article

References (53)

1. G. E. Hinton, S. Osindero & Y. Teh. A fast learning algorithm for deep belief nets. Neural Computation 18, 1527-1554 (2006).
2. G. E. Hinton & R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science 313, 5786, 504-507 (2006).
3. J. Pearl. Causality: Models, Reasoning, and Inference vol. 29, (Cambridge University Press, New York 2000).
4. J. Pearl. Probabilistic Reasoning in intelligent systems: Networks of plausible inference (Morgan Kaufmann 2014).
5. Y. Bengio, P. Lamblin, D. Popovici & H. Larochelle. Greedy layer-wise training of deep networks. In Advances in Neural Information Processing Systems 19, (NIPS'06), 153-160 (2007).
6. Y. Bengio. Learning deep architectures for AI. Foundations and trends in machine learning 2, 1, 1-27 (2009).
7. Y. Bengio, A. Courville & P. Vincent. Representation Learning: A Review and New Perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 8, 1798-1828 (2013).
8. G. E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation 14, 1771-1800 (2002).
9. H. Lee, R. Grosse, R. Ranganath & A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In proceedings of the 26th Annual International Conference on Machine Learning, pp. 609-616, ACM (2009).
10. P. Smolensky. Parallel Distributed Processing: vol. 1, Foundations pp. 194-281, D. E. Rumelhart, J. L. McClelland Eds (MIT Press, Cambridge, 1986).
11. G. E. Hinton & T. J. Sejnowski. Learning and relearning in Boltzmann machines. Parallel Distributed Processing: Explorations in the Microstructure of Cognition Volume 1, Foundations (Cambridge University Press, New York, 1986).
12. J. Misra & A. Saha. Artifcial neural networks in hardware: A survey of two decades of progress. Neurocomputing 74, 239-255 (2010).
13. R. Venkatesan et al. SPINTASTIC: Spin-based Stochastic Logic for Energy-efcient Computing. Design, Automation and Test in Europe Conference and Exhibition (DAT E), 1575-1578 (2015).
14. W. H. Choi et al. A Magnetic Tunnel Junction Based True Random Number Generator with Conditional Perturb and Real-Time Output Probability Tracking. International Electron Devices Meeting (IEDM), 12.5.1-12.5.4 (2015).
15. A. F. Vincent et al. Spin-Transfer Torque Magnetic Memory as a Stochastic Memristive Synapse for Neuromorphic Systems. IEEE transactions on biomedical circuits and systems 9, 2, 166-174 (2015).
16. S. Khasanvis et al. Physically equivalent magneto-electric nanoarchitectures for probabilistic reasoning, Proceedings of International Symposium on Nanoscale Architectures (NANOARCH), pp. 25-26 (2015).
17. S. Khasanvis et al. Self-similar Magneto-electric Nanocircuit Technology for Probabilistic Inference Engines. IEEE Transactions on Nanotechnology 14(6), 980-991 (2015).
18. V. Mansinghka & E. Jonas. Building fast Bayesian computing machines out of intentionally stochastic, digital parts. Pre-print (arXiv: 1402.4914v1 (2014).
19. H. Chen, C. D. Fleury & A. F. Murray. Continuous-Valued Probabilistic Behavior in a VLSI Generative Model. IEEE Transactions on Neural Networks 17, 3, 755-770 (2006).
20. H. B. Hamid, A. F. Murray, D. A. Laurenson & B. Cheng. Probabilistic computing with future deep submicrometer devices: a modeling approach. International symposium on circuits and systems 2510-2513 (2005).
21. B. Behin-Aein, A. Sarkar & S. Datta. Tunable mesoscopic interactions in a nanomagnet array, see Chapter 5, PhD thesis, Angik Sarkar, Purdue University (2012).
22. B. Behin-Aein. Computing multi-magnet based devices and methods for solution of optimization problems, United States Patent, US 20140043061 A1 (2012).
23. S. Datta, S. Salahuddin & B. Behin-Aein. Non-volatile spin switch for Boolean and non-Boolean logic. Applied Physics Letters 101, 252411.1-5 (2012).
24. N. Locatelli et al. Noise-Enhanced Synchronization of Stochastic Magnetic Oscillators. Physical Review Applied 2, pp. 034009, 1-6 (2014).
25. J. Z. Sun. Spin-current interaction with a monodomain magnetic body: A model study. Physical Review B 62, 570-578 (2000).
26. B. Behin-Aein, A. Sarkar, S. Srinivasan & S. Datta. Switching energy-delay of all spin logic devices. Applied physics Letters 98, 123510.1-123510.3 (2011).
27. D. Bedau et al. Spin-transfer pulse switching: From the dynamic to the thermally activated regime. Applied Physics Letters 97, 262502.1-3 (2010).
28. L. Liu, Y. Li, H. W. Tseng, D. C. Ralph & R. A. Buhrman. Spin-torque switching with giant spin Hall Effect. Science 336, 6081, 555-558 (2012).
29. L. Liu, O. J. Li, T. J. Gudmundsen, D. C. Ralph & R. A. Buhrman. Current-induced switching of perpendicularly magnetized layers using spin torque from the spin Hall Effect. Physical Review Letters 109, 096602.1-4 (2012).
30. L. You et al. Switching of perpendicularly polarized nanomagnets with spin orbit torque without an external magnetic feld by engineering a tilted anisotropy. Proceedings of National Academy of Sciences 112, 33, 10310-10315 (2015).
31. S. Fukami, C. Zhang, S. DuttaGupta, A. Kurenkov & H. Ohno. Magnetization switching by spin-orbit torque in an antiferromagnet-ferromagnet bilayer system. Nature Materials 15, 535-541 (2016).
32. S. Datta, V. Q. Diep & B. Behin-Aein. What constitutes a nanoswitch? A perspective. In Emerging Nanoelectronic Devices Chapter 2, A. Chen, J. Hutchby, V. Zhirnov, G. Bourianof Eds (Wiley, New York, 2015).
33. B. Behin-Aein, J.-P. Wang & R. Weisendanger. Computing with Spins and Magnets. MRS Bulletin 39, 696-702 (August 2014).
34. Y. Niimi et al. Giant spin Hall Effect induced by skew scattering from Bismuth impurities inside thin flm CuBi alloys. Physical Review Letters 109, 156602-156606 (2012).
35. V. Q. Diep, B. Sutton, B. Behin-Aein & S. Datta. Spin switches for compact implementation of Neuron and Synapse. Applied Physics Letters 104, 222405.1-5 (2014).
36. W.-G. Wang, M. Li, S. Hageman & C. L. Chien. Electric-feld-assisted switching in magnetic tunnel junctions. Nature materials 11, 64-68 (2012).
37. P. Khalili & K. Wang. Voltage-controlled MRAM: Status, challenges and prospects. EE Times (February 25, 2013).
38. A. Imre et al. Majority Logic Gate for Magnetic Quantum-Dot Cellular Automata. Science 311, 205-208 (2006).
39. B. Behin-Aein, S. Salahuddin & S. Datta. Switching energy of ferromagnetic logic bits. IEEE Transactions Nanotechnology 8, 505-514 (2009).
40. B. Behin-Aein, D. Datta, S. Salahuddin & S. Datta. Proposal for an all spin logic device with built-in memory. Nature Nanotechnology 5, 266-270 (2010).
41. A. Brataas, A. D. Kent & H. Ohno. Current induced torques in magnetic materials. Nature Materials 11, 372-381 (2012).
42. I. L. Prejbeanu et al. Termally assisted switching in exchange-biased storage layer magnetic tunnel junctions. IEEE Transactions on Magnetics 40, 4 (2004).
43. B. Behin-Aein, A. Sarkar & S. Datta. Modeling circuits with spins and magnets for all-spin logic. Proceedings of European Solid-State Device Conference, pp. 36-40 (2012).
44. K. H. Fischer & J. A. Hertz. Spin Glasses (Cambridge University Press, New York 1991).
45. D. S. Fisher, G. M. Grinstein & A. Khurana. Theory of random magnets. Physics Today 41, 12, 56-67 (1988).
46. B. A. Cipra. An Introduction to the Ising Model. American Mathematics Monthly 94, 937-959 (1987).
47. S. Kirkpatrick, C. D. Gelatt & M. P. Vecchi. Optimization by simulated annealing. Science 220, 4598, 671-680 (1983).
48. L. Zdeborova & F. Krzakala. Statistical Physics of Inference: Tresholds and algorithms, http://arxiv.org/abs/1511.02476 (2015).
49. Murty S. S. Challa, D. P. Landau & K. Binder. Finite-size Effects at temperature-driven frst-order transitions, Physical Review B 34, 1841-1852 (1986).
50. L. Onsager. Crystal statistics I. A two-dimensional model with an order-disorder transition. Physical Review, Series II 65, 117-149 (1944).
51. B. M. Sutton, K. Y. Camsari, B. Behin-Aein & S. Datta. Intrinsic optimization using stochastic nanomagnets. preprint (SRC Publication ID 087933) (2016).
52. V. Diep. Transistor-like spin nano-swithces: physics AND applications, PhD Disertaion, Chapter 3 (2015).
53. A. J. Newell, W. Williams & D. J. Dunlop. A Generalization of the Demagnetizing Tensor for Nonuniform Magnetization. Journal of Geophysical Research-Solid Ear th 98(B6), 9551-9555 (1993).