Towards acceleration of deep convolutional neural networks using stochastic computing

Proceedings of the Asia and South Pacific Design Automation Conference, ASP-DAC

Volumn , Issue , 2017, Pages 115-120

  Li, Ji ^a   Ren, Ao ^b   Li, Zhe ^b   Ding, Caiwen ^b   Yuan, Bo ^c   Qiu, Qinru ^b   Wang, Yanzhi ^b  

^a University of Southern California ^*  (United States)

^b Syracuse University   (United States)

^c City University of New York   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BUDGET CONTROL; COMPLEX NETWORKS; COMPUTER AIDED DESIGN; CONVOLUTION; DEEP NEURAL NETWORKS; ECONOMIC AND SOCIAL EFFECTS; EMBEDDED SYSTEMS; NETWORK ARCHITECTURE; NEURONS; STOCHASTIC SYSTEMS; STRUCTURAL OPTIMIZATION;

CONVOLUTIONAL NEURAL NETWORK; DESIGN PARAMETERS; ENERGY-ACCURACY TRADE-OFFS; PARALLEL COUNTERS; SCALABLE HARDWARE; SOFTWARE ACCURACY; STOCHASTIC COMPUTING; STRUCTURE OPTIMIZATION;

NEURAL NETWORKS;

EID: 85015332539     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASPDAC.2017.7858306     Document Type: Conference Paper

References (22)

1. Y. Bengio, "Learning deep architectures for ai," Foundations and trends® in Machine Learning, Vol. 2, no. 1, pp. 1-127, 2009.
2. Y. LeCun, Y Bengio, and G. Hinton, "Deep learning," Nature, Vol. 521, no. 7553, pp. 436-44, 2015.
3. T. N. Sainath, A.-r. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for lvcsr," in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2013, pp. 8614-8618.
4. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," arXiv preprint arXiv:1409.1556, 2014.
5. A. Karpathy et al., "Large-scale video classification with convolutional neural networks," in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2014, pp. 1725-1732.
6. C. Szegedy et al, "Going deeper with convolutions," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1-9.
7. M. Motamedi, P. Gysel, V. Akella, and S. Ghiasi, "Design space exploration of fpga-based deep convolutional neural networks," in 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC). IEEE, 2016, pp. 575-580.
8. A. Rahman, J. Lee, and K. Choi, "Efficient fpga acceleration of convolutional neural networks using logical-3d compute array," in 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 2016, pp. 1393-1398.
9. P. Li et al., "The synthesis of complex arithmetic computation on stochastic bit streams using sequential logic," in Proceedings of the International Conference on Computer-Aided Design. ACM, 2012, pp. 480-487.
10. J. Li and J. Draper, "Accelerating soft-error-rate (ser) estimation in the presence of single event transients," in Proceedings of the 53rd Annual Design Automation Conference. ACM, 2016, p. 55.
11. J. Li and J. Draper, "Joint soft-error-rate (ser) estimation for combinational logic and sequential elements," in VLSI (ISVLSI), 2016 IEEE Computer Society Annual Symposium on. IEEE, 2016, pp. 737-742.
12. K. Kim et al., "Dynamic energy-accuracy trade-off using stochastic computing in deep neural networks," in Proceedings of the 53rd Annual Design Automation Conference. ACM, 2016, p. 124.
13. K. Sanni, G. Garreau, J. L. Molin, and A. G. Andreou, "Fpga implementation of a deep belief network architecture for character recognition using stochastic computation," in Information Sciences and Systems (CISS), 2015 49th Annual Conference on. IEEE, 2015, pp. 1-5.
14. Y Ji, F. Ran, C. Ma, and D. J. Lilja, "A hardware implementation of a radial basis function neural network using stochastic logic," in Proceedings of the 2015 Design, Automation & Test in Europe Conference & Exhibition. EDA Consortium, 2015, pp. 880-883.
15. A. Ren et al., "Designing reconfigurable large-scale deep learning systems using stochastic computing," in 2016 IEEE International Conference on Rebooting Computing. IEEE, 2016.
16. Z. Li et al., "Dscnn: Hardware-oriented optimization for stochastic computing based deep convolutional neural networks," in Computer Design (ICCD), 2016 IEEE 34th International Conference on. IEEE, 2016.
17. B. D. Brown and H. C. Card, "Stochastic neural computation. ii. soft competitive learning," IEEE Transactions on Computers, Vol. 50, no. 9, pp. 906-920, 2001.
18. Y LeCun, L. Bottou, Y Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, Vol. 86, no. 11, pp. 2278-2324, 1998.
19. P.-S. Ting and J. P. Hayes, "Stochastic logic realization of matrix operations," in Digital System Design (DSD), 2014 17th Euromicro Conference on. IEEE, 2014, pp. 356-364.
20. B. D. Brown and H. C. Card, "Stochastic neural computation. i.computational elements," IEEE Transactions on computers, Vol. 50, no. 9, pp. 891-905, 2001.
21. L. Deng, "The mnist database of handwritten digit images for machine learning research," IEEE Signal Processing Magazine, Vol. 29, no. 6, pp. 141-142, 2012.
22. Nangate 45nm Open Library, Nangate Inc., 2009. [Online]. Available: http://www.nangate.com/