Structural design optimization for deep convolutional neural networks using stochastic computing

Proceedings of the 2017 Design, Automation and Test in Europe, DATE 2017

Volumn , Issue , 2017, Pages 250-253

  Li, Zhe ^a   Ren, Ao ^a   Li, Ji ^b   Qiu, Qinru ^a   Yuan, Bo ^c   Draper, Jeffrey ^b,d   Wang, Yanzhi ^a  

^a SYRACUSE UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c CITY UNIVERSITY OF NEW YORK   (United States)

^d UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; EMBEDDED SYSTEMS; EXTRACTION; FEATURE EXTRACTION; HARDWARE; NEURAL NETWORKS; SIGNAL SAMPLING; STOCHASTIC SYSTEMS; STRUCTURAL DESIGN; STRUCTURAL OPTIMIZATION;

CALCULATION PRECISION; CONVOLUTIONAL NEURAL NETWORK; HARDWARE IMPLEMENTATIONS; HARDWARE PERFORMANCE; LARGE-SCALE COMPUTING; SOFTWARE IMPLEMENTATION; STOCHASTIC COMPUTING; STRUCTURAL DESIGN OPTIMIZATION;

DEEP NEURAL NETWORKS;

EID: 85020208252     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.23919/DATE.2017.7926991     Document Type: Conference Paper

References (20)

1. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei, "Large-scale video classification with convolutional neural networks," in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2014, pp. 1725-1732.
2. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
3. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in neural information processing systems, 2012, pp. 1097-1105.
4. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1-9.
5. B. Catanzaro, "Deep learning with cots hpc systems," 2013.
6. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding," in Proceedings of the 22nd ACM international conference on Multimedia. ACM, 2014, pp. 675-678.
7. M. Motamedi, P. Gysel, V. Akella, and S. Ghiasi, "Design space exploration of FPGA-based deep convolutional neural networks," in 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC). IEEE, 2016, pp. 575-580.
8. A. Ren, J. Li, Z. Li, C. Ding, X. Qian, Q. Qiu, B. Yuan, and Y. Wang, "Sc-dcnn: highly-scalable deep convolutional neural network using stochastic computing," arXiv preprint arXiv:1611.05939.
9. B. Huval, T. Wang, S. Tandon, J. Kiske, W. Song, J. Pazhayampallil, M. Andriluka, P. Rajpurkar, T. Migimatsu, R. Cheng-Yue et al., "An empirical evaluation of deep learning on highway driving," arXiv preprint arXiv:1504.01716, 2015.
10. N. Y. Hammerla, S. Halloran, and T. Ploetz, "Deep, convolutional, and recurrent models for human activity recognition using wearables," arXiv preprint arXiv:1604.08880, 2016.
11. J. Li, A. Ren, Z. Li, C. Ding, B. Yuan, Q. Qiu, and Y. Wang, "Towards acceleration of deep convolutional neural networks using stochastic computing," in The 22nd Asia and South Pacific Design Automation Conference (ASP-DAC). IEEE, 2017.
12. B. D. Brown and H. C. Card, "Stochastic neural computation. i. computational elements," IEEE Transactions on computers, vol. 50, no. 9, pp. 891-905, 2001.
13. J. Li and J. Draper, "Accelerating soft-error-rate (ser) estimation in the presence of single event transients," in Proceedings of the 53rd Annual Design Automation Conference. ACM, 2016, p. 55.
14. K. Kim, J. Kim, J. Yu, J. Seo, J. Lee, and K. Choi, "Dynamic energyaccuracy trade-off using stochastic computing in deep neural networks," in Proceedings of the 53rd Annual Design Automation Conference. ACM, 2016, p. 124.
15. Y. Ji, F. Ran, C. Ma, and D. J. Lilja, "A hardware implementation of a radial basis function neural network using stochastic logic," in Proceedings of the 2015 Design, Automation & Test in Europe Conference & Exhibition. EDA Consortium, 2015, pp. 880-883.
16. A. Ren, Z. Li, Y. Wang, Q. Qiu, and B. Yuan, "Designing reconfigurable large-scale deep learning systems using stochastic computing," in 2016 IEEE International Conference on Rebooting Computing. IEEE, 2016.
17. Z. Li, A. Ren, J. Li, Q. Qiu, Y. Wang, and B. Yuan, "Dscnn: Hardwareoriented optimization for stochastic computing based deep convolutional neural networks," in Computer Design (ICCD), 2016 IEEE 34th International Conference on. IEEE, 2016.
18. Y. LeCun, C. Cortes, and C. J. Burges, "Mnist handwritten digit database," AT&T Labs [Online]. Available: http://yann. lecun. com/exdb/mnist, 2010.
19. Nangate 45nm Open Library, Nangate Inc., 2009. [Online]. Available: http://www.nangate.com/
20. K. Kim, J. Lee, and K. Choi, "An energy-efficient random number generator for stochastic circuits," in 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC). IEEE, 2016, pp. 256-261.