Embedded binarized neural networks

International Conference on Embedded Wireless Systems and Networks

Volumn , Issue , 2017, Pages 168-173

  McDanel, Bradley ^a   Teerapittayanon, Surat ^a   Kung, H T ^a  

^a HARVARD UNIVERSITY   (United States)

Author keywords

Binary neural network; BNN; DNN; EBNN; Embedded device; Embedded systems; Energy efficiency

Indexed keywords

EID: 85120003531     PISSN: None     EISSN: 25622331     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. R. Collobert, S. Bengio, and J. Mariéthoz. Torch: a modular machine learning software library. Technical report, Idiap, 2002.
2. M. Courbariaux and Y. Bengio. Binarynet: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv preprint arXiv:1602.02830, 2016.
3. M. Courbariaux, Y. Bengio, and J.-P. David. Binaryconnect: Training deep neural networks with binary weights during propagations. In Advances in Neural Information Processing Systems, pages 3123–3131, 2015.
4. K. He, X. Zhang, S. Ren, and J. Sun. Identity mappings in deep residual networks. arXiv preprint arXiv:1603.05027, 2016.
5. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167, 2015.
6. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images. 2009.
7. Y. LeCun, C. Cortes, and C. J. Burges. The mnist database of handwritten digits, 1998.
8. M. Rastegari, V. Ordonez, J. Redmon, and A. Farhadi. Xnor-net: Imagenet classification using binary convolutional neural networks. arXiv preprint arXiv:1603.05279, 2016.
9. D. Scherer, A. Müller, and S. Behnke. Evaluation of pooling operations in convolutional architectures for object recognition. In International Conference on Artificial Neural Networks, pages 92–101. Springer, 2010.
10. T. T. D. Team, R. Al-Rfou, G. Alain, A. Almahairi, C. Angermueller, D. Bahdanau, N. Ballas, F. Bastien, J. Bayer, A. Belikov, et al. Theano: A python framework for fast computation of mathematical expressions. arXiv preprint arXiv:1605.02688, 2016.
11. S. Tokui, K. Oono, S. Hido, and J. Clayton. Chainer: a next-generation open source framework for deep learning. In Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS), 2015.