BranchyNet: Fast inference via early exiting from deep neural networks

Proceedings - International Conference on Pattern Recognition

Volumn 0, Issue , 2016, Pages 2464-2469

  Teerapittayanon, Surat ^a   McDanel, Bradley ^a   Kung, H T ^a  

^a HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP NEURAL NETWORKS; NETWORK ARCHITECTURE; PATTERN RECOGNITION;

DEEP NETWORKS; ENERGY SENSITIVE; ENERGY USAGE; FAST INFERENCE; HIGH CONFIDENCE; LEARNING TASKS; SIDE BRANCHES; STATE-OF-THE-ART METHODS;

NETWORK LAYERS;

EID: 85019129480     PISSN: 10514651     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPR.2016.7900006     Document Type: Conference Paper

References (26)

1. A. Bendale and T. Boult. Towards open set deep networks. arXiv preprint arXiv: 1511. 06233, 2015.
2. A. Bendale and T. Boult. Towards open world recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1893. 1902, 2015.
3. C. Bucilu, R. Caruana, and A. Niculescu-Mizil. Model compression. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 535. 541. ACM, 2006.
4. X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In International conference on artificial intelligence and statistics, pages 249. 256, 2010.
5. S. Han, H. Mao, and W. J. Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv: 1510. 00149, 2015.
6. S. Han, J. Pool, J. Tran, and W. Dally. Learning both weights and connections for efficient neural network. In Advances in Neural Information Processing Systems, pages 1135. 1143, 2015.
7. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. arXiv preprint arXiv: 1512. 03385, 2015.
8. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into recti-ers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE International Conference on Computer Vision, pages 1026. 1034, 2015.
9. G. Huang, Y. Sun, Z. Liu, D. Sedra, and K. Weinberger. Deep networks with stochastic depth. arXiv preprint arXiv: 1603. 09382, 2016.
10. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv: 1502. 03167, 2015.
11. Y.-D. Kim, E. Park, S. Yoo, T. Choi, L. Yang, and D. Shin. Compression of deep convolutional neural networks for fast and low power mobile applications. arXiv preprint arXiv: 1511. 06530, 2015.
12. D. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv: 1412. 6980, 2014.
13. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097. 1105, 2012.
14. A. Lavin. Fast algorithms for convolutional neural networks. arXiv preprint arXiv: 1509. 09308, 2015.
15. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11): 2278. 2324, 1998.
16. Y. A. LeCun, L. Bottou, G. B. Orr, and K.-R. Müller. Efficient backprop. In Neural networks: Tricks of the trade, pages 9. 48. Springer, 2012.
17. M. Mathieu, M. Henaff, and Y. LeCun. Fast training of convolutional networks through ffts. arXiv preprint arXiv: 1312. 5851, 2013.
18. P. Panda, A. Sengupta, and K. Roy. Conditional deep learning for energyef cient and enhanced pattern recognition. In 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE), pages 475. 480. IEEE, 2016.
19. W. J. Scheirer, A. Rocha, R. J. Micheals, and T. E. Boult. Metarecognition: The theory and practice of recognition score analysis. IEEE transactions on pattern analysis and machine intelligence, 33(8): 1689. 1695, 2011.
20. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv: 1409. 1556, 2014.
21. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from over-tting. The Journal of Machine Learning Research, 15(1): 1929. 1958, 2014.
22. R. K. Srivastava, K. Greff, and J. Schmidhuber. Highway networks. arXiv preprint arXiv: 1505. 00387, 2015.
23. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1. 9, 2015.
24. S. Teerapittayanon, B. McDanel, and H. Kung. Branchynet: Fast inference via early exiting from deep neural networks. https: //gitlab. com/htkung/branchynet, 2016.
25. V. Vanhoucke, A. Senior, and M. Z. Mao. Improving the speed of neural networks on cpus.
26. P. Zhang, J. Wang, A. Farhadi, M. Hebert, and D. Parikh. Predicting failures of vision systems. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3566. 3573, 2014.