Distributed Deep Neural Networks over the Cloud, the Edge and End Devices

Proceedings - International Conference on Distributed Computing Systems

Volumn , Issue , 2017, Pages 328-339

  Teerapittayanon, Surat ^a   McDanel, Bradley ^a   Kung, H T ^a  

^a HARVARD UNIVERSITY   (United States)

Author keywords

Cloud computing; Ddnn; Deep neural networks; Distributed computing hierarchies; Distributed deep neural networks; Dnn; Edge computing; Embedded dnn; Sensor fusion

Indexed keywords

CLOUD COMPUTING; COST REDUCTION; DATA PRIVACY; DEEP NEURAL NETWORKS; FAULT TOLERANCE; FAULT TOLERANT COMPUTER SYSTEMS; NEURAL NETWORKS; OBJECT RECOGNITION; SENSOR DATA FUSION;

COMMUNICATION COST; DDNN; EDGE COMPUTING; EMBEDDED DNN; NEURAL NETWORK SIZE; RECOGNITION ACCURACY; SENSOR FUSION; SYSTEM FAULT TOLERANCE;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 85027287268     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDCS.2017.226     Document Type: Conference Paper

References (21)

1. W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, "Edge computing: Vision and challenges, " IEEE Internet of Things Journal, vol. 3, no. 5, pp. 637-646, 2016.
2. K. Skala, D. Davidovic, E. Afgan, I. Sovic, and Z. Sojat, "Scalable distributed computing hierarchy: Cloud, fog and dew computing, " Open Journal of Cloud Computing (OJCC), vol. 2, no. 1, pp. 16-24, 2015.
3. S. Teerapittayanon, B. McDanel, and H. Kung, "Branchynet: Fast inference via early exiting from deep neural networks, " in International Conference on Pattern Recognition, 2016.
4. M. Courbariaux, Y. Bengio, and J.-P. David, "Binaryconnect: Training deep neural networks with binary weights during propagations, " in Advances in Neural Information Processing Systems, 2015, pp. 3123-3131.
5. B. McDanel, S. Teerapittayanon, and H. Kung, "Embedded binarized neural networks, " in International Conference on Embedded Wireless Systems and Networks, 2017.
6. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradientbased learning applied to document recognition, " Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
7. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks, " in Advances in neural information processing systems, 2012, pp. 1097-1105.
8. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " arXiv preprint arXiv:1409. 1556, 2014.
9. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1-9.
10. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition, " arXiv preprint arXiv:1512. 03385, 2015.
11. S. Yi, Z. Hao, Z. Qin, and Q. Li, "Fog computing: Platform and applications, " in Hot Topics in Web Systems and Technologies (HotWeb), 2015 Third IEEE Workshop on. IEEE, 2015, pp. 73-78.
12. M. Rastegari, V. Ordonez, J. Redmon, and A. Farhadi, "Xnornet: Imagenet classification using binary convolutional neural networks, " arXiv preprint arXiv:1603. 05279, 2016.
13. M. Figurnov, M. D. Collins, Y. Zhu, L. Zhang, J. Huang, D. Vetrov, and R. Salakhutdinov, "Spatially adaptive computation time for residual networks, " arXiv preprint arXiv:1612. 02297, 2016.
14. J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, M. Mao, A. Senior, P. Tucker, K. Yang, Q. V. Le et al., "Large scale distributed deep networks, " in Advances in neural information processing systems, 2012, pp. 1223-1231.
15. F. N. Iandola, K. Ashraf, M. W. Moskewicz, and K. Keutzer, "Firecaffe: near-linear acceleration of deep neural network training on compute clusters, " arXiv preprint arXiv:1511. 00175, 2015.
16. J. Dean, "Large scale deep learning, " in Keynote GPU Technical Conference, vol. 3, 2015, p. 2015.
17. D. Kingma and J. Ba, "Adam: A method for stochastic optimization, " arXiv preprint arXiv:1412. 6980, 2014.
18. G. Roig, X. Boix, H. B. Shitrit, and P. Fua, "Conditional random fields for multi-camera object detection, " in 2011 International Conference on Computer Vision. IEEE, 2011, pp. 563-570.
19. X. Li, W. Hu, C. Shen, Z. Zhang, A. Dick, and A. V. D. Hengel, "A survey of appearance models in visual object tracking, " ACM transactions on Intelligent Systems and Technology (TIST), vol. 4, no. 4, p. 58, 2013.
20. B. McDanel, "Multiview multicamera dataset, " https: //www. dropbox. com/s/uk8c6iymy8nprc0/MVMC. npz, 2016, accessed: 2016-12-10.
21. M. Cha, Y. Gwon, and H. Kung, "Multimodal sparse representation learning and applications, " arXiv preprint arXiv:1511. 06238, 2015.