DjiNN and Tonic: DNN as a service and its implications for future warehouse scale computers

Proceedings - International Symposium on Computer Architecture

Volumn 13-17-June-2015, Issue , 2015, Pages 27-40

  Hauswald, Johann ^a   Kang, Yiping ^a   Laurenzano, Michael A ^a   Chen, Quan ^a   Li, Cheng ^a   Mudge, Trevor ^a   Dreslinski, Ronald G ^a   Mars, Jason ^a   Tang, Lingjia ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL LINGUISTICS; COST BENEFIT ANALYSIS; DESIGN; FACE RECOGNITION; IMAGE PROCESSING; INTERNET; LEARNING ALGORITHMS; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; NETWORK ARCHITECTURE; SPEECH RECOGNITION; THROUGHPUT; WAREHOUSES; WEB SERVICES;

DEEP NEURAL NETWORKS; END-TO-END APPLICATION; FACIAL RECOGNITION; IMPLICATIONS FOR FUTURES; LANGUAGE PROCESSING; NATURAL LANGUAGE PROCESSING; THROUGHPUT IMPROVEMENT; TOTAL COST OF OWNERSHIP;

COMPUTER ARCHITECTURE;

EID: 84960091813     PISSN: 10636897     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2749469.2749472     Document Type: Conference Paper

References (48)

1. "Cuda toolkit documentation," http://docs.nvidia.com/cuda/profiler-users-guide/.
2. "DjiNN and Tonic: DNN as a Service," http://djinn.clarity-lab.org.
3. "Facebook's quest to build an artificial brain depends on this guy," www.wired.com/2014/08/deep-learning-yann-lecun.
4. "Google Glass," www.google.com/glass/start.
5. "Inside the artificial brain that's remaking the google empire," www. wired.com/2014/07/google-brain/.
6. "Maple 2015. maplesoft, a division of waterloo maple inc., waterloo, ontario." http://www.maplesoft.com/.
7. "Microsoft corp to challenge apple inc with siri alternative: More intelligent and fast enough!" www.dazeinfo.com/2013/06/18/microsoft-corp-to-challenge-apple-inc-with-siri-alternative/-more-intelligent-and-fast-enough.
8. "Multi-process service," https://docs.nvidia.com/deploy/pdf/CUDA- Multi-Process-Service-Overview.pdf.
9. "Nvidia visual profiler," https://developer.nvidia.com/NVIDIA-visual-profiler.
10. "Apple's Massive New Data Center Set To Host Nuance Tech," http: //techcrunch.com/2011/05/09/apple-nuance-data-center-deal/, 2011.
11. L. A. Barroso, J. Clidaras, and U. Hölzle, "The datacenter as a computer: an introduction to the design of warehouse-scale machines," Synthesis Lectures on Computer Architecture, 2013.
12. F. Bastien, P. Lamblin, R. Pascanu, J. Bergstra, I. Goodfellow, A. Bergeron, N. Bouchard, D. Warde-Farley, and Y. Bengio, "Theano: new features and speed improvements," Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop, 2012.
13. B. C. Becker and E. G. Ortiz, "Evaluating open-universe face identification on the web," in Computer Vision and Pattern Recognition Workshops (CVPRW), 2013.
14. T. Chen, Z. Du, N. Sun, J. Wang, C. Wu, Y. Chen, and O. Temam, "Diannao: A small-footprint high-throughput accelerator for ubiquitous machine-learning," Architectual Support for Programming Languages and Operating Systems(ASPLOS), 2014.
15. Y. Chen, T. Luo, S. Liu, S. Zhang, L. He, J.Wang, L. Li, T. Chen, Z. Xu, N. Sun et al., "Dadiannao: A machine-learning supercomputer," in Microarchitecture (MICRO), 2014 47th Annual IEEE/ACM International Symposium on. IEEE, 2014, pp. 609-622.
16. S. Chetlur, C. Woolley, P. Vandermersch, J. Cohen, J. Tran, B. Catanzaro, and E. Shelhamer, "cudnn: Efficient primitives for deep learning," arXiv preprint arXiv:1410.0759, 2014.
17. T. Chilimbi, Y. Suzue, J. Apacible, and K. Kalyanaraman, "Project adam: building an efficient and scalable deep learning training system," in Operating Systems Design and Implementation(OSDI), 2014.
18. A. Coates, B. Huval, T. Wang, D. Wu, B. Catanzaro, and N. Andrew, "Deep learning with cots hpc systems," in International Conference on Machine Learning(ICML), 2013.
19. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa, "Natural language processing (almost) from scratch," The Journal of Machine Learning Research, 2011.
20. J. Deng,W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "Imagenet: A large-scale hierarchical image database," in Computer Vision and Pattern Recognition (CVPR), 2009.
21. I. J. Goodfellow, D. Warde-Farley, P. Lamblin, V. Dumoulin, M. Mirza, R. Pascanu, J. Bergstra, F. Bastien, and Y. Bengio, "Pylearn2: a machine learning research library," arXiv preprint arXiv:1308.4214, 2013.
22. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks," in International Conference on Acoustics, Speech and Signal Processing(ICASSp), 2013.
23. J. Hauswald, T. Manville, Q. Zheng, R. Dreslinski, C. Chakrabarti, and T. Mudge, "A hybrid approach to offloading mobile image classification," in International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2014.
24. J. Hauswald, M. A. Laurenzano, Y. Zhang, C. Li, A. Rovinski, A. Khurana, R. G. Dreslinski, T. Mudge, V. Petrucci, L. Tang, and J. Mars, "Sirius: An open end-to-end voice and vision personal assistant and its implications for future warehouse scale computers," in International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2015.
25. C.-H. Hsu, Y. Zhang, M. A. Laurenzano, D. Meisner, T. Wenisch, L. Tang, J. Mars, and R. Dreslinski, "Adrenaline: Pinpointing and reigning in tail queries with quick voltage boosting," in International Symposium on High Performance Computer Architecture (HPCA), 2015.
26. X. Huang, J. Baker, and R. Reddy, "A historical perspective of speech recognition," Commun. ACM, 2014.
27. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding," arXiv preprint arXiv:1408.5093, 2014.
28. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in neural information processing systems, 2012.
29. N. Kurd, J. Douglas, P. Mosalikanti, and R. Kumar, "Next generation intel-R micro-architecture (nehalem) clocking architecture," in VLSI Circuits, 2008 IEEE Symposium on. IEEE, 2008, pp. 62-63.
30. M. Laurenzano, Y. Zhang, L. Tang, and J. Mars, "Protean code: Achieving near-free online code transformations for warehouse scale computers," in International Symposium on Microarchitecture (MICRO), 2014.
31. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, 1998.
32. D. Liu, T. Chen, S. Liu, J. Zhou, S. Zhou, O. Teman, X. Feng, X. Zhou, and Y. Chen, "Pudiannao: A polyvalent machine learning accelerator," in International Conference on Architectural Support for Programming Languages and Operating Systems(ASPLOS), 2015.
33. Y. Low, D. Bickson, J. Gonzalez, C. Guestrin, A. Kyrola, and J. M. Hellerstein, "Distributed graphlab: a framework for machine learning and data mining in the cloud," Proceedings of the VLDB Endowment( PVLDB), 2012.
34. J. Mars and L. Tang, "Whare-map: Heterogeneity in "homogeneous" warehouse-scale computers," in International Symposium on Computer Architecture (ISCA), 2013.
35. J. Mars, L. Tang, R. Hundt, K. Skadron, and M. L. Soffa, "Bubble-up: Increasing utilization in modern warehouse scale computers via sensible co-locations," in International Symposium on Microarchitecture (MICRO), 2011.
36. V. Petrucci, M. A. Laurenzano, Y. Zhang, J. Doherty, D. Mosse, J. Mars, and L. Tang, "Octopus-man: Qos-driven task management for heterogeneous multicore in warehouse scale computers," in International Symposium on High Performance Computer Architecture (HPCA), 2015.
37. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz et al., "The kaldi speech recognition toolkit," in Proc. ASRU, 2011.
38. A. Putnam, A. M. Caulfield, E. S. Chung, D. Chiou, K. Constantinides, J. Demme, H. Esmaeilzadeh, J. Fowers, G. P. Gopal, J. Gray et al., "A reconfigurable fabric for accelerating large-scale datacenter services," in International Symposium on Computer Architecture (ISCA), 2014.
39. W. Qadeer, R. Hameed, O. Shacham, P. Venkatesan, C. Kozyrakis, and M. A. Horowitz, "Convolution engine: balancing efficiency & flexibility in specialized computing," in International Symposium on Computer Architecture(ISCA), 2013.
40. A. Research, "Wearable Computing Devices, Like Apple iWatch, Will Exceed 485 Million Annual Shipments by 2018," 2013.
41. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei, "ImageNet Large Scale Visual Recognition Challenge(ILSVRC)," 2014.
42. M. Skach, M. Arora, C.-H. Hsu, Q. Li, D. Tullsen, L. Tang, and J. Mars, "Thermal time shifting: Leveraging phase change materials to reduce cooling costs in warehouse-scale computers," in Proceedings of the 42nd Annual International Symposium on Computer Architecture (ISCA), ser. ISCA '15, 2015.
43. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification," in Computer Vision and Pattern Recognition (CVPR), 2014.
44. O. Temam, "A defect-tolerant accelerator for emerging highperformance applications," in ACM SIGARCH Computer Architecture News, 2012.
45. V. Vanhoucke, A. Senior, and M. Z. Mao, "Improving the speed of neural networks on cpus," in Proc. Deep Learning and Unsupervised Feature Learning NIPS Workshop, 2011.
46. R. C. Whaley and J. Dongarra, "Automatically tuned linear algebra software," in SuperComputing: High Performance Networking and Computing, 1998.
47. H. Yang, A. Breslow, J. Mars, and L. Tang, "Bubble-flux: Precise online qos management for increased utilization in warehouse scale computers," in International Symposium on Computer Architecture (ISCA), 2013.
48. Y. Zhang, M. Laurenzano, J. Mars, and L. Tang, "Smite: Precise qos prediction on real system smt processors to improve utilization in warehouse scale computers," in International Symposium on Microarchitecture (MICRO), 2014.