Slacker: Fast distribution with lazy docker containers

Proceedings of the 14th USENIX Conference on File and Storage Technologies, FAST 2016

Volumn , Issue , 2016, Pages 181-195

  Harter, Tyler ^a   Salmon, Brandon ^b   Liu, Rose ^b   Arpaci Dusseau, Andrea C ^a   Arpaci Dusseau, Remzi H ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b Tintri

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; DIGITAL STORAGE;

DEPLOYMENT METHODS; DEVELOPMENT CYCLE;

CONTAINERS;

EID: 85077215754     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (50)

1. Tintri VMstore(tm) T600 Series. http://www.tintri.com/sites/default/files/field/pdf/document/t600-datasheet_0.pdf, 2013.
2. Kubernetes. http://kubernetes.io, August 2014.
3. Docker Hub. https://hub.docker.com/u/library/, 2015.
4. Modern HTTP Benchmarking Tool. https://github.com/wg/wrk/, 2015.
5. pgbench. http://www.postgresql.org/docs/devel/static/pgbench.html, September 2015.
6. Tintri Operating System. https://www.tintri.com/sites/default/files/field/pdf/whitepapers/tintri-osdatasheet-150701t10072.pdf, 2015.
7. Keith Adams and Ole Agesen. A Comparison of Software and Hardware Techniques for x86 Virtualization. In Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS XIII), Seattle, Washington, March 2008.
8. Sebastian Angel, Hitesh Ballani, Thomas Karagiannis, Greg O'Shea, and Eno Thereska. End-to-end Performance Isolation Through Virtual Datacenters.
9. Andrea Arcangeli, Izik Eidus, and Chris Wright. Increasing memory density by using KSM. In Proceedings of the linux symposium, pages 19-28, 2009.
10. Remzi H. Arpaci-Dusseau and Andrea C. Arpaci-Dusseau. Operating Systems: Three Easy Pieces. Arpaci-Dusseau Books, 0.91 edition, May 2015.
11. Jens Axboe, Alan D. Brunelle, and Nathan Scott. blktrace(8) - Linux man page. http://linux.die.net/man/8/blktrace, 2006.
12. Edouard Bugnion, Scott Devine, and Mendel Rosenblum. Disco: Running Commodity Operating Systems on Scalable Multiprocessors. In Proceedings of the 16th ACM Symposium on Operating Systems Principles (SOSP'97), pages 143-156, Saint-Malo, France, October 1997.
13. Jeremy Elson and Jon Howell. Handling Flash Crowds from Your Garage. In USENIX 2008 Annual Technical Conference, ATC'08, pages 171-184, Berkeley, CA, USA, 2008. USENIX Association.
14. Diwaker Gupta, Ludmila Cherkasova, Rob Gardner, and Amin Vahdat. Enforcing Performance Isolation Across Virtual Machines in Xen. In Proceedings of the ACM/IFIP/USENIX 7th International Middleware Conference (Middleware'2006), Melbourne, Australia, Nov 2006.
15. Tyler Harter. HelloBench. http://research.cs.wisc.edu/adsl/Software/hello-bench/, 2015.
16. Mike Hibler, Leigh Stoller, Jay Lepreau, Robert Ricci, and Chad Barb. Fast, Scalable Disk Imaging with Frisbee. In USENIX Annual Technical Conference, General Track, pages 283-296, 2003.
17. Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D Joseph, Randy H Katz, Scott Shenker, and Ion Stoica. Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. In NSDI, volume 11, pages 22-22, 2011.
18. Drew Houston. https://www.youtube.com/watch?t=1278&v=NZINmtuTSu0, 2014.
19. Michael Kerrisk and Eric W. Biederman. namespaces(7) - overview of Linux namespaces. http://man7.org/linux/man-pages/man7/namespaces.7.html, 2013.
20. Horacio Andrés Lagar-Cavilla, Joseph Andrew Whitney, Adin Matthew Scannell, Philip Patchin, Stephen M Rumble, Eyal De Lara, Michael Brudno, and Mahadev Satyanarayanan. SnowFlock: Rapid Virtual Machine Cloning for Cloud Computing. In Proceedings of the 4th ACM European conference on Computer systems, pages 1-12. ACM, 2009.
21. Dave Lester. All about Apache Aurora. https://blog.twitter.com/2015/all-about-apache-aurora, 2015.
22. Lanyue Lu, Yupu Zhang, Thanh Do, Samer Al-Kiswany, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. Physical Disentanglement in a Container-Based File System. In Proceedings of the 11th Symposium on Operating Systems Design and Implementation (OSDI'14), Broomfield, CO, October 2014.
23. Git Manpages. git-bisect(1) Manual Page. https://www.kernel.org/pub/software/scm/git/docs/git-bisect. html, 2015.
24. Arif Merchant, Mustafa Uysal, Pradeep Padala, Xiaoyun Zhu, Sharad Singhal, and Kang Shin. Maestro: quality-of-service in large disk arrays.
25. Dirk Merkel. Docker: lightweight Linux containers for consistent development and deployment. Linux Journal, Issue 239, March 2014.
26. Aravind Narayanan. Tupperware: Containerized Deployment at Facebook. http://www.slideshare.net/Docker/ aravindnarayanan-facebook140613153626phpapp02-37588997, 2014.
27. Ripal Nathuji, Aman Kansal, and Alireza Ghaffarkhah. Q-Clouds: Managing Performance Interference Effects for QoSAware Clouds.
28. Bogdan Nicolae, John Bresnahan, Kate Keahey, and Gabriel Antoniu. Going back and forth: Efficient multideployment and multisnapshotting on clouds. In Proceedings of the 20th international symposium on High performance distributed computing, pages 147-158. ACM, 2011.
29. Patrick ONeil, Edward Cheng, Dieter Gawlick, and Elizabeth ONeil. The Log-Structured Merge-Tree (LSM-Tree). Acta Informatica, 33(4):351-385, 1996.
30. John Pescatore. Nimda Worm Shows You Can't Always Patch Fast Enough. https://www.gartner.com/doc/340962, September 2001.
31. David Saff and Michael D Ernst. An Experimental Evaluation of Continuous Testing During Development. In ACM SIGSOFT Software Engineering Notes, volume 29, pages 76-85. ACM, 2004.
32. Constantine P. Sapuntzakis, Ramesh Chandra, Ben Pfaff, Jim Chow, Monica S. Lam, and Mendel Rosenblum. Optimizing the Migration of Virtual Computers. SIGOPS Oper. Syst. Rev., 36(SI):377-390, December 2002.
33. Sunil Shah. Integration Testing with Mesos, Chronos and Docker. http://mesosphere.com/blog/2015/03/26/integration-testing-with-mesos-chronos-docker/, 2015.
34. David Shue, Michael J. Freedman, and Anees Shaikh. Performance Isolation and Fairness for Multi-Tenant Cloud Storage. In Proceedings of the 10th Symposium on Operating Systems Design and Implementation (OSDI'12), Hollywood, California, October 2012.
35. Matt Soldo. Upgraded Autobuild System on Docker Hub. http://blog.docker.com/2015/11/upgradedautobuild-docker-hub/, 2015.
36. spoon.net. Containerized Selenium Testing. https://blog.spoon.net/running-a-selenium-grid-using-containers/, 2015.
37. The Linux Community. LXC - Linux Containers, 2014.
38. E. Thereska, A. Rowstron, H. Ballani, G. O'Shea, T. Karagiannis, T. Talpey, R. Black, and T. Zhu. IOFlow: A Software-Defined Storage Architecture. In Proceedings of the 24th ACM Symposium on Operating Systems Principles (SOSP'13), Farmington, Pennsylvania, November 2013.
39. Paul van der Ende. Fast and Easy Integration Testing with Docker and Overcast. http://blog.xebia.com/2014/10/13/fast-and-easy-integration-testing-with-docker-and-overcast/, 2014.
40. Ben Verghese, Anoop Gupta, and Mendel Rosenblum. Performance Isolation: Sharing and Isolation in Shared-memory Multiprocessors. In Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS VIII), pages 181-192, San Jose, California, October 1998.
41. Abhishek Verma, Luis Pedrosa, Madhukar R. Korupolu, David Oppenheimer, Eric Tune, and John Wilkes. Large-scale cluster management at Google with Borg. In Proceedings of the European Conference on Computer Systems (EuroSys), Bordeaux, France, 2015.
42. Matthew Wachs, Michael Abd-El-Malek, Eno Thereska, and Gregory R. Ganger. Argon: Performance Insulation for Shared Storage Servers. In Proceedings of the 5th USENIX Symposium on File and Storage Technologies (FAST'07), San Jose, California, February 2007.
43. Carl A. Waldspurger. Memory Resource Management in VMware ESX Server. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02), Boston, Massachusetts, December 2002.
44. Xi Wang, Nickolai Zeldovich, M Frans Kaashoek, and Armando Solar-Lezama. Towards optimization-safe systems: Analyzing the impact of undefined behavior. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, pages 260-275. ACM, 2013.
45. Romain Wartel, Tony Cass, Belmiro Moreira, Ewan Roche, Manuel Guijarro, Sebastien Goasguen, and Ulrich Schwickerath. Image distribution mechanisms in large scale cloud providers. In Cloud Computing Technology and Science (Cloud-Com), 2010 IEEE Second International Conference on, pages 112-117. IEEE, 2010.
46. Zev Weiss, Sriram Subramanian, Swaminathan Sundararaman, Nisha Talagala, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. ANViL: Advanced Virtualization for Modern Non-Volatile Memory Devices. In Proceedings of the 13th USENIX Conference on File and Storage Technologies (FAST'15), Santa Clara, CA, February 2015.
47. Xingbo Wu, Wenguang Wang, and Song Jiang. TotalCOW: Unleash the Power of Copy-On-Write for Thin-provisioned Containers. In Proceedings of the 6th Asia-Pacific Workshop on Systems, APSys'15, pages 15:1-15:7, New York, NY, USA, 2015. ACM.
48. Suli Yang, Tyler Harter, Nishant Agrawal, Salini Selvaraj Kowsalya, Anand Krishnamurthy, Samer Al-Kiswany, Rini T. Kaushik, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. Split-level I/O Scheduling. In Proceedings of the 25th Symposium on Operating Systems Principles, SOSP'15, pages 474-489, New York, NY, USA, 2015. ACM.
49. Xiao Zhang, Eric Tune, Robert Hagmann, Rohit Jnagal, Vrigo Gokhale, and John Wilkes. CPI2: CPU Performance Isolation for Shared Compute Clusters.
50. Jun Zhu, Zhefu Jiang, and Zhen Xiao. Twinkle: A Fast Resource Provisioning Mechanism for Internet Services. In INFOCOM, 2011 Proceedings IEEE, pages 802-810. IEEE, 2011.