Overdriver: Handling memory overload in an oversubscribed cloud

Proceedings of the 2011 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE 2011

Volumn , Issue , 2011, Pages 205-216

  Williams, Dan ^a   Weatherspoon, Hakim ^a   Jamjoom, Hani ^b   Liu, Yew Huey ^b  

^a Department of Computer Science and School of Operations Research and Information Engineering   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Cloud computing; Network memory; Resource oversubcription; Virtualization; Vm migration

Indexed keywords

APPLICATION PERFORMANCE; CLOUD PROVIDERS; CURRENT DATA; DATA CENTERS; NETWORK MEMORY; NETWORK TRAFFIC; PHYSICAL RESOURCES; RESOURCE OVERSUBCRIPTION; VIRTUALIZATIONS; VM MIGRATION;

COMPUTER SYSTEMS; POWER QUALITY; PROFITABILITY;

CLOUD COMPUTING;

EID: 79953199788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1952682.1952709     Document Type: Conference Paper

References (35)

1. memcached. http://www.danga.com/memcached/, May 2003.
2. T. E. Anderson, D. E. Culler, D. A. Patterson, and the NOW team. A case for NOW (Networks of Workstations). IEEE Micro, 15(1):54-64, Feb. 1995.
3. M. Andreolini, S. Casolari, M. Colajanni, and M. Messori. Dynamic load management of virtual machines in a cloud architecture. In Proc. of ICST CLOUDCOMP, Munich, Germany, Oct. 2009.
4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proc. of ACM SOSP, Bolton Landing, NY, Oct. 2003.
5. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. of USENIX NSDI, Boston, MA, May 2005.
6. B. Cully, G. Lefebvre, D. Meyer, M. Feeley, N. Hutchinson, and A. Warfield. Remus: high availability via asynchronous virtual machine replication. In Proc. of USENIX NSDI, San Francisco, CA, Apr. 2008.
7. M. D. Dahlin, R. Y. Wang, T. E. Anderson, and D. A. Patterson. Cooperative caching: Using remote client memory to improve file system performance. In Proc. of USENIX OSDI, Monterey, CA, Nov. 1994.
8. M. J. Feeley, W. E. Morgan, E. P. Pighin, A. R. Karlin, H. M. Levy, and C. A. Thekkath. Implementing global memory management in a workstation cluster. In Proc. of ACM SOSP, Copper Mountain, CO, Dec. 1995.
9. K. Govil, D. Teodosiu, Y. Huang, and M. Rosenblum. Cellular Disco: Resource management using virtual clusters on shared-memory multiprocessors. In Proc. of ACM SOSP, Charleston, SC, Dec. 1999.
10. D. Gupta, S. Lee, M. Vrable, S. Savage, A. C. Snoeren, G. Varghese, G. M. Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. In Proc. of USENIX OSDI, San Diego, CA, Dec. 2008.
11. F. Hermenier, X. Lorca, J.-M. Menaud, G. Muller, and J. Lawall. Entropy: a consolidation manager for clusters. In Proc. of ACM VEE, Washington, DC, Mar. 2009.
12. M. Hines and K. Gopalan. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In Proc. of ACM VEE, Washington, DC, Mar. 2009.
13. M. R. Hines and K. Gopalan. MemX: supporting large memory workloads in Xen virtual machines. In Proc. of IEEE VTDC, Reno, NV, Nov. 2007.
14. R. H. Katz. Tech Titans Building Boom, http://www.spectrum.ieee.org/ feb09/7327, Feb. 2009.
15. G. Khanna, K. Beaty, G. Kar, and A. Kochut. Application performace management in virtualized server environments. In Proc. of IEEE/IFIP NOMS, Vancouver, Canada, Apr. 2006.
16. A. Kivity, Y. Kamay, and D. Laor. KVM: The kernel-based virtual machine for Linux. In Proc. of Ottawa Linux Symposium, Ottawa, Canada, June 2007.
17. M. Kozuch and M. Satyanarayanan. Internet suspend/resume. In Proc. of IEEE WMCSA, Calicoon, NY, June 2002.
18. H. A. Lagar-Cavilla, J. Whitney, A. Scannell, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. SnowFlock: Rapid virtual machine cloning for cloud computing. In Proc. of ACM EuroSys, Nuremberg, Germany, Apr. 2009.
19. E. P. Markatos and G. Dramitinos. Implementation of a reliable remote memory pager. In Proc. of USENIX Annual Technical Conf, San Diego, CA, Jan. 1996.
20. D. S. Milojicic, F. Douglis, Y. Paindaveine, and S. Zhou. Process migration. ACM Computing Surveys, 32(3):241-299, Sept. 2000.
21. G. Miłoś, D. G. Murray, S. Hand, and M. A. Fetterman. Satori: Enlightened page sharing. In Proc. of USENIX Annual Technical Conf, San Diego, CA, June 2009.
22. B. Mitchell, J. Rosse, and T. Newhall. Reliability algorithms for network swapping systems with page migration. In Proc. of IEEE CLUSTER, San Diego, CA, Sept. 2004.
23. M. Nelson, B.-H. Lim, and G. Hutchins. Fast transparent migration for virtual machines. In Proc. of USENIX Annual Technical Conf., Anaheim, CA, Apr. 2005.
24. T. Newhall, S. Finney, K. Ganchev, and M. Spiegel. Nswap: A Network Swapping Module for Linux Clusters. In Proc. of Euro-Par, Klagenfurt, Austria, Aug. 2003.
25. H. Qian, E. Miller, W. Zhang, M. Rabinovich, and C. E. Wills. Agility in virtualized utility computing. In Proc. of IEEE VTDC, Reno, NV, Nov. 2007.
26. C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the migration of virtual computers. In Proc. of USENIX OSDI, Boston, MA, Dec. 2002.
27. V. Shrivastava, P. Zerfos, K. won Lee, H. Jamjoom, Y-H. Liu, and S. Banerjee. Application-aware virtual machine migration in data centers (to appear). In Proc. of IEEE INFOCOM Mini-conference, Shanghai, China, Apr. 2011.
28. A. Stage and T. Setzer. Network-aware migration control and scheduling of differentiated virtual machine workloads. In Proc. of ICSE Workshop on Software Engineering Challenges of Cloud Computing, Vancouver, Canada, May 2009.
29. Standard Performance Evaluation Corporation. Specweb2009 release 1.10 banking workload design document, http://www.spec.org/web2009/docs/design/ BankingDesign.html, Apr. 2009.
30. H. N. Van, F. D. Tran, and J.-M. Menaud. Autonomic virtual resource management for service hosting platforms. In Proc. of ICSE Workshop on Software Engineering Challenges of Cloud Computing, Vancouver, Canada, May 2009.
31. C. A. Waldspurger. Memory resource management in VMware ESX server. In Proc. of USENIX OSDI, Boston, MA, Dec. 2002.
32. A. Warfield, S. Hand, K. Fraser, and T. Deegan. Facilitating the development of soft devices. In Proc. of USENIX Annual Technical Conf, Anaheim, CA, Apr. 2005.
33. S. Weber and R. Hariharan. A new synthetic web server trace generation methodology. In Proc. of IEEE ISPASS, Austin, TX, Mar. 2003.
34. T. Wood, P. Shenoy, and A. Venkataramani. Black-box and gray-box strategies for virtual machine migration. In Proc. of USENIX NSDI, Cambridge, MA, Apr. 2007.
35. T. Wood, G. Tarasuk-Levin, P. Shenoy, P. Desnoyers, E. Cecchet, and M. D. Corner. Memory buddies: Exploiting page sharing for smart colocation in virtualized data centers. In Proc. of ACM VEE, Washington, DC, Mar. 2009.