A case for tracking and exploiting inter-node and intra-node memory content sharing in virtualized large-scale parallel systems

VTDC '12 - 6th International Workshop on Virtualization Technologies in Distributed Computing

Volumn , Issue , 2012, Pages 11-18

  Xia, Lei ^a   Dinda, Peter ^a  

^a Northwestern University   (United States)

Author keywords

Content Sharing; Virtualization

Indexed keywords

CONTENT SHARING; DIFFERENT SCALE; HIGH-LEVEL APPROACH; LARGE-SCALE PARALLEL SYSTEMS; LOW OVERHEAD; MEMORY COST; MEMORY FOOTPRINT; MEMORY REDUNDANCY; MULTIPLE SOURCE; PARALLEL APPLICATION; VIRTUAL NODE; VIRTUALIZATIONS;

BENCHMARKING; VIRTUAL REALITY;

REDUNDANCY;

EID: 84863952062     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2287056.2287061     Document Type: Conference Paper

References (29)

1. HPCC. http://icl.cs.utk.edu/hpcc/.
2. LAMMPS. http://lammps.sandia.gov/.
3. Memcached. http://memcached.org/.
4. Miniapplications. https://software.sandia.gov/mantevo/.
5. MOLDY. http://www.ccp5.ac.uk/moldy/moldy.html.
6. NPB. http://www.nas.nasa.gov/publications/npb.html.
7. SuperHash. redshift.sourceforge.net/superhash/.
8. AGARWAL, S., GARG, R., AND GUPTA, M. S. Adaptive incremental checkpointing for massively parallel systems. In Proceedings of the 18th annual international conference on Supercomputing (ICS'04) (2004).
9. AL-KISWANY, S., SUBHRAVETI, D., SARKAR, P., AND RIPEANU, M. VMFlock: virtual machine co-migration for the cloud. In Proceedings of the 20th international symposium on High performance distributed computing (HPDC'11) (2011).
10. ARCANGELI, A., EIDUS, I., AND WRIGHT, C. Increasing memory density by using KSM. In Proceedings of the Linux Symposium (OLS'09) (2009).
11. BISWAS, S., DE SUPINSKI, B. R., SCHULZ, M., FRANKLIN, D., SHERWOOD, T., AND CHONG, F. T. Exploiting data similarity to reduce memory footprints. In Processing of the 25th IEEE International Symposium on Parallel and Distributed (IPDPS'11) (2011).
12. CLARK, C., FRASER, K., HAND, S., HANSEN, J. G., JUL, E., LIMPACH, C., PRATT, I., AND WARFIELD, A. Live migration of virtual machines. In Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation (NSDI'05) (2005).
13. DESHPANDE, U., WANG, X., AND GOPALAN, K. Live gang migration of virtual machines. In Proceedings of the 20th international symposium on High performance distributed computing (HPDC'11) (2011).
14. FERREIRA, K., STEARLEY, J., LAROS, III, J. H., OLDFIELD, R., PEDRETTI, K., BRIGHTWELL, R., RIESEN, R., BRIDGES, P. G., AND ARNOLD, D. Evaluating the viability of process replication reliability for exascale systems. In Proceedings of the International Conference for High Performance Computing, Networking,Storage and Analysis (SC'11) (2011).
15. GUPTA, D., LEE, S., VRABLE, M., SAVAGE, S., SNOEREN, A. C., VARGHESE, G., VOELKER, G. M., AND VAHDAT, A. Difference engine: Harnessing memory redundancy in virtual machines. In Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI '08) (2008), pp. 309-322.
16. HUANG, W., LIU, J., ABALI, B., AND PANDA, D. K. A case for high performance computing with virtual machines. In 20th Annual International Conference on Supercomputing (ICS'06) (2006).
17. KLOSTER, J., KRISTENSEN, J., AND MEJLHOLM, A. On the feasibility of memory sharing: Content-based page sharing in the xen virtual machine monitor. Tech. rep., Master Thesis, Department of Computer Science, Aalborg University, 2006.
18. LANGE, J. R., PEDRETTI, K. T., HUDSON, T., DINDA, P. A., CUI, Z., XIA, L., BRIDGES, P. G., GOCKE, A., JACONETTE, S., LEVENHAGEN, M., AND BRIGHTWELL, R. Palacios and Kitten: New high performance operating systems for scalable virtualized and native supercomputing. In 24th IEEE International Symposium on Parallel and Distributed Processing (IPDPS'10) (2010).
19. MIŁÓS, G., MURRAY, D. G., HAND, S., AND FETTERMAN, M. A. Satori: Enlightened page sharing. In Proceedings of the 2009 conference on USENIX Annual technical conference (USENIX'09) (2009).
20. MOODY, A., BRONEVETSKY, G., MOHROR, K., AND DE SUPINSKI, B. R. Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'10) (2010).
21. NAGARAJAN, A. B., MUELLER, F., ENGELMANN, C., AND SCOTT, S. L. Proactive fault tolerance for HPC with Xen virtualization. In 21st Annual International Conference on Supercomputing (ICS'07) (2007).
22. NATH, S., YU, H., GIBBONS, P. B., AND SESHAN, S. Subtleties in tolerating correlated failures in wide-area storage systems. In Proceedings of the 3rd conference on Networked Systems Design & Implementation (NSDI'06) (2006).
23. NISHIMURA, H., MARUYAMA, N., AND MATSUOKA, S. Virtual clusters on the fly - fast, scalable, and flexible installation. In Proceedings of the 7th IEEE International Symposium on Cluster Computing and the Grid (CCGRID'07) (2007).
24. OUSTERHOUT, J. K., AGRAWAL, P., ERICKSON, D., KOZYRAKIS, C., LEVERICH, J., MAZIÈRES, D., MITRA, S., NARAYANAN, A., PARULKAR, G. M., ROSENBLUM, M., RUMBLE, S. M., STRATMANN, E., AND STUTSMAN, R. The case for ramclouds: scalable high-performance storage entirely in dram. Operating Systems Review 43, 4 (2009), 92-105.
25. RITEAU, P., MORIN, C., AND PRIOL, T. Shrinker: Improving Live Migration of Virtual Clusters over WANs with Distributed Data Deduplication and Content-Based Addressing. In Proceedings of the 17th International European Conference on Parallel and Distributed Computing (EuroPar'11) (2011).
26. SAPUNTZAKIS, C. P., CHANDRA, R., PFAFF, B., CHOW, J., LAM, M. S., AND ROSENBLUM, M. Optimizing the migration of virtual computers. In Proceedings of the 5th symposium on Operating systems design and implementation (OSDI'02) (2002).
27. VRABLE, M., MA, J., CHEN, J., MOORE, D., VANDEKIEFT, E., SNOEREN, A. C., VOELKER, G. M., AND SAVAGE, S. Scalability, fidelity, and containment in the potemkin virtual honeyfarm. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP'05) (2005).
28. WALDSPURGER, C. A. Memory resource management in vmware esx server. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02) (2002).
29. WOOD, T., TARASUK-LEVIN, G., SHENOY, P. J., DESNOYERS, P., CECCHET, E., AND CORNER, M. D. Memory buddies: exploiting page sharing for smart colocation in virtualized data centers. In Proceedings of the 5th International Conference on Virtual Execution Environments (VEE'09) (2009).