Combining virtual machine migration with process migration for HPC on multi-clusters and grids

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn Proceedings of the 2008 IEEE International Conference on Cluster Computing, ICCC 2008, Issue , 2008, Pages 89-98

  Maoz, Tal ^a   Barak, Amnon ^a   Amar, Lior ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER OPERATING SYSTEMS; PLANNING; RESOURCE ALLOCATION; WINDOWS; WINDOWS OPERATING SYSTEM;

DYNAMIC RESOURCE ALLOCATIONS; GRID MANAGEMENTS; HARDWARE AND SOFTWARES; HIGH PERFORMANCE COMPUTING; JOB MIGRATIONS; JOB SUBMISSIONS; NEW OPPORTUNITIES; ON DEMANDS; PARALLEL JOBS; PROCESS MIGRATIONS; PROCESS PERFORMANCES; VIRTUAL MACHINES; VIRTUALIZATION;

APPLICATIONS;

EID: 57949111058     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2008.4663759     Document Type: Conference Paper

References (40)

1. M. Harchol-Balter and A. B. Downey, "Exploiting process lifetime distributions for dynamic load balancing," ACM Trans. Comput. Syst., vol. 15, no. 3, pp. 253-285, 1997.
2. D. S. Milojičić, F. Douglis, Y. Paindaveine, R. Wheeler, and S. Zhou, "Process migration," ACM Comput. Surv., vol. 32, no. 3, pp. 241-299, 2000.
3. A. Barak and O. La'adan, "The MOSIX multicomputer operating system for high performance cluster computing," Future Generation Computer Systems, vol. 13, no. 4-5, pp. 361-372, 1998.
4. S. Osman, D. Subhraveti, G. Su, and J. Nieh, "The design and implementation of zap: a system for migrating computing environments," SIGOPS Oper. Syst. Rev., vol. 36, no. SI, pp. 361-376, 2002.
5. C. Steketee, "Process migration and load balancing in amoeba." [Online]. Available: citeseer.ist.psu.edu/315429.html
6. A. B. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott, "Proactive fault tolerance for HPC with Xen virtualization," in Proceedings of the 21st annual international conference on Supercomputing (ICS '07). ACM, 2007, pp. 23-32.
7. E. Bugnion, S. Devine, K. Govil, and M. Rosenblum, "Disco: running commodity operating systems on scalable multiprocessors," ACM Trans. Comput. Syst., vol. 15, no. 4, pp. 412-447, 1997.
8. (2008) VMware. [Online]. Available: http://www.vmware.org
9. (2008) XenSource. [Online]. Available: http://www.xensource.org
10. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live migration of virtual machines," in Proceedings of the 2nd ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI), May 2005, pp. 273-286. [Online]. Available: http://citeseer.ist.psu.edu/clark05live.html
11. M. Nelson, B.-H. Lim, and G. Hutchins, "Fast transparent migration for virtual machines," in Proceedings of the USENIX Annual Technical Conference (ATEC '05). USENIX Assoc., 2005, p. 25.
12. (2008) Quick Migration with Hyper-V. [Online]. Available: http://download.microsoft.com/download/3/B/5/3B51A025-7522-4686-AA16- 8AE2E536034D/Quick Migration with Hyper-V.doc
13. (2008) VMware Server 1.0.4. [Online]. Available: http://www.vmware.com/ products/server
14. H. Nishimura, N. Maruyama, and S. Matsuoka, "Virtual clusters on the fly - fast, scalable, and flexible installation," in Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGRID '07). IEEE Computer Society, 2007, pp. 549-556.
15. K. Keahey, I. Foster, T. Freeman, and X. Zhang, "Virtual workspaces: Achieving quality of service and quality of life in the grid," Sci. Program., vol. 13, no. 4, pp. 265-275, 2005.
16. A. Barak, A. Shiloh, and L. Amar, "An organizational grid of federated MOSIX clusters," in Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 1. IEEE Computer Society, 2005, pp. 350-357.
17. (2008) MOSIX. [Online]. Available: http://www.MOSIX.org
18. M. F. Oberhumer. (2005) lzop v1.02rc1. [Online]. Available: http://www.lzop.org/
19. W. J. Kent, "BLAT - The BLAST-Like Alignment Tool," Genome Res., vol. 12, no. 4, pp. 656-664, 2002. [Online]. Available: http://www.genome.org/cgi/content/abstract/12/4/656
20. (2007) Rosetta commons. [Online]. Available: http://www.rosettacommons. org
21. T. Austin, E. Larson, and D. Ernst, "Simplescalar: An infrastructure for computer system modeling," Computer, vol. 35, no. 2, pp. 59-67, 2002.
22. (2008) Persistance of Vision Ray-Tracer, POV-Ray. [Online]. Available: http://www.povray.org
23. A. Fava, E. Fava, and M. Bertozzi, "MPIPOV: A parallel implementation of POV-Ray based on MPI," in Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. London, UK: Springer-Verlag, 1999, pp. 426-433.
24. (2008) MPI documents. [Online]. Available: http://www.mpiforum. org/docs/docs.html
25. (2007) POV-Anywhere. [Online]. Available: http://www.imagico.de/povany/ index.html
26. K. Adams and O. Agesen, "A comparison of software and hardware techniques for x86 virtualization," in Proceedings of the 12th international conference on Architectural support for programming languages and operating systems (ASPLOS-XII). ACM, 2006, pp. 2-13.
27. A. Whitaker, R. S. Cox, M. Shaw, and S. D. Gribble, "Rethinking the design of virtual machine monitors," Computer, vol. 38, no. 5, pp. 57-62, 2005.
28. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the art of virtualization," in Proceedings of the nineteenth ACM symposium on Operating systems principles (SOSP '03). ACM, 2003, pp. 164-177.
29. (2008) Hypervisor top level functional specification v0 83. [Online]. Available: http://download.microsoft.com/download/4/5/2/45275c52-93a9-4a29-bdbc- 45dc1c82bc1d/Hypervisor Top Level Functional Specification v0 83.docx
30. R. J. Figueiredo, P. A. Dinda, and J. A. B. Fortes, "A case for grid computing on virtual machines," in Proceedings of the 23rd International Conference on Distributed Computing Systems (ICDCS '03). IEEE Computer Society, 2003, p. 550.
31. J. S. Chase, D. E. Irwin, L. E. Grit, J. D. Moore, and S. E. Sprenkle, "Dynamic virtual clusters in a grid site manager," in HPDC '03: Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing. IEEE Computer Society, 2003, p. 90.
32. A. N. Coles and A. Edwards, "Rapid node reallocation between virtual clusters for data intensive utility computing," in Proceedings of the 2006 IEEE International Conference on Cluster Computing (Cluster 2006), 2006.
33. G. Stellner, "CoCheck: Checkpointing and process migration for MPI," in Proceedings of the 10th International Parallel Processing Symposium (IPPS '96). IEEE Computer Society, 1996, pp. 526-531.
34. T. Boyd and P. Dasgupta, "Process migration: A generalized approach using a virtualizing operating system," in Proceedings of the 22nd International Conference on Distributed Computing Systems (ICDCS'02). IEEE Computer Society, 2002, p. 385.
35. J. G. Hansen and E. Jul, "Self-migration of operating systems," in Proceedings of the 11th ACM SIGOPS European workshop (EW11). ACM, 2004, p. 23.
36. W. Huang, Q. Gao, J. Liu, and D. Panda. (2007) High performance virtual machine migration with RDMA over modern interconnects. [Online]. Available: http://hpc.pnl.gov/projects/scalable-fault/cluster07-paper.pdf
37. A. I. Sundararaj and P. A. Dinda, "Towards virtual networks for virtual machine grid computing," in Proceedings of the 3rd conference on Virtual Machine Research And Technology Symposium (VM'04). USENIX Assoc., 2004, pp. 14-14.
38. A. Menon, A. L. Cox, and W. Zwaenepoel, "Optimizing network virtualization in xen," in Proceedings of the USENIX Annual Technical Conference (ATEC '06). USENIX Assoc., 2006, pp. 2-2.
39. J. Liu, W. Huang, B. Abali, and D. K. Panda, "High performance vmmbypass i/o in virtual machines," in Proceedings of the USENIX Annual Technical Conference (ATEC '06). USENIX Assoc., 2006, pp. 3-3.
40. A. Margolin, personal communication, 2008.