Scalable transparent checkpoint-restart of global address space applications on virtual machines over infiniband

Proceedings of the 6th ACM Conference on Computing Frontiers, CF 2009

Volumn , Issue , 2009, Pages 197-206

  Villa, Oreste ^a   Krishnamoorthy, Sriram ^a   Nieplocha, Jarek ^a   Brown Jr , David M ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

Checkpoint Restart; Global address space; Infiniband; Virtual machines

Indexed keywords

CHECKPOINT-RESTART; GLOBAL ADDRESS SPACES; INFINIBAND; ONE-SIDED COMMUNICATIONS; SYSTEM-LEVEL APPROACH; VIRTUAL MACHINE ENVIRONMENTS; VIRTUAL MACHINES; VIRTUALIZATION SOFTWARE;

COMMUNICATION; COMPUTER SIMULATION; FAULT TOLERANCE; QUEUEING NETWORKS; SPACE APPLICATIONS;

COMPUTER SYSTEMS PROGRAMMING;

EID: 79952782887     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1531743.1531776     Document Type: Conference Paper

References (29)

1. D. Abramson, J. Jackson, S. Muthrasanallur, G. Neiger, G. Regnier, R. Sankaran, I. Schoinas, R. Uhlig, B. Vembu, and J. Wiegert. Intel Technology Journal (Intel) 10 (3): 179-192.
2. A. Beguelin, E. Seligman, and P. Stephan. Application Level Fault Tolerance in Heterogeneus Networks of Workstations. Journal of Parallel and Distributed Computing, 43(2):147-155, May 25, 1997.
3. A. Borg, W. Blau, W. Graetsch, F. Herrmann, and W. Oberle. Fault Tolerance under UNIX. ACM Transactions on Computer Systems (TOCS), 7(1):1-24, Feb. 1989.
4. S. Chakravorty and L. Kalé. A Fault Tolerance Protocol for Fast Fault Recovery. In IEEE/ACM International Parallel and Distributed Processing Symposium (IPDPS 2007), Long Beach, CA, March 2007.
5. L. Cherkasova and R. Gardner. Measuring CPU overhead for i/o processing in the Xen virtual machine monitor. In Proceedings of the USENIX 2005 Annual Technical Conference, General Track, pages 387-390, 2005.
6. Y. Dotsenko, C. Coarfa, and J. Mellor-Crummey. A Multiplatform Co-Array Fortran Compiler. In Proc. of the 13th Intl. Conference of Parallel Architectures and Compilation Techniques, September 2004.
7. B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, I. Pratt, A. Warfield, P. Barham, and R. Neugebauer. Xen and the Art of Virtualization. In Proceedings of the ACM Symposium on Operating Systems Principles, October 2003.
8. K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. Warfield, and M. Williamson. Safe hardware access with the Xen virtual machine monitor. In In Proceedings of the OASIS ASPLOS Workshop, 2004, 2004.
9. Q. Gao, W. Yu, W. Huang, and D. K. Panda. Application-transparent checkpoint/restart for mpi programs over infiniband. In ICPP '06: Proceedings of the 2006 International Conference on Parallel Processing, pages 471-478, 2006.
10. A. Geist and C. Engelmann. Development of Naturally Fault Tolerant Algorithms for Computing on 100,000 Processors. Oak Ridge National Laboratory, 2002.
11. R. Gioiosa, J. C. Sancho, S. Jiang, F. Petrini, and K. Davis. Transparent Incremental Checkpointing at Kernel Level: A Foundation for Fault Tolerance for Parallel Computers. In IEEE/ACM Conference on Supercomputing SC'05, Seattle, WA, November 2005.
12. W. Huang, Q. Gao, J. Liu, and D. Panda. High performance virtual machine migration with rdma over modern interconnects. Cluster Computing, 2007 IEEE International Conference on, pages 11-20, Sept. 2007.
13. W. Huang, J. Liu, M. Koop, B. Abali, and D. K. Panda. Nomad: Migrating OS-bypass networks in virtual machines. In Proc. of the Third Intl. ACM SIGPLAN/SIGOPS Conference on Virtual Execution Environments, June 2007.
14. A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. kvm: the linux virtual machine monitor. In Ottawa Linux Symposium, pages 225-230, July 2007.
15. N.-B. C. Laboratory. MPI over InfiniBand Project.
16. C. J. Li and W. K. Fuch. CATCH - Compiler Assisted Techniques for Checkpointing. In Proceedings of the International Symposium on Fault Tolerant Computing, pages 74-81, June 1990.
17. J. Liu, W. Huang, B. Abali, and D. Panda. High Performance VMM-Bypass I/O in Virtual Machines. In USENIX Annual Technical Conference, Boston, MA, June 2006.
18. J. Liu, J. Wu, S. P. Kini, D. Buntinas, W. Yu, B. Chandrasekaran, R. M. Noronha, P. Wyckoff, and D. K. Panda. MPI over infiniband: Early experiences. Technical Report OSU-CISRC-10/02-TR25, Ohio State Univ., Aug 2003.
19. J. Liu, J. Wu, and D. K. Panda. High performance RDMA-based MPI implementation over infiniband. Int. J. Parallel Program., 32(3):167-198, 2004.
20. A. Menon, J. R. Santos, Y. Turner, G. J. Janakiraman, and W. Zwaenepoel. Diagnosing performance overheads in the xen virtual machine environment. In VEE '05: Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments, pages 13-23, New York, NY, USA, 2005. ACM Press.
21. A. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for HPC with Xen virtualization. In Proc. of the ACM International Conference on Supercomputing (ICS), Seattle, WA, USA, June 16-20, 2007.
22. J. Nieplocha, R. J. Harrison, and R. J. Littlefield. Global arrays: A nonuniform memory access programming model for high-performance computers. The Journal of Supercomputing, 10(2):169-189, 1996.
23. J. Nieplocha, V. Tipparaju, M. Krishnan, and D. Panda. High Performance Remote Memory Access Comunications: The ARMCI Approach. International Journal of High Performance Computing and Applications, 20(2), 2006.
24. K. Parzyszek, J. Nieplocha, and R. A. Kendall. Generalized Portable SHMEM Library for High Performance Computing. In M. Guizani and X. Shen, editors, IASTED Parallel and Distributed Computing and Systems, pages 401-406, 2000.
25. M. Prvulovic, Z. Zhang, and J. Torrellas. Revive: Cost-Effective Architectural Support for Rollback Recovery in Shared-Memory Multiprocessors. In Proceedings of the International Symposium on Computer Architecture, May 25-29, 2002.
26. J. Ruscio, M. Heffner, and S. Varadarajan. DejaVu: Transparent User-Level Checkpointing, Migration and Recovery for Distributed Systems. In Proc. of the Intl. Parallel and Distributed Processing Symposium (IPDPS 2007), March 2007.
27. T. P. Straatsma and J. A. McCammon. Load balancing of molecular dynamics simulation with nwchem. IBM Syst. J., 40(2):328-341, 2001.
28. C. Wang, F. Mueller, C. Engelmann, and S. Scott. A Job Pause Service under LAM/MPI + BLCR for Transparent Fault Tolerance. In IEEE/ACM International Parallel and Distributed Processing Symposium (IPDPS 2007), March 2007.
29. D. Zimmer. VMware Server and VMware Player. The way forward for Virtualization. BoD, 2006.