Snapify: Capturing snapshots of offload applications on Xeon Phi manycore processors

HPDC 2014 - Proceedings of the 23rd International Symposium on High-Performance Parallel and Distributed Computing

Volumn , Issue , 2014, Pages 1-12

  Rezaei, Arash ^a   Coviello, Giuseppe ^b   Li, Cheng Hong ^b   Chakradhar, Srimat ^b   Mueller, Frank ^a  

^a North Carolina State University   (United States)

^b NEC LABORATORIES AMERICA   (United States)

Author keywords

Checkpoint and restart; Coprocessor; Fault tolerance; Process migration; Process swapping; Snapshot; System software; Xeon Phi

Indexed keywords

APPLICATION PROGRAMMING INTERFACES (API); DATA TRANSFER; FAULT TOLERANCE; SUPERCOMPUTERS;

CHECKPOINT-AND-RESTART; CO-PROCESSORS; PROCESS MIGRATION; SNAPSHOT; SYSTEM SOFTWARES; XEON PHI;

APPLICATION PROGRAMS;

EID: 84904409465     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2600212.2600215     Document Type: Conference Paper

References (37)

1. J. Ansel, K. Arya, and G. Cooperman. DMTCP: Transparent checkpointing for cluster computations and the desktop. In Proc. of Intl. Parallel and Distributed Processing Symposium, 2009.
2. D. Bailey et al. The NAS parallel benchmarks. Technical Report RNR-94-007, NASA Advanced Supercomputing Division, Mar. 1994.
3. M. Becchi, K. Sajjapongse, I. Graves, A. Procter, V. Ravi, and S. Chakradhar. A virtual memory based runtime to support multi-tenancy in clusters with GPUs. In Proc. of the Intl. Symposium on High-Perf. Parallel and Distributed Computing, pages 97-108, June 2012.
4. G. Bosilca et al. MPICH-V: toward a scalable fault tolerant MPI for volatile nodes. In Proc. of the ACM/IEEE Intl. Conf. for High Perf. Computing, Networking, Storage and Analysis, 2002.
5. S. Cadambi, G. Coviello, C.-H. Li, R. Phull, K. Rao, M. Sankaradass, and S. Chakradhar. COSMIC: Middleware for high performance and reliable multiprocessing on Xeon Phi coprocessors. In Proc. of the Intl. Symposium on High-Perf. Parallel and Distributed Computing, pages 215-226, June 2013.
6. F. Cappello, A. Geist, B. Gropp, L. Kale, B. Kramer, and M. Snir. Toward exascale resilience. Int. J. High Perform. Comput. Appl., 23(4):374-388, Nov. 2009.
7. K. M. Chandy and L. Lamport. Distributed snapshots: Determining global states of distributed systems. ACM Tran. on Computer Syst., 3(1):63-75, Feb. 1985.
8. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. of the USENIX Conf. on Networked Syst. Design and Implementation, pages 273-286, 2005.
9. R. F. V. der Wijngaart and H. Jin. NAS parallel benchmarks, multi-zone versions. Technical Report NAS-03-010, NASA Advanced Supercomputing Division, July 2003.
10. W. R. Dieter. User-level checkpointing for linuxthreads programs. In USENIX Annual Technical Conf. (FREENIX Track), pages 81-92, 2001.
11. J. Duell. The design and implementation of Berkeley Lab's Linux Checkpoint/Restart. Technical report, Lawrence Berkeley National Laboratory, 2003.
12. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv., 34(3):375-408, Sept. 2002.
13. http://www.criu.org/.
14. http://www.top500.org/.
15. J. Hursey, J. M. Squyres, T. I. Mattox, and A. Lumsdaine. The design and implementation of checkpoint/restart process fault tolerance for Open MPI. In Proc. of Intl. Parallel and Distributed Processing Symposium, Mar. 2007.
16. Intel Corporation. MIC COI API Reference Manual, 0.65 edition.
17. Intel Corporation. Intel Manycore Platform Software Stack (Intel MPSS): User's Guide, 2013.
18. Intel Corporation. Symmetric Communications Interface (SCIF) for Intel Xeon Phi Product Family Users Guide, 2013.
19. G. J. Janakiraman, J. Renato, S. D. Subhraveti, and Y. Turner. Cruz: Application-transparent distributed checkpoint-restart on standard operating systems. In Dependable Systems and Networks, 2005. DSN 2005. Proceedings. International Conference on, pages 260-269, June 2005.
20. J. Jeffers and J. Reindeer. Intel Xeon Phi Coprocessor High-Performance Programming. Morgan Kaufmann Publishers, 2013.
21. S. Kannan, A. Gavrilovska, K. Schwan, and D. Milojicic. Optimizing checkpoints using NVM as virtual memory. Proc. of Intl. Parallel and Distributed Processing Symposium, pages 29-40, 2013.
22. R. Koo and S. Toueg. Checkpointing and rollback-recovery for distributed systems. IEEE Tran. on Software Engineering, SE-13(1):23-31, Jan. 1987.
23. A. Nukada, H. Takizawa, and S. Matsuoka. NVCR: A transparent checkpoint-restart library for NVIDIA CUDA. In IEEE Intl. Symposium on Parallel and Distributed Processing Workshops and Phd Forum, pages 104-113, 2011.
24. S. Osman, D. Subhraveti, G. Su, and J. Nieh. The design and implementation of Zap: A system for migrating computing environments. In Proc. of the USENIX Conf. on Oper. Syst. Design and Implementation, pages 361-376, Dec. 2002.
25. R. Phull, C.-H. Li, K. Rao, H. Cadambi, and S. Chakradhar. Interference-driven resource management for GPU-based heterogeneous clusters. In Proc. of the Intl. Symposium on High-Perf. Parallel and Distributed Computing, pages 109-120, June 2012.
26. J. S. Plank, M. Beck, G. Kingsley, and K. Li. Libckpt: Transparent checkpointing under unix. In USENIX Technical Conf. Proc., 1995.
27. M. Rieker, J. Ansel, and G. Cooperman. Transparent user-level checkpointing for the native posix thread library for linux. In Proc. of the Intl. Conf. on Parallel and Distributed Processing Techniques and Applications, pages 492-498, July 2006.
28. J. F. Ruscio, M. A. Heffner, and S. Varadarajan. DejaVu: Transparent user-level checkpointing, migration, and recovery for distributed systems. In Proc. of Intl. Parallel and Distributed Processing Symposium, Mar. 2007.
29. K. Sajjapongse, X. Wang, and M. Becchi. A preemption-based runtime to efficiently schedule multi-process applications on heterogeneous clusters with GPUs. In Proc. of the Intl. Symposium on High-Perf. Parallel and Distributed Computing, pages 179-190, June 2013.
30. F. Salfner, M. Lenk, and M. Malek. A survey of online failure prediction methods. ACM Comput. Surv., 42(3), Mar. 2010.
31. S. Sankaran, J. M. Squyres, B. Barrett, and A. Lumsdaine. The LAM/MPI checkpoint/restart framework: System-initiated checkpointing. In Proc. of the Symposium of Los Alamos Computer Science Institute, pages 479-493, 2003.
32. K. Sato, N. Maruyama, K. Mohror, A. Moody, T. Gamblin, B. R. de Supinski, and S. Matsuoka. Design and modeling of a non-blocking checkpointing system. In Proc. of the ACM/IEEE Intl. Conf. for High Perf. Computing, Networking, Storage and Analysis, Nov. 2012.
33. B. Schroeder and G. A. Gibson. Understanding failures in petascale computers. J. of Physics: Conf. Series, 78(1), 2007.
34. H. Takizawa, K. Koyama, K. Sato, K. Komatsu, and H. Kobayashi. CheCL: Transparent checkpointing and process migration of OpenCL applications. In Proc. of Intl. Parallel and Distributed Processing Symposium, pages 864-876, May 2011.
35. H. Takizawa, K. Sato, K. Komatsu, and H. Kobayashi. CheCUDA: A checkpoint/restart tool for CUDA applications. In Proc. of the Intl. Conf. on Parallel and Distributed Computing, Applications and Technologies, pages 408-413, Dec. 2009.
36. T. Tannenbaum and M. Litzkow. Checkpointing and migration of unix processes in the Condor distributed processing system. Dr Dobbs Journal, Feb. 1995.
37. C. Wang, F. Mueller, C. Engelmann, and S. L. Scott. Proactive process-level live migration in HPC environments. In Proc. of the ACM/IEEE Intl. Conf. for High Perf. Computing, Networking, Storage and Analysis, 2008.