Enhancing checkpoint performance with staging IO and SSD

Proceedings - 2010 International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2010

Volumn , Issue , 2010, Pages 13-20

  Ouyang, Xiangyong ^a   Marcarelli, Sonya ^a   Panda, Dhabaleswar K ^a  

^a Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION PROCESS; CHECK POINTING; COMPUTER CLUSTERS; DATA SERVER; HARD DISKS; JOB SIZE; LOW-POWER CONSUMPTION; NEW STRATEGY; PARALLEL FILE SYSTEM; PARALLEL STORAGE SYSTEMS; RANDOM ACCESS; REAL APPLICATIONS; SHOCK RESISTANCE; SYSTEM FAILURES; WRITING PERFORMANCE;

COMPUTER APPLICATIONS; FAULT TOLERANCE; FAULT TOLERANT COMPUTER SYSTEMS; FILE ORGANIZATION; QUALITY ASSURANCE; SERVERS; SYSTEMS ENGINEERING;

NETWORK ARCHITECTURE;

EID: 77958107571     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SNAPI.2010.10     Document Type: Conference Paper

References (28)

1. Filesystem in Userspace. http://fuse.sourceforge.net/.
2. Fusion IO. http://www.fusionio.com/.
3. InfiniBand Trade Association.http://www.in-niband.org/.
4. Lustre Parallel Filesystem. http://wiki.lustre.org/.
5. MPI over InfiniBand Project. In http://nowlab.cse.ohio-state.edu/ projects/mpi-iba/.
6. PVFS2. http://www.pvfs.org/.
7. Application Requirements and Objectives for Petascale Systems. HPCwire, February 2008.
8. Milo Polte and Jiri Simsa etc.. Fast log-based concur- rent writing of checkpoints. In PDSI 2008 workshop in conjunction with SC08, Nov. 2008.
9. Paul Nowoczynski, Nathan Stone, Jared Yanovich, Jason Sommerfield. Zest: Checkpoint Storage System for Large Supercomputers. In PDSI 2008 workshop in conjunction with SC08, Nov. 2008.
10. Hasan Abbasi, Matthew Wolf, Greg Eisenhauer, Scott Klasky, Karsten Schwan, and Fang Zheng. Datastager: scalable data staging services for petascale applications. In HPDC '09: Proceedings of the 18th ACM international symposium on High performance distributed computing, 2009.
11. S. Al-Kiswany, M. Ripeanu, S.S. Vazhkudai, and A. Gharaibeh. stdchk: A checkpoint storage system for desktop grid computing. June 2008.
12. John Bent, Garth Gibson, Gary Grider, Ben McClelland, Paul Nowoczynski, James Nunez, Milo Polte, and Meghan Wingate. Plfs: a checkpoint filesystem for parallel appli-cations. In SC '09: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, 2009.
13. Avery Ching, Alok Choudhary, Kenin Coloma, Wei-keng Liao, Robert Ross, and William Gropp. Noncontiguous i/o accesses through mpi-io. In CCGRID '03: Proceedings of the 3st International Symposium on Cluster Computing and the Grid, 2003.
14. Avery Ching, Alok Choudhary, Wei keng Liao, Robert Ross, and William Gropp. Efficient structured data access in parallel file systems. Cluster Computing, IEEE International Conference on, 2003.
15. Avery Ching, Alok Choudhary, Wei-Keng Liao, Robert Ross, and William Gropp. Evaluating structured i/o methods for parallel file systems. Int. J. High Perform. Comput. Netw., 2.
16. J. Duell. The design and implementation of Berkeley lab's linux checkpoint/restart. Lawrence Berkeley Na-tional Laboratory,Paper LBNL-54941, April 2005.
17. I.R. Philp. Software failures and the road to a petaop machine. In First Workshop on High Performance Computing Reliability Issues (HPCRI), February 2005.
18. Sang-Won Lee and Bongki Moon. Design of ash-based dbms: an in-page logging approach. In SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data, 2007.
19. Pin Lu and Kai Shen. Multi-layer event trace analysis for parallel i/o performance tuning. In ICPP '07: Pro- ceedings of the 2007 International Conference on Parallel Processing, page 12, Washington, DC, USA, 2007. IEEE Computer Society.
20. Michael Litzkow, Todd Tannenbaum, Jim Basney, and Miron Livny. Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing Sys- tem. In Technical Report UW-CS-TR-1346, University of Wisconsin-Madison, Computer Sciences Department, April 1997.
21. Paul H. Hargrove and Jason C. Duell. Berkeley Lab Checkpoint/Restart (BLCR) for Linux Clusters. In Sci-DAC, 6 2006.
22. Eduardo Pinheiro, Wolf-Dietrich Weber, and Luiz André Barroso. Failure trends in a large disk drive population. In FAST '07: Proceedings of the 5th USENIX conference on File and Storage Technologies, pages 2-2, Berkeley, CA, USA, 2007. USENIX Association.
23. J. S. Plank, M. Beck, G. Kingsley, and K. Li. Libckpt: Transparent checkpointing under Unix. In Usenix Winter Technical Conference, pages 213-223, January 1995.
24. Q. Gao, W. Huang, M. Koop, and D. K. Panda. Group-based Coordinated Checkpointing for MPI: A Case Study on InfiniBand. In Int'l Conference on Parallel Processing (ICPP), XiAn, China, 9 2007.
25. Q. Gao, W. Yu, W. Huang and D. K. Panda. Application- Transparent Checkpoint/Restart for MPI Programs over InfiniBand. In International Conference on Parallel Processing (ICPP), August 2006.
26. Xiangyong Ouyang, Karthik Gopalakrishnan and Dhabaleswar K. Panda. Accelerating checkpoint operation by node-level write aggregation on multicore systems. ICPP 2009, September 2009.
27. Xiangyong Ouyang, Karthik Gopalakrishnan, Tejus Gangadharappa and Dhabaleswar K. Panda. Fast checkpointing by write aggregation with dynamic buffer and interleaving on multicore architecture. HiPC 2009, December 2009.
28. Xuechen Zhang, Song Jiang, and Kei Davis. Making resonance a common case: A high-performance implementation of collective i/o on parallel file systems. In IPDPS '09: Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing, Washington, DC, USA, 2009. IEEE Computer Society.