Parallel I/O performance for application-level checkpointing on the Blue Gene/P system

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2011, Pages 465-473

  Fu, Jing ^a   Min, Misun ^b   Latham, Robert ^b   Carothers, Christopher D ^a  

^a Rensselaer Polytechnic Institute   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Blue Gene P; checkpointing; fault tolerance; Parallel I O

Indexed keywords

ARGONNE NATIONAL LABORATORY; BLUE GENE; CHECKPOINTING; ELECTROMAGNETIC SOLVERS; FAILURE PROBABILITY; I/O BOTTLENECK; LOCAL STATE; MASSIVELY PARALLEL SYSTEMS; PARALLEL COMPUTER ARCHITECTURE; PARALLEL I/O; PARAMETER SETTING; POTENTIAL BENEFITS; PRODUCTION PERFORMANCE; STABLE STORAGE;

CLUSTER COMPUTING; COMPUTER ARCHITECTURE; FAULT TOLERANCE; SUPERCOMPUTERS;

PARALLEL PROCESSING SYSTEMS;

EID: 80955140988     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTER.2011.81     Document Type: Conference Paper

References (32)

1. IBM Blue Gene team, "Overview of the IBM Blue Gene/P project,"IBM Journal of Research and Development Volume 52 Issue 1/2, 2008.
2. DARPA, "DARPA ExaScale Software Study: Software Challenges in Extreme Scale System," http://users.ece.gatech.edu/mrichard/ ExascaleComputingStudyReports/ecss%20report%20101909.pdf, September 2009.
3. J. Fu, N. Liu, O. Sahni, K. Jansen, M. Shephard, and C. Carothers, "Scalable parallel I/O alternatives for massively parallel partitioned solver systems," in LSPP workshop of IPDPS, April 2010.
4. "NekCEM: Computational ElectroMagnetic Code," https://svn.mcs.anl. gov/repos/NEKCEM.
5. A. Nisar, W. Liao, and A. Choudhary, "Scaling parallel I/O performance through I/O delegate and caching system," in Supercomputing, 2008.
6. J. Lofstead, F. Zheng, S. Klasky, and K. Schwan, "Adaptable, metadata rich IO methods for portable high performance IO," in IPDPS 09, Washington, DC, USA, 2009.
7. A. Choudhary, W. Liao, K. Gao, A. Nisar, R. Ross, R. Thakur, and R. Latham, "Scalable I/O and analytics," Journal of Physics: Conference Series, vol. 180, no. 1, 2009.
8. P. M. Dickens and J. Logan, "Y-lib: A user level library to increase the performance of MPI-IO in a Lustre file system environment," in HPDC, 2009.
9. M. S. Min, T. W. Lee, P. F. Fischer, and S. K. Gray, "Fourier spectral simulations and gegenbauer reconstructions for electromagnetic waves in the presence of a metal nanoparticle," Journal of Computational Physics, vol. 213, no. 2, pp. 730-747, 2006.
10. J. Hesthaven, S. Gottlieb, and D. Gottlieb, Spectral methods for time-dependent problems, Volume 21 of Cambridge monographs on applied and computational mathematics. Cambridge University Press, 2007.
11. M. Carpenter and C. Kennedy, "Fourth-order 2N-storage Runge-Kutta schemes," NASA Report TM 109112, 1994.
12. E. Gallopoulos and Y. Saad, "Efficient solution of parabolic equations by Krylov approximation methods," SIAM J. Sci. Stat. Comput., vol. 13, no. 5, pp. 1936-1964, 1992.
13. M. Deville, P. Fischer, and E. Mund, High-order methods for incompressible fluid flow, Cambridge Monographs on Applied and Computational Mathematics. Cambridge University Press, 2002.
14. J. Hesthaven and T. Warburton, Nodal discontinuous Galerkin methods, algorithms, analysis, and applications. Springer, 2008.
15. "Nek5000: Computational Fluid Dynamics Code," https://svn.mcs.anl. gov/repos/nek5000.
16. M. S. Min and J. Fu, "Performance analysis on the IBM BG/P for the spectral-element discontinuous Galerkin method for electromagnetic modeling," 2010, MCS, ANL, Preprint ANL/MCS-P1802-1010.
17. P. Carns, K. Harms, W. Allcock, C. Bacon, S. Lang, R. Latham, and R. Ross, "Storage access characteristics of computational science applications," in Proceedings of 27th IEEE Conference on Mass Storage Systems and Technologies (MSST), 2011.
18. IEEE/ANSI Std. 1003.1, "Portable operating system interface (POSIX)-Part 1: System application program interface (API) [C language]," 1996.
19. R. Thakur, E. Lusk, and W. Gropp, "Users guide for ROMIO: A high-performance, portable MPI-IO implementation," 2004, technical Memorandum ANL/MCS-TM-234, MCS, ANL.
20. "Message Passing Interface," http://www.mcs.anl.gov/research/ projects/ mpi.
21. F. B. Schmuck and R. L. Haskin, "GPFS: A shared-disk file system for large computing clusters," in FAST, 2002.
22. S. Lang, P. Carns, R. Latham, R. Ross, K. Harms, and W. Allcock, "I/O performance challenges at leadership scale," in Supercomputing, November 2009.
23. R. Thakur, W. Gropp, and E. Lusk, "Optimizing noncontiguous accesses in MPI-IO," Parallel Computing, vol. 28, no. 1, pp. 83-105, 2002.
24. H. Yu, R. K. Sahoo, C. Howson, G. Almasi, J. G. Castanos, M. Gupta, J. E. Moreira, J. J. Parker, T. E. Engelsiepen, R. Ross, R. Thakur, R. Latham, and W. D. Gropp, "High performance file I/O for the BlueGene/L supercomputer," in HPCA-12, February 2006.
25. W. Liao and A. Choudhary, "Dynamically adapting file domain partitioning methods for collective I/O based on underlying parallel file system locking protocols," in Supercomputing, Austin, Texas, November 2008.
26. P. Carns, R. Latham, R. Ross, K. Iskra, S. Lang, and K. Riley, "24/7 characterization of petascale i/o workloads," in Workshop on Interfaces and Architectures for Scientific Data Storage, September 2009.
27. W. Yu, J. S. Vetter, and S. Oral, "Performance characterization and optimization of parallel I/O on the Cray XT," in IPDPS, 2008.
28. H. Shan, K. Antypas, and J. Shalf, "Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark," in Supercomputing, 2008.
29. "IOR Benchmark," https://asc.llnl.gov/sequoia/benchmarks/#ior.
30. M. R. Fahey, J. M. Larkin, and J. Adams, "I/O performance on a massively parallel Cray XT3/XT4," in IPDPS, 2008, pp. 1-12.
31. J. Borrill, L. Oliker, J. Shalf, H. Shan, and A. Uselton, "HPC global file system performance analysis using a scientific-application derived benchmark," Parallel Computing, vol. 35, no. 6, pp. 358-373, 2009.
32. A. Moody, G. Bronevetsky, K. Mohror, and B. R. de Supinski, "Design, modeling, and evaluation of a scalable multi-level checkpointing system," in Supercomputing, New Orleans, November 2010.