Modeling the impact of checkpoints on next-generation systems

Proceedings - 24th IEEE Conference on Mass Storage Systems and Technologies, MSST 2007

Volumn , Issue , 2007, Pages 30-43

  Oldfield, Ron A ^a   Teller, Patricia J ^b   Varela, Maria Ruiz ^b   Arunagiri, Sarala ^b   Seelam, Seetharami ^c   Riesen, Rolf ^a   Roth, Philip C ^d  

^a SANDIA NATIONAL LABORATORIES   (United States)

^b UNIVERSITY OF TEXAS AT EL PASO   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

^d OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALTERNATIVE APPROACH; APPLICATION EXECUTION; APPLICATION PERFORMANCE; APPLICATION SCALABILITY; CHECKPOINT (CO); CHECKPOINT/RESTART; GENERATION SYSTEMS; LOWER BOUNDS; MASS STORAGE SYSTEMS; MASSIVELY PARALLEL PROCESSING; MATHEMATICAL MODELLING; NEW APPROACHES; OVERLAY NETWORKS (ON); PETAFLOP SYSTEMS; STORAGE SYSTEMS;

CONTINUOUS TIME SYSTEMS; CONTROL THEORY; DATA STORAGE EQUIPMENT; DIFFRACTIVE OPTICAL ELEMENTS; FAULT TOLERANCE; MILITARY DATA PROCESSING; NETWORK ARCHITECTURE; PARALLEL PROCESSING SYSTEMS; QUALITY ASSURANCE; RELIABILITY; SECURITY OF DATA;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 47249142074     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MSST.2007.4367962     Document Type: Conference Paper

References (39)

1. S. Agarwal, R. Garg, M. S. Gupta, and J. E. Moreira. Adaptive incremental checkpointing for massively parallel systems. In Proceedings of the 18th Annual International Conference on Supercomputing, pages 277-286, New York, NY, 2004. ACM Press.
2. S. Arunagiri, S. Seelam, R. A. Oldfield, M. R. Varela, P. J. Teller, and R. Riesen. An analysis of the consequences of a reduction in checkpoint latency for periodic checkpointing systems. Technical Report SAND2007-xxxx, Sandia National Laboratories, 2007.
3. A. J. Borr and F. Putzolu. High performance SQL through low-level system integration. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 342-349, Chicago, IL, 1988. ACM Press.
4. P. J. Braam. The lustre storage architecture. Cluster File Systems, Inc. Architecture, Design, and Manual for Lustre, November 2002. http://www.lustre. org/docs/lustre.pdf.
5. R. Brightwell, W. Camp, B. Cole, E. DeBenedictis, R. Leland, J. Tomkins, and A. B. Maccabe. Architectural specification for massively parallel computers: an experience and measurement-based approach. Concurrency and Computation: Practice and Experience, 17(10):1271-1316, March 2005.
6. W. J. Camp and J. L. Tomkins. The red storm computer architecture and its implementation. In The Conference on High-Speed Computing: LANL/LLNL/SNL, Salishan Lodge, Glenedon Beach, Oregon, April 2003.
7. T.-C. Chiueh and P. Deng. Evaluation of checkpoint mechanisms for massively parallel machines. In Proceedings of the Annual Symposium on Fault Tolerant Computing, pages 370-379, Sendai, Japan, June 1996. IEEE Computer Society Press.
8. J. Daly. A model for predicting the optimum checkpoint interval for restart dumps. Lecture Notes in Computer Science, 2660:3-12, August 2003.
9. J. Daly. A strategy for running large scale applications based on a model that optimizes the checkpoint interval for restart dumps. In Proceedings of the 26th International Conference on Software Engineering, pages 70-74, Edinburgh, Scotland, UK, May 2004.
10. J. Daly. A higher order estimate of the optimum checkpoint interval for restart dumps. Future Generation Computer Systems, 22:303-312, 2006.
11. E. N. Elnozahy, L. Alvisi, Y. M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Computing Surveys, 34(3):375-408, September 2002.
12. E. N. Elnozahy, D. B. Johnson, and W. Zwaenepoel. The performance of consistent checkpointing. In Proceedings of the 11th Symposium on Reliable Distributed Systems, pages 39-47, Houston, TX, October 1992. IEEE Computer Society Press.
13. E. N. Elnozahy and J. S. Plank. Checkpointing for petascale systems: A look into the future of practical rollback-recovery. IEEE Transactions on Dependable and Secure Computing, 1(2):97-108, April-June 2004.
14. E. Franke and M. Magee. Reducing data distribution bottlenecks by employing data visualization filters. In Proceedings of the Eighth IEEE International Symposium on High Performance Distributed Computing, pages 255-262, Redondo Beach, CA, August 1999. IEEE Computer Society Press.
15. A. Gavrilovska, K. Schwan, O. Nordstrom, and H. Seifu. Network processors as building blocks in overlay networks. In Proceedings of the 11 th Symposium on High Performance Interconnects (HOTI03), pages 83-88, August 2003.
16. D. Kotz. Expanding the potential for disk-directed I/O. In Proceedings of the 1995 IEEE Symposium on Parallel and Distributed Processing, pages 490-495, San Antonio, TX, October 1995. IEEE Computer Society Press.
17. T Kurc, C. Chang, R. Ferreira, and A. Sussman. Querying very large multi-dimensional datasets in ADR. In Proceedings of SC99: High Performance Networking and Computing, Portland, OR, November 1999. ACM Press and IEEE Computer Society Press.
18. K. Li, J. S. Naughton, and J. S. Plank. Low-latency, concurrent checkpointing for parallel programs. IEEE Transactions on Parallel and Distributed Systems, 5(8):874-879, August 1994.
19. R. A. Oldfield. Investigating lightweight storage and overlay networks for fault tolerence. In Proceedings of the High Availability and Performance Computing Workshop, Santa Fe, NM, Oct. 2006.
20. R. A. Oldfield, A. B. Maccabe, S. Arunagiri, T. Kordenbrock, R. Riesen, L. Ward, and P. Widener. Lightweight I/O for scientific applications. In Proceedings of the IEEE International Conference on Cluster Computing, Barcelona, Spain, September 2006.
21. R. A. Oldfield, D. E. Womble, and C. C. Ober. Efficient parallel I/O in seismic imaging. The International Journal of High Performance Computing Applications, 12(3):333-344, Fall 1998.
22. K. Pattabiraman, C. Vick, and A. Wood. Modeling coordinated checkpointing for large-scale supercomputers. In Proceedings of the 2005 International Conference on Dependable Systems and Networks (DSN'05), pages 812-821, Washington, DC, 2005. IEEE Computer Society.
23. F. Petrini and K. Davis. Tutorial: Achieving Usability and Efficiency in Large-Scale Parallel Computing Systems, August 31, 2004. Euro-Par 2004, Pisa, Italy.
24. I. R. Philp. Software failures and the road to a petaflop machine. In 1st Workshop on High Performance Computing Reliability Issues (HPCRI). Los Alamos National Laboratory, February 2005.
25. J. S. Plank. Improving the performance of coordinated checkpointers on networks of workstations using RAID techniques. In Proceedings of the Symposium on Reliable Distributed Systems, pages 76-85, 1996.
26. J. S. Plank, Y. Kim, and J. J. Dongarra. Fault-tolerant matrix operations for networks of workstations using diskless checkpointing. Journal of Parallel and Distributed Computing, 43(2):125-138, June 1997.
27. J. S. Plank and K. Li. Faster checkpointing with n+1 parity. In Proceedings of the 24th International Symposium on Fault-Tolerant Computing, pages 288-297, Austin, Texas, June 1994.
28. R. Ross, J. Moreira, K. Cupps, and W. Pfeiffer. Parallel I/O on the IBM Blue Gene/L system. BlueGene Consortium Quarterly Newsletter, 2006.
29. P. C. Roth, D. C. Arnold, and B. P. Miller. MRNet: A software-based multicast/reduction network for scalable tools. In Proceedings of SC2003: High Performance Networking and Computing, Pheonix, AZ, Nov. 2003.
30. B. Schroeder and G. A. Gibson. A large-scale study of failures in high-performance computing systems. In Proceedings of the International Conference on Dependable Systems and Networks (DSN2006), Philadelphia, PA, June 2006. School of Computer Science, Carnegie Mellon University, Pittsburgh, PA.
31. L. M. Silva and J. G. Silva. An experimental study about diskless checkpointing. In Proceedings of the 24th EUROMICRO Conference, pages 395-402, Vasteras, Sweden, August 1998. IEEE Computer Society Press.
32. R. Subramaniyan, R. S. Studham, and E. Grobelny. Optimization of checkpointing-related I/O for high-performance parallel and distributed computing. In Proceedings of The International Conference on Parallel and Distributed Processing Techniques and Applications, pages 937-943, 2006.
33. T. B. Team. An overview of the BlueGene/L supercomputer. In Proceedings of SC2002: High Performance Networking and Computing, Baltimore, MD, November 2002.
34. J. Tomkins. A conservative path to petaflop computing: The Red Storm architecture scaled to a petaflop and beyond. 4th Annual Workshop on Linux Clusters for Supercomputing, October 2003.
35. N. H. Vaidya. A case for two-level distributed recovery schemes. SIGMETRICS Perform. Eval. Rev., 23(1):64-73, 1995.
36. N. H. Vaidya. Impact of checkpoint latency on overhead ratio of a checkpointing scheme. IEEE Transactions on Computers, 46(8):942-947, 1997.
37. J. S. Vetter, S. R. Alam, J. Thomas H. Dunigan, M. R. Fahey, P. C. Roth, and P. H. Worley. Early evaluation of the cray xt3. In Proceedings of the International Parallel and Distributed Processing Symposium. Oak Ridge National Laboratory, April 2006.
38. L. Ward, J. Laros, R. Klundt, and B. Kellog. Red storm IO performance and scaling. Presentation given to Cray Inc., August 2006.
39. J. W. Young. A first order approximation to the optimum checkpoint interval. Communications of the ACM, 17(9):530-531, 1974.