FREM: A fast restart mechanism for general checkpoint/restart

IEEE Transactions on Computers

Volumn 60, Issue 5, 2011, Pages 639-652

  Li, Yawei ^a   Lan, Zhiling ^b  

^a GOOGLE INC   (United States)

^b Illinois Institute of Technology   (United States)

Author keywords

Fast restart; fault tolerance; high performance computing; Linux; operating system

Indexed keywords

APPLICATION RECOVERY; CHECKPOINT/RESTART; FAILURE RATE; FAST RESTART; HIGH PERFORMANCE COMPUTING; LARGE SYSTEM; LATENCY PROBLEM; LINUX; LINUX ENVIRONMENT; OPERATING SYSTEM; PROCESS DATA; PROTOTYPE SYSTEM; REAL APPLICATIONS; RESTART MECHANISM; SYSTEM DEPENDABILITY;

COMPUTER OPERATING SYSTEMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; FAULT TOLERANCE; FAULT TOLERANT COMPUTER SYSTEMS;

QUALITY ASSURANCE;

EID: 79953201544     PISSN: 00189340     EISSN: None     Source Type: Journal    
DOI: 10.1109/TC.2010.129     Document Type: Article

References (43)

1. S. Arunagiri, J. Daly, P. Teller, S. Seelam, R. Oldfield, M. Varela, and R. Riesen, "Opportunistic Checkpoint Intervals to Improve System Performance," Technical Report UTEP-CS-08-24, 2008.
2. M. Baker and M. Sullivan, "The Recovery Box: Using Fast Recovery to Provide High Availability in the UNIX Environment," Proc. Summer USENIX Technical Conf., 1992.
3. C. Clark, K. Fraser, H. Steven, J. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live Migration of Virtual Machines," Proc. ACM/USENIX Symp. Networked Systems Design and Implementation, 2005.
4. J. Daly, "A Model for Predicting the Optimum Checkpoint Interval for Restart Dumps," Proc. Int'l Conf. Computational Science, 2003.
5. P. Dinda and D. O'Hallaron, "An Evaluation of Linear Models for Host Load Prediction," Proc. IEEE Int'l Symp. High Performance Distributed Computing, 1999.
6. E. Elnozahy and J. Plank, "Checkpointing for Peta-Scale Systems: A Look Into the Future of Practical Rollback-Recovery," IEEE Trans. Dependable and Secure Computing, vol. 1, no. 2, pp. 97-108, Apr.-June 2004.
7. EPCKPT: A Checkpoint Utility for Linux Kernel, http://www. research.rutgers.edu/~edpin/epckpt, 2010.
8. S. Feldman and C. Brown, "IGOR: A System for Program Debugging via Reversible Execution," Proc. ACM SIGPLAN and SIGOPS Workshop Parallel and Distributed Debugging, 1989.
9. B. Gupta, Z. Liu, and Z. Liang, "On Designing Direct Dependency-Based Fast Recovery Algorithms for Distributed Systems," ACM SIGOPS Operating Systems Rev., vol. 38, no. 1, pp. 58-73, 2004. (Pubitemid 46746979)
10. P. Hargrove and J. Duell, "Berkeley Lab Checkpoint/Restart (BLCR) for Linux Clusters," Proc. Scientific Discovery through Advanced Computing (SciDAC), 2006.
11. J. Henning, "SPEC CPU2000 Memory Footprint," ACM SIGARCH Computer Architecture News, vol. 35, no. 1, pp. 84-89, 2007.
12. B. Jacob and T. Mudge, "Virtual Memory: Issues of Implementation," Computer, vol. 31, no. 6, pp. 33-43, June 1998. (Pubitemid 128550816)
13. O. Laadan and J. Nieh, "Transparent Checkpoint-Restart of Multiple Processes on Commodity Operating Systems," Proc. USENIX Ann. Technical Conf., 2007.
14. Z. Lan and Y. Li, "Adaptive Fault Management of Parallel Applications for High Performance Computing," IEEE Trans. Computers, vol. 57, no. 12, pp. 1647-1660, Dec. 2008.
15. Y. Li and Z. Lan, "A Fast Recovery Mechanism for Checkpointing in Networked Environments," Proc. Int'l Conf. Dependable Systems and Networks (DSN), 2008.
16. Y. Li, Z. Lan, P. Gujrati, and X. Sun, "Fault-Aware Runtime Strategies for High-Performance Computing," IEEE Trans. Parallel and Distributed Systems, vol. 20, no. 4, pp. 460-473, Apr. 2009.
17. K. Li, J. Naughton, and J.S. Plank, "Low-Latency, Concurrent Checkpointing for Parallel Programs," IEEE Trans. Parallel and Distributed Systems, vol. 5, no. 8, pp. 874-879, Aug. 1994.
18. Y. Ling, J. Mi, and X. Lin, "A Variational Calculus Approach to Optimal Checkpoint Placement," IEEE Trans. Computers, vol. 50, no. 7, pp. 699-708, July 2001. (Pubitemid 32720123)
19. C. Lu, "Scalable Diskless Checkpointing for Large Parallel Systems," PhD thesis, Univ. of Illinois at Urbana-Champaign, 2005.
20. D. Milojičić, F. Douglis, Y. Paindaveine, R. Wheeler, and S. Zhou, "Process Migration," ACM Computing Surveys, vol. 32, no. 3, pp. 241-299, 2000.
21. NCSA web site, http://teragrid.ncsa.uiuc.edu, 2009.
22. A. Oliner, L. Rudolph, and R. Sahoo, "Cooperative Checkpointing: A Robust Approach to Large-Scale Systems Reliability," Proc. Int'l Conf. Supercomputing, 2006.
23. OpenSolaris, http://hub.opensolaris.org, 2010.
24. Oracle high availability document, http://www.oracle.com/technology/ deploy/availability/htdocs/fs-on-demand-rollback.htm, 2010.
25. D. Patterson et al., "Recovery-Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies," Technical Report UCB//CSD-02-1175, UC Berkeley Computer Science, 2002.
26. J. Plank, Y. Chen, K. Li, M. Beck, and G. Kingsley, "Memory Exclusion: Optimizing the Performance of Checkpointing Systems," Software-Practice and Experience, vol. 29, no. 2, pp. 125-142, 1999.
27. J. Plank, K. Li, and M. Puening, "Diskless Checkpointing," IEEE Trans. Parallel and Distributed Systems, vol. 9, no. 10, pp. 972-986, Oct. 1998. (Pubitemid 128747893)
28. J. Plank and M.G. Thomason, "Processor Allocation and Checkpoint Interval Selection in Cluster Computing Systems," J. Parallel and Distributed Computing, vol. 61, no. 11, pp. 1570-1590, 2001. (Pubitemid 33119054)
29. S. Rao, L. Alvisi, and H. Vin, "The Cost of Recovery in Message Logging Protocols," IEEE Trans. Knowledge and Data Eng., vol. 12, no. 2, pp. 160-173, Mar./Apr. 2000.
30. E. Roush and R. Campbell, "Fast Dynamic Process Migration," Proc. Int'l Conf. Distributed Computing Systems, 1996.
31. SPEC CPU benchmark, http://www.spec.org/cpu2006/, 2006.
32. J. Sancho, F. Petrini, G. Johnson, J. Fernández, and E. Frachtenberg, "On the Feasibility of Incremental Checkpointing for Scientific Computing," Proc. Int'l Parallel and Distributed Processing Symp., 2004.
33. B. Schroeder and G. Gibson, "A Large Scale Study of Failures in High-Performance-Computing Systems," Proc. Int'l Symp. Dependable Systems and Networks, 2006.
34. J. Squyres and A. Lumsdaine, "A Component Architecture for LAM/MPI," Proc. European PVM/MPI Users' Group Meeting, 2003.
35. L. Snyder and Z. Shen, "Managing Disruptions to Supply Chains," The Bridge, vol. 36, no. 4, pp. 39-45, 2006.
36. T. Tannenbaum and M. Litzkow, "The Condor Distributed Processing System," Dr. Dobb's J., vol. 227, pp. 40-48, 1995.
37. A. Tanenbaum and A. Woodhull, Operating Systems: Design and Implementation, second ed., Prentice-Hall, 1997.
38. The FreeBSD Project, http://www.freebsd.org, 2010.
39. N. Vaidya, "Impact of Checkpoint Latency on Overhead Ratio of a Checkpointing Scheme," IEEE Trans. Computers, vol. 46, no. 8, pp. 942-947, 1997. (Pubitemid 127760644)
40. F. Wu, H. Xi, and C. Xu, "On the Design of a New Linux Readahead Framework," ACM SIGOPS Operating Systems Rev., vol. 42, no.5, pp. 75-84, 2008.
41. R. Wolski, "Dynamically Forecasting Network Performance Using the Network Weather Service," J. Cluster Computing, vol. 1, no.1, pp. 119-132, 1998.
42. J. Young, "A First Order Approximation to the Optimal Checkpoint Interval," Comm. ACM, vol. 17, no. 9, pp. 530-531, 1974.
43. G. Zheng, L. Shi, and L. Kale, "FTC-Charm++: An In-Memory Checkpoint-Based Fault Tolerant Runtime for Charm++ and MPI," Proc. IEEE Cluster Computing, 2004.