On the complexity of scheduling checkpoints for computational workflows

Proceedings of the International Conference on Dependable Systems and Networks

Volumn , Issue , 2012, Pages

  Robert, Yves ^a,b   Vivien, Frédéric ^a   Zaidouni, Dounia ^a  

^a UNIVERSITÉ DE LYON   (France)

^b UNIVERSITY OF TENNESSEE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL WORKFLOWS; DYNAMIC PROGRAMMING ALGORITHM; EXPECTED EXECUTION TIME; FAILURE DISTRIBUTIONS; ROLLBACK AND RECOVERY; SCHEDULING PROBLEM; SCHEDULING STRATEGIES; THEORETICAL FOUNDATIONS;

COMPLEX NETWORKS; SCHEDULING;

COMPUTATIONAL COMPLEXITY;

EID: 84880916044     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DSNW.2012.6264675     Document Type: Conference Paper

References (29)

1. N. Kolettis and N. D. Fulton, "Software rejuvenation: Analysis, module and applications," in FTCS '95. Washington, DC, USA: IEEE CS, 1995, p. 381.
2. "DataCutter Project: Middleware for Filtering Large Archival Scientific Datasets in a Grid Environment," http://www.cs.umd.edu/projects/ hpsl/ResearchAreas/DataCutter.htm.
3. K. Taura and A. A. Chien, "A heuristic algorithm for mapping communicating tasks on heterogeneous resources," in Heterogeneous Computing Workshop. IEEE Computer Society Press, 2000, pp. 102-115. (Pubitemid 30592821)
4. Q. Wu and Y. Gu, "Supporting distributed application workflows in heterogeneous computing environments," in 14th Int. Conf. on Parallel and Distributed Systems (ICPADS). IEEE Computer Society Press, 2008.
5. A. Duda, "The effects of checkpointing on program execution time," Inf. Processing Letters, Vol. 16, no. 5, pp. 221-229, 1983. (Pubitemid 13590444)
6. J. T. Daly, "A higher order estimate of the optimum checkpoint interval for restart dumps," Future Generation Computer Systems, Vol. 22, no. 3, pp. 303-312, 2004. (Pubitemid 41689812)
7. T. Heath, R. P. Martin, and T. D. Nguyen, "Improving cluster availability using workstation validation," SIGMETRICS Perf. Eval. Rev., Vol. 30, no. 1, pp. 217-227, 2002. (Pubitemid 35009524)
8. B. Schroeder and G. A. Gibson, "A large-scale study of failures in high-performance computing systems," in Proc. of DSN, 2006, pp. 249-258. (Pubitemid 44930426)
9. Y. Liu, R. Nassar, C. Leangsuksun, N. Naksinehaboon, M. Paun, and S. Scott, "An optimal checkpoint/restart model for a large scale high performance computing system," in IPDPS 2008. IEEE, 2008, pp. 1-9.
10. E. Heien, D. Kondo, A. Gainaru, D. LaPine, B. Kramer, and F. Cappello, "Modeling and tolerating heterogeneous failures in large parallel systems," in Proc. SC'2011 Int. Conf. for High Performance Computing, Networking, Storage and Analysis. ACM Press, 2011.
11. M.-S. Bouguerra, T. Gautier, D. Trystram, and J.-M. Vincent, "A flexible checkpoint/restart model in distributed systems," in PPAM, ser. LNCS, Vol. 6067, 2010, pp. 206-215. [Online]. Available: http://dx.doi.org/10. 1007/978-3-642-14390-822
12. M. Bougeret, H. Casanova, M. Rabie, Y. Robert, and F. Vivien, "Checkpointing strategies for parallel jobs," in Proc. SC'2011 Int. Conf. for High Performance Computing, Networking, Storage and Analysis. ACM Press, 2011.
13. G. Amdahl, "The validity of the single processor approach to achieving large scale computing capabilities," in AFIPS Conference Proceedings, Vol. 30. AFIPS Press, 1967, pp. 483-485.
14. L. S. Blackford, J. Choi, A. Cleary, E. D'Azevedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, and R. C. Whaley, ScaLAPACK Users' Guide. SIAM, 1997.
15. M. Bougeret, H. Casanova, Y. Robert, F. Vivien, and D. Zaidouni, "Using group replication for resilience on exascale systems," INRIA, Research report RR-7876, February 2012. [Online]. Available: http://hal.inria.fr/hal-00668016
16. M. R. Garey and D. S. Johnson, Computers and Intractability, a Guide to the Theory of NP-Completeness. W.H. Freeman and Company, 1979.
17. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms. The MIT Press, 2001.
18. P. françois Dutot, G. Mounié, and D. Trystram, "Scheduling Parallel Tasks Approximation Algorithms," in Handbook of Scheduling. CRC Press, 2004, p. chapter 26.
19. M.-S. Bouguerra, D. Trystram, and F. Wagner, "Complexity analysis of checkpoint scheduling with variable costs," Computers, IEEE Transactions on, 2012.
20. D. Kondo, B. Javadi, A. Iosup, and D. Epema, "The failure trace archive: Enabling comparative analysis of failures in diverse distributed systems," Cluster Computing and the Grid, IEEE International Symposium on, Vol. 0, pp. 398-407, 2010.
21. J. W. Young, "A first order approximation to the optimum checkpoint interval," Communications of the ACM, Vol. 17, no. 9, pp. 530-531, 1974.
22. W. Jones, J. Daly, and N. DeBardeleben, "Impact of sub-optimal checkpoint intervals on application efficiency in computational clusters," in HPDC'10. ACM, 2010, pp. 276-279.
23. K. Venkatesh, "Analysis of Dependencies of Checkpoint Cost and Checkpoint Interval of Fault Tolerant MPI Applications," Analysis, Vol. 2, no. 08, pp. 2690-2697, 2010.
24. A. Tantawi and M. Ruschitzka, "Performance analysis of checkpointing strategies," ACM TOCS, Vol. 2, no. 2, pp. 123-144, 1984.
25. J. Dongarra, E. Jeannot, E. Saule, and Z. Shi, "Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems," in ACM Symposium on Parallel Algorithms and Architectures (SPAA). ACM Press, 2007, pp. 280-288. (Pubitemid 47568577)
26. A. Dogan and F. Özgüner, "Matching and scheduling algorithms for minimizing execution time and failure probability of applications in heterogeneous computing," IEEE Trans. Parallel Distributed Systems, Vol. 13, no. 3, pp. 308-323, 2002. (Pubitemid 34448783)
27. A. Girault, E. Saule, and D. Trystram, "Reliability versus performance for critical applications," J. Parallel Distributed Computing, Vol. 69, no. 3, pp. 326-336, 2009.
28. S. Yi, D. Kondo, B. Kim, G. Park, and Y. Cho, "Using Replication and Checkpointing for Reliable Task Management in Computational Grids," in Proc. of the International Conference on High Performance Computing & Simulation, 2010.
29. K. Ferreira, J. Stearley, J. H. I. Laros, R. Oldfield, K. Pe-dretti, R. Brightwell, R. Riesen, P. G. Bridges, and D. Arnold, "Evaluating the Viability of Process Replication Reliability for Exascale Systems," in Proceedings of the 2011 ACM/IEEE Conference on Supercomputing, 2011.