Fault-driven re-scheduling for improving system-level fault resilience

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2007, Pages 39-46

  Li, Yawei ^a   Gujrati, Prashasta ^a   Lan, Zhiling ^a   Sun, Xian He ^a,b  

^a Illinois Institute of Technology   (United States)

^b FERMI NATIONAL ACCELERATOR LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FAULT TOLERANCE; FORECASTING; PRODUCTIVITY;

CONVENTIONAL METHODS; FAILURE PREDICTION; IMPROVING SYSTEMS; PERFORMANCE IMPACT; POTENTIAL FAILURES; SYSTEM PRODUCTIVITY; SYSTEM RESILIENCES; TOLERANCE APPROACH;

SCHEDULING;

EID: 47249092857     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2007.42     Document Type: Conference Paper

References (30)

1. B. Allen, "Monitoring Hard Disk with SMART", Linux Journal, January, 2004.
2. J. Brevik, D. Nurmi, and R. Wolski, "Automatic Methods for Predicting Machine Availability in Desktop Grid and Peer-to-Peer Systems", Proc. of IEEE CCGrid, IEEE Computer Society, Chicago,IL, 2004, pp. 190-199.
3. F. Berman, H. Casanova, et al., "New Grid Scheduling and Rescheduling Methods in the GrADS Project", Intl. Journal of Parallel Programming, 2005, pp. 209-229
4. A. Dogan,F. Ozguner, "Reliable matching and scheduling of precedence-constrained tasks in heterogeneous distributed computing,"In Proc. of the ICPP, IEEE Computer Society, Toronto, Canada, 2000, pp. 307
5. Cong Du and Xian-He Sun, "MPI-Mitten: Enabling Migration Technology in MPI", in Proc. of CCGRID, IEEE Computer Society, Singapore, 2006, pp. 11-18
6. Elmootazbellah N. Elnozahy and James S. Plank, "Checkpointing for Peta-Scale Systems: A Look into the Future of Practical Rollback-Recovery", IEEE Transactions on Dependable and Secure Computing, Volume 1, No 2, 2004, pp. 97-108.
7. D.Feitelson. Parallel Workloads Archive http://cs.huji.ac.il/labs/ parallel/workload/index.html
8. P. Gujrati, Y. Li, Z. Lan, R. Thakur, and J. White, "Exploring Meta-learning to Improve Failure Prediction in Supercomputing Clusters", in Proc. of ICPP07, 2007
9. C.-C. Han, K.G. Shin, J. Wu, "A fault-tolerant scheduling algorithm for real-time periodic tasks with possible software faults," IEEE Trans. Computers, Vol.52, No.3 pp.362-372, 2003
10. G. Hoffmann, F. Salfner, M. Malek, "Advanced Failure Prediction in Complex Software Systems", in Proc. of SRDS, 2004
11. K. C. Gross, R. M. Singer, S. W. Wegerich, J. P. Herzog, R. VanAlstine, and F. Bockhorst, "Application Of A Model-Based Fault Detection System To Nuclear Plant Signals", in Proc. of ISAP,Seoul,Korea, 1997, pp. 66-70
12. Health Application Programming Interface, http://www.renci.org
13. C. Leangsuksun et al, "A Failure Predictive and Policy-Based High Availability Strategy for Linux High Performance Computing Cluster", in Proc. of LCI International Conference on Linux Clusters: The HPC Revolution 2004, Austin, TX, 2004
14. IBM LoadLeveler for AIX 5L, available at http: //publib.boulder.ibm.com
15. Yawei Li, Zhiling Lan, "Exploit Failure Prediction for Adaptive Fault-Tolerance in Cluster Computing", in Proc. of IEEE CCGrid'06, Singapore,2006,pp. 531-538
16. Hardware monitoring by lm sensors, available at http: //secure.netroedge.com/-lm78/info.html.
17. R. Lawrence, "A Survey of Process Migration Mechanisms",http:// www.cs.uiowa.edu/~rlawrenc/research/Papers/proc_mig.pdf
18. M. Lizkow, T. Tannenbaum, et al., "Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing System", University of Wisconsin-Madison Computer Science Technical Report #1346, 1997.
19. Charng-Da Lu, "Scalable Diskless Checkpointing for Large Parallel Systems", Ph.D. thesis, University of Illinois at Urbana-Champaign, 2005
20. Moab Workload Manager, available at http://www.clusterresources.com
21. A. Mu'alem and D. Feitelson, "Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling", in IEEE Trans. Parallel and Distributed Systems, Vol. 12(6), 2001,pp. 529-543
22. A. Oliner, Ramendra K. Sahoo, José E. Moreira, Manish Gupta, Anand Sivasubramaniam, "Fault-Aware Job Scheduling for BlueGene/L Systems", in Proc. of IPDPS, 2004,
23. Parallel Workloads Archive, available at http://www.cs.huji.ac.il/labs/ parallel/workload/
24. Petrini, F.; Davis, K.; Sancho, J.C," System-level fault-tolerance in large-scale parallel machines with buffered coscheduling", in Proc. of IPDPS, 2004, pp. 209
25. S. Srinivasan, and N.K. Jha, "Safety and Reliability Driven Task Allocation in Distributed Systems," in IEEE Trans. Parallel and Distributed Systems, Vol 10(3), 1999, pp. 238-251
26. X. Qin and H. Jiang, "A Dynamic and Reliability-driven Scheduling Algorithmfor Parallel Real-time Jobs on Heterogeneous Clusters," in Journal of Parallel and Distributed Computing, vol. 65, no. 8, 2005, pp. 885-900.
27. Ramendra K. Sahoo, A. Oliner, et al., "Critical Event Prediction for Proactive Management in Large-scale Computer Clusters", in Proc. of KDD, Washington DC, USA,2003,pp. 426-435
28. S. Shatz, J. Wang, and M. Goto, "Task Allocation for Maximizing Reliability of Distributed Computer Systems", in IEEE Trans. on Computers, Vol 41(9), 1992,pp. 1156-1168
29. R. Vilalta and S. Ma, "Predicting Rare Events in Temporal Domains", in Proc. of IEEE ICDM, 2002, pp.474-481
30. Y. Zhang et al., "Performance Implications of Failures in Large-Scale Cluster Scheduling", Proc. of 10th Workshop on JSSPP, held in conjunction with SIGMETRICS , New York, USA, 2004.