Failure prediction for autonomic management of networked computer systems with availability assurance

Proceedings of the 2010 IEEE International Symposium on Parallel and Distributed Processing, Workshops and Phd Forum, IPDPSW 2010

Volumn , Issue , 2010, Pages

  Zhang, Ziming ^a   Fu, Song ^a  

^a NEW MEXICO INSTITUTE OF MINING AND TECHNOLOGY   (United States)

Author keywords

Autonomic systems; Failure management; Networked computer systems; System dependability

Indexed keywords

AUTONOMIC MANAGEMENT; AUTONOMIC SYSTEMS; COMPONENT FAILURES; COMPUTATIONAL GRIDS; FAILURE BEHAVIORS; FAILURE CORRELATION; FAILURE DYNAMICS; FAILURE MANAGEMENT; FAILURE PREDICTION; NETWORKED COMPUTER SYSTEMS; OFFLINE; ONLINE PREDICTION; OPERATION COST; PRODUCTION ENVIRONMENTS; SELF MANAGEMENT; SYSTEM DEPENDABILITY; SYSTEM DESIGNERS;

DISTRIBUTED PARAMETER NETWORKS; FORECASTING; HIERARCHICAL SYSTEMS;

COMPUTER SYSTEMS;

EID: 77954054232     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2010.5470868     Document Type: Conference Paper

References (45)

1. Weka: The University of Waikato. Machine learning software in Java. Available at: http://www.cs.waikato.ac.nz/ml/weka/.
2. N. Adiga, G. Almasi, and et al. An overview of the BlueGene/L supercomputer. In Proceedings of ACM/IEEE Conference on Supercomputing (SC), 2002.
3. A. Agbaria and R. Friedman. Model-based performance evaluation of distributed checkpointing protocols. Performance Evaluation, 65(5):345-365, 2008.
4. J. O. Berger, V. D. Oliveira, and B. Sansó. Objective Bayesian analysis of spatially correlated data. Journal of the American Statistical Association, 96(456):1361-1374, 2001.
5. D. Bernick, B. Bruckert, P. D. Vigna, D. Garcia, R. Jardine, J. Klecka, and J. Smullen. Nonstop advanced architecture. In Proceedings of IEEE International Conference on Depend- able Systems and Networks (DSN), 2005.
6. G. Bronevetsky, D. J. Marques, K. K. Pingali, R. Rugina, and S. A. McKee. Compiler-enhanced incremental checkpointing for openmp applications. In Proceedings of ACM Symposium on Principles and Practice of Parallel Programming (PPoPP), 2008.
7. L. E. Buzato, G. M. D. Vieira, and W. Zwaenepoel. Dynamic content web applications: Crash, failover, and recovery analysis. In Proceedings of International Conference on Dependable Systems and Networks (DSN), 2009.
8. S. Chakravorty, C. Mendes,, and L. Kale. Proactive fault tolerance in MPI applications via task migration. In Proceedings of IEEE International Conference on High Performance Computing, 2006.
9. A. Dogan and F. Özgüner. Matching and scheduling algorithms for minimizing execution time and failure probability of applications in heterogeneous computing. IEEE Transactions on Parallel and Distributed Systems, 13(3):308-323, 2002.
10. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Computing Surveys, 34(3):375-408, 2002.
11. M. L. Fair, C. R. Conklin, S. B. Swaney, P. J. Meaney, W. J. Clarke, L. C. Alves, I. N. Modi, F. Freier, W. Fischer, and N. E. Weber. Reliability, availability, and serviceability (RAS) of the IBM eServer z990. IBM Journal of Research and Development, 48(3-4), 2004.
12. S. Fu. Failure-aware construction and reconfiguration of distributed virtual machines for high availability computing. In Proceedings of IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid), 2009.
13. S. Fu. Failure-aware resource management for highavailability computing clusters with distributed virtual machines. Journal of Parallel and Distributed Computing, In Press, 2010.
14. S. Fu and C.-Z. Xu. Exploring event correlation for failure prediction in coalitions of clusters. In Proceedings of ACM/IEEE Supercomputing Conference (SC), November 2007.
15. S. Fu and C.-Z. Xu. Quantifying temporal and spatial correlation of failure events for proactive management. In Proceedings of IEEE International Symposium on Reliable Distributed Systems (SRDS), 2007.
16. S. Fu and C.-Z. Xu. Proactive resource management for failure resilient high performance computing clusters. In Proceedings of IEEE International Conference on Availability, Reliability and Security (ARES), March 2009.
17. R. G. Gallager. Discrete Stochastic Processes. Boston: Kluwer Academic Publishers, 1996.
18. S. S. Gokhale and K. S. Trivedi. Analytical models for architecture-based software reliability prediction: A unification framework. IEEE Transactions on Reliability, 55(4):578-590, 2006.
19. J. Gu, Z. Zheng, Z. Lan, J. White, E. Hocks, and B.-H. Park. Dynamic meta-learning for failure prediction in large-scale systems: A case study. In Proceedings of IEEE International Conference on Parallel Processing (ICPP), 2008.
20. M. Hakem and F. Butelle. Reliability and scheduling on systems subject to failures. In Proceedings of IEEE Conference on Parallel Processing, 2007.
21. T. Heath, R. P. Martin, and T. D. Nguyen. Improving cluster availability using workstation validation. In Proceedings of the ACM Conference on Measurement and modeling of computer systems (SIGMETRICS), 2002.
22. C.-H. Hsu and W.-C. Feng. A power-aware run-time system for high-performance computing. In Proceedings of ACM/IEEE Conference on Supercomputing (SC), November 2005.
23. O. Laadan and J. Nieh. Transparent checkpoint-restart of multiple processes on commodity operating systems. In Proceedings of USENIX Annual Technical Conference (USENIX), 2007.
24. Y. Li and Z. Lan. Exploit failure prediction for adaptive fault-tolerance in cluster computing. In Proceedings of IEEE Symposium on Cluster Computing and the Grid (CCGRID), 2006.
25. Y. Li and Z. Lan. Fast restart mechanism for checkpoint/recovery protocols in networked environments. In Proceedings of IEEE International Conference on Dependable Systems and Networks (DSN), 2008.
26. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. K. Sahoo. BlueGene/L failure analysis and prediction models. In Proceedings of International Conference on Dependable Systems and Networks (DSN), 2006.
27. Y. Liang, Y. Zhang, A. Sivasubramaniam, R. Sahoo, J. Moreira, and M. Gupta. Filtering failure logs for a BlueGene/L prototype. In Proceedings of Conference on Dependable Systems and Networks (DSN), 2005.
28. J. W. Mickens and B. D. Noble. Exploiting availability prediction in distributed systems. In Proceedings of USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2006.
29. S. Mourad and D. Andrews. On the reliability of the IBM MVS/XA operating system. IEEE Transactions on Software Engineering, 13(10):1135-1139, 1987.
30. A. B. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for HPC with Xen virtualization. In Proceedings of ACM International Conference on Supercomputing (ICS), 2007.
31. A. J. Oliner and J. E. Moreira. Probabilistic QoS guarantees for supercomputing systems. In Proceedings of IEEE International Conference on Dependable Systems and Networks (DSN), 2005.
32. A. J. Oliner and J. Stearley. What supercomputers say: A study of five system logs. In Proceedings of International Conference on Dependable Systems and Networks (DSN), 2007.
33. I. Philp. Software failures and the road to a petaflop machine. In Proceedings of Symposium on High Performance Computer Architecture Workshop, 2005.
34. X. Qin and H. Jiang. A dynamic and reliability-driven scheduling algorithm for parallel real-time jobs executing on heterogeneous clusters. Journal of Parallel and Distributed Computing, 65(8):885-900, 2005.
35. D. Reed, C. Lu, and C. Mendes. Big systems and big reliability challenges. In Proceedings of Parallel Computing, 2003.
36. R. K. Sahoo, A. J. Oliner, I. Rish, and et al. Critical event prediction for proactive management in large-scale computer clusters. In Proceedings of ACM International Conference on Knowledge Discovery and Data Dining (SIGKDD), August 2003.
37. R. K. Sahoo, A. Sivasubramaniam, M. S. Squillante, and Y. Zhang. Failure data analysis of a large-scale heterogeneous server environment. In Proceedings of IEEE International Conference on Dependable Systems and Networks (DSN), 2004.
38. F. Salfner, M. Schieschke, and M. Malek. Predicting failures of computer systems: a case study for a telecommunication system. In Proceedings of IEEE Parallel and Distributed Processing Symposium (IPDPS), 2006.
39. B. Schroeder and G. Gibson. A large-scale study of failures in high-performance-computing systems. In Proceedings of International Conference on Dependable Systems and Networks (DSN), 2006.
40. B. Schroeder and G. Gibson. Understanding failures in petascale computers. In Proceedings of SciDAC, 2007.
41. C. Wang, F. Mueller, C. Engelmann, and S. L. Scott. Proactive process-level live migration in HPC environments. In Proceedings of ACM/IEEE Conference on Supercomputing (SC), 2008.
42. L. Wu, D. Meng, W. Gao, and J. Zhan. A proactive fault-detection mechanism in large-scale cluster systems. In Proceedings of IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2006.
43. M. Wu, X.-H. Sun, and H. Jin. Performance under failures of high-end computing. In Proceedings of ACM/IEEE Conference on Supercomputing, 2007.
44. P. Yalagandula, S. Nath, H. Yu, P. B. Gibbons, and S. Sesha. Beyond availability: Towards a deeper understanding of machine failure characteristics in large distributed systems. In Proceedings of USENIX WORLDS, 2004.
45. Y. Zhang, M. S. Squillante, A. Sivasubramaniam, and R. K. Sahoo. Performance implications of failures in large-scale cluster scheduling. In Proceedings of the 10th Workshop on Job Scheduling Strategies for Parallel Processing, 2004.