A meta-learning failure predictor for blue gene/L systems

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2007, Pages

  Gujrati, Prashasta ^a   Li, Yawei ^a   Lan, Zhiling ^a   Thakur, Rajeev ^b   White, John ^c  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BLUE GENE/L; CLUSTER SYSTEMS; COMPUTATIONAL POWER; FAILURE PATTERNS; FAILURE PROBABILITIES; FAULT TOLERANCE (FT) MECHANISMS; INDIVIDUAL COMPONENTS; INTERNATIONAL CONFERENCES; LARGE CLUSTERS; META-LEARNING; NUMBER OF COMPONENTS; PARALLEL PROCESSING; PHASE FAILURE; PREDICTION ACCURACY; SCIENCE AND ENGINEERING; SYSTEM PRODUCTIVITY; TOTAL COST OF OWNERSHIP (TCO);

FAULT TOLERANCE; FORECASTING; LEARNING SYSTEMS; QUALITY ASSURANCE; RELIABILITY; SAFETY ENGINEERING;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 47249153592     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2007.9     Document Type: Conference Paper

References (29)

1. R. Agrawal, R. Srikant, "Fast Algorithms for Mining Association Rules", VLDB. Sep 12-15 1994, Chile, 487-99
2. ANL Blue Gene/L Homepage.. www.bgl.mcs.anl.gov
3. S. Chakravorty, C. L. Mendes and L. V. Kale, "Proactive Fault Tolerance in Large Systems", Proc. of HPCRI Workshop in conjunction with HPCA, 2005.
4. P. Chan and S. Stolfo, "Metalearning for Multistrategy and Parallel Learning", Proc. of Multistrategy Learning Workshop, Center for Artificial Intelligence, 1993.
5. A. Oliner and J. Stearly, "What Supercomputers Say: A Study of Five System Logs", Proc. of DSN 2007.
6. R. Polikar, "Ensemble Based Systems in Decision Making", IEEE Circuits and Systems Magazine, vol.6, no. 3, pp. 21-45, 2006.
7. E. Elnozahy and J. S. Plank, "Checkpointing for Peta-Scale Systems: A Look into the Future of Practical Rollback-Recovery", IEEE Transactions on Dependable and Secure Computing, Volume 1, Number 2, 2004, pp. 97-108.
8. A. Gara, M. A. Blumrich et al., "Overview of the Blue Gene/L System Architecture", IBM J. Res. & Dev. 49, No. 2/3, 195-212, 2005.
9. M. Goldszmidt, I. Cohen, A. Fox and S. Zhang, "Three research challenges at the intersection of machine learning, statistical induction, and systems", HOTOS 2005.
10. Hoffmann, Salfner et al, "Advanced Failure Prediction in Complex Software Systems", Proc. of SRDS, 2004.
11. A. Goyal, S. Lavenberg, and K. Trivedi, "Probabilistic Modeling of Computer System Availability", Annals of Operations Research, 1987.
12. R. Gioiosa, J. Sancho, S. Jiang, F. Petrini, K. Davis, "Transparent Incremental Checkpointing at Kernel Level: A Foundation for Fault Tolerance for Parallel Computers", Proc. of SC2005, 2005.
13. G. Hamerly and C. Elkan, "Bayesian Approaches to Failure Prediction for Disk Drives", Proc. of ICML, 2001.
14. J. Han, J. Pei, Y. Yin, R. Mao, "Mining Frequent Patterns without Candidate Generation: A Frequent-Pattern Tree Approach", Data Min. Knowl. Discov. 8 (1): 53-87 2004.
15. J. Hellerstein, F. Zhang, P. Shahabuddin, "A Statistical Approach to Predictive Detection", Computer Networks: The International Journal of Computer and Telecommunications Networking, 2001.
16. R. K. Iyer, L. T. Young, V. Sridhar, "Recognition of error symptoms in large systems", Proceedings of 1986 ACM Fall joint computer conference, 1986.
17. D. Kerbyson, A. Hoisie, and H. Wasserman, "Use of Predictive Performance Modeling During Large-scale Systems Installation", Proc. of the 1st International Workshop on Hardware/Software Support for Parallel and Distributed Scientific and Engineering Computing, 2002.
18. R. Vilalta and S. Ma, "Predicting Rare Events in Temporal Domains", Proc. of IEEE Intl. Conf. On Data Mining, 2002.
19. Y. Li, Z. Lan, "Exploit Failure Prediction for Adaptive Fault-Tolerance in Cluster Computing", Proc. of IEEE CCGrid'06, 2006.
20. L. Lanzi, W. Stolzmann, S. Wilson, "Learning Classifier Systems, From Foundations to Applications", Lecture Notes In Computer Science,Vol. 1813, 2000.
21. Y. Liang, Y. Zhang, M. Jette, A. Sivasubramanium, R. Sahoo, "BlueGene/L Failure Analysis and Prediction Models", Proc. of DSN, 2006.
22. Y. Liang, Y. Zhang, A. Sivasubramanium, R. Sahoo, J Moreira, M. Gupta, "Filtering Failure Logs for a BlueGene/L Prototype", Proc. of DSN, 2005.
23. K. Vaidyanathan and K. Gross, "MSET Performance Optimization for Detection of Softtware Aging", Proc. of ISSRE, 2003.
24. A. Oliner, Ramendra K. Sahoo, José E. Moreira, Manish Gupta, Anand Sivasubramaniam, "Fault-Aware Job Scheduling for BlueGene/L Systems", IPDPS, 2004.
25. The TOP500 Supercomputer Sites. www.top500.org
26. SDSC Blue Gene/L Homepage. www.sdsc.edu/us/resources/bluegene
27. R.K. Sahoo, A.J. Oliner et al., "Critical event prediction for proactive management in large-scale computer clusters", Proc. of KDD, 2003, pp. 426-435.
28. D. Turnbull, N. Alldrin, "Failure Prediction in Hardware Systems", UCSD CSE221 Project, 2003.
29. K. Trivedi and K. Vaidyanathan, "A Measurement-based Model for Estimation of Resource Exhaustion in Operational Software Systems", Proc. of the 10th Int'l Symposium on Software Reliability Engineering, 1999.