Critical event prediction for proactive management in large-scale computer clusters

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2003, Pages 426-435

  Sahoo, R K ^a   Oliner, A J ^a   Rish, I ^a   Gupta, M ^a   Moreira, J E ^a   Ma, S ^a   Vilalta, R ^b   Sivasubramaniam, A ^c  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b University of Houston ^*  (United States)

^c PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Critical event prediction; Large scale clusters; System event log

Indexed keywords

ACTIVITY REPORT; AUTONOMIC COMPUTING; AVAILABILITY AND SERVICEABILITY; BAYESIAN NETWORK MODELS; CATASTROPHIC FAILURES; CLUSTER SYSTEMS; COMPUTER CLUSTERS; CONTINUOUS MONITORING; CRITICAL EVENTS; DISTRIBUTED COMPUTING SYSTEMS; EVENT CORRELATION; FILTERING TECHNIQUE; HEALTH MEASUREMENT; HIGH DEGREE OF ACCURACY; HISTORICAL DATA; LARGE CLUSTERS; LARGE-SCALE CLUSTERS; LEVELS OF AUTOMATION; POTENTIAL PROBLEMS; PREDICTION ALGORITHMS; PREDICTION AND CONTROL; PROACTIVE MANAGEMENT; PROBABILISTIC NETWORK; REDUNDANT EVENT; RULE-BASED CLASSIFICATION; SELF-HEALING; SYSTEM PERFORMANCE PARAMETERS; SYSTEM RELIABILITY; SYSTEMS MANAGEMENT; TIME SERIES MODELS;

ALGORITHMS; BAYESIAN NETWORKS; CLUSTER COMPUTING; COMPUTER HARDWARE DESCRIPTION LANGUAGES; CONTINUOUS TIME SYSTEMS; DATA MINING; FORECASTING; INFERENCE ENGINES; SECURITY OF DATA;

REAL TIME SYSTEMS;

EID: 77952378080     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/956750.956799     Document Type: Conference Paper

References (29)

1. A web-based data-analysis tool for bayesian modeling http://b-course. chelsinki.fi.
2. N. Adiga and B. G. Team. An overview of the bluegene/1 supercomputer. In Supercomputing (SG2002) Technical Papers, November 2002
3. J. Berger. Statistical Decision Theory and aysian Analysis. Springer-Verlag, New York, 1985
4. P. J. Brockwell and R. Davis. Introduction to Time-Series and Forecasting. Springer-Verlag, New York, 2002.
5. M. F. Buckley and D. P. Siewiorek. Vax/vms event monitoring and analysis In FTCS-25, Computing Digest of Papers, pages 414-423, June 1995.
6. M. F. Buckley and D. P. Siewiorek. Comparative analysis of event tupling schemes. In FTCS-26, Computing igest of Papers, pages 24-303, June 1996.
7. T. Dietterich and R. Michalski. Discovering patterns in sequences of events Artificial Intelligence., 25:187-232 1985.
8. P. Dinda. A prediction-based real-time scheduling advisor. In Proceeding 16th. Intl. Parallel and Distributed Processing Symposium IPDPS 2002), April 2002.
9. C. Domeniconi, C. S. Perng, R. Vilalta, and S. Ma. A classification approach for prediction of targetted events in temporal sequences. In SIGMOD/PODS 2002, ACM SIGMOD/PODS Conference, 2002.
10. N. Friedman. Learning belief networks in the presence of missing values and hidden variables. In Proceedings 14th. Intl. Conf. on Machine Lerning, pages 125-133, 1997.
11. N. Friedman, K. Murphy, and S. Russell. Learning the structure of dynamic probabilistic networks. In Proceedings 14th. Conf. on Uncertainty in Articial Intligence (UAI), pages 139-147, 1998.
12. D. Heckerman. A tutorial on learning with bayesian networks. Tech. Rep. MSR-TR-95-06, Microsoft Research, 1996.
13. P. Horn. Autonomic computing: Ibm's prospective on the state of information technology. http://www.research.ibm.com/autonomic/IBM Corporation, 2001
14. F. Jensen. An Introduction to Bayesian Networks. UCL Press, London, 1996.
15. I. Lee, R. K. Iye, and D. Tang. Error/failure analysis using event logs from fault tolerant systems. In Proceedings 21st Intl. Symposium on Fault-Tolerant Computing, pages 10-17, June 1991.
16. T. Y. Lin and D. P. Siewiorek. Error log analysis: Statistical modeling and heuristic trend analysis. IEEE Trans Reliability, 39 (4):419-432, October 1990.
17. R. S. Michalski. A theory and methodology of inductive learning Machine Learning, 39 (4):419-432, October 1995.
18. K. P. Murphy. Active learning of causal bayes net structure. In http://citeseer.nj.nec.com/451402.html.
19. T. Nakagawa and S. Osaki. The discrete weibull distribution. IEEE Trans. On Reliability, R24:300-30, December 1975.
20. J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers, San Mateo, California, 1988.
21. J. R. Quinlan. C4-5: Programs for Machine Learning-Morgan Kaufmann Publishers, San Mateo, California, 1994.
22. R. K. Sahoo, M. Bae, R. Vilalta, J. Moreira, S. Ma and M. Gupta. Providing persistent and consistent resources through event log analysis and predictions for large-scale computing systems In SHAMAN, Workshop, ICS'2002, June 2002
23. M. M. Tsao. Trend Analysis and Fault Prediction. PhD Dissertation, Carnegie-Mellon University, Mayr 1983.
24. R. Vilalta, C. Apte, J. Hellerstein, S. Ma, and S. Weiss. Predictive algorithms in the management of computer systems In IBM Systems Journal, Special Issue on Artificial Intelligence, volume 41, 2002.
25. R. Vilalta and S. Ma. Predictive rare events in temporal domains. In Proceedings IEEE Conf. on Data Mining (IGDM.02), 2002.
26. G. M. Weiss. Timeweaver: A genetic algorithm for identifying predictive patterns in sequence of events. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 13-17, 1999.
27. G. M. Weiss and H. Hirsh. Learning to predict rare events in event sequences. In Proceedings 4th. Intl. Conf. on KDD (KDD-98), volume 4 pages 359-363, 1998.
28. G. M. Weiss and J. P. Ros. Implementing design patterns with object-oriented rules. 1 l (7):25-35, 1998.
29. G. M. Weiss, J. P. Ros, and A. Singhal. Answer: Network monitoring using objectoriented rules. In Proceedings 10th Conference IAAI (IAAI-98), volume 10, pages 1087-1093, 1998.