An anomaly detection framework for autonomic management of compute cloud systems

Proceedings - International Computer Software and Applications Conference

Volumn , Issue , 2010, Pages 376-381

  Smith, Derek ^a   Guan, Qiang ^a   Fu, Song ^a  

^a NEW MEXICO INSTITUTE OF MINING AND TECHNOLOGY   (United States)

Author keywords

Anomaly detection; Autonomic systems; Compute clouds; System dependability

Indexed keywords

ANOMALY DETECTION; AUTONOMIC MANAGEMENT; AUTONOMIC SYSTEMS; CLOUD SYSTEMS; COMPONENT FAILURES; COMPUTATION OVERHEADS; COMPUTE CLOUDS; DATA ANALYSIS; DATA FORMAT; DATA SIZE; DATA TRANSFORMATION; ERROR PRONES; FAULTY NODE; HIGH DIMENSIONAL DATA; OPERATION COST; SYSTEM DEPENDABILITY; SYSTEM DESIGNERS; TROUBLESHOOTING;

CLOUDS; COMPUTER APPLICATIONS; FEATURE EXTRACTION; SYSTEMS ANALYSIS; WEB SERVICES;

METADATA;

EID: 78649864973     PISSN: 07303157     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/COMPSACW.2010.72     Document Type: Conference Paper

References (29)

1. sysstat. Available at: http://pagesperso-orange.fr/sebas-tien.godard/.
2. H. Berenji, J. Ametha, and D. Vengerov. Inductive learning for fault diagnosis. In Proc. of IEEE Conf. on Fuzzy Systems, 2003.
3. V. Chandola, A. Banerjee, and V. Kumar. Anomaly detection: A survey. ACM Computing Surveys, 41(3): 1-58, 2009.
4. B. Chun and A. Vahdat. Workload and failure characterization on a large-scale federated testbed. Technical Report IRB-TR-03-040, Intel Research Berkeley, 2003.
5. I. Cohen, M. Goldszmidt, T. Kelly, J. Symons, and J. S. Chase. Correlating instrumentation data to system states: a building block for automated diagnosis and control. In Proc. of USENIX Symp. on Opearting Systems Design and Implementation (OSDI), 2004.
6. N. Friedman, D. Geiger, and M. Goldszmidt. Bayesian network classifiers. Machine Learning, 29 (2-3), 1997.
7. S. Fu. Failure-aware resource management for high-availability computing clusters with distributed virtual machines. Journal of Parallel and Distributed Computing, 70(4): 384-393, 2010.
8. S. Fu and C.-Z. Xu. Exploring event correlation for failure pre diction in coalitions of clusters. In Proc. of ACM/IEEE Super-computing Conf. (SC), 2007.
9. S. Fu and C.-Z. Xu. Quantifying temporal and spatial correlation of failure events for proactive management. In Proc. of IEEE Intl. Symp. on Reliable Distributed Systems (SRDS), 2007.
10. A. G. Ganek and T. A. Corbi. The dawning of the autonomic computing era. IBM Systems Journal, 42(1): 5-18, 2003.
11. J. Han. Data Mining: Concepts and Techniques. 2005.
12. C.-H. Hsu and W.-C. Feng. A power-aware run-time system for high-performance computing. In Proc. of ACM/IEEE conf. on Supercomputing (SC), November 2005.
13. J. O. Kephart and D. M. Chess. The vision of autonomic com puting. IEEE Computer, 36(1): 41-50, 2003.
14. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. K. Sahoo. BlueGene/L failure analysis and prediction models. In Proc. of IEEE Conf. on Dependable Systems and Networks (DSN), 2006.
15. Y. Liang, Y. Zhang, A. Sivasubramaniam, R. Sahoo, J. Moreira, and M. Gupta. Filtering failure logs for a BlueGene/L prototype. In Proc. of IEEE Conf. on Dependable Systems and Networks (DSN), 2005.
16. C. Lim, N. Singh, and S. Yajnik. A log mining approach to failure analysis of enterprise telephony systems. In Proc. of IEEE Intl. Conf. on Dependable Systems and Networks (DSN), 2008.
17. S. Ma and J. L. Hellerstein. Mining partially periodic event pat terns with unknown periods. In Proc. of IEEE Intel. Conf. on Data Engineering (ICDE), 2001.
18. J. Meyer and L. Wei. Analysis of workload influence on depend ability. In Proc. of IEEE Symp. on Fault-Tolerant Computing (FTCS), 1988.
19. A. J. Oliner and J. Stearley What supercomputers say: A study of five system logs. In Proc. of IEEE Conf. on Dependable Systems and Networks (DSN), 2007.
20. D. Oppenheimer, A. Ganapathi, and D. Patterson. Why do In ternet services fail, and what can be done about it. In Proc. of USENIX Symp. on Internet Technologies and Systems (USITS), 2003.
21. W. Peng, T. Li, and S. Ma. Mining logs files for computing sys tem management. In Proc. of IEEE Intl. Conf. on Automatic Com puting (ICAC), 2005.
22. R. K. Sahoo, A. Sivasubramaniam, M. S. Squillante, and Y. Zhang. Failure data analysis of a large-scale heterogeneous server environment. In Proc. of IEEE Conf. on Dependable Sys tems and Networks (DSN), 2004.
23. B. Schroeder and G. Gibson. A large-scale study of failures in high-performance-computing systems. In Proc. of IEEE Conf. on Dependable Systems and Networks (DSN), 2006.
24. J. Tucek, S. Lu, C. Huang, S. Xanthos, and Y Zhou. Triage: diagnosing production run failures at the user's site. In Proc. of ACM Symp. on Operating Systems Principles (SOSP), 2007.
25. R. Vilalta and S. Ma. Predicting rare events in temporal domains. In Proc. of IEEE Conf. on Data Mining (ICDM), 2002.
26. P. Yalagandula, S. Nath, H. Yu, P. B. Gibbons, and S. Sesha. Be yond availability: Towards a deeper understanding of machine failure characteristics in large distributed systems. In Proc. of USENIX WORLDS, 2004.
27. K. Yamanishi and Y. Maruyama. Dynamic syslog mining for network failure monitoring. InProc. of ACM Conf. on Knowledge Discovery in Data Mining (KDD), 2005.
28. Y. Zhang, M. S. Squillante, A. Sivasubramaniam, and R. K. Sahoo. Performance implications of failures in large-scale cluster scheduling. In Proc. of the 10th Workshop on Job Scheduling Strategies for Parallel Processing, 2004.
29. A. X. Zheng, J. Lloyd, and E. Brewer. Failure diagnosis using de cision trees. In Proc. of IEEE Intl. Conf. on Automatic Computing (ICAC), 2004.