A self-evolving anomaly detection framework for developing highly dependable utility clouds

Proceedings - IEEE Global Communications Conference, GLOBECOM

Volumn , Issue , 2012, Pages 1605-1610

  Pannu, Husanbir S ^a   Liu, Jianguo ^a   Fu, Song ^b  

^a UNIVERSITY OF NORTH TEXAS   (United States)

^b Center for Advanced Research and Technology   (United States)

Author keywords

Anomaly identification; Autonomic management; Cloud computing; Dependable systems; Self evolvement

Indexed keywords

ANOMALY DETECTION FRAMEWORKS; ANOMALY IDENTIFICATION; AUTONOMIC MANAGEMENT; AUTONOMICS; CLOUD-COMPUTING; DEPENDABILITY ASSURANCE; DEPENDABLE SYSTEMS; FAILURE MANAGEMENT; RESOURCE MANAGEMENT; SELF EVOLVEMENT;

CLOUD COMPUTING;

EID: 84877668862     PISSN: 23340983     EISSN: 25766813     Source Type: Conference Proceeding    
DOI: 10.1109/GLOCOM.2012.6503343     Document Type: Conference Paper

References (46)

1. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. A view of cloud computing. Communications of the ACM, 53(4):50-58, 2010.
2. A. Ben-Hur, D. Horn, H. Siegelmann, and V. Vapnik. Support vector clustering. Journal of Machine Learning Research, 2:125-137, 2001.
3. D. Bernick, B. Bruckert, P. D. Vigna, D. Garcia, R. Jardine, J. Klecka, and J. Smullen. Nonstop advanced architecture. In Proceedings of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2005.
4. E. Cecchet, J. Marguerite, and W. Zwaenepoel. Performance and scalability of EJB applications. In Proceedings of ACM Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA), 2002.
5. V. Chandola, A. Banerjee, and V. Kumar. Anomaly detection: A survey. ACM Computing Surveys, 41(3):15:1-15:58, 2009.
6. M. Y. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer. Pinpoint: Problem determination in large, dynamic internet services. In Proceedings of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2002.
7. I. Cohen, M. Goldszmidt, T. Kelly, J. Symons, and J. S. Chase. Correlating instrumentation data to system states: a building block for automated diagnosis and control. In Proceedings of USENIX Symposium on Opearting Systems Design and Implementation (OSDI), 2004.
8. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Communications of the ACM, 51(1):107-113, 2008.
9. M. L. Fair, C. R. Conklin, S. B. Swaney, P. J. Meaney, W. J. Clarke, L. C. Alves, I. N. Modi, F. Freier, W. Fischer, and N. E. Weber. Reliability, availability, and serviceability (RAS) of the IBM eServer z990. IBM Journal of Research and Development, 48(3-4):519-534, 2004.
10. S. Fu. Performance metric selection for autonomic anomaly detection on cloud computing systems. In Proceedings of IEEE Global Communications Conference (GLOBECOM), 2011.
11. S. Fu and C. Xu. Exploring event correlation for failure prediction in coalitions of clusters. In Proceedings of ACM/IEEE Supercomputing Conference (SC), 2007.
12. S. Fu and C. Xu. Quantifying temporal and spatial correlation of failure events for proactive management. In Proceedings of IEEE International Symposium on Reliable Distributed Systems (SRDS), 2007.
13. S. Fu and C. Xu. Quantifying event correlations for proactive failure management in networked computing systems. Journal of Parallel and Distributed Computing, 70(11):1100-1109, 2010.
14. S. Garg, A. Puliafito, and K. S. Trivedi. Analysis of software rejuvenation using markov regenerative stochastic petri net. In Proceedings of IEEE International Symposium on Software Reliability Engineering (ISSRE), 1995.
15. Q. Guan and S. Fu. auto-AID: A data mining framework for autonomic anomaly identification in networked computer systems. In Proceedings of IEEE International Performance Computing and Communications Conference (IPCCC), 2010.
16. Q. Guan, Z. Zhang, and S. Fu. Ensemble of bayesian predictors for autonomic failure management in cloud computing. In Proceedings of IEEE International Conference on Computer Communications and Networks (ICCCN), 2011.
17. Q. Guan, Z. Zhang, and S. Fu. Proactive failure management by integrated unsupervised and semi-supervised learning for dependable cloud systems. In Proceedings of IEEE International Conference on Availability, Reliability and Security (ARES), 2011.
18. Q. Guan, Z. Zhang, and S. Fu. Ensemble of bayesian predictors and decision trees for proactive failure management in cloud computing systems. Journal of Communications, 7(1):52-61, 2012.
19. G. Hamerly and C. Elkan. Bayesian approaches to failure prediction for disk drives. In Proceedings of International Conference on Machine Learning (ICML), 2001.
20. J. L. Hellerstein, F. Zhang, and P. Shahabuddin. A statistical approach to predictive detection. Computer Networks: The International Journal of Computer and Telecommunications Networking, 35(1):77-95, 2001.
21. V. Hodge and J. Austin. A survey of outlier detection methodologies. Artificial Intelligence Review, 22:85-126, 2004.
22. V. Kumar, B. F. Cooper, G. Eisenhauer, and K. Schwan. iManage: policy-driven self-management for enterprise-scale systems. In Proceedings of ACM/IFIP/USENIX International Conference on Middleware (Middleware), 2007.
23. V. Kumar, K. Schwan, S. Iyer, Y. Chen, and A. Sahai. A state-space approach to SLA based management. In Proceedings of IEEE Network Operations and Management Symposium (NOMS), 2008.
24. Z. Lan, J. Gu, Z. Zheng, R. Thakur, and S. Coghlan. A study of dynamic meta-learning for failure prediction in large-scale systems. Journal of Parallel and Distributed Computing, 70(6):630-643, 2010.
25. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. K. Sahoo. BlueGene/L failure analysis and prediction models. In Proceedings of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2006.
26. Y. Liang, Y. Zhang, A. Sivasubramaniam, R. Sahoo, J. Moreira, and M. Gupta. Filtering failure logs for a BlueGene/L prototype. In Proceedings of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2005.
27. F. Longo, R. Ghosh, V. Naik, and K. Trivedi. A scalable availability model for infrastructure-as-a-service cloud. In Proceedings of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2011.
28. A. Oliner and J. Stearley. What supercomputers say: A study of five system logs. In Proceedings of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2007.
29. D. Oppenheimer, A. Ganapathi, and D. Patterson. Why do Internet services fail, and what can be done about it. In Proceedings of USENIX Symposium on Internet Technologies and Systems (USITS), 2003.
30. W. Peng and T. Li. Mining logs files for computing system management. In Proceedings of IEEE International Conference on Autonomic Computing (ICAC), 2005.
31. perf Subsystem. perf: Linux profiling with performance counters. Available at: http://perf.wiki.kernel.org/.
32. S. Pertet and P. Narasimhan. Causes of failure in web applications. Technical Report Technical report, CMU-PDL-05-109, MIT Laboratory for Computer Science, December 2005.
33. M. Rosenblum and T. Garfinkel. Virtual machine monitors: current technology and future trends. IEEE Computer, 38(5):39-47, 2005.
34. R. K. Sahoo, A. J. Oliner, I. Rish, M. Gupta, J. E. Moreira, S. Ma, R. Vilalta, and A. Sivasubramaniam. Critical event prediction for proactive management in large-scale computer clusters. In Proceedings of ACM International Conference on Knowledge Discovery and Data Dining (KDD), 2003.
35. F. Salfner, M. Lenk, and M. Malek. A survey of online failure prediction methods. ACM Computing Surveys, 42(3):10:1-10:42, 2010.
36. B. Schölkopf, R. C. Williamson, A. J. Smola, J. Shawe-Taylor, and J. C. Platt. Support vector method for novelty detection. In Proceedings of Conference on Advances in Neural Information Processing Systems, 2000.
37. B. Schroeder and G. A. Gibson. A large-scale study of failures in high-performance computing systems. IEEE Transactions on Dependable and Secure Computing, 7:337-351, 2010.
38. M. Steinder and A. Sethi. A survey of fault localization techniques in computer networks. Science of Computer Programming, 53(2):165-194, 2004.
39. SYSSTAT Utilities. SYSSTAT: Performance monitoring tools. Available at: http://sebastien.godard.pagesperso-orange.fr/.
40. D. M. J. Tax and R. P.W. Duin. Support vector data description. Machine learning, 54(1):45-66, January 2004.
41. K. Vaidyanathan and K. Gross. Mset performance optimization for detection of software aging. In Proceedings of IEEE International Symposium on Software Reliability Engineering (ISSRE), 2003.
42. V. N. Vapnik. The nature of statistical learning theory, 2nd edition. Springer-Verlag, New York, 2000.
43. R. Vilalta and S. Ma. Predicting rare events in temporal domains. In Proceedings of IEEE International Conference on Data Mining (ICDM), 2002.
44. K. V. Vishwanath and N. Nagappan. Characterizing cloud computing hardware reliability. In Proceedings of ACM Symposium on Cloud computing (SOCC), 2010.
45. Z. Zhang and S. Fu. Failure prediction for autonomic management of networked computer systems with availability assurance. In Proceedings of DPDNS, IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2010.
46. A. Zheng, J. Lloyd, and E. Brewer. Failure diagnosis using decision trees. In Proceedings of IEEE International Conference on Autonomic Computing (ICAC), 2004.