Ensemble of Bayesian predictors for autonomic failure management in cloud computing

Proceedings - International Conference on Computer Communications and Networks, ICCCN

Volumn , Issue , 2011, Pages

  Guan, Qiang ^a   Zhang, Ziming ^a   Fu, Song ^a  

^a UNIVERSITY OF NORTH TEXAS   (United States)

Author keywords

Cloud computing; Ensemble of Bayesian models; Failure management; Unsupervised learning

Indexed keywords

ANOMALOUS BEHAVIOR; BAYESIAN MODEL; CLOUD SYSTEMS; COMPUTING SYSTEM; CRUCIAL TECHNOLOGY; FAILURE DETECTION METHOD; FAILURE DYNAMICS; FAILURE MANAGEMENT; FAILURE PREDICTION; FALSE POSITIVE RATES; HEALTH MONITORING; LEARNING-BASED APPROACH; MULTI-LAYER NETWORK; RUNTIME PERFORMANCE; SYSTEM BEHAVIORS; TRUE POSITIVE RATES;

BAYESIAN NETWORKS; BEHAVIORAL RESEARCH; COMPUTER SYSTEMS; MONITORING; NETWORK LAYERS; PROBABILITY DISTRIBUTIONS; UNSUPERVISED LEARNING;

CLOUD COMPUTING;

EID: 80053047973     PISSN: 10952055     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCCN.2011.6006036     Document Type: Conference Paper

References (44)

1. sysstat. Available at: http://sebastien.godard.pagesperso-orange.fr/.
2. A. Agbaria and R. Friedman. Model-based performance evaluation of distributed checkpointing protocols. Performance Evaluation, 65(5):345-365, 2008. (Pubitemid 351400683)
3. G. Bronevetsky, D. J. Marques, K. K. Pingali, R. Rugina, and S. A. McKee. Compiler-enhanced incremental checkpointing for openmp applications. In Proceedings of ACM Symposium on Principles and Practice of Parallel Programming (PPoPP), 2008.
4. S. Chakravorty, C. Mendes, , and L. Kale. Proactive fault tolerance in MPI applications via task migration. In Proceedings of IEEE International Conference on High Performance Computing, 2006.
5. V. Chandola, A. Banerjee, and V. Kumar. Anomaly detection: A survey. ACM Computing Surveys, 41:15:1-15:58, 2009.
6. T. Cover and J. Thomas. Elements of Information Theory. John Wiley & Sons, 1991.
7. R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. Wiley- Interscience, 2001.
8. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Computing Surveys, 34(3):375-408, 2002.
9. S. Fu. Failure-aware construction and reconfiguration of distributed virtual machines for high availability computing. In Proceedings of IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid), 2009.
10. S. Fu. Failure-aware resource management for high-availability computing clusters with distributed virtual machines. Journal of Parallel and Distributed Computing, 70(4):384-393, 2010.
11. S. Fu and C. Xu. Exploring event correlation for failure prediction in coalitions of clusters. In Proceedings of ACM/IEEE Supercomputing Conference (SC), 2007.
12. S. Fu and C. Xu. Quantifying temporal and spatial correlation of failure events for proactive management. In Proceedings of IEEE International Symposium on Reliable Distributed Systems (SRDS), 2007.
13. S. Fu and C. Xu. Proactive resource management for failure resilient high performance computing clusters. In Proceedings of IEEE International Conference on Availability, Reliability and Security (ARES), 2009.
14. S. Fu and C. Xu. Quantifying event correlations for proactive failure management in networked computing systems. Journal of Parallel and Distributed Computing, 70(11):1100-1109, 2010.
15. S. S. Gokhale and K. S. Trivedi. Analytical models for architecture-based software reliability prediction: A unification framework. IEEE Transactions on Reliability, 55(4):578-590, 2006. (Pubitemid 46405748)
16. J. Gu, Z. Zheng, Z. Lan, J. White, E. Hocks, and B.-H. Park. Dynamic meta-learning for failure prediction in large-scale systems: A case study. In Proceedings of IEEE International Conference on Parallel Processing (ICPP), 2008.
17. Q. Guan and S. Fu. auto-AID: A data mining framework for autonomic anomaly identification in networked computer systems. In Proceedings of IEEE International Performance Computing and Communications Conference (IPCCC), 2010.
18. Q. Guan, D. Smith, and S. Fu. Anomaly detection in large-scale coalition clusters for dependability assurance. In Proceedings of IEEE International Conference on High Performance Computing (HiPC), 2010.
19. J. Han. Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers Inc., 2005.
20. T. Heath, R. P. Martin, and T. D. Nguyen. Improving cluster availability using workstation validation. In Proceedings of ACM Conference on Measurement and modeling of computer systems (SIGMETRICS), 2002.
21. V. Hodge and J. Austin. A survey of outlier detection methodologies. Artificial Intelligence Review, 22:85-126, 2004.
22. D. Ippoliti and X. Zhou. An adaptive growing hierarchical self organizing map for network intrusion detection. In Proceedings of IEEE International Conference on Computer Communications and Networks (ICCCN), 2010.
23. O. Laadan and J. Nieh. Transparent checkpoint-restart of multiple processes on commodity operating systems. In Proceedings of USENIX Annual Technical Conference (USENIX), 2007.
24. Y. Li and Z. Lan. Fast restart mechanism for checkpoint/recovery protocols in networked environments. In Proceedings of IEEE International Conference on Dependable Systems and Networks (DSN), 2008.
25. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. K. Sahoo. BlueGene/L failure analysis and prediction models. In Proceedings of International Conference on Dependable Systems and Networks (DSN), 2006.
26. Y. Liang, Y. Zhang, A. Sivasubramaniam, R. Sahoo, J. Moreira, and M. Gupta. Filtering failure logs for a BlueGene/L prototype. In Proceedings of Conference on Dependable Systems and Networks (DSN), 2005.
27. C. Lim, N. Singh, and S. Yajnik. A log mining approach to failure analysis of enterprise telephony systems. In Proc. of IEEE Conference on Dependable Systems & Networks (DSN), 2008.
28. S. Ma and J. L. Hellerstein. Mining partially periodic event patterns with unknown periods. In Proc. of IEEE Conference on Data Engineering (ICDE), 2001.
29. J. W. Mickens and B. D. Noble. Exploiting availability prediction in distributed systems. In Proceedings of USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2006.
30. S. Muppala and X. Zhou. Coordinated session-based admission control with statistical learning for multi-tier internet applications. Journal of Network and Computer Applications, Elsevier, 34(1):20-29, 2011.
31. S. Muppala, X. Zhou, and L. Zhang. Regression based multi-tier resource provisioning for session slowdown guarantees. In IEEE Int'l Performance Computing and Communications Conference (IPCCC), 2010.
32. A. B. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for HPC with Xen virtualization. In Proceedings of ACM International Conference on Supercomputing (ICS), 2007.
33. A. J. Oliner, R. K. Sahoo, J. E. Moreira, and et al. Fault-aware job scheduling for BlueGene/L systems. In Proceedings of the 18th International Parallel and Distributed Processing Symposium (IPDPS), 2004.
34. I. Philp. Software failures and the road to a petaflop machine. In Proceedings of Symposium on High Performance Computer Architecture Workshop, 2005.
35. R. K. Sahoo, A. J. Oliner, I. Rish, and et al. Critical event prediction for proactive management in large-scale computer clusters. In Proceedings of ACM International Conference on Knowledge Discovery and Data Dining (SIGKDD), 2003.
36. R. K. Sahoo, A. Sivasubramaniam, M. S. Squillante, and Y. Zhang. Failure data analysis of a large-scale heterogeneous server environment. In Proceedings of IEEE International Conference on Dependable Systems and Networks (DSN), 2004.
37. F. Salfner, M. Lenk, and M. Malek. A survey of online failure prediction methods. ACM Computing Surveys, 42:10:1-10:42, 2010.
38. B. Schroeder and G. Gibson. A large-scale study of failures in high-performance-computing systems. In Proceedings of International Conference on Dependable Systems and Networks (DSN), 2006.
39. H. Song, C. Leangsuksun, and R. Nassar. Availability modeling and analysis on high performance cluster computing systems. In Proceedings of IEEE International Conference on Availability, Reliability and Security (ARES), 2006.
40. C. Wang, F. Mueller, C. Engelmann, and S. L. Scott. Proactive processlevel live migration in HPC environments. In Proceedings of ACM/IEEE Conference on Supercomputing (SC), 2008.
41. P. Yalagandula, S. Nath, H. Yu, P. B. Gibbons, and S. Sesha. Beyond availability: Towards a deeper understanding of machine failure characteristics in large distributed systems. In Proceedings of USENIX WORLDS, 2004.
42. K. Yamanishi and Y. Maruyama. Dynamic syslog mining for network failure monitoring. In Proc. of ACM Conference on Knowledge Discovery in Data Mining (KDD), 2005.
43. Z. Zhang and S. Fu. Failure prediction for autonomic management of networked computer systems with availability assurance. In Proceedings of IEEE Workshop on Dependable Parallel, Distributed and Network- Centric Systems in conjunction with IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2010.
44. Z. Zhang and S. Fu. A hierarchical failure management framework for dependability assurance in compute clusters. International Journal of Computational Science, 4(4):313-326, 2010.