Proactive resource management for failure resilient high performance computing clusters

Proceedings - International Conference on Availability, Reliability and Security, ARES 2009

Volumn , Issue , 2009, Pages 257-264

  Fu, Song ^a   Xu, Cheng Zhong ^b  

^a NEW MEXICO INSTITUTE OF MINING AND TECHNOLOGY   (United States)

^b Wayne State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPONENT FAILURES; DEPENDABLE COMPUTING; FAILURE PREDICTION; FAILURE RESILIENCE; HIGH PERFORMANCE COMPUTING SYSTEMS; HIGH-PERFORMANCE COMPUTING CLUSTERS; HPC CLUSTERS; JOB COMPLETION; LARGE-SCALE COMPUTING; LOS ALAMOS NATIONAL LABORATORY; PERFORMANCE STATUS; RESOURCE MANAGEMENT; SELECTION DECISIONS; SYSTEM COMPLEXITY; SYSTEM DEPENDABILITY; VIRTUAL MACHINE TECHNOLOGY;

COMPUTATION THEORY; NATURAL RESOURCES MANAGEMENT; RESOURCE ALLOCATION;

RELIABILITY;

EID: 70349679287     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ARES.2009.13     Document Type: Conference Paper

References (30)

1. System availability, failure and usage data sets. Los Alamos National Laboratory (LANL). Available at: http://institutes.lanl.gov/data/fdata/.
2. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proc. of ACM Symp. on Operating Systems Principles (SOSP), 2003.
3. B. Calder, A. A. Chien, J. Wang, and D. Yang. The entropia virtual machine for desktop grids. In Proc. of ACM/USENIX conf. on Virtual Execution Environments (VEE), 2005.
4. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. of ACM/USENIX Symp. on Networked Systems Design and Implementation (NSDI), 2005.
5. S. Fu and C.-Z. Xu. Exploring event correlation for failure prediction in coalitions of clusters. In Proc. of ACM/IEEE Conf. for High Performance Computing, Networking, Storage, and Analysis (SC'07), 2007.
6. S. Fu and C.-Z. Xu. Quantifying temporal and spatial correlation of failure events for proactive management. In Proc. of IEEE Symp. on Reliable Distributed Systems (SRDS), 2007.
7. W. Goscinski and D. Abramson. Motor: A virtual machine for high performance computing. In Proc. of IEEE Symp. on High Performance Distributed Computing (HPDC), 2006.
8. N. R. Gottumukkala, C. Leangsuksun, N. Taerat, R. Nassar, and S. L. Scott. Reliability-aware resource allocation in HPC systems. In Proc. of IEEE Conf. on Cluster Computing (Cluster), 2007.
9. C.-H. Hsu and W.-C. Feng. A power-aware run-time system for high-performance computing. In Proc. of ACM/IEEE conf. on Supercomputing (SC'05), 2005.
10. W. Huang, J. Liu, B. Abali, and D. K. Panda. A case for high performance computing with virtual machines. In Proc. of ACM Intl. Conf. on Supercomputing (ICS), 2006.
11. I. Krsul, A. Ganguly, J. Zhang, J. A. B. Fortes, and R. J. Figueiredo. Vmplants: Providing and managing virtual machine execution environments for grid computing. In Proc. of ACM/IEEE High Performance Computing, Networking and Storage Conf. (SC'04), 2004.
12. Y. Li and Z. Lan. Exploit failure prediction for adaptive fault-tolerance in cluster computing. In Proc. of IEEE Intl. Symp. on Cluster Computing and the Grid (CCGRID), 2006.
13. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. K. Sahoo. BlueGene/L failure analysis and prediction models. In Proc. of Conf. on Dependable Systems and Networks (DSN), 2006.
14. Y. Liang, Y. Zhang, A. Sivasubramaniam, R. Sahoo, J. Moreira, and M. Gupta. Filtering failure logs for a BlueGene/L prototype. In Proc. of Intl. Conf. on Dependable Systems and Networks (DSN), 2005.
15. J. Liu, W. Huang, B. Abali, and D. K. Panda. High performance VMM-bypass I/O in virtual machines. In Proc. of USENIX Annual Technical Conf. (USENIX), 2006.
16. J.W. Mickens and B. D. Noble. Exploiting availability prediction in distributed systems. In Proc. of USENIX Symp. on Networked Systems Design and Implementation (NSDI), 2006.
17. A. B. Nagarajan, F. Mueller, C. Engelmann, and S. L. Scott. Proactive fault tolerance for HPC with Xen virtualization. In Proc. of the ACM Intl. Conf. on Super- computing (ICS), 2007.
18. A. J. Oliner and J. E. Moreira. Probabilistic QoS guarantees for supercomputing systems. In Proc. of IEEE Conf. on Dependable Systems and Networks (DSN), 2005.
19. I. Philp. Software failures and the road to a petaflop machine. In Proc. of Symp. on High Performance Computer Architecture Workshop, 2005.
20. H. Raj and K. Schwan. High performance and scalable i/o virtualization via self-virtualized devices. In Proc. of symp. on High Performance Distributed Computing (HPDC), 2007.
21. M. Rosenblum and T. Garfinkel. Virtual machine monitors: current technology and future trends. IEEE Computer, 38(5):39-47, 2005.
22. R. K. Sahoo, A. J. Oliner, I. Rish, and et al. Critical event prediction for proactive management in largescale computer clusters. In Proc. of ACM Intl. Conf. on Knowledge Discovery and Data Dining (SIGKDD), 2003.
23. R. K. Sahoo, A. Sivasubramaniam, M. S. Squillante, and Y. Zhang. Failure data analysis of a large-scale heterogeneous server environment. In Proc. of Conf. on Dependable Systems and Networks (DSN), 2004.
24. R. K. Sahoo, A. Sivasubramaniam, M. S. Squillante, and Y. Zhang. Failure data analysis of a large-scale heterogeneous server environment. In Proc. of Intl. Conf. on Dependable Systems and Networks (DSN), 2004.
25. F. Salfner, M. Schieschke, and M. Malek. Predicting failures of computer systems: a case study for a telecommunication system. In Proc. of IEEE Parallel and Distributed Processing Symp. (IPDPS), 2006.
26. C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the migration of virtual computers. In Proc. of USENIX Symp. on Operating Systems Design and Implementation (OSDI), 2002.
27. B. Schroeder and G. Gibson. A large-scale study of failures in high-performance-computing systems. In Proc. of Intl. Conf. on Dependable Systems and Networks (DSN), 2006.
28. VMware Corporation. White paper:VMware ESX server performance and resource management for CPU-intensive workloads. Available at: http://www.vmware.com/pdf/ESX2 CPU Performance.pdf.
29. M. Wu, X.-H. Sun, and H. Jin. Performance under failure of high-end computing. In Proc. of Intl. Conf. for High Performance Computing, Networking, Stor- age, and Analysis (SC'07), 2007.
30. Y. Zhang, M. S. Squillante, A. Sivasubramaniam, and R. K. Sahoo. Performance implications of failures in large-scale cluster scheduling. In Proc. of the 10th Workshop on Job Scheduling Strategies for Parallel Processing, 2004.