Fault-aware, utility-based job scheduling on Blue Gene/P systems

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2009, Pages

  Tang, Wei ^a   Lan, Zhiling ^a   Desai, Narayan ^b   Buettner, Daniel ^b  

^a Illinois Institute of Technology   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARGONNE NATIONAL LABORATORY; EVENT-DRIVEN SIMULATIONS; JOB ALLOCATION; JOB SCHEDULING; SCHEDULING POLICIES; SYSTEM FAILURES; UTILITY-BASED SCHEDULING;

CLUSTER COMPUTING; COMPUTER SCIENCE; SYSTEMS ENGINEERING; TECHNICAL PRESENTATIONS;

SCHEDULING;

EID: 72049093226     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2009.5289206     Document Type: Conference Paper

References (28)

1. Cobalt project web site, http://trac.mcs.anl.gov/projects/cobalt.
2. Blue Gene/P red books, http://www.redbooks.ibm.com/abstracts/sg247417. html.
3. B. Allen, "Monitoring Hard Disk with SMART," Linux Journal, 2004.
4. F. Chen, "A Utility-based Approach to Scheduling Multimedia Streams in Peer-to-Peer Systems," Proc. of the 18th International Parallel and Distributed Processing Symposium (IPDPS'04), 2004.
5. DOE INCITE project web site, http://www.sc.doe.gov/ascr/incite.
6. N. Desai, E. Lusk, D. Buettner, A. Cherry, and Theron Voran, "Simulating Failures on Large-Scale Systems," International Conference on Parallel Processing - Workshops (ICPPW'08), 2008.
7. Hardware Monitoring by LM Sensors, http://secure.netroedge.com/-lm78/ info.html.
8. Health API, http://www.renci.org.
9. J. Gu, Z. Zheng, Z. Lan, J. White, E. Hocks, and B. Park, "Dynamic Meta-Learning for Failure Prediction in Large-Scale Systems: A Case Study," Proc. of International Conference on Parallel Processing (ICPP'08), 2008.
10. P. Gujrati, Y. Li, Z. Lan, R. Thakur, and J. White, "A Meta-Learning Failure Predictor for Blue Gene/L Systems," Proc. of International Conference on Parallel Processing (ICPP'07), 2007.
11. D. Jackson, Q. Snell, and M. Clement, "Core Algorithms of the Maui Scheduler," International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP'01), 2001.
12. C. Lee and A. Snavely, "Precise and Realistic Utility Functions for User-Centric Performance Analysis of Schedulers," Proc. of IEEE Symposium on High-Performance Distributed Computing (HPDC'07), 2007.
13. Y. Li, Z. Lan, P. Gujrati, and X. Sun, "Fault-Aware Runtime Strategies for High Performance Computing," IEEE Transactions on Parallel and Distributed Systems, vol.20, no.4, pp. 460-473, 2009.
14. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. Sahoo,"Blue Gene /L Failure Analysis and Models," Proc. of DSN'06, 2006.
15. K. Limaye, C. Leangsuksun, and A. Tikotekar, "Fault Tolerance Enabled HPC Scheduling with HA-OSCAR Framework," Proc. of the High Availability and Performance Workshop, 2005.
16. Maui project web site, http://mauischeduler.sourceforge.net.
17. A. Oliner, R. Sahoo, J. Moreira, and M. Gupta, "Fault-aware Job Scheduling for BlueGene/L Systems," Proc. of the 18th International Parallel and Distributed Processing Symposium (IPDPS'04), 2004.
18. A. Oliner and J. Stearly, "What Supercomputers Say: A Study of Five System Logs," Proc. of DSN'07, 2007.
19. TOP500 Super Computing Web Site, http://www.top500.org.
20. R. Sahoo, A. Oliner, I. Rish, M. Gupta, J. Moreira, S. Ma, R. Vilalta, and A. Sivasubramaniam, "Critical Event Prediction for Proactive Management in Large-scale Computer Clusters," Proc. of International Conference on Knowledge Discovery and Data Mining, 2003.
21. B. Schroeder and G. A. Gibson, "A Large-scale Study of Failures in High Performance Computing Systems," Proc. of DSN'06, 2006.
22. A. Tikotekar, G. Vallee, T. Naughton, S. Scott, C. Leangsuksum, "Evaluation of Fault-Tolerant Policies Using Simulation," Proc. of IEEE Cluster'07, 2007
23. K. Trivedi and K. Vaidyanathan, "A Measurement-based Model for Estimation of Resource Exhaustion in Operational Software Systems," Proc. of ISSRE'99, 1999.
24. D. Vengerov, L. Mastroleon, D. Murphy, and N. Bambos, "Adaptive Data-Aware Utility-Based Scheduling in Resource-Constrained Systems," Research Disclosure, No.513, pp. 38-39, 2007.
25. R. Vilalta and S. Ma, "Predicting Rare Events in Temporal Domains," Proc. of ICDM'02, 2002.
26. G. Weiss and H.Hirsh, "Learning to Predict Rare Events in Eevent Sequences," Proc. of SIGKDD, 1998.
27. Y. Zhang, M. Squillante, A. Sivasubramaniam and R. Sahoo, "Performance Implications of Failures in Large-Scale Cluster Scheduling," Proc. of Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP'01), 2004.
28. Z. Zheng, Y. Li, and Z. Lan, "Anomaly Localization in Large-Scale Clusters," Proc. of IEEE Cluster'07, 2007.