Co-analysis of RAS log and job log on Blue Gene/P

Proceedings - 25th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2011

Volumn , Issue , 2011, Pages 840-851

  Zheng, Ziming ^a   Yu, Li ^a   Tang, Wei ^a   Lan, Zhiling ^a   Gupta, Rinku ^b   Desai, Narayan ^b   Coghlan, Susan ^b   Buettner, Daniel ^b  

^a Illinois Institute of Technology   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Blue Gene P; Co Analysis; Log Analysis; Reliability

Indexed keywords

BLUE GENE; CO-ANALYSIS; FAILURE CHARACTERISTICS; FAULT RESILIENCE; LOG ANALYSIS; PETASCALE; SYSTEM BEHAVIORS; SYSTEM SIZE;

COBALT COMPOUNDS; DISTRIBUTED PARAMETER NETWORKS; PARALLEL PROCESSING SYSTEMS; RELIABILITY; RELIABILITY ANALYSIS;

FAILURE ANALYSIS;

EID: 80053278089     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2011.83     Document Type: Conference Paper

References (30)

1. Blue Gene Team, "Overview of the IBM Blue Gene/P project,"IBM Journal of Research and Development, 2008.
2. Top500 supercomputing sites http://top500.org/.
3. R. Gupta, P. Beckman, B.-H. Park, E. Lusk, and P. Hargrove. CiFTS: A coordinated infrastructure for fault-tolerant systems. In Proc. of ICPP, 2009.
4. Y. Liang, Y. Zhang, H. Xiong, and R. Sahoo. An adaptive semantic filter for Blue Gene/L failure log analysis systems. Workshop on SMTPS, 2007.
5. A. Oliner, R. Sahoo, J. Moreira, M. Gupta, and A. Sivasubramaniam. Fault-aware job scheduling for Blue Gene/L systems. In Proc. of IPDPS, 2004.
6. Z. Zheng, R. Gupta, Z. Lan, and S. Coghlan. FTB-enabled failure prediction for Blue Gene/P systems. In Proc. of SuperComputing (research poster), 2009.
7. Z. Zheng, Z. Lan, B. Park, and A. Geist. System log pre-processing to improve failure prediction. In Proc. of DSN, 2009.
8. B. Schroeder and G. Gibson. A large-scale study of failures in high-performance computing systems. In Proc. of DSN, 2006.
9. A. Oliner and J. Stearly. What supercomputers say: A study of five system logs. In Proc. of DSN, 2007.
10. T. Hacker, F. Romero, and C. Carothers. An analysis of clustered failures on large supercomputing systems. Journal of Parallel and Distributed Computing, 69:652-665, 2009.
11. N. Taerat, N. Naksinehaboon, C. Chandler, J. Elliott, C. Leangsuksun, G. Ostrouchov, S. Scott, and C. Engelmann. Blue Gene/L log analysis and time to interrupt estimation. In Proc. of ARES, 2009.
12. Y. Liang, Y. Zhang, A. Sivasubramanium, R. Sahoo, J. Moreia, and M. Gupta. Filtering failure logs for a Blue Gene/L prototype. In Proc. of DSN, 2005.
13. J. Young. A first order approximation to the optimal checkpoint interval. Comm. ACM, 17(9): 530-531, 1974.
14. W. Tang, Z. Lan, N. Desai, and D. Buettner. Fault-aware utility-based job scheduling on Blue Gene/P systems. In Proc. of Cluster, 2009.
15. N. Desai, R. Bradshaw, C. Lueninghoener, A. Cherry, S. Coghlan, and W. Scullin. Petascale system management experiences. In Proc. of LISA, 2008.
16. M. Crowder, A. Kimber, T. Sweeting, and R. Smith. Statistical analysis of reliability data. London: Chapman and Hall, 1991.
17. R. Sahoo, A. Sivasubramanium, M. Squillante, and Y. Zhang. Failure data analysis of a large-scale heterogeneous server environment. In Proc. of DSN, 2004.
18. F. Petrini, K. Davis, and J. Sancho. System-level fault tolerance in largescale parallel machines with buffered coscheduling. In Proc. of IPDPS, 2004.
19. Z. Ziming and Z. Lan. Reliability-aware scalability models for high performance computing. In Proc. of Cluster, 2009.
20. N. DeBardeleben, J. Laros, J. Daly, S. Scott, C. Engelmann and B. Harrod. High-end computing resilience: Analysis of issues facing the HEC community and path-forward for research and development. Whitepaper, 2009.
21. W. Jones, J. Daly, and N. DeBardeleben. Impact of suboptimal checkpoint intervals on application efficiency in computational clusters. In Proc. of HPDC, 2010.
22. J. Xu, Z. Kallbarczyk, and R. Iyer. Networked Windows NT system field failure data analysis. Technical Report CRHC 9808, UIUC, 1999.
23. S. Fu and C. Xu Exploring event correlation for failure prediction in coalitions of clusters. In Proc. of Supercomputing, 2007.
24. W. Jiang, C. Hu, S. Pasupathy, A. Kanevsky, Z. Li, and Y. Zhou. Understanding customer problem troubleshooting from storage system logs. In Proc. of FAST, 2009.
25. W. Xu, L. Huang, A. Fox, D. Patterson, and M. Jordan. Detecting large-scale system problems by mining console logs. In SOSP, 2009.
26. H. Liu and L. Yu. Toward Integrating Feature Selection Algorithms for Classification and Clustering. IEEE Trans. on Knowledge and Data Engineering, 17(4):491-502, 2005. (Pubitemid 40495592)
27. B. Schroeder and G. Gibson. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you? In Proc. of FAST, 2007.
28. Parallel Workloads Archive. http://www.cs.huji.ac.il/labs/parallel/ workload/.
29. USENIX Computer Failure Data Repository. http://cfdr.usenix.org/.
30. N. Gottumukkala, R. Nassar, M. Paun, and C. Leangsuksun. Reliability of a System of k Nodes for High Performance Computing Applications. IEEE Trans. on Reliability, 59(1):142-169, 2010.