Event log mining tool for large scale HPC systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6852 LNCS, Issue PART 1, 2011, Pages 52-64

  Gainaru, Ana ^a,c   Cappello, Franck ^a,b   Trausan Matu, Stefan ^c   Kramer, Bill ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b INRIA   (France)

^c UNIVERSITY POLITEHNICA OF BUCHAREST   (Romania)

Author keywords

[No Author keywords available]

Indexed keywords

CHANGING ENVIRONMENT; COMMON SOURCE; ERROR PRONES; FALSE POSITIVE; LARGE DATASETS; LARGE SIZES; LOG FILE; LOG MINING; NOVEL METHODOLOGY; OTHER ALGORITHMS; PRECISION AND RECALL; SYSTEM ADMINISTRATORS;

PARALLEL PROCESSING SYSTEMS;

CLUSTERING ALGORITHMS;

EID: 80052352428     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-23400-2_6     Document Type: Conference Paper

References (23)

1. Archive, F.T., http://fta.inria.fr (accessed on 2010)
2. Schroeder, G.G.B.: A large-scale study of failures in high-performance computing systems. In: IEEE DSN 2006, pp. 249-258 (June 2006)
3. Bookstein, A., all: Generalized hamming distance. Information Retrieval Journal 5(4), 353-375 (2002)
4. Chuah, E., et al.: Diagnosing the root-cause of failures from cluster log files (2010)
5. T. computer failure data repository, http://cfdr.usenix.org (accessed on 2010)
6. Fu, Q.: all. Execution anomaly detection in distributed systems through unstructured log analysis. In: ICDM, pp. 149-158 (December 2009)
7. Fu, S., Xu, C.-Z.: Exploring event correlation for failure prediction in coalitions of clusters. In: Proceedings of the ACM/IEEE Conference on Supercomputing (November 2007)
8. Han, J., et al.: Mining frequent patterns without candidate generation. In: ACM SIGMOD, pp. 1-12 (May 2000)
9. Lan, Z., all: Toward automated anomaly identification in large-scale systems. IEEE Trans. on Parallel and Distributed Systems 21(2), 174-187 (2010)
10. Makanju, A., et al: Clustering event logs using iterative partitioning. In: 15th ACM SIGKDD, pp. 1255-1264 (2009)
11. McCallum, A., all: Efficient clustering of high-dimensional data sets with application to reference matching. In: ACM SIGKDD, pp. 169-178 (August 2000)
12. Mitra, M., Chaudhuri, B.: Information retrieval from documents: A survey. Information Retrieval Journal 2(2-3), 141-163 (2000)
13. NCSA, http://www.ncsa.illinois.edu (accessed on 2010)
14. Pang, W., et al.: Mining logs files for data-driven system management. ACM SIGKDD 7, 44-51 (2005)
15. Park, Geist, A.: System log pre-processing to improve failure prediction. In: DSN 2009, pp. 572-577 (2009)
16. Salfner, F., et al.: A survey of online failure prediction methods. ACM Computing Surveys 42(3) (March 2010)
17. Stearley, J.: Towards informatic analysis of syslogs. In: IEEE Conference on Cluster Computing (September 2004)
18. Stearley, J.: Towards informatic analysis of syslogs. In: IEEE International Conference on Cluster Computing, vol. 5, pp. 309-318 (2004)
19. Vaarandi, R.: Mining event logs with slct and loghound. In: IEEE NOMS 2008, pp. 1071-1074 (April 2008)
20. Wei Peng, S.M., Li, T.: Mining logs files for data driven system management. ACM SIGKDD 7, 44-51 (2005)
21. Xue, Z., et al.: A survey on failure prediction of large-scale server clusters. In: ACIS SNPD 2007, pp. 733-738 (June 2007)
22. Zarza, G., et al.: Fault-tolerant routing for multiple permanent and non-permanent faults in hpc systems. In: PDPTA 2010 (July 2010)
23. Zhang, X., Furtlehner, C., Sebag, M.: Data streaming with affinity propagation. In: Daelemans, W., Goethals, B., Morik, K. (eds.) ECML PKDD 2008, Part II. LNCS (LNAI), vol. 5212, pp. 628-643. Springer, Heidelberg (2008)