Mining console logs for large-scale system problem detection

3rd Workshop on Tackling Computer Systems Problems with Machine Learning Techniques, SysML 2008

Volumn , Issue , 2008, Pages

  Xu, Wei ^a   Huang, Ling ^b   Fox, Armando ^a   Patterson, David ^a   Jordan, Michael ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b INTEL RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANOMALY DETECTION; DECISION TREES; LARGE SCALE SYSTEMS; MACHINE LEARNING; TEXT MINING;

ANOMALY-DETECTION ALGORITHMS; APPLICATION DEVELOPERS; DOMAIN EXPERTS; OPERATOR INTERVENTIONS; PROBLEM DETECTION; SOURCE CODE ANALYSIS; STRUCTURED INFORMATION; SYSTEM OPERATOR;

PROGRAM DEBUGGING;

EID: 77951439561     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Hadoop 0.18 api documentation. Hadoop web site.
2. Amazon.com. Amazon Elastic Compute Cloud Developer Guide, 2008.
3. D. Borthakur. The hadoop distributed file system: Architecture and design. Hadoop Project Website, 2007.
4. R. Dunia and S. J. Qin. Multi-dimensional fault diagnosis using a subspace approach. In Proceedings of ACC, 1997.
5. R. Feldman and J. Sanger. The Text Mining Handbook: Advanced Approaches in Analyzing Unstructured Data. Cambridge Univ. Press, 12 2006.
6. R. Fonseca, G. Porter, R. H. Katz, S. Shenker, and I. Stoica. Xtrace: A pervasive network tracing framework. In In Proceedings of NSDI, 2007.
7. C. Gulcu. Short introduction to log4j, March 2002. http://logging.apache.org/log4j.
8. J. Hellerstein, S. Ma, and C. Perng. Discovering actionable patterns in event data. IBM Systems Journal, 41(3), 2002.
9. J. E. Jackson and G. S. Mudholkar. Control procedures for residuals associated with principal component analysis. Technometrics, 21(3):341-349, 1979.
10. A. Lakhina, M. Crovella, and C. Diot. Diagnosing network-wide traffic anomalies. In Proceedings of ACM SIGCOMM, 2004.
11. C. Lim, N. Singh, and S. Yajnik. A log mining approach to failure analysis of enterprise telephony systems. In Proceedings of DSN, June 2008.
12. S. Ma and J. L. Hellerstein. Mining partially periodic event patterns with unknown periods. In Proceedings of IEEE ICDE, Washington, DC, 2001.
13. I. Mierswa, M. Wurst, R. Klinkenberg, M. Scholz, and T. Euler. Yale: Rapid prototyping for complex data mining tasks. In Proceedings of ACM KDD, New York, NY, 2006.
14. A. Oliner and J. Stearley. What supercomputers say: A study of five system logs. In Proceedings of IEEE DSN, Washington, DC, 2007.
15. J. E. Prewett. Analyzing cluster log files using logsurfer. In Proceedings of Annual Conf. on Linux Clusters, 2003.
16. J. Stearley. Towards informatic analysis of syslogs. In Proceedings of IEEE CLUSTER, Washington, DC, 2004.
17. R. Vaarandi. A data clustering algorithm for mining patterns from event logs. Proceedings of IPOM, 2003.
18. I. H. Witten and E. Frank. Data mining: practical machine learning tools and techniques with Java implementations. Morgan Kaufmann Publishers Inc., 2000.
19. K. Yamanishi and Y. Maruyama. Dynamic syslog mining for network failure monitoring. In Proceedings of ACM KDD, New York, NY, 2005.