LogTree: A framework for generating system events from raw textual logs

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2010, Pages 491-500

  Tang, Liang ^a   Li, Tao ^a  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

Author keywords

Event creation; Log analysis; Message clustering;

Indexed keywords

CLUSTERING PROCESS; CLUSTERING TECHNIQUES; COMPLEX SYSTEMS; COMPUTING SYSTEM; EVENT CREATION; GENERATING SYSTEM; LOG ANALYSIS; MESSAGE CLUSTERING; REAL SYSTEMS; STRUCTURAL INFORMATION;

CLUSTERING ALGORITHMS; DATA MINING; DATA STRUCTURES;

CLUSTER ANALYSIS;

EID: 79951729098     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2010.76     Document Type: Conference Paper

References (22)

1. W. Peng, C. Perng, T. Li, and H. Wang, "Event summarization for system management," in Proceedings of ACM KDD, San Jose, California, USA, August 2007, pp. 1028-1032. (Pubitemid 350229290)
2. W. Xu, L. Huang, A. Fox, D. A. Patterson, and M. I. Jordan, "Mining console logs for large-scale system problem detection," in SysML, San Diego, CA, USA, December 2008.
3. J. L. Hellerstein, S. Ma, and C.-S. Perng, "Discovering actionable patterns in event data," IBM Systems Journal, vol. 43, no. 3, pp. 475-493, 2002.
4. J. Stearley, "Towards informatic analysis of syslogs," in Proceedings of IEEE International Conference on Cluster Computing, San Diego, California, USA, September 2004, pp. 309-318. (Pubitemid 40822381)
5. T. Li, F. Liang, S. Ma, and W. Peng, "An integrated framework on mining logs files for computing system management," in Proceedings of ACM KDD, Chicago, Illinois, USA, August 2005, pp. 776-781. (Pubitemid 43218354)
6. J. Gao, G. Jiang, H. Chen, and J. Han, "Modeling probabilistic measurement correlations for problem determination in large-scale distributed systems," in Proceedings of the 29th International Conference on Distributed Computing Systems (ICDCS'09), 2009, pp. 623-630.
7. "PVFS2: The state-of-the-art parallel I/O and high performance virtual file system," http://pvfs.org.
8. M. Aharon, G. Barash, I. Cohen, and E. Mordechai, "One graph is worth a thousand logs: Uncovering hidden structures in massive system event logs," in Proceedings of ECML/PKDD, Bled, Slovenia, September 2009, pp. 227-243.
9. "FileZilla: An open-source and free FTP/SFTP solution," http://filezilla-project.org.
10. J. O. Kephart and D. M. Chess, "The vision of autonomic computing," IEEE Computer, vol. 36, no. 1, pp. 41-50, 2003.
11. A. Makanju, A. N. Zincir-Heywood, and E. E. Milios, "Clustering event logs using iterative partitioning," in Proceedings of ACM KDD, Paris, France, June 2009, pp. 1255-1264.
12. G. Salton and M. McGill, Introduction to Modern Information Retrieval. McGraw-Hill, 1984.
13. P.-N. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining. Addison Wesley, 2005.
14. "MySQL: The world's most popular open source database," http://www.mysql.com.
15. C. D. Manning and H. Schuetze, Foundations of Statistical Natural Language Processing. MIT Press, 1999.
16. K. Fisher, D. Walker, and K. Q. Zhu, "Incremental learning of system log formats," SIGOPS Oper. Syst. Rev., vol. 44, no. 1, pp. 85-90, 2010.
17. K. Zhang and D. Shasha, "Simple fast algorithms for the editing distance between trees and related problems," SIAM Journal on Computing, vol. 18, no. 6, pp. 1245-1262, 1989. (Pubitemid 20613578)
18. T. Dalamagas, T. Cheng, K.-J. Winkel, and T. K. Sellis, "Clustering xml documents using structural summaries," in Proceedings of EDBT Workshops, Heraklion, Crete, Greece, March 2004, pp. 547-556. (Pubitemid 39750586)
19. "Apache HTTP Server: An Open-Source HTTP Web Server," http://www.apache.org.
20. A. Moschitti, "Making tree kernels practical for natural language learning," in Proceedings of EACL, Trento, Italy, April 2006.
21. A. Culotta and J. S. Sorensen, "Dependency tree kernels for relation extraction," in Proceedings of ACL, Barcelona, Spain, July 2004, pp. 423-429.
22. J. Han, M. Kamber, and J. Pei, Data Mining: Concepts and Techniques, 2ed. Morgan Kaufmann, 2005.