Storage and retrieval of system log events using a structured schema based on message type transformation

Proceedings of the ACM Symposium on Applied Computing

Volumn , Issue , 2011, Pages 528-533

  Makanju, Adetokunbo ^a   Zincir Heywood, A Nur ^a   Milios, Evangelos E ^a  

^a DALHOUSIE UNIVERSITY   (Canada)

Author keywords

data storage; event log management; event log mining; network control and management; retrieval; systems administration

Indexed keywords

DATA STORAGE; LOG MANAGEMENTS; LOG MINING; NETWORK CONTROL AND MANAGEMENT; RETRIEVAL;

METADATA; SEMANTICS;

NETWORK MANAGEMENT;

EID: 79959315543     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1982185.1982298     Document Type: Conference Paper

References (16)

1. Usenix - the computer failure data repository. Last Accessed June 2009.
2. M. Aharon, G. Barash, I. Cohen, and E. Mordechai. One Graph Is Worth a Thousand Logs: Uncovering Hidden Structures in Massive System Event Logs. Lecture Notes in Computer Science, 5781/2009:227-243, 2009.
3. C. Lonvick. The BSD Syslog Protocol. RFC3164, August 2001.
4. A. Makanju, S. Brooks, N. Zincir-Heywood, and E. E. Milios. Logview: Visualizing Event Log Clusters. In Proceedings of Sixth Annual Conference on Privacy, Security and Trust. PST 2008, pages 99-108, October 2008.
5. A. Makanju, A. N. Zincir-Heywood, and E. E. Milios. Clustering Event Logs Using Iterative Partitioning. In Proceedings of the 15th ACM Conference on Knowledge Discovery in Data., pages 1255-1264, July 2009.
6. A. Makanju, A. N. Zincir-Heywood, and E. E. Milios. Extracting Message Types from BlueGene/L's Logs. In Proceedings of the SOSP Workshop on the Analysis of System Logs (WASL), October 2009.
7. A. Makanju, A. N. Zincir-Heywood, and E. E. Milios. Fast Entropy Based Alert Detection in Supercomputer Logs. In Proceedings of the DSN Workshop on Proactive Failure Avoidance, Recovery and Maintenance (PFARM)., June 2010.
8. A. Makanju, N. Zincir-Heywood, and E. E. Milios. Message type extraction based alert detection in system logs. Technical Report CS-2009-08, Dalhousie University, March 2009.
9. A. Oliner, A. Aiken, and J. Stearley. Alert Detection in System Logs. In Proceedings of the International Conference on Data Mining (ICDM). Pisa, Italy., pages 959-964, Los Alamitos, CA, USA, 2008. IEEE Computer Society.
10. A. Oliner and J. Stearley. What Supercomputers say: A Study of Five System Logs. In 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, 2007 (DSN '07)., pages 575-584, June 2007.
11. B. Schneiderman. Tree Visualization with Tree-Maps: A 2-D space filling approach. In ACM Transactions on Graphics., volume 2, pages 92-99, 1992.
12. Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, and Richard Harshman. Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science, 41(6):391-407, 1990.
13. J. Stearley. Towards Informatic Analysis of Syslogs. In Proceedings of the 2004 IEEE International Conference on Cluster Computing, pages 309-318, 2004.
14. R. Vaarandi. A Data Clustering Algorithm for Mining Patterns from Event Logs. In Proceedings of the 2003 IEEE Workshop on IP Operations and Management (IPOM), pages 119-126, 2003.
15. R. Vaarandi. Mining Event Logs with SLCT and Loghound. In Proceedings of the 2008 IEEE/IFIP Network Operations and Management Symposium, pages 1071-1074, April 2008.
16. W. Xu, L. Huang, A. Fox, D. Patterson, and M. I. Jordan. Detecting large-scale system problems by mining console logs. In SOSP '09: Proceedings of the ACM SIGOPS 22nd Symposium on Operating systems principles, pages 117-132, New York, NY, USA, 2009. ACM.