GAUL: Gestalt analysis of unstructured logs for diagnosing recurring problems in large enterprise storage systems

Proceedings of the IEEE Symposium on Reliable Distributed Systems

Volumn , Issue , 2010, Pages 148-159

  Zhou, Pin ^a   Gill, Binny ^a   Belluomini, Wendy ^a   Wildani, Avani ^b  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Fuzzy match; Index; Problem diagnosis; Search; Whole log comparison

Indexed keywords

FUZZY MATCH; INDEX; PROBLEM DIAGNOSIS; SEARCH; WHOLE LOG COMPARISON;

EID: 78650558227     PISSN: 10609857     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SRDS.2010.25     Document Type: Conference Paper

References (19)

1. S. Duan and S. Babu, "Guided problem diagnosis through active learning," International Conference on Autonomic Computing (ICAC), pp. 45-54, 2008.
2. G. Banga, "Auto-diagnosis of field problems in an appliance operating system," in Proceedings of 2010 USENIX Annual Technical Conference (USENIX), 2000, pp. 24-24.
3. H. Huang, Y. Ruan, R. Sahoo, S. Sahu, and A. Shaikh, "PDA: a tool for automated problem determination," in the 21st Large Installation System Administration Conference, 2007.
4. W. Jiang, C. Hu, S. Pasupathy, A. Kanevsky, Z. Li, and Y. Zhou, "Understanding Customer Problem Troubleshooting from Storage System Logs," in Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST), 2009.
5. I. Cohen, S. Zhang, M. Goldszmidt, J. Symons, T. Kelly, and A. Fox, "Capturing, indexing, clustering, and retrieving system history," in Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP), 2005, pp. 105-118.
6. Y. Liang, Y. Zhang, H. Xiong, and R. Sahoo, "Failure prediction in ibm bluegene/l event logs," in the 7th IEEE International Conference on Data Mining (ICDM), 2007, pp. 583-588.
7. K. Yamanishi and Y. Maruyama, "Dynamic syslog mining for network failure monitoring," in Proceedings of the eleventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2005, pp. 499-508.
8. Z. Zheng, Z. Lan, B. Park, and A. Geist, "System log preprocessing to improve failure prediction," in Proceedings of the 39th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2009.
9. N. E. Roddy and A. Varma, "System and method for processing a new diagnostics case relative to historical case data and determining a ranking for possible repairs, US patent 7206965," 1997.
10. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. Sahoo, "Bluegene/l failure analysis and prediction models," in Proceedings of the International Conference on Dependable Systems and Networks (DSN), 2006.
11. J. Lin, "Brute force and indexed approaches to pairwise document similarity comparisons with mapreduce," in Proceedings of the 32nd Annual ACM SIGIR Conferenc (SIGIR), 2009. [Online]. Available: http://dx.doi.org/10. 1145/1571941.1571970
12. V. N. Anh, O. de Kretser, and A. Moffat, "Vector-space ranking with effective early termination," in Proceedings of the 24th Annual ACM SIGIR Conferenc (SIGIR), 2001, pp. 35-42.
13. A. Moffat and J. Zobel, "Self-indexing inverted files for fast text retrieval," ACM Transactions on Information Systems, 1996.
14. S. Brin and L. Page, "The anatomy of a large-scale hypertextual web search engine," Computer Networks and ISDN Systems, vol. 30, no. 1-7, pp. 107-117, 1998.
15. E. Hatcher and O. Gospodnetic, "Lucene in action," Action series. Manning Publications Co., Greenwich, CT, 2004.
16. L. Jing, H. Huang, and H. Shi, "Improved feature selection approach TFIDF in text mining," in International Conference on Machine Learning and Cybernetics, 2002.
17. S. Kavulya, R. Gandhi, and P. Narasimhan, "Gumshoe: Diagnosing performance problems in replicated filesystems," in the 27th International Symposium on Reliable Distributed Systems (SRDS), 2008.
18. D. Banerjee, V. Madduri, and M. Srivatsa, "A framework for distributed monitoring and root cause analysis for large ip networks," in the 28th International Symposium on Reliable Distributed Systems (SRDS), 2009.
19. M. Aguilera, J. Mogul, J. Wiener, P. Reynolds, and A. Muthitacharoen, "Performance debugging for distributed systems of black boxes," in Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP), 2003, pp. 74-89.