Improving Log-based Field Failure Data Analysis of multi-node computing systems

Proceedings of the International Conference on Dependable Systems and Networks

Volumn , Issue , 2011, Pages 97-108

  Pecchia, Antonio ^a   Cotroneo, Domenico ^a   Kalbarczyk, Zbigniew ^b   Iyer, Ravishankar K ^b  

^a UNIVERSITY OF NAPLES FEDERICO II   (Italy)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

collision; dependability measurements; Field Failure Data Analysis; supercomputer; tuple heuristic

Indexed keywords

COLLISION; COMPUTING SYSTEM; DEPENDABILITY MEASUREMENTS; FIELD FAILURE DATA; NATIONAL CENTER FOR SUPERCOMPUTING APPLICATIONS; OPERATIONAL SYSTEMS; STATISTICAL INDICATORS; TUPLE HEURISTIC;

DATA REDUCTION; MERCURY (METAL); SUPERCOMPUTERS;

FAILURE ANALYSIS;

EID: 80051915968     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DSN.2011.5958210     Document Type: Conference Paper

References (26)

1. S. Brin, R. Motwani, J. D. Ullman, and S. Tsur. Dynamic itemset counting and implication rules for market basket data. pages 255-264. ACM Press, 1997.
2. M. Buckley, D. Siewiorek, I. Center, and Y. Heights. A Comparative Analysis of Event Tupling Schemes. In Proc. Of Annual Symp. on Fault-Tolerant Computing, pages 294-303, 1996.
3. M. Cinque, D. Cotroneo, and S. Russo. Collecting and analyzing failure data of bluetooth personal area networks. In Proc. Intl. Conf. on Dependable Systems and Networks, Philadelphia, Pennsylvania, USA, June 2006.
4. S. Fu and C.-Z. Xu. Quantifying temporal and spatial correlation of failure events for proactive management. In Reliable Distributed Systems, 2007. SRDS 2007. 26th IEEE International Symposium on, pages 175-184, 2007.
5. J. Gray. A census of tandem system availability. In IEEE Transactions on Reliability, pages 40-9, 1990.
6. J. P. Hansen and D. P. Siewiorek. Models for time coalescence in event logs. In Proc. of Intl. Symp. on Fault-Tolerant Computing, pages 221-227, 1992.
7. T. Heath, R. P. Martin, and T. D. Nguyen. Improving cluster availability using workstation validation. In In Proc. of ACM SIGMETRICS, 2002.
8. R. Iyer, L. Young, and P. Iyer. Automatic recognition of intermittent failures: An experimental study of field data. IEEE Transactions on Computers, 39:525-537, 1990. (Pubitemid 20702262)
9. R. K. Iyer, D. J. Rossetti, and M. C. Hsueh. Measurement and modeling of computer reliability as affected by system activity. ACM Trans. Comput. Syst., 4:214-237, August 1986.
10. R. K. Iyer, L. T. Young, and V. Sridhar. Recognition of error symptoms in large systems. In Proceedings of 1986 ACM Fall joint computer conference, ACM '86, pages 797-806, Los Alamitos, CA, USA, 1986. IEEE Computer Society Press. (Pubitemid 17537011)
11. M. Kalyanakrishnam, Z. Kalbarczyk, and R. K. Iyer. Failure data analysis of a LAN of windows NT based computers. In Proc. of Symp. on Reliable Distributed Systems, 1999.
12. J.-C. Laplace and M. Brun. Critical Software for Nuclear Reactors: 11 Years of Field Experience Analysis. In Proc. Of the 9th Intl. Symp. on Software Reliability Engineering, 1999.
13. Y. Liang, Y. Zhang, A. Sivasubramaniam, M. Jette, and R. K. Sahoo. Bluegene/L failure analysis and prediction models. In Proc. Intl. Conf. on Dependable Systems and Networks, Philadelphia, Pennsylvania, USA, 2006.
14. C. Lim, N. Singh, and S. Yajnik. A Log Mining Approach to Failure Analysis of Enterprise Telephony Systems. In Proc. Intl. Conf. on Dependable Systems and Networks, June 2008.
15. B. Murphy and B. Levidow. Windows 2000 Dependability. MSR-TR-2000-56, Microsoft Research, Microsoft Corporation, Redmond, WA, June 2000.
16. A. J. Oliner and J. Stearley. What supercomputers say: A study of five system logs. In Proc. Intl. Conf. on Dependable Systems and Networks, pages 575-584. IEEE Computer Society, 2007. (Pubitemid 350080462)
17. D. L. Oppenheimer, A. Ganapathi, and D. A. Patterson. Why do internet services fail, and what can be done about it? In USENIX Symp. on Internet Technologies and Systems, 2003.
18. R. K. Sahoo, A. J. Oliner, I. Rish, M. Gupta, J. E. Moreira, S. Ma, R. Vilalta, and A. Sivasubramaniam. Critical event prediction for proactive management in large-scale computer clusters. In Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '03, pages 426-435, New York, NY, USA, 2003. ACM.
19. R. K. Sahoo, A. Sivasubramaniam, M. S. Squillante, and Y. Zhang. Failure Data Analysis of a Large-Scale Heterogeneous Server Environment. In Proc. Intl. Conf. on Dependable Systems and Networks, Florence, Italy, 2004.
20. B. Schroeder and G. A. Gibson. A large-scale study of failures in high-performance computing systems. In Proc. Intl. Conf. on Dependable Systems and Networks, 2006.
21. C. Simache and M. Kaâniche. Availability assessment of sunOS/solaris unix systems based on syslogd and wtmpx log files: A case study. In PRDC, pages 49-56. IEEE Computer Society, 2005.
22. D. Tang, M. Hecht, J. Miller, and J. Handal. Meadep: A dependability evaluation tool for engineers. IEEE Transactions on Reliability, 47(4):443-450, 1998.
23. D. Tang and R. Iyer. Impact of correlated failures on dependability in a vaxcluster system. In Proc. of the IFIP Working Conference on Dependable Computing for Critical Applications, 1991.
24. A. Thakur and R. K. Iyer. Analyze-NOW-An Environment for Collection and Analysis of Failures in a Networked of Workstations. IEEE Transactions on Reliability, pages Vol. 45, no. 4,560-570, 1996.
25. W. Xu, L. Huang, A. Fox, D. Patterson, and M. Jordan. Detecting Large-Scale System Problems by Mining Console Logs. In Proceedings of the ACM SIGOPS 22nd symposium on Operating Systems Principles (SOSP), 2009.
26. Z. Zheng, Z. Lan, B. Park, and A. Geist. System log preprocessing to improve failure prediction. In International Conference on Dependable Systems and Networks, 2009.