One size does not fit all: Clustering supercomputer failures using a multiple time window approach

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7905 LNCS, Issue , 2013, Pages 302-316

  Di Martino, Catello ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING PROCESS; COMPLEX FAILURE; ERROR EVENTS; LARGE COMPUTING SYSTEMS; LARGE SYSTEM; MULTIPLE TIME WINDOWS; SYNTHETIC DATASETS; TIME WINDOWS;

CLUSTERING ALGORITHMS; SUPERCOMPUTERS;

VEHICLE ROUTING;

EID: 84884479401     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-38750-0_23     Document Type: Conference Paper

References (24)

1. Guermouche, A., Ropars, T., Snir, M., Cappello, F.: Hydee: Failure containment without event logging for large scale send-deterministic mpi applications. In: 2012 IEEE 26th International on Parallel Distributed Processing Symposium (IPDPS), pp. 1216-1227 (May 2012)
2. Fu, S., Xu, C.: Exploring event correlation for failure prediction in coalitions of clusters. In: SC 2007: Proc. of the 2007 ACM/IEEE Conference on Supercomputing, pp. 1-12. ACM (2007)
3. Gainaru, A., Cappello, F., Snir, M., Kramer, W.: Fault prediction under the microscope: a closer look into hpc systems. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC 2012, pp. 77:1-77:11. IEEE Computer Society Press, Los Alamitos (2012)
4. Di Martino, C., Cinque, M., Cotroneo, D.: Assessing time coalescence techniques for the analysis of supercomputer logs. In: IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2012), pp. 1-12 (2012)
5. Buckley, M.F., Siewiorek, D.P.: A comparative analysis of event tupling schemes. In: FTCS 1996: Proc. of the The Twenty-Sixth Annual Int. Symp. on Fault-Tolerant Computing (FTCS 1996), p. 294. IEEE Computer Society, Washington, DC (1996)
6. Liang, Y., Zhang, Y., Sivasubramaniam, A., Jette, M., Sahoo, R.: Bluegene/l failure analysis and prediction models. In: Int. Conference on Dependable Systems and Networks, DSN 2006, pp. 425-434 (2006)
7. Hansen, J., Siewiorek, D.: Models for time coalescence in event logs. In: Twenty-Second Int. Symp. on Fault-Tolerant Computing, FTCS-22, Digest of Papers, pp. 221-227 (July 1992)
8. Oliner, A., Stearley, J.: What supercomputers say: A study of five system logs. In: 37th Annual IEEE/IFIP Int. Conference on Dependable Systems and Networks, DSN 2007, pp. 575-584 (June 2007)
9. Sahoo, R.K., Sivasubramaniam, A., Squillante, M.S., Zhang, Y.: Failure data analysis of a large-scale heterogeneous server environment. In: DSN 2004: Proc. of the 2004 Int. Conference on Dependable Systems and Networks, p. 772. IEEE Computer Society, Washington, DC (2004)
10. Liang, Y., Sivasubramaniam, A., Moreira, J.: Filtering failure logs for a bluegene/l prototype. In: DSN 2005: Proc. of the 2005 Int. Conference on Dependable Systems and Networks, pp. 476-485. IEEE Computer Society, Washington, DC (2005)
11. Simache, C., Kaâniche, M., Saidane, A.: Event log based dependability analysis of windows nt and 2k systems. In: PRDC 2002: Proc. of the 2002 Pacific Rim Int. Symp. on Dependable Computing, p. 311. IEEE Computer Society, Washington, DC (2002)
12. Casola, V., Cuomo, A., Rak, M., Villano, U.: Security and performance trade-off in perfcloud. In: Guarracino, M.R., Vivien, F., Träff, J.L., Cannatoro, M., Danelutto, M., Hast, A., Perla, F., Knüpfer, A., Di Martino, B., Alexander, M. (eds.) Euro- Par-Workshop 2010. LNCS, vol. 6586, pp. 633-640. Springer, Heidelberg (2011)
13. Palmieri, F., Pardi, S., Veronesi, P.: A fault avoidance strategy improving the reliability of the EGI production grid infrastructure. In: Lu, C., Masuzawa, T., Mosbah, M. (eds.) OPODIS 2010. LNCS, vol. 6490, pp. 159-172. Springer, Heidelberg (2010)
14. Barone, G.B., Boccia, V., Bottalico, D., Carracciuolo, L., Doria, A., Laccetti, G.: Modelling the behaviour of an adaptive scheduling controller. In: 2012 Sixth International Conference on Complex, Intelligent and Software Intensive Systems (CISIS), pp. 438-442 (2012)
15. Tsao, M.M., Siewiorek, D.P.: Trend analysis on system error files. In: Thirteenth Annual International Symposium on Fault-Tolerant Computing, pp. 116-119 (July 1983)
16. Di Martino, C., Cotroneo, D., Kalbarczyk, Z., Iyer, R.K.: A framework for assessing the dependability of supercomputers via automated log analysis. In: DSN 2008: Sup. Volume of Proc. of the Int. Conference on Dependable Systems and Networks, Anchorage, AK, pp. 383-384 (2008)
17. Pecchia, A., Cotroneo, D., Kalbarczyk, Z., Iyer, R.K.: Improving log-based field failure data analysis of multi-node computing systems. In: 2011 IEEE/IFIP 41st International Conference on Dependable Systems Networks (DSN), pp. 97-108 (June 2011)
18. Thakur, A., Iyer, R.K.: Analyze-now-an environment for collection and analysis of failures in a network of workstations. IEEE Transactions on Reliability 45(4), 561-570 (1996)
19. Kalyanakrishnam, M., Kalbarczyk, Z., Iyer, R.: Failure data analysis of a lan of windows nt based computers. In: Proc. of the 18th IEEE Symp. on Reliable Distributed Systems, pp. 178-187 (1999)
20. Stearley, J., Oliner, A.J.: Bad words: Finding faults in spirit's syslogs. In: 8th IEEE International Symposium on Cluster Computing and the Grid, CCGRID 2008, pp. 765-770 (May 2008)
21. Vaarandi, R.: Mining event logs with slct and loghound. In: IEEE Network Operations and Management Symposium, NOMS 2008, pp. 1071-1074 (April 2008)
22. Zheng, Z., Lan, Z., Park, B., Geist, A.: System log pre-processing to improve failure prediction. In: IEEE/IFIP International Conference on Dependable Systems Networks, DSN 2009, June 29-July 2, pp. 572-577 (2009)
23. Lal, R., Choi, G.: Error and failure analysis of a unix server. In: Proc. Third IEEE Int High-Assurance Systems Engineering Symp., pp. 232-239 (November 1998)
24. Cinque, M., Cotroneo, D., Kalbarczyk, Z., Iyer, R.K.: How do mobile phones fail? a failure data analysis of symbian os smart phones. In: Proceedings of the 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2007, pp. 585-594. IEEE Computer Society, Washington, DC (2007)