Fail-in-Place Network Design: Interaction between Topology, Routing Algorithm and Failures

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn 2015-January, Issue January, 2014, Pages 597-608

  Domke, Jens ^a   Hoefler, Torsten ^b   Matsuoka, Satoshi ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b ETH ZURICH   (Switzerland)

Author keywords

availability; fail in place; fault tolerance; Network design; network management; network simulations; routing protocols

Indexed keywords

ALGORITHMS; AVAILABILITY; DESIGN; FAULT TOLERANCE; MICROPROCESSOR CHIPS; NETWORK COMPONENTS; NETWORK MANAGEMENT; ROUTING ALGORITHMS; ROUTING PROTOCOLS;

FAIL-IN-PLACE; HIGH PERFORMANCE COMPUTERS; IN-PLACE STRATEGY; MEAN TIME BETWEEN FAILURES; NETWORK DESIGN; NETWORK SIMULATION; PERFORMANCE DEGRADATION; SYSTEM DESIGNERS;

NETWORK ROUTING;

EID: 84936942406     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2014.54     Document Type: Conference Paper

References (43)

1. M. Banikazemi, J. Hafner, W. Belluomini, K. Rao, D. Poff, and B. Abali, "Flipstone: Managing Storage with Fail-in-place and Deferred Maintenance Service Models," SIGOPS Oper. Syst. Rev., vol. 42, no. 1, pp. 54-62, Jan. 2008.
2. Los Alamos National Laboratory, "Operational Data to Support and Enable Computer Science Research," Apr. 2014, https://institute.lanl. gov/data/fdata/.
3. Global Scientific Information and Computing Center, "Failure History of TSUBAME2.0 and TSUBAME2.5," Apr. 2014, http://mon.g.gsic.titech. ac.jp/trouble-list/index.htm.
4. B. Schroeder and G. A. Gibson, "A Large-Scale Study of Failures in High-Performance Computing Systems," in Proceedings of the International Conference on Dependable Systems and Networks, ser. DSN '06. Washington, DC, USA: IEEE Computer Society, 2006, pp. 249-258.
5. M. Kalyanakrishnam, Z. Kalbarczyk, and R. Iyer, "Failure Data Analysis of a LAN of Windows NT Based Computers," in Proceedings of the 18th IEEE Symposium on Reliable Distributed Systems, ser. SRDS '99. Washington, DC, USA: IEEE Computer Society, 1999, pp. 178-187.
6. D. Oppenheimer, A. Ganapathi, and D. A. Patterson, "Why do internet services fail, and what can be done about it?" in Proceedings of the 4th conference on USENIX Symposium on Internet Technologies and Systems - Volume 4, ser. USITS'03. Berkeley, CA, USA: USENIX Association, 2003, pp. 1-15.
7. L. J. Wilson, "Managing vendor relations: a case study of two HPC network issues," in Proceedings of the 24th international conference on Large installation system administration, ser. LISA'10. Berkeley, CA, USA: USENIX Association, 2010, pp. 1-13.
8. W. Nelson, Applied Life Data Analysis, ser. Wiley Series in Probability and Statistics. Wiley, 2004.
9. A. Verma, A. Srividya, and D. Karanki, Reliability and Safety Engineering, ser. Springer series in reliability engineering. Springer, 2010.
10. G. Wang and J. Chen, "On fault tolerance of 3-dimensional mesh networks," in Proceedings of the 7th International Symposium on Parallel Architectures, Algorithms and Networks, May 2004, pp. 149-154.
11. F. Petrini and M. Vanneschi, "k-ary n-trees: high performance networks for massively parallel architectures," in Proceedings of the 11th International Parallel Processing Symposium, Apr. 1997, pp. 87-93.
12. S. R. Öhring, M. Ibel, S. K. Das, and M. J. Kumar, "On generalized fat trees," in IPPS '95: Proceedings of the 9th International Symposium on Parallel Processing. Washington, DC, USA: IEEE Computer Society, 1995, p. 37.
13. J. Kim, W. J. Dally, S. Scott, and D. Abts, "Technology-Driven, Highly- Scalable Dragonfly Topology," in Proceedings of the 35th Annual International Symposium on Computer Architecture, ser. ISCA '08. Washington, DC, USA: IEEE Computer Society, 2008, pp. 77-88.
14. D. Li, X. Lu, and J. Su, "Graph-Theoretic Analysis of Kautz Topology and DHT Schemes," in NPC, 2004, pp. 308-315.
15. J. Xu, Topological Structure and Analysis of Interconnection Networks, 1st ed. Springer Publishing Company, Incorporated, 2010.
16. T. Rauber and G. Rünger, Parallel Programming: for Multicore and Cluster Systems. Springer, 2013.
17. L. Hsu and C. Lin, Graph Theory and Interconnection Networks. Taylor & Francis, 2008.
18. Mellanox OFED for Linux User Manual, Rev 2.0-3.0.0 ed., Mellanox Technologies, Sunnyvale, CA, USA, Oct. 2013.
19. E. Zahavi, G. Johnson, D. J. Kerbyson, and M. Lang, "Optimized InfiniBand fat-tree routing for shift all-to-all communication patterns," Concurr. Comput. : Pract. Exper., vol. 22, no. 2, pp. 217-231, Feb. 2010.
20. J. Domke, T. Hoefler, and W. E. Nagel, "Deadlock-Free Oblivious Routing for Arbitrary Topologies," in Proceedings of the 25th IEEE International Parallel & Distributed Processing Symposium (IPDPS). Washington, DC, USA: IEEE Computer Society, May 2011, pp. 613-624.
21. T. Hoefler, T. Schneider, and A. Lumsdaine, "Optimized Routing for Large-Scale InfiniBand Networks," in 17th Annual IEEE Symposium on High Performance Interconnects (HOTI 2009), Aug. 2009.
22. W. J. Dally and C. L. Seitz, "Deadlock-Free Message Routing in Multiprocessor Interconnection Networks," IEEE Trans. Comput., vol. 36, no. 5, pp. 547-553, 1987.
23. F. R. K. Chung, E. Coffman, Jr., M. Reiman, and B. Simon, "The forwarding index of communication networks," IEEE Trans. Inf. Theor., vol. 33, no. 2, pp. 224-232, Mar. 1987.
24. G. Hahn and G. Sabidussi, Graph Symmetry: Algebraic Methods and Applications, ser. NATO ASI series / C: NATO ASI series. Springer, 1997.
25. C. Croarkin, P. Tobias, J. J. Filliben, B. Hembree, W. Guthrie, L. Trutna, and J. Prins, Eds., NIST/SEMATECH e-Handbook of Statistical Methods. NIST/SEMATECH, Jan. 2014, http://www.itl.nist.gov/div898/handbook/.
26. A. Varga and R. Hornig, "An overview of the OMNeT++ simulation environment," in Simutools '08: Proceedings of the 1st international conference on Simulation tools and techniques for communications, networks and systems & workshops. ICST, Brussels, Belgium, Belgium: ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 2008, pp. 1-10.
27. E. G. Gran and S.-A. Reinemo, "InfiniBand congestion control: modelling and validation," in Proceedings of the 4th International ICST Conference on Simulation Tools and Techniques, ser. SIMUTools '11. ICST, Brussels, Belgium, Belgium: ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 2011, pp. 390-397.
28. D. Blake and W. Gore, "Effect of Passive and Active Copper Cable Interconnects on Latency of Infiniband DDR compliant systems," Sep. 2007, http://www.openfabrics.org/archives/2007infiniband/10 W.L. Gore&Associates.pdf.
29. B. Prisacari, G. Rodriguez, C. Minkenberg, and T. Hoefler, "Bandwidthoptimal all-to-all exchanges in fat tree networks," in Proceedings of the 27th international ACM conference on International conference on supercomputing, ser. ICS '13. New York, NY, USA: ACM, 2013, pp. 139-148.
30. G. Ho and C. Ramamoorthy, "Protocols for Deadlock Detection in Distributed Database Systems," IEEE Transactions on Software Engineering, vol. SE-8, no. 6, pp. 554-557, 1982.
31. J. Flich, T. Skeie, A. Mejia, O. Lysne, P. Lopez, A. Robles, J. Duato, M. Koibuchi, T. Rokicki, and J. C. Sancho, "A Survey and Evaluation of Topology-Agnostic Deterministic Routing Algorithms," IEEE Trans. Parallel Distrib. Syst., vol. 23, no. 3, pp. 405-425, Mar. 2012.
32. T. Hoefler, T. Schneider, and A. Lumsdaine, "Multistage Switches are not Crossbars: Effects of Static Routing in High-Performance Networks," in Proceedings of the 2008 IEEE International Conference on Cluster Computing. IEEE Computer Society, Oct. 2008.
33. I. Adams, G.B., D. Agrawal, and H. Siegel, "A Survey and Comparision of Fault-Tolerant Multistage Interconnection Networks," Computer, vol. 20, no. 6, pp. 14-27, 1987.
34. S. Sharma and P. K. Bansal, "A new fault tolerant multistage interconnection network," in TENCON '02. Proceedings. 2002 IEEE Region 10 Conference on Computers, Communications, Control and Power Engineering, vol. 1, 2002, pp. 347-350 vol.1.
35. E. Szlachcic, "Fault Tolerant Topological Design for Computer Networks," in International Conference on Dependability of Computer Systems. DepCos-RELCOMEX '06, 2006, pp. 150-159.
36. V. Liu, D. Halperin, A. Krishnamurthy, and T. Anderson, "F10: A Fault-tolerant Engineered Network," in Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation, ser. NSDI'13. Berkeley, CA, USA: USENIX Association, 2013, pp. 399- 412.
37. E. Okorafor and M. Lu, "Percolation routing in a three-dimensional multicomputer network topology using optical interconnection," J. Opt. Netw., vol. 4, no. 3, pp. 157-175, Mar 2005.
38. C. Fleiner, R. Garner, J. Hafner, K. K. Rao, D. Kenchammana-Hosekote, W. Wilcke, and J. Glider, "Reliability of modular meshconnected intelligent storage brick systems," IBM Journal of Research and Development, vol. 50, no. 2.3, pp. 199-208, 2006.
39. J. Duato, S. Yalamanchili, and N. Lionel, Interconnection Networks: An Engineering Approach. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 2002.
40. Y.-J. Suh, B. V. Dao, J. Duato, and S. Yalamanchili, "Software based fault-tolerant oblivious routing in pipelined networks," in Proc. of the 1995 International Conference on Parallel Processing. August 1995, I 101 - I, 1995, p. 105.
41. A. Ben Ahmed and A. Ben Abdallah, "Architecture and design of high-throughput, low-latency, and fault-tolerant routing algorithm for 3D-network-on-chip (3D-NoC)," The Journal of Supercomputing, vol. 66, no. 3, pp. 1507-1532, 2013.
42. K. L. Man, K. Yedluri, H. K. Kapoor, C.-U. Lei, E. G. Lim, and J. M, "Highly Resilient Minimal Path Routing Algorithm for Fault Tolerant Network-on-Chips," Procedia Engineering, vol. 15, no. 0, pp. 3406-3410, 2011.
43. A. Rezazadeh, M. Fathy, and G. Rahnavard, "Evaluating Throughput of a Wormhole-Switched Routing Algorithm in NoC with Faults," in International Conference on Network and Service Security, 2009. N2S '09., 2009, pp. 1-5.