The impact of network noise at large-scale communication performance

IPDPS 2009 - Proceedings of the 2009 IEEE International Parallel and Distributed Processing Symposium

Volumn , Issue , 2009, Pages

  Hoefler, Torsten ^a   Schneider, Timo ^a   Lumsdaine, Andrew ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION PERFORMANCE; LARGE-SCALE APPLICATIONS; NETWORK NOISE; OPERATING SYSTEM NOISE; PARALLEL APPLICATION; PARALLEL PROCESS; REDUCTION OPERATION; SHARED USE; SYSTEM SIZE;

BENCHMARKING; COMPUTER OPERATING SYSTEMS; DISTRIBUTED PARAMETER NETWORKS; EXPERIMENTS;

COMPUTER SIMULATION;

EID: 70449975307     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2009.5161095     Document Type: Conference Paper

References (30)

1. S. Agarwal, R. Garg, and N. Vishnoi, "The Impact of Noise on the Scaling of Collectives: A Theoretical Approach," in 12th Annual IEEE International Conference on High Performance Computing, Dec. 2005.
2. K. B. Ferreira, P. Bridges, and R. Brightwell, "Characterizing application sensitivity to OS interference using kernellevel noise injection," in SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing. Piscataway, NJ, USA: IEEE Press, 2008, pp. 1-12.
3. R. Garg and P. De, "Impact of Noise on Scaling of Collectives: An Empirical Evaluation," in HiPC 2006, 13th International Conference, ser. LNCS, Y. Robert et al., Eds., vol. 4297. Springer, 2006, pp. 460-471.
4. K. Iskra, P. Beckman, K. Yoshii, and S. Coghlan, "The Influence of Operating Systems on the Performance of Collective Operations at Extreme Scale." in Proceedings of Cluster Computing IEEE International Conference, 2006.
5. A. Nataraj et al., "The ghost in the machine: observing the effects of kernel operation on parallel application performance," in SC '07: Proceedings of the 2007 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM, 2007, pp. 1-12.
6. F. Petrini, D. J. Kerbyson, and S. Pakin, "The Case of the Missing Supercomputer Performance: Achieving Optimal Performance on the 8,192 Processors of ASCI Q." in Proceedings of the ACM/IEEE SC2003 Conference. ACM, 2003, p. 55.
7. S. M. Kelly and R. Brightwell, "Software architecture of the light weight kernel, Catamount," in Cray User Group Annual Technical Conference, May 2005.
8. J. E. Moreira et al., "Blue Gene/L programming and operating environment." IBM Journal of Research and Development, vol. 49, no. 2-3, pp. 367-376, 2005.
9. M. J. Sottile, "A measurement and simulation methodology for parallel computing performance studies," Ph.D. dissertation, Albuquerque, NM, USA, 2006.
10. M. Sottile and R. Minnich, "Analysis of microbenchmarks for performance tuning of clusters," in CLUSTER '04: Proceedings of the 2004 IEEE International Conference on Cluster Computing. Washington, DC, USA: IEEE Computer Society, 2004, pp. 371-377.
11. A. Braccini, A. Del Bimbo, and E. Vicario, "Interprocess communication dependency on network load," Software Engineering, IEEE Transactions on, vol. 17, no. 4, pp. 357-369, 1991.
12. D. J. Kerbyson, "A Look at Application Performance Sensitivity to the Bandwidth and Latency of Infiniband Networks," in in Proc. of Workshop on Communication Architectures for Clusters (CAC), IEEE/ACM Int. Parallel and Distibuted Processing Symposium (IPDPS), Rhodes, Greece, March 2006.
13. R. M. Badia, J. Labarta, and J. Gimenez, "DIMEMAS: Predicting MPI applications behavior in Grid environments." in Workshop on Grid Applications and Programming Tools (GGF '03), 2003.
14. M. J. Sottile, V. P. Chandu, and D. A. Bader, "Performance analysis of parallel programs via message-passing graph traversal," in 20th International Parallel and Distributed Processing Symposium, Proceedings, Rhodes Island, Greece. IEEE, 2006.
15. R. Mraz, "Reducing the variance of point to point transfers in the ibm 9076 parallel computer," in Supercomputing '94: Proceedings of the 1994 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM, 1994, pp. 620-629.
16. T. Hoefler, T. Schneider, and A. Lumsdaine, "Multistage Switches are not Crossbars: Effects of Static Routing in High-Performance Networks," in Proceedings of the IEEE International Conference on Cluster Computing. IEEE Computer Society, Oct. 2008.
17. K. Bryan, "A numerical method for the study of the circulation of the world ocean," J. Comput. Phys., vol. 135, no. 2, pp. 154-169, 1997.
18. E. S. Hertel et al., "CTH: A Software Family for Multi- Dimensional Shock Physics Analysis," in in Proceedings of the 19th International Symposium on Shock Waves, held at, 1993, pp. 377-382.
19. D. J. Kerbyson et al., "Predictive performance and scalability modeling of a large-scale application," in Supercomputing '01: Proceedings of the ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM, 2001, pp. 37-37.
20. R. Rabenseifner, "Automatic MPI Counter Profiling," in Proceedings of 42nd CUG Conference, 2000.
21. W. Gropp and E. L. Lusk, "Reproducible Measurements of MPI Performance Characteristics," in Proceedings of the 6th European PVM/MPI Users' Group Meeting. London, UK: Springer-Verlag, 1999, pp. 11-18.
22. T. Hoefler, T. Schneider, and A. Lumsdaine, "Accurately Measuring Collective Operations at Massive Scale," in Proceedings of the 22nd IEEE International Parallel & Distributed Processing Symposium (IPDPS), Apr. 2008.
23. T. Hoefler, T. Mehlan, A. Lumsdaine, and W. Rehm, "Netgauge: A Network Performance Measurement Framework," in High Performance Computing and Communications, HPCC 2007, Houston, USA, Proceedings, vol. 4782. Springer, Sep. 2007, pp. 659-671.
24. J. Emerson and H. Strenio, "Box-plots and batch comparison. Understanding Robust and Exploratory Data Analysis," 1983.
25. A. D. Malony and S. S. Shende, "Overhead compensation in performance profiling," in In Proceedings of the European Conference on Parallel Processing (Euro-Par). Springer-Verlag, 2004, pp. 119-132.
26. F. Wolf, A. Malony, S. Shende, and A. Morris, "Trace-Based Parallel Performance Overhead Compensation," in In Proc. of the International Conference on High Performance Computing and Communications, September 2005.
27. C. E. Leiserson, "Fat-trees: universal networks for hardwareefficient supercomputing," IEEE Trans. Comput., vol. 34, no. 10, pp. 892-901, 1985.
28. T. Schneider and T. Hoefler, "ORCS: An Oblivious Routing Congestion Simulator," Indiana University, Computer Science Department, Tech. Rep., February 2009.
29. S. R. Öhring, M. Ibel, S. K. Das, and M. J. Kumar, "On generalized fat trees," in IPPS '95: Proceedings of the 9th International Symposium on Parallel Processing. Washington, DC, USA: IEEE Computer Society, 1995, p. 37.
30. E. Zahavi, G. Johnson, D. J. Kerbyson, and M. Lang, "Optimized InfiniBand Fat-tree Routing for Shift All-To-All Communication Patterns," in Proceedings of the International Supercomputing Conference 2007 (ISC07), Dresden, Germany.