Accurately measuring collective operations at massive scale

IPDPS Miami 2008 - Proceedings of the 22nd IEEE International Parallel and Distributed Processing Symposium, Program and CD-ROM

Volumn , Issue , 2008, Pages

  Hoefler, Torsten ^a,b   Schneider, Timo ^b   Lumsdaine, Andrew ^a  

^a INDIANA UNIVERSITY   (United States)

^b CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Benchmarking; Collective operations; MPI; Scalable synchronization; Time synchronization

Indexed keywords

COMPUTER NETWORKS; DISTRIBUTED PARAMETER NETWORKS; ERROR ANALYSIS; ERRORS; SYNCHRONIZATION; WINDOWS;

BENCHMARKING; COLLECTIVE OPERATIONS; MPI; SCALABLE SYNCHRONIZATION; TIME SYNCHRONIZATION;

MEASUREMENT ERRORS;

EID: 51049102790     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2008.4536494     Document Type: Conference Paper

References (26)

1. S. Agarwal, R. Garg, and N. Vishnoi. The impact of noise on the scaling of collectives: A theoretical approach. In 12th Annual IEEE International Conference on High Performance Computing, Goa, India, Dec. 2005.
2. S. R. Alam, N. Bhatia, and J. S. Vetter. An exploration of performance attributes for symbolic modeling of emerging processing devices. In R. H. Perrott, B. M. Chapman, J. Subhlok, R. F. de Mello, and L. T. Yang, editors, HPCC, volume 4782 of Lecture Notes in Computer Science, pages 683-694. Springer, 2007.
3. T. Bönisch, M. M. Resch, and H. Berger. Benchmark evaluation of the message-passing overhead on modern parallel architectures. In Parallel Computing: Fundamentals, Applications and New Directions, Proceedings of the Conference ParCo97, pages 411-418, 1997.
4. D. Culler, R. Karp, D. Patterson, A. Sahay, K. E. Schauser, E. Santos, R. Subramonian, and T. von Eicken. LogP: towards a realistic model of parallel computation. In Principles Practice of Parallel Programming, pages 1-12, 1993.
5. D. Culler, L. T. Liu, R. P. Martin, and C. Yoshikawa. LogP Performance Assessment of Fast Network Interfaces. IEEE Micro, February 1996.
6. W. Gropp and E. L. Lusk. Reproducible measurements of mpi performance characteristics. In Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, pages 11-18, London, UK, 1999. Springer-Verlag.
7. T. Hoefler, R. Janisch, and W. Rehm. Parallel scaling of Teter's minimization for Ab Initio calculations. 11 2006. Presented at the workshop HPC Nano in conjunction with SC'06.
8. T. Hoefler, A. Lichei, and W. Rehm. Low-Overhead LogGP Parameter Assessment for Modern Interconnection Networks. 03 2007.
9. T. Hoefler, A. Lumsdaine, and W. Rehm. Implementation and performance analysis of non-blocking collective operations for mpi. In Accepted for publication in the proceesings of Supercomputing'07, 2007.
10. T. Hoefler, T. Mehlan, A. Lumsdaine, and W. Rehm. Netgauge: A Network Performance Measurement Framework. In High Performance Computing and Communications, Third International Conference, HPCC 2007, Houston, USA, September 26-28, 2007, Proceedings, volume 4782, pages 659-671. Springer, 9 2007.
11. T. Hoefler, T.Mehlan, F.Mietke, and W. Rehm. Fast Barrier Synchronization for InfiniBand. In Proceedings, 20th International Parallel and Distributed Processing Symposium IPDPS 2006 (CAC 06), April 2006.
12. T. Hoefler, T. Mehlan, F. Mietke, and W. Rehm. LogfP - A Model for small Messages in InfiniBand. In Proceedings, 20th International Parallel and Distributed Processing Symposium IPDPS 2006 (PMEO-PDS 06), April 2006.
13. Intel Corporation. Intel Application Notes - Using the RDTSC Instruction for Performance Monitoring. Technical report, Intel, 1997.
14. K. Iskra, P. Beckman, K. Yoshii, and S. Coghlan. The influence of operating systems on the performance of collective operations at extreme scale. In Proceedings of Cluster Computing, 2006 IEEE International Conference, 2006.
15. T. Kohno, A. Broido, and K. Claffy. Remote physical device fingerprinting. Dependable and Secure Computing, IEEE Transactions on, 2(2):93-108, 2005.
16. P. J.Mucci, K. London, and J. Thurman. TheMPIBench Report. Technical report, CEWES/ERDCMSRC/PET, 1998.
17. S. Murdoch. Hot or not: revealing hidden services by their clock skew. Proceedings of the 13th ACM conference on Computer and communications security, pages 27-36, 2006.
18. Pallas GmbH. Pallas MPI Benchmarks - PMB, Part MPI-1. Technical report, 2000.
19. J. Pjesivac-Grbovic. Open MPI Collective Operation Performance on Thunderbird. Technical report, The University of Tennessee, Computer Science Department, Knoxville, Technical Report, UT-CS-07-594, 2007.
20. J. Pjesivac-Grbovic, T. Angskun, G. Bosilca, G. E. Fagg, E. Gabriel, and J. J. Dongarra. Performance Analysis of MPI Collective Operations. In Proceedings of the 19th International Parallel and Distributed Processing Symposium, Denver, CO, April 2005.
21. R. Rabenseifner. Automatic MPI Counter Profiling. In 42nd CUG Conference, 2000.
22. S. Saini, R. Ciotti, B. T. N. Gunney, T. E. Spelce, A. E. Koniges, D. Dossa, P. A. Adamidis, R. Rabenseifner, S. R. Tiyyagura, M. Mller, and R. Fatoohi. Performance evaluation of supercomputers using hpcc and imb benchmarks. In 20th International Parallel and Distributed Processing Symposium (IPDPS 2006), Proceedings, 25-29 April 2006, Rhodes Island, Greece. IEEE, 2006.
23. M. Shro and R. Geijn. Collmark mpi collective communication benchmark, 2001.
24. S. S. Vadhiyar, G. E. Fagg, and J. Dongarra. Automatically tuned collective communications. In Supercomputing '00: Proceedings of the 2000 ACM/IEEE conference on Supercomputing (CDROM), page 3,Washington, DC, USA, 2000. IEEE Computer Society.
25. T.Worsch, R. Reussner, andW. Augustin. On benchmarking collective mpi operations. In Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, pages 271-279, London, UK, 2002. Springer-Verlag.
26. W. Yu, D. Buntinas, R. L. Graham, and D. K. Panda. Efficient and scalable barrier over quadrics and myrinet with a new nic-based collective message passing protocol. In 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), CD-ROM / Abstracts Proceedings, 26-30 April 2004, Santa Fe, New Mexico, USA, 2004.