Message progression in parallel computing - To thread or not to thread?

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn Proceedings of the 2008 IEEE International Conference on Cluster Computing, ICCC 2008, Issue , 2008, Pages 213-222

  Hoefler, Torsten ^a   Lumsdaine, Andrew ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; PARALLEL PROCESSING SYSTEMS;

CPU CORES; OPERATING SYSTEMS; PARALLEL APPLICATIONS; PARALLEL COMPUTING; PERFORMANCE IMPROVEMENTS; REAL-TIME SCHEDULING;

COMMUNICATION;

EID: 57949089840     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2008.4663774     Document Type: Conference Paper

References (26)

1. G. Liu and T. Abdelrahman, "Computation-communication overlap on network-of-workstation multiprocessors," in Proc. of the Int'l Conference on Parallel and Distributed Processing Techniques and Applications, July 1998, pp. 1635-1642.
2. R. Brightwell and K. D. Underwood, "An analysis of the impact of MPI overlap and independent progress," in ICS '04: Proceedings of the 18th annual international conference on Supercomputing. New York, NY, USA: ACM Press, 2004, pp. 298-305.
3. R. Dimitrov, "Overlapping of communication and computation and early binding: Fundamental mechanisms for improving parallel performance on clusters of workstations," Ph.D. dissertation, Mississippi State University, 2001.
4. C. Iancu, P. Husbands, and P. Hargrove, "Hunting the overlap," in PACT '05: Proceedings of the 14th International Conference on Parallel Architectures and Compilation Techniques (PACT'05). Washington, DC, USA: IEEE Computer Society, 2005, pp. 279-290.
5. J. W. III and S. Bova, "Where's the Overlap? - An Analysis of Popular MPI Implementations," 1999. [Online]. Available: citeseer.ist.psu.edu/white99wheres.html
6. A. Adelmann, W. P. P. A. Bonelli and, and C. W. Ueberhuber, "Communication efficiency of parallel 3d ffts." in High Performance Computing for Computational Science - VECPAR 2004, 6th International Conference, Valencia, Spain, June 28-30, 2004, Revised Selected and Invited Papers, ser. Lecture Notes in Computer Science, vol. 3402. Springer, 2004, pp. 901-907.
7. C. Calvin and F. Desprez, "Minimizing communication overhead using pipelining for multidimensional fft on distributed memory machines," 1993.
8. A. Dubey and D. Tessera, "Redistribution strategies for portable parallel FFT: a case study." Concurrency and Computation: Practice and Experience, vol. 13, no. 3, pp. 209-220, 2001.
9. S. Goedecker, M. Boulet, and T. Deutsch, "An efficient 3-dim FFT for plane wave electronic structure calculations on massively parallel machines composed of multiprocessor nodes," Computer Physics Communications, vol. 154, pp. 105-110, Aug. 2003.
10. T. Hoefler, A. Lumsdaine, and W. Rehm, "Implementation and Performance Analysis of Non-Blocking Collective Operations for MPI," in In proceedings of the 2007 International Conference on High Performance Computing, Networking, Storage and Analysis, SC07. IEEE Computer Society/ACM, 11 2007. [Online]. Available: ./img/hoefler-sc07.pdf
11. C. L. Lawson, R. J. Hanson, D. Kincaid, and F. T. Krogh, "Basic Linear Algebra Subprograms for FORTRAN usage," in In ACM Trans. Math. Soft., 5 (1979), pp. 308-323, 1979.
12. G. M. Shipman, T. S. Woodall, G. Bosilca, R. ch L. Graham, and A. B. Maccabe, "High performance RDMA protocols in HPC," in Proceedings, 13th European PVM/MPI Users' Group Meeting, ser. Lecture Notes in Computer Science. Bonn, Germany: Springer-Verlag, September 2006.
13. T. Hoefler and A. Lumsdaine, "Optimizing non-blocking Collective Operations for InfiniBand," in Proceedings of the 22nd IEEE International Parallel & Distributed Processing Symposium (IPDPS), 04 2008. [Online]. Available: ./img//hoefler-cac08.pdf
14. C. Keppitiyagama and A. S. Wagner, "Asynchronous mpi messaging on myrinet," in IPDPS '01: Proceedings of the 15th International Parallel & Distributed Processing Symposium. Washington, DC, USA: IEEE Computer Society, 2001, p. 50.
15. P. Shivam, P. Wyckoff, and D. Panda, "Emp: zero-copy os-bypass nic-driven gigabit ethernet message passing," in Supercomputing '01: Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM). New York, NY, USA: ACM Press, 2001, pp. 57-57.
16. W. Yu, D. Buntinas, and D. K. Panda, "High Performance and Reliable NIC-Based Multicast over Myrinet/GM-2," pp. 197-204, 2003.
17. W. Yu, D. Buntinas, R. L. Graham, and D. K. Panda, "Efficient and scalable barrier over quadrics and myrinet with a new nic-based collective message passing protocol." in 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), CD-ROM / Abstracts Proceedings, 26-30 April 2004, Santa Fe, New Mexico, USA, 2004.
18. A. Wagner, D. Buntinas, D. K. Panda, and R. Brightwell, "Application-bypass reduction for large-scale clusters." in 2003 IEEE International Conference on Cluster Computing (CLUSTER 2003). IEEE Computer Society, December 2003, pp. 404-411.
19. D. Buntinas, D. K. Panda, and R. Brightwell, "Application-bypass broadcast in mpich over gm," in CCGRID '03: Proceedings of the 3st International Symposium on Cluster Computing and the Grid. Washington, DC, USA: IEEE Computer Society, 2003, p. 2.
20. R. Rabenseifner, "Hybrid parallel programming on hpc platforms," in In proceedings of the Fifth European Workshop on OpenMP, EWOMP'03, Aachen, Germany, 2003.
21. T. Hoefler, P. Kambadur, R. L. Graham, G. Shipman, and A. Lumsdaine, "A Case for Standard Non-Blocking Collective Operations," in Recent Advances in Parallel Virtual Machine and Message Passing Interface, EuroPVM/MPI 2007, vol. 4757. Springer, 10 2007, pp. 125-134. [Online]. Available: ./img/hoefler-nbc-standard.pdf
22. T. Hoefler, T. Mehlan, A. Lumsdaine, and W. Rehm, "Netgauge: A Network Performance Measurement Framework," in High Performance Computing and Communications, Third International Conference, HPCC 2007, Houston, USA, September 26-28, 2007, Proceedings, vol. 4782. Springer, 9 2007, pp. 659-671.
23. T. Hoefler, T. Schneider, and A. Lumsdaine, "Accurately Measuring Collective Operations at Massive Scale," in Proceedings of the 22nd IEEE International Parallel & Distributed Processing Symposium (IPDPS), 04 2008. [Online]. Available: ./img/hoefler-pmeo08.pdf
24. R. Rabenseifner, "Automatic MPI Counter Profiling," in Proceedings of 42nd CUG Conference, 2000.
25. J. Pjesivac-Grbovic, T. Angskun, G. Bosilca, G. E. Fagg, E. Gabriel, and J. J. Dongarra, "Performance Analysis of MPI Collective Operations," in Proceedings of the 19th International Parallel and Distributed Processing Symposium, 4th International Workshop on Performance Modeling, Evaluation, and Optimization of Parallel and Distributed Systems (PMEO-PDS 05), Denver, CO, April 2005.
26. K. Magoutis, M. I. Seltzer, and E. Gabber, "The case against user-level networking," in Proceedings of Workshop on Novel Uses of System-Area Networks (SAN-3), Madrid, Spain, 2004.