Analyzing the impact of overlap, offload, and independent progress for message passing interface applications

International Journal of High Performance Computing Applications

Volumn 19, Issue 2 SPEC. ISS., 2005, Pages 103-117

  Brightwell, Ron ^a,b   Riesen, Rolf ^b   Underwood, Keith D ^b  

^a University of New Mexico   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

Message passing interface; Offload; Overlap; Progress

Indexed keywords

COMPUTER HARDWARE; COMPUTER NETWORKS; COMPUTER SOFTWARE; DATA COMMUNICATION SYSTEMS; INTELLIGENT NETWORKS; LOCAL AREA NETWORKS; PARALLEL PROCESSING SYSTEMS;

IDENTICAL NETWORK HARDWARE; INTELLIGENT NETWORK INTERFACE; MESSAGE PASSING INTERFACE; PARALLEL BENCHMARKS; VIRTUALLY IDENTICAL SOFTWARE STACKS;

NETWORK PROTOCOLS;

EID: 19744376706     PISSN: 10943420     EISSN: None     Source Type: Journal    
DOI: 10.1177/1094342005054257     Document Type: Article

References (26)

1. Boden, N. J., Cohen, D., Kulawik, R. E. F. A. E., Seitz, C. L., Seizovic, J. N., and Su, W-K. 1995. Myrinet: a gigabitper-second local area network. IEEE Micro 15(1):29-36
2. Brightwell, R. 2004. A new MPI implementation for Cray SHMEM. Recent Advances in Parallel Virtual Machine and Message Passing Interface: 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 18-21.
3. Brightwell, R. and Shuler, P. L. 1996. Design and implementation of MPI on Puma portals. Proceedings of the 2nd MPI Developer's Conference , July, pp. 18-25.
4. Brightwell, R. and Underwood, K. 2003. Evaluation of an eager protocol optimization for MPI. Proceedings of the 10th European PVM/MPI Users' Group Meeting (EuroPVM/MPI), Venice, Italy, September.
5. Brightwell, R. and Underwood, K. D. 2004a. An analysis of NIC resource usage for offloading MPI. Proceedings of the 2004 Workshop on Communication Architecture for Clusters, Santa Fe, NM, April.
6. Brightwell, R. and Underwood, K. D. 2004b. An initial analysis of the impact of overlap and independent progress for MPI. Recent Advances in Parallel Virtual Machine and Message Passing Interface: 9th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September.
7. Brightwell, R., Hudson, T. B., Maccabe, A. B., and Riesen, R. E. 1999. The Portals 3.0 message passing interface. Sandia National Laboratories, Technical Report SAND99-2959, December.
8. Brightwell, R., Lawry, W., Maccabe, A. B., and Riesen, R. 2002. Portals 3.0: protocol building blocks for low over-head communication. Proceedings of the 2002 Workshop on Communication Architecture for Clusters, April.
9. Cray Research, Inc. 1994. SHMEM Technical Note for C, SG-2516 2.3, October.
10. Dimitrov, R. and Skjellum, A. 2000. Impact of latency on applications' performance. Fourth MPI Developers' and Users' Conference, March.
11. Liu, J., Wu, J., Kini, S. P., Wyckoff, P., and Panda, D. K. 2003a. High performance RDMA-based MPI implementation over InfiniBand. Proceedings of the 2003 International Conference on Supercomputing (ICS-03), June 23-26, ACM Press, New York, pp. 295-304.
12. Liu, J., Chandrasekaran, B., Wu, J., Jiang, W., Kini, S., Yu, W., Buntinas, D., Wyckoff, P., and Panda, D. K. 2003b. Performance comparison of MPI implementations over InfiniBand, Myrinet and Quadrics. Proceedings of the International Conference for High Performance Computing and Communications (SC2003), November.
13. Liu, J., Chandrasekaran, B., Yu, W., Wu, J., Buntinas, D., Kini, S. P., Wyckoff, P., and Panda, D. K. 2004. Microbenchmark performance comparison of high-speed cluster interconnects. IEEE Micro 24(1):42-51.
14. Maccabe, A. B., Riesen, R., and van Dresser, D. W. 1996. Dynamic processor modes in Puma. Bulletin of the Technical Committee on Operating Systems and Application Environments (TCOS) 8(2):4-12.
15. Martin, R. P., Vahdat, A. M., Culler, D. E., and Anderson, T. E. 1997. Effects of communication latency, overhead, and bandwidth in a cluster architecture. Proceedings of the 24th Annual International Symposium on Computer Architecture, June.
16. MPI Forum. 1994. MPI: a message-passing interface standard. International Journal of Supercomputer Applications and High Performance Computing 8(3-4): 159-416.
17. MPI Forum. 1997. MPI-2: Extensions to the Message-Passing Interface, http://www.mpi-forum.org/docs/mpi-20-html/mpi2-report.html.
18. Petrini, F., Chun Feng, W., Hoisie, A., Coll, S., and Frachtenberg, E. 2002. The Quadrics network: high-performance clustering technology. IEEE Micro 22(1):46-57.
19. Petrini, F., Kerbyson, D. J., and Pakin, S. 2003. The case of the missing supercomputer performance: identifying and eliminating the performance variability on the ASCI Q machine. Proceedings of the 2003 Conference on High Performance Networking and Computing, Phoenix, AZ, November.
20. Rehm, W., Grabner, R., Mietke, F., Mehlan, T., and Siebert, C. 2004. An MPICH2 channel device implementation over VAPI on InfiniBand. Proceedings of the 2004 Workshop on Communication Architecture for Clusters, April.
21. Rodrigues, A., Murphy, R., Kogge, P., and Underwood, K. 2004. Characterizing a new class of threads in scientific applications for high end supercomputers. Proceedings of the 2004 International Conference on Supercomputing (ICS2004), St. Malo, France, June.
22. Shuler, L., Jong, C., Riesen, R., van Dresser, D., Maccabe, A. B., Fisk, L. A., and Stallcup, T. M. 1995. The Puma operating system for massively parallel computers. Proceedings of the 1995 Intel Supercomputer User's Group Conference.
23. Underwood, K. D. and Brightwell, R. 2004. The impact of MPI queue usage on message latency. Proceedings of the International Conference on Parallel Processing (ICPP), Montreal, Canada, August.
24. Vetter, J. S. and Mueller, F. 2002. Communication characteristics of large-scale scientific applications for contemporary cluster architectures. Proceedings of the 16th International Parallel and Distributed Processing Symposium (IPDPS'02), April, pp. 27-29.
25. Wheat, S., Mattson, T. G., and Scott, D. 1996. A TeraFLOPS Supercomputer in 1996: the ASCI TFLOP System. Proceedings of the 1996 International Parallel Processing Symposium.
26. Wong, F., Martin, R., Arpaci-Dusseau, R., and Culler, D. E. 1999. Architectural requirements and scalability of the NAS parallel benchmarks. Proceedings of the SC99 Conference on High Performance Networking and Computing, November.