Optimizing bandwidth limited problems using one-sided communication and overlap

20th International Parallel and Distributed Processing Symposium, IPDPS 2006

Volumn 2006, Issue , 2006, Pages

  Bell, Christian ^a,b   Bonachea, Dan ^a   Nishtala, Rajesh ^a   Yelick, Katherine ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BANDWIDTH; COMPUTER PROGRAMMING LANGUAGES; FREQUENCY ALLOCATION; OPTIMIZATION; SEMANTICS;

COMMUNICATION MICROBENCHMARKS; MESSAGE PASSING; SCALABILITY;

TELECOMMUNICATION NETWORKS;

EID: 33847103649     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2006.1639320     Document Type: Conference Paper

References (38)

1. R. C. Agarwal, F. G. Gustavson, and M. Zubair. A high performance parallel algorithm for 1-d fft. In SC, pages 34-40, 1994.
2. D. H. Bailey, et al. The NAS Parallel Benchmarks. The Int'l J. of Supercomputer Applications, 5(3):63-73, Fall 1991.
3. J. Beecroft , et al. QSNETII: Defining high-performance network design. IEEE Micro, 25(4):34-47, 2005.
4. C. Bell and D. Bonachea. A new DMA registration strategy for pinning-based high performance networks. In Communication Architecture for Clusters (CAC03), Nice, France, 2002.
5. C. Bell, D. Bonachea, R. Nishtala, and K. Yelick. Optimizing bandwidth limited problems using one-sided communication and overlap. Technical Report LBNL-59207, Berkeley National Lab, 2005.
6. C. Bell, W. Chen, D. Bonachea, and K. Yelick. Evaluating Support for Global Address Space Languages on the Cray X1. In 19th Annual Int'l Conference on Supercomputing (ICS), June 2004.
7. The Berkeley UPC Compiler, 2002. http://upc.lbl.gov.
8. D. Bonachea. GASNet specification. Technical Report CSD-02-1207, University of California, Berkeley, October 2002.
9. D. Bonachea. Proposal for extending the UPC memory copy library functions and supporting extensions to GASNet, v1.0. Technical Report LBNL-56495, Berkeley National Lab, October 2004.
10. D. Bonachea and J. C. Duell. Problems with using MPI 1.1 and 2.0 as compilation targets. In Proc. Support for High Performance Scientific and Engineering Computing (SHPSEC-03), 2003.
11. F. Cantonnet, Y. Yao, M. Zahran, and T. El-Ghazawi. Productivity Analysis of the UPC Language. In IPDPS, 2004.
12. S. Chalasani and P. Ramanathan. Parallel FFT on ATM-based networks of workstations. In Proc. of the 6th Int'l Symposium on High Performance Distributed Computing (HPDC), 1997.
13. W. Chen, D. Bonachea, J. Duell, P. Husband, C. Iancu, and K. Yelick. A Performance Analysis of the Berkeley UPC Compiler. In Proc. of Int'l Conference on Supercomputing (ICS), June 2003.
14. C. Y. Chu. Comparison of two-dimensional FFT methods on the hypercube. In Proc. of Hypercube concurrent computers and applications, pages 1430-1437, 1988.
15. C. Coarfa, Y. Dotsenko, J. Eckhardt, and J. Mellor-Crummey. Co-array Fortran performance and potential: An NPB experimental study. In 16th Int'l Workshop on Languages and Compilers for Parallel Processing (LCPC), October 2003.
16. A. Danalis, K.-Y. Kim, L. Pollock, and M. Swany. Transformations to parallel codes for communication-computation overlap. In Supercomputing 2005, November 2005.
17. K. Datta, D. Bonachea, and K. Yelick. Titanium performance and potential: an NPB experimental study. In Proc. of Languages and Compilers for Parallel Computing, 2005.
18. L. Díaz, M. Valero-García, and A. González. A method for exploiting communication/computation overlap in hypercubes. Parallel Computing, 24(2):221-245, 1998.
19. P. Dmitruk, et al. Scalable parallel FFT for spectral simulations on a beowulf cluster. Parallel Computing, 2001.
20. T. El-Ghazawi and F. Cantonnet. UPC performance and potential: A NPB experimental study. In Supercomputing, 2002.
21. A. Faraj and X. Yuan. Automatic generation and tuning of MPI collective communication routines. In Proc. Supercomputing, 2005.
22. M. Frigo and S. G. Johnson. The design and implementation of FFTW3. Proc. of the IEEE, 93(2):216-231, 2005.
23. GASNet home page. http://gasnet.cs.berkeley.edu/.
24. D. Han and T. Jones. Survey of MPI call usage. In SciComp, 2004.
25. P. Hilfinger, D. Bonachea, D. Gay, S. Graham, B. Liblit, G. Pike, and K. Yelick. Titanium language reference manual. Tech Report UCB/CSD-01-1163, U.C. Berkeley, November 2001.
26. C. Iancu, P. Husbands, and W. Chen. Message strip mining heuristics for high speed networks. In Proc. High Performance Computing for Computational Science (VECPAR), 2004.
27. J. Liu, A. Vishnu, and D. K. Panda. Building multirail Infiniband clusters: MPI-level design. In SuperComputing, 2004.
28. J. Liu, J. Wu, and D. K. Panda. High performance RDMA-based mpi implementation over Infiniband. Int'l J. of Parallel Prog., 2004.
29. MPI: A message-passing interface standard, v1.1. Technical report, University of Tennessee, Knoxville, June 12, 1995.
30. MPI-2: a message-passing interface standard. Int'l J. of High Performance Computing Applications, 12:1-299, 1998.
31. J. Nieplocha and B. Carpenter. ARMCI: A portable remote memory copy library for distributed array libraries and compiler run-time systems. In Proc. RTSPP IPPS/SDP'99, 1999.
32. R. Numrich and J. Reid. Co-array fortran for parallel programming. In ACM Fortran Forum 17, 2, 1-31., 1998.
33. L. Oliker, et al. Scientific computations on modern parallel vector systems. In Proc. of Supercomputing, 2004.
34. P. Swartztrauber and S. Hammond. A comparison of optimal FFTs on torus and hypercube multicomputers. Parallel Computing, 2001.
35. UPC consortium home page. http://upc.gwu.edu/.
36. UPC language specifications, v1.2. Technical Report LBNL-59208, Berkeley National Lab, 2005.
37. S. S. Vadhiyar, G. E. Fagg, and J. Dongarra. Automatically tuned collective communications. In Supercomputing, 2000.
38. V. Velusamy, et al. Programming the Infiniband network architecture for high performance message passing systems. In ISCA, 2003.