Transformations to parallel codes for communication-computation overlap

Proceedings of the ACM/IEEE 2005 Supercomputing Conference, SC'05

Volumn 2005, Issue , 2005, Pages

  Danalis, Anthony ^a   Kim, Ki Yong ^a   Pollock, Lori ^a   Swany, Martin ^a  

^a University of Delaware   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION COMPUTATION OVERLAP; PROGRAM TRANSFORMATIONS; RUNTIME PERFORMANCE; UNDERLYING CLUSTERS;

COMMUNICATION SYSTEMS; COMPUTER NETWORKS; COMPUTER PROGRAMMING; ITERATIVE METHODS; MATHEMATICAL TRANSFORMATIONS; PARALLEL PROCESSING SYSTEMS; PROBLEM SOLVING;

CODES (SYMBOLS);

EID: 33845393854     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2005.75     Document Type: Conference Paper

References (42)

1. Ammasso. http://www.ammasso.com/.
2. GM reference manual. http://www.myri.com/scs/GM/doc/refman.pdf.
3. A. Alexandrov, M. F. lonescu, K. E. Schauser, and C. Scheiman. LogGP: Incorporating long messages into the LogP model for parallel computation. Journal of Parallel and Distributed Computing, 44(1):71-79, 1997.
4. P. Banerjee, J. A. Chandy, M. Gupta, J. G. Holm, A. Lain, D. J. Palermo, S. Ramaswamy, and E. Su. The PARADIGM Compiler for Distributed-Memory Message Passing Multicomputers. In First International Workshop on Parallel Processing, 1994.
5. N. J. Boden, D. Cohen, R. E. Felderman, A. E. Kulawik, C. L. Seitz, J. N. Seizovic, and W.-K. Su. Myrinet: A gigabit-per-second local area network. IEEE Micro, 15(1):29-36, 1995.
6. D. Bonachea and J. Duell. Problems with using MPI 1.1 and 2.0 as compilation targets for parallel language implementations. In 2nd Workshop on Hardware/Software Support for High Performance Scientific and Engineering Computing (SHPSEC-03), 2003.
7. L. Bouge, J. Mehaut, R. Namyst, and L. Prylli. Using VIA to build distributed, multithreaded runtime systems: a case study. Research Report 1999-27, CNRS-INRIA-ENS LYON, 1999.
8. R. Brightwell and K. D. Underwood. An analysis of the impact of MPI overlap and independent progress. In Proceedings of the 18th annual international conference on Supercomputing, pages 298-305. ACM Press, 2004.
9. K. W. Cameron and R. Ge. Predicting and Evaluating Distributed Communication Performance. In Supercomputing, Pittsburgh, PA, 2004.
10. F. Chaussumier, F. Desprez, and L. Prylli. Asynchronous Communications in MPI - the BIP/Myrinet Approach. In Euro PVM/MPI '99, 1999.
11. M. J. Clement and M. J. Quinn. Overlapping Computations, Communications and I/O in parallel Sorting. Journal of Parallel and Distributed Computing, 28(2):162-172, 1995.
12. D. E. Culler, A. C. Arpaci-Dusseau, S. C. Goldstein, A. Krishnamurthy, S. Lumetta, T. von Eicken, and K. A. Yelick. Parallel programming in Split-C. In Supercomputing, pages 262-273, 1993.
13. F. Desprez, J. Dongarra, and B. Tourancheau. Performance study of LU factorization with low communication overhead on multiprocessors. Parallel Processing Letters, 5:157-169, 1995.
14. P. Dmitruk, L.-P. Wang, W. H. Matthaeus, R. Zhang, and D. Seckel. Scalable parallel FFT for spectral simulations on a Beowulf cluster. Parallel Computing, 27:1921-1936, 2001.
15. D. Dunning, G. Regnier, G. McAlpine, D. Cameron, B. Shubert, F. Berry, A. Merritt, E. Gronke, and C. Dodd. The virtual interface architecture. IEEE Micro, pages 66-76, March/April, 1998.
16. T. A. El-Ghazawi, W. W. Carlson, and J. M. Draper. UPC Specification v. 1.1. http://upc.gwu.edu/documentation, 2003.
17. L. Fishgold, A. Danalis, L. Pollock, and M. Swany. An Automated Approach to Improving Communication-Computation Overlap in Clusters. In Parallel Computing 2005, 2005.
18. G. Goumas, A. Sotiropoulos, and N. Koziris. Minimizing completion time for loops tiling with computation and communication overlapping. In 15th International Parallel and Distributed Processing Symposium, 2001.
19. High Performance Fortran Forum. High Performance Fortran language specification, version 1.0. CRPC-TR92225, Rice University, Houston, TX, 1993.
20. S. Hiranandani, K. Kennedy, and C.-W. Tseng. Compiler optimizations for Fortran D on MIMD distributed-memory machines. In Supercomputing, pages 86-100, 1991.
21. K. Housiadas and A. Beris. An efficient fully implicit spectral scheme for DNS of turbulent viscoelastic channel flow. Non-Newtonian Fluid Mechanics, 2004.
22. C. Iancu, P. Husbands, and W. Chen. Message Strip Mining Heuristics for High Speed Networks. In VECPAR, 2004.
23. InfiniBand Trade Association. InfiniBand Architecture Specification, Release 1.0, October 24 2000.
24. F. Ino, N. Fujimoto, and K. Hagihara. Loggps: a parallel computational model for synchronization analysis. In Proceedings of the eighth ACM SIGPLAN symposium on Principles and practices of parallel programming, pages 133-142, 2001.
25. A. Karwande, X. Yuan, and D. K. Lowenthal. CC-MPI: A Compiled Communication Capable MPI Prototype for Ethernet Switched Clusters. In ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP), 2003.
26. G. Liu and T. Abdelrahman. Computation-Communication Overlap on Network-of-Workstation Multiprocessors. In International Conference on Parallel and Distributed Processing Techniques and Applications, 1998.
27. K. Magoutis, M. I. Seltzer, and E. Gabber. The Case Against User-level Networking. In Third Workshop on Novel Uses of System Area Networks (SAN-3) (Held in conjunction with HPCA-10), 2004.
28. R. W. Numrich and J. K. Reid. Co-Array Fortran for parallel programming. ACM Fortran Forum 17, 2, 1-31, 1998.
29. P. S. Pacheco. Parallel Programming with MPI. Morgan Kaufmann Publishers, Inc., 1997.
30. S. Pakin, M. Lauria, and A. Chien. High performance messaging on workstations: Illinois Fast Messages (FM) for Myrinet. In Proceedings of Supercomputing '95, 1995.
31. F. Petrini, W. Feng, A. Hoisie, S. Coll, and E. Frachtenberg. The Quadrics Network: High-Performance Clustering Technology. IEEE Micro, 22(1):46-57, 2002.
32. M. Prieto, I. M. Llorente, and F. Tirado. Data locality exploitation in the decomposition of regular domain problems. IEEE Trans. Parallel Distrib. Syst., 11(11):1141-1150, 2000.
33. R. Rabenseifner. Automatic MPI Counter Profiling of All Users: First Results on a CRAY T3E 900-512. In Message Passing Interface Developer's and User's Conference 1999 (MPIDC'99), pages 77-85, 1999.
34. S. H. Rodrigues, T. E. Anderson, and D. E. Culler. High-performance local-area communication with fast sockets. In Proceedings of Usenix Annual Technical Conference, pages 257-274, 1997.
35. D. Turner and X. Chen. Protocol-Dependent Message-Passing Performance on Linux Clusters. In Proceedings of the IEEE International Conference on Cluster Computing (Cluster 2002), Chicago, Illinois, 2002.
36. T. von Eicken, A. Basu, V. Buch, and W. Vogels. U-Net: A user-level network interface for parallel and distributed computing. In Proceedings of the 14th ACM Symposium on Operating Systems Principles, pages 40-53, Dec 1995.
37. T. von Eicken, D. Culler, S. Goldstein, and K. Schauser. Active messages: a mechanism for integrated communication and computation. In Proceedings of the International, Symposium on Computer Architecture, 1992.
38. R. C. Whaley and J. Dongarra. Automatically Tuned Linear Algebra Software. In Supercomputing 1998: High Performance Networking and Computing, 1998.
39. J. B. White III and S. Bova. Where's the Overlap? An Analysis of Popular MPI Implementations. In MPI Developer's and User's Conference (MPIDC '99), 1999.
40. K. Yelick, L. Semenzato, G. Pike, C. Miyamoto, B. Liblit, A. Krishnamurthy, P. Hilfinger, S. Graham, D. Gay, P. Colella, and A. Aiken. Titanium: A high-performance Java dialect, 1998.
41. X. Yuan, R. Melhem, and R. Gupta. Compiled Communication for All-Optical TDM Networks. In Supercomputing'96, 1996.
42. X. Yuan, R. Melhem, and R. Gupta. Algorithms for Supporting Compiled Communication. IEEE Transactions on Parallel and Distributed Systems, 14(2): 107-118, 2003.