Performance without pain = Productivity data layout and collective communication in UPC

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn , Issue , 2008, Pages 99-109

  Nishtala, Rajesh ^a   Almási, George ^b   Caşcaval, Cǎlin ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Blue gene; Collective communication; Parallel programming; PGAS; Programming productivity; UPC

Indexed keywords

BLUE GENE; CHOLESKY FACTORIZATIONS; COLLECTIVE COMMUNICATIONS; DENSE MATRICES; MACHINE RESOURCES; MULTIDIMENSIONAL FOURIER TRANSFORM; PARALLEL LANGUAGES; PARTITIONED GLOBAL ADDRESS SPACE; PGAS; PRODUCTIVITY DATA; RUNTIME SYSTEMS; UNIFIED PARALLEL C; UPC; UPC CODE;

C (PROGRAMMING LANGUAGE); COMPUTER PROGRAMMING LANGUAGES; FOURIER TRANSFORMS; GENES; PARALLEL PROCESSING SYSTEMS; PRODUCTIVITY; SCALABILITY; SUPERCOMPUTERS;

PARALLEL PROGRAMMING;

EID: 70350625706     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (48)

1. The cascade high productivity language, hips, 00: 52-60, 2004.
2. R. C. Agarwal, F. G. Gustavson, and M. Zubair. A high performance parallel algorithm for 1-d fft. In Supercomputing '94: Proceedings of the 1994 conference on Supercomputing, pages 34-40, Los Alamitos, CA, USA, 1994. IEEE Computer Society Press.
3. E. Allen, D. Chase, J. Hallett, V. Luchangco, J.-W. Maessen, S. Ryu, G. L. Steele Jr., and S. Tobin-Hochstadt. The Fortress Language Specification. Sun Microsystems, Inc., 1.0α edition, Sept. 2006.
4. G. Almási, C. Archer, J. G. C. nos, J. A. Gunnels, C. C. Erway, P. Heidelberger, X. Martorell, J. E. Moreira, K. Pinnow, J. Ratterman, B. SteinmacherBurow, W. Gropp, and B. Toonen. Design and implementation of message-passing services for the Blue Gene/L supercomputer. IBM Journal of Research and Development, 49(2/3): 393-406, March/May 2005. Available at http://www.research.ibm.com/journal/rd49-23.html.
5. G. Almási, P. Heidelberger, C. J. Archer, X. Martorell, C. C. Erway, J. E. Moreira, B. Steinmacher-Burow, and Y. Zheng. Optimization of mpi collective communication on bluegene/1 systems. In ICS '05: Proceedings of the 19th annual international conference on Supercomputing, pages 253-262, New York, NY, USA, 2005. ACM Press.
6. P. Balaji, D. Buntinas, S. Balay, B. Smith, R. Thakur, and W Gropp. Nonuniformly communicating noncontiguous data: A case study with petsc and mpi. In IEEE Parallel and Distributed Processing Symposium (IPDPS), 2006.
7. S. Balay, K. Buschelman, V. Eijkhout, W D. Gropp, D. Kaushik, M. G. Knepley, L. C. McInnes, B. F. Smith, and H. Zhang. PETSc users manual. Technical Report ANL-95/11 - Revision 2.1.5, Argonne National Laboratory, 2004.
8. C. Barton, C. Caşcaval, G. Almási, Y. Zheng, M. Farreras, S. Chatterjee, and J. N. Amaral. Shared memory programming for large scale machines. In Programming Language Design and Implementation (PLDI), Ottawa, Canada, 2006.
9. C. Barton, C. Cascaval, G. Almasi, R. Garg, and J. N. Amaral. Multidimensional blocking in UPC. Technical Report RC24305, IBM, July 2007.
10. C. Bell, D. Bonachea, R. Nishtala, and K. Yelick. Optimizing bandwidth limited problems using one-sided communication and overlap. In The 20th Int'l Parallel and Distributed Processing Symposium (IPDPS), 2006.
11. The Berkeley UPC Compiler, 2002. http : //upc.1b1.gov.
12. BLAS Home Page, http://www.netlib.org/blas/.
13. J. Bruck, C.-T. Ho, S. Kipnis, E. Upfal, and D. W. y. Efficient algorithms for all-to-all communications in multiport messagepassing systems. 1997.
14. L. E. Cannon. A cellular computer to implement the kalman filter algorithm. PhD thesis, Montanat State University, 1969.
15. F. Cantonnet, Y. Yao, M. Zahraň, and T. El-Ghazawi. Productivity Analysis of the UPC Language. In IPDPS, 2004.
16. B. L. Chamberlain, S.-E. Choi, E. C. Lewis, C. Lin, L. Snyder, and D. Weathersby. ZPL: A machine independent programming language for parallel computers. Software Engineering, 26(3): 197-211, 2000.
17. W Chen, D. Bonachea, J. Duell, P. Husband, C. Iancu, and K. Yelick. A Performance Analysis of the Berkeley UPC Compiler. In Proc. of Int'l Conference on Supercomputing (ICS), June 2003.
18. J. Choi, J. Dongarra, S. Ostrouchov, A. Petitet, D. W Walker, and R. C. Whaley. A proposal for a set of parallel basic linear algebra subprograms. In PARA '95: Proceedings of the Second International Workshop on Applied Parallel Computing, Computations in Physics, Chemistry and Engineering Science, pages 107-114, London, UK, 1996. Springer-Verlag.
19. C. Coarfa, Y Dotsenko, J. Mellor-Crummey, F. Cantonnet, T. ElGhazawi, A. Mohanti, Y. Yao, and D. Chavarría-Miranda. An evaluation of global address space languages: co-array fortran and unified parallel c. In PPoPP '05: Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming, pages 36-47, New York, NY, USA, 2005. ACM Press.
20. D. E. Culler, R. M. Karp, D. A. Patterson, A. Sahay, K. E. Schauser, E. Santos, R. Subramonian, and T. von Eicken. LogP: Towards a realistic model of parallel computation. In Proc. 4th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pages 1-12, 1993.
21. K. Datta, D. Bonachea, and K. Yelick. Titanium performance and potential: an NPB experimental study. In Proc. of Languages and Compilers for Parallel Computing, 2005.
22. T. El-Ghazawi and F. Cantonnet. Upc performance and potential: a npb experimental study. In Supercomputing '02: Proceedings of the 2002 ACM/IEEE conference on Supercomputing, pages 1-26, Los Alamitos, CA, USA, 2002. IEEE Computer Society Press.
23. ESSL User Guide. http://www-03.ibm.com/systems/p/software/essl.html.
24. L. S. B. et al. ScaLAPACK: a linear algebra library for messagepassing computers. In Proceedings of the Eighth SIAM Conference on Parallel Processing for Scientific Computing (Minneapolis, MN, 1997), page 15 (electronic), Philadelphia, PA, USA, 1997. Society for Industrial and Applied Mathematics.
25. M. Frigo and S. G. Johnson. The design and implementation of FFTW3. Proceedings of the IEEE, 93(2): 216-231, 2005. special issue on "Program Generation, Optimization, and Platform Adaptation". (Pubitemid 40851223)
26. A. Gara, M. A. Blumrich, D. Chen, G. L.-T. Chiu, P. Coteus, M. Giampapa, R. A. Haring, P. Heidelberger, D. Hoenicke, G. V. Kopcsay, T. A. Liebsch, M. Ohmacht, B. D. Steinmacher-burow, T. Takken, and P. Vranas. Overview of the BlueGene/L system architecture. IBM Journal of Research and Development, 49(2/3): 195-212, 2005.
27. High Performance Fortran Forum. High Performance Fortran language specification, version 1.0. Technical Report CRPCTR92225, Houston, Tex., 1993.
28. P. Hilfinger, D. Bonachea, D. Gay, S. Graham, B. Liblit, G. Pike, and K. Yelick. Titanium language reference manual. Tech Report UCB/CSD-01-1163, U.C. Berkeley, November 2001.
29. HPL Algorithm description. http://www.netlib.org/benchmark/hpl/algorithm. html.
30. Intel Math Kernel Library Reference Manual. http://www.intel.com/ software/products/mkl/techtopics/mklman52.pdf.
31. T. MathWorks. Using matlab, 1997.
32. Message Passing Interface. http://www.mpiforum.org/docs/docs.html.
33. J. C. Nash. "The Cholesky Decomposition." In Compact Numerical Methods for Computers: Linear Algebra and Function Minimisation, chapter 7, pages 84-93. Bristol, England: Adam Hilger, 2nd edition, 1990.
34. R. W. Numrich and J. Reid. Co-array fortran for parallel programming. ACMFortran Forum, 17(2): 1 -31, 1998.
35. R. W. Numrich and J. Reid. Co-array fortran for parallel programming. SIGPLAN Fortran Forum, 17(2): 1-31, 1998.
36. OpenMP. Simple, portable, scalable SMP programming. http://www.openmp. org/, 2000.
37. M. Püschel, J. M. F. Moura, J. Johnson, D. Padua, M. Veloso, B. W. Singer, J. Xiong, F. Franchetti, A. Gačić, Y. Voronenko, K. Chen, R. W. Johnson, and N. Rizzolo. SPIRAL: Code generation for DSP transforms. Proceedings of the IEEE, special issue on "Program Generation, Optimization, and Adaptation", 93 (2): 23 2-275, 2005.
38. Y. Qian and A. Afsahi. Efficient rdma-based multi-port collectives on multi-rail qsnetii clusters. In The 6th Workshop on Communication Architecture for Clusters (CAC 2006), In Proceedin gs of the 20th International Parallel and Distributed Processing Symposium (IPDPS 2006), 2006.
39. Z. Ryne and S. Seidel. A specification of the extensions to the collective operations of unified parallel c. Technical Report Technical Report 05-08, Michigan Technological University, Department of Computer Science, 2005.
40. M. J. Sottile, C. E. Rasmussen, and R. L. Graham. Co-array collectives: Refined semantics for co-array fortran. In V. N. Alexandrov, G. D. van Albada, P. M. A. Sloot, and J. Dongarra, editors, International Conference on Computational Science (2), volume 3992 of Lecture Notes in Computer Science, pages 945-952. Springer, 2006.
41. UPC Language Specification, V1.2, May 2005.
42. S. S. Vadhiyar, G. E. Fagg, and J. J. Dongarra. Performance modeling for self adapting collective communications for mpi. In LACSI Symposium, 2001.
43. R. van de Geijn and J. Watts. Summa: Scalable universal matrix multiplication algorithm. TR-95-13, Department of Computer Sciences, University of Texas, 1995.
44. R. Vuduc, J. W Demmel, and K. A. Yelick. OSKI: A library of automatically tuned sparse matrix kernels. In Proceedings of SciDAC 2005, Journal of Physics: Conference Series, San Francisco, CA, USA, June 2005. Institute of Physics Publishing.
45. R. C. Whaley, A. Petitet, and J. J. Dongarra. Automated empirical optimization of software and the ATLAS project. Parallel Computing, 27(1-2): 3-35, 2001. (Pubitemid 32264775)
46. The X10 programming language. http://x10.sourceforge.net, 2004.
47. K. Yelick. Keynote: Compilation techniques for partitioned global address space languages. In The 19th International Workshop on Languages and Compilers for Parallel Computing, 2006.
48. K. Yelick, L. Semenzato, G. Pike, C. Miyamoto, B. Liblit, A. Krishnamurthy, P. Hilfinger, S. Graham, D. Gay, P. Colella, and A. Aiken. Titanium: A high-performance java dialect. Concurrency: Practice and Experience, 10(11-13), September-November 1998.