Productive programming of GPU clusters with OmpSs

Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium, IPDPS 2012

Volumn , Issue , 2012, Pages 557-568

  Bueno, Javier ^a   Planas, Judit ^a   Duran, Alejandro ^a   Badia, Rosa M ^b   Martorell, Xavier ^a   Ayguadé, Eduard ^a   Labarta, Jesús ^a  

^a BARCELONA SUPERCOMPUTING CENTER   (Spain)

^b ARTIFICIAL INTELLIGENCE RESEARCH INSTITUTE IIIA CSIC   (Spain)

Author keywords

accelerators; Cluster programming; GPGPU computing; OpenMP

Indexed keywords

ASYNCHRONY; COMPUTATIONAL TASK; GPGPU COMPUTING; GPU CLUSTERS; HYBRID MODEL; OPENMP; PARALLELIZATIONS; REMOTE NODE; RUNTIME SYSTEMS; TASK PARALLELISM; TASK-BASED;

APPLICATION PROGRAMMING INTERFACES (API); CLUSTER COMPUTING; COMMUNICATION; DISTRIBUTED PARAMETER NETWORKS; PARTICLE ACCELERATORS;

PROGRAM PROCESSORS;

EID: 84866856745     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2012.58     Document Type: Conference Paper

References (36)

1. OpenMP ARB, "OpenMP Application Program Interface, v. 3.0," May 2008.
2. J. M. Perez, R. M. Badia, and J. Labarta, "A dependency-aware task-based programming environment for multi-core architectures," IEEE Int. Conference on Cluster Computing, pp. 142-151, September 2008.
3. J. M. Perez, P. Bellens, R. M. Badia, and J. Labarta, "CellSs: Making it easier to program the Cell Broadband Engine processor," IBM Journal of Research and Development, vol. 51, no. 5, pp. 593-604, September 2007.
4. "Optimizing the Exploitation of Multicore Processors and GPUs with OpenMP and OpenCL," in Proceedings of the 23rd International Workshop on Languages and Compilers for Parallel Computing (LCPC2010), October 2010.
5. J. Bueno, L. Martinell, A. Duran, M. Farreras, X. Martorell, R. M. Badia, E. Ayguade, and J. Labarta, " Productive Cluster Programming with OmpSs ," in Europar'11 (to appear), 2011.
6. R. D. Blumofe, C. F. Joerg, B. C. Kuszmaul, C. E. Leiserson, K. H. Randall, and Y. Zhou, "Cilk: an efficient multithreaded runtime system," SIGPLAN Not., vol. 30, no. 8, pp. 207-216, 1995.
7. A. Duran, J. M. Pérez, E. Eduard Ayguadé, R. M. Badia, and J. Labarta, "Extending the OpenMP Tasking Model to Allow Dependent Tasks," in OpenMP in a New Era of Parallelism. Springer Berlin / Heidelberg, 2008, pp. 111-122.
8. J. M. Perez, R. M. Badia, and J. Labarta, "Handling task dependencies under strided and aliased references," in Proceedings of the 24th ACM International Conference on Supercomputing, ser. ICS '10. New York, NY, USA: ACM, 2010, pp. 263-274.
9. E. Ayguade, R. M. Badia, D. Cabrera, A. Duran, M. Gonzalez, F. Igual, D. Jimenez, J. Labarta, X. Martorell, R. Mayo, J. M. Perez, and E. S. Quintana-Orti, "A Proposal to Extend the OpenMP Tasking Model for Heterogeneous Architectures," in IWOMP: Evolving OpenMP in an Age of Extreme Parallelism, vol. 5568. Dresden, Germany: Springer, June 2009, pp. 154-167.
10. J. J. Dongarra, I. High, and P. C. Systems, "Overview of the hpc challenge benchmark suite."
11. "Trace-driven Simulation of Multithreaded Applications," in Proceedings of the 2011 ISPASS (to appear), 2011.
12. L. Martinell, ""Memory usage improvements for the SMPSs runtime"," Master's thesis, Computer Architecture Department, Universitat Politècnica de Catalunya, 2010.
13. D. Bonachea, "GASNet Specification, v1.8 ," http://gasnet.cs.berkeley.edu/, U.C. Berkeley, Tech. Rep., 2006.
14. NVIDIA CUDA Compute Unified Device Architecture Version 2.0, NVIDIA Corporation, 2008.
15. R. A. V. D. Geijn and J. Watts, "Summa: Scalable universal matrix multiplication algorithm," Tech. Rep., 1997.
16. MPI Forum, "MPI: A Message Passing Interface Standard," Intl. Journal of Supercomputer Applications and High Performance Computing, vol. 8, no. 3/4, pp. 159-416, 1994.
17. U. Consortium, "UPC Language Specifications v1.2," May 2005.
18. P. Charles, C. Grothoff, V. Saraswat, C. Donawa, A. Kielstra, K. Ebcioglu, C. von Praun, and V. Sarkar, "X10: an object-oriented approach to non-uniform cluster computing," in Proceedings of the 20th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, ser. OOPSLA '05. New York, NY, USA: ACM, 2005, pp. 519-538.
19. B. Chamberlain, D. Callahan, and H. Zima, "Parallel programmability and the chapel language," Int. J. High Perform. Comput. Appl., vol. 21, pp. 291-312, August 2007.
20. E. A. V. Marjanovic, J. Labarta and M. Valero, "Effective communication and computation overlap with hybrid mpi/smpss," in Proceedings of the 15th ACM SIGPLAN symposium on Principles and practice of parallel programming, ser. PPoPP '10. New York, NY, USA: ACM, 2010, pp. 337-338.
21. S.-Z. Ueng, M. Lathara, S. S. Baghsorkhi, and W. mei W. Hwu, "CUDA-lite: Reducing GPU Programming Complexity," in In Languages and Compilers for Parallel Computing (LCPC) 21st Annual Workshop, August 2008.
22. Khronos OpenCLWorking Group, The OpenCL Specification, version 1.0.29, 8 December 2008. [Online]. Available: http://khronos.org/registry/cl/specs/opencl- 1.0.29.pdf
23. T. Hamada and K. Nitadori, "190 tflops astrophysical n-body simulation on a cluster of gpus," in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, ser. SC '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 1-9.
24. S. J. Pennycook, S. D. Hammond, S. A. Jarvis, and G. R. Mudalige, "Performance analysis of a hybrid mpi/cuda implementation of the naslu benchmark," SIGMETRICS Perform. Eval. Rev., vol. 38, pp. 23-29, March 2011.
25. N. Karunadasa and D. D. N. Ranasinghe, "Accelerating high performance applications with CUDA and MPI," in Proceedings of the Fourth International Conference on Industrial and Information Systems (ICIIS 2009), Sri Lanka, 28-31 December 2009.
26. O. S. Lawlor, "Message passing for gpgpu clusters: Cudampi," in Proceedings of the IEEE International Conference on Cluster Computing, 2009, pp. 1-8.
27. M. Fatica, "Accelerating linpack with cuda on heterogenous clusters," in Proceedings of 2nd Workshop on General Purpose Processing on Graphics Processing Units, ser. GPGPU-2. New York, NY, USA: ACM, 2009, pp. 46-51.
28. S. Lee and R. Eigenmann, "Openmpc: Extended openmp programming and tuning for gpus," in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, ser. SC '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 1-11.
29. L. Chen, L. Liu, S. Tang, L. Huang, Z. Jing, S. Xu, D. Zhang, and B. Shou, "Unified parallel c for gpu clusters: Language extensions and compiler implementation," in Languages and Compilers for Parallel Computing, ser. Lecture Notes in Computer Science, K. Cooper, J. Mellor-Crummey, and V. Sarkar, Eds. Springer Berlin / Heidelberg, 2011, vol. 6548, pp. 151-165.
30. T. D. Han and T. S. Abdelrahman, "hicuda: High-level gpgpu programming," IEEE Transactions on Parallel and Distributed Systems, vol. 22, pp. 78-90, 2011.
31. D. Unat, X. Cai, and S. B. Baden, "Mint: Realizing cuda performance in 3d stencil methods with annotated c," in Proceedings of the 25th ACM International Conference on Supercomputing, ser. ICS '11. New York, NY, USA: ACM, 2011, pp. 214-224.
32. R. Dolbeau, S. Bihan, and F. Bodin, "HMPP: A Hybrid Multicore Parallel Programming Environment," in Workshop on General Processing Using GPUs, 2006.
33. P. Cooper, U. Dolinsky, A. F. Donaldson, A. Richards, C. Riley, and G. Russell, "Offload - automating code migration to heterogeneous multicore systems," in Lecture Notes in Computer Science, HiPEAC Conference 2010, 2010, pp. 307-321.
34. T. J. Knight, J. Y. Park, M. Ren, M. Houston, M. Erez, K. Fatahalian, A. Aiken, W. J. Dally, and P. Hanrahan, "Compilation for explicitly managed memory hierarchies," in Proceedings of the 2007 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2007.
35. Portland Group Inc., "PGI Accelerator Compilers," Sep 2011.
36. Alistair Hart and Harvey Richardson and Alan Gray and Karthee Sivalingham, "Directive-based programming for GPUs, accelerators and HPC," December 2010. [Online]. Available: www.many-core.group.cam.ac.uk/ ukgpucc2/talks/Hart.pdf