Programming GPU clusters with shared memory abstraction in software

Proceedings - 19th International Euromicro Conference on Parallel, Distributed, and Network-Based Processing, PDP 2011

Volumn , Issue , 2011, Pages 223-230

  Karantasis, Konstantinos I ^a   Polychronopoulos, Eleftherios D ^a  

^a UNIVERSITY OF PATRAS   (Greece)

Author keywords

CUDA; GPU Clusters; OpenMP; Pleiad; Software DSM

Indexed keywords

CUDA; GPU CLUSTERS; OPENMP; PLEIAD; SOFTWARE DSM;

ABSTRACTING; APPLICATION PROGRAMMING INTERFACES (API); MIDDLEWARE; PARALLEL PROCESSING SYSTEMS; PROGRAM PROCESSORS;

SOFTWARE DESIGN;

EID: 79955023145     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PDP.2011.91     Document Type: Conference Paper

References (27)

1. K. Olukotun and L. Hammond, "The Future of Microprocessors," Queue, vol. 3, no. 7, pp. 26-29, 2005.
2. H. Sutter and J. Larus, "Software and the Concurrency Revolution," Queue, vol. 3, no. 7, pp. 54-62, 2005.
3. J. Howard, S. Dighe, Y. Hoskote, S. Vangal, D. Finan, G. Ruhl, D. Jenkins, H. Wilson, N. Borkar, G. Schrom, F. Pailet, S. Jain, T. Jacob, S. Yada, S. Marella, P. Salihundam, V. Erraguntla, M. Konow, M. Riepen, G. Droege, J. Lindemann, M. Gries, T. Apel, K. Henriss, T. Lund-Larsen, S. Steibl, S. Borkar, V. De, R. V. D. Wijngaart, and T. Mattson, "A 48-Core IA-32 Message-Passing Processor with DVFS in 45nm CMOS," in IEEE International Solid-State Circuits Conference, San Francisco, California, USA, Feb. 2010.
4. E. Lindholm, J. Nickolls, S. Oberman, and J. Montrym, "NVIDIA Tesla: A Unified Graphics and Computing Architecture," IEEE Micro, vol. 28, no. 2, pp. 39-55, 2008. (Pubitemid 351796170)
5. NVIDIA CUDA, Compute Unified Device Architecture, Programming Guide (Version 3.1), NVIDIA Corporation, Jun. 2010. [Online]. Available: http://developer.nvidia.com/object/cuda-3-1-downloads.html
6. OpenCL, OpenCL - the Open Standard for Parallel Programming of Heterogeneous Systems, Khronos Group, 2009. [Online]. Available: http://www.khronos.org/opencl/
7. Z. Fan, F. Qiu, A. Kaufman, and S. Yoakum-Stover, "GPU Cluster for High Performance Computing," in SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2004, p. 47.
8. D. Göddeke, R. Strzodka, J. Mohd-Yusof, P. McCormick, S. H. M. Buijssen, M. Grajewski, and S. Turek, "Exploring weak scalability for FEM calculations on a GPU-enhanced cluster," Parallel Computing, vol. 33, no. 10-11, pp. 685-699, 2007. (Pubitemid 350051061)
9. D. A. Jacobsen, J. C. Thibault, and I. Senocak, "An MPI-CUDA Implementation for Massively Parallel Incompressible Flow Computations on Multi-GPU Clusters," in 48th AIAA Aerospace Sciences Meeting, Orlando, Florida, USA, Jan. 2010.
10. D. Göddeke, R. Strzodka, J. Mohd-Yusof, P. S. McCormick, H. Wobker, C. Becker, and S. Turek, "Using GPUs to Improve Multigrid Solver Performance on a Cluster," International Journal of Computational Science and Engineering, vol. 4, no. 1, pp. 36-55, Nov. 2008.
11. J. C. Phillips, J. E. Stone, and K. Schulten, "Adapting a message-driven parallel application to GPU-accelerated clusters," in SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing. Piscataway, NJ, USA: IEEE Press, 2008, pp. 1-9.
12. E. P. Mancini, G. Marsh, and D. K. Panda, "An MPI-Stream Hybrid Programming Model for Computational Clusters," Cluster Computing and the Grid, IEEE International Symposium on, vol. 0, pp. 323-330, 2010.
13. I. Gelado, J. E. Stone, J. Cabezas, S. Patel, N. Navarro, and W.-m. W. Hwu, "An asymmetric distributed shared memory model for heterogeneous parallel systems," in ASPLOS '10: Proceedings of the fifteenth edition of ASPLOS on Architectural support for programming languages and operating systems. New York, NY, USA: ACM, 2010, pp. 347-358.
14. Z. Fan, F. Qiu, and A. E. Kaufman, "Zippy: A Framework for Computation and Visualization on a GPU Cluster," Comput. Graph. Forum, vol. 27, no. 2, pp. 341-350, 2008. (Pubitemid 351612851)
15. M. Strengert, C. Mller, C. Dachsbacher, and T. Ertl, "CUDASA: Compute Unified Device and Systems Architecture," in Eurographics 2008 Symposium on Parallel Graphics and Visualization (EGPGV'08), K.-L. M. Daniel Weiskopf, Jean M. Favre, Ed. Eurographics Association, 2008, pp. 49-56.
16. A. Barak, T. Ben-Nun, E. Levy, and A. Shiloh, "A package for OpenCL based heterogeneous computing on clusters with many GPU devices," in Cluster Computing Workshops and Posters (CLUSTER WORKSHOPS), 2010 IEEE International Conference on, Sep. 2010, pp. 1-7.
17. A. Barak and O. La'adan, "The MOSIX multicomputer operating system for high performance cluster computing," Future Gener. Comput. Syst., vol. 13, pp. 361-372, Mar. 1998. (Pubitemid 128395367)
18. C. Amza, A. L. Cox, S. Dwarkadas, P. Keleher, H. Lu, R. Rajamony, W. Yu, and W. Zwaenepoel, "TreadMarks: Shared Memory Computing on Networks of Workstations," Computer, vol. 29, no. 2, pp. 18-28, 1996. (Pubitemid 126522507)
19. K. I. Karantasis and E. D. Polychronopoulos, "Pleiad: a cross-environment middleware providing efficient multithreading on clusters," in CF '09: Proceedings of the 6th ACM conference on Computing frontiers. New York, NY, USA: ACM, 2009, pp. 109-116.
20. Y. Yan, M. Grossman, and V. Sarkar, "JCUDA: A Programmer-Friendly Interface for Accelerating Java Programs with CUDA," in Euro-Par '09: Proceedings of the 15th International Euro-Par Conference on Parallel Processing. Berlin, Heidelberg: Springer-Verlag, 2009, pp. 887-899.
21. The IMPACT Research Group, Parboil benchmark suite, 2009. [Online]. Available: http://impact.crhc.illinois.edu/parboil.php
22. A. Danalis, G. Marin, C. McCurdy, J. S. Meredith, P. C. Roth, K. Spafford, V. Tipparaju, and J. S. Vetter, "The Scalable Heterogeneous Computing (SHOC) benchmark suite," in GPGPU '10: Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units. New York, NY, USA: ACM, 2010, pp. 63-74.
23. J. B. MacQueen, "Some Methods for Classification and Analysis of MultiVariate Observations," in Proc. of the fifth Berkeley Symposium on Mathematical Statistics and Probability, L. M. L. Cam and J. Neyman, Eds., vol. 1. University of California Press, 1967, pp. 281-297.
24. G.-S. Jiang and C.-W. Shu, "Efficient implementation of weighted ENO schemes," J. Comput. Phys., vol. 126, no. 1, pp. 202-228, 1996. (Pubitemid 126162204)
25. J. M. Cohen and J. Molemake, "A Fast Double Precision CFD Code Using CUDA," in 21st International Conference on Parallel Computational Fluid Dynamics (ParCFD2009), 2009.
26. S. D. Bay, D. Kibler, M. J. Pazzani, and P. Smyth, "The UCI KDD archive of large data sets for data mining research and experimentation," SIGKDD Explor. Newsl., vol. 2, no. 2, pp. 81-85, 2000.
27. J. Pisharath, Y. Liu, W.-k. Liao, A. Choudhary, o. GMemik, and J. Parhi, "NU-Minebench 2.0," Center for Ultra-Scale Computing and Information Security (CUCIS) Northwestern University, Tech. Rep. CUCIS-2005-08-01, Aug. 2005. [Online]. Available: http://cucis.ece.northwestern.edu/techreports/pdf/ CUCIS-2004-08-001.pdf