Performance analysis of memory transfers and GEMM subroutines on NVIDIA Tesla GPU cluster

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2009, Pages

  Allada, Veerendra ^a   Benjegerdes, Troy ^a   Bode, Brett ^b  

^a Iowa State University   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

CUBLAS; CUDA; GPU cluster; Math Kernel Library; NetPIPE; Performance; Tesla

Indexed keywords

APPLICATION ACCELERATOR; BASIC LINEAR ALGEBRA SUBROUTINES; COMMODITY CLUSTERS; COMPUTATIONAL CHEMISTRY; DOUBLE PRECISION; EFFICIENT IMPLEMENTATION; GRAPHICAL PROCESSING UNITS; HIGH PERFORMANCE COMPUTING SYSTEMS; KERNEL LIBRARIES; MATRIX; OVERALL EFFICIENCY; PERFORMANCE ANALYSIS; PRICE RATIO; SCIENTIFIC APPLICATIONS;

CLUSTER COMPUTING; COMPUTATION THEORY; COMPUTATIONAL EFFICIENCY; EQUIPMENT TESTING; PROGRAM PROCESSORS; SUBROUTINES; TECHNICAL PRESENTATIONS;

COMPUTER GRAPHICS EQUIPMENT;

EID: 72049102909     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2009.5289124     Document Type: Conference Paper

References (22)

1. Q. O. Snell, A. R. Mikler, and J. L. Gustafson, "Netpipe: A network protocol independent performace evaluator," in In Proceedings of the IASTED International Conference on Intelligent Information Management and Systems, 1996.
2. J. L. Hennessy and D. A. Patterson, Computer Architecture: A Quantitative Approach. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 2003.
3. I. Buck, T. Foley, D. Horn, J. Sugerman, K. Fatahalian, M. Houston, and P. Hanrahan, "Brook for gpus: stream computing on graphics hardware," in SIGGRAPH '04: ACM SIGGRAPH 2004 Papers. NewYork,NY, USA: ACM, 2004, pp. 777-786.
4. J. Nickolls, I. Buck, M. Garland, and K. Skadron, "Scalable parallel programming with cuda," Queue, vol.6, no.2, pp. 40-53, 2008.
5. J. Owens, M. Houston, D. Luebke, S. Green, J. Stone, and J. Phillips, "Gpu computing," Proceedings of the IEEE, vol.96, no.5, pp. 879-899, May 2008.
6. J. D. Owens, D. Luebke, N. Govindaraju, M. Harris, J. Krger, A. E. Lefohn, and T. J. Purcell, "A survey of general-purpose computation on graphics hardware," Computer Graphics Forum, vol.26, no.1, pp. 80-113, 2007. [Online]. Available: http://www.blackwellsynergy.com/doi/pdf/10.1111/j. 1467-8659.2007.01012.x
7. L. Seiler, D. Carmean, E. Sprangle, T. Forsyth, M. Abrash, P. Dubey, S. Junkins, A. Lake, J. Sugerman, R. Cavin, R. Espasa, E. Grochowski, T. Juan, and P. Hanrahan, "Larrabee: a many-core x86 architecture for visual computing," ACM Trans. Graph., vol.27, no.3, pp. 1-15, 2008.
8. http://www.khronos.org/opencl/
9. J. A. Kahle, M. N. Day, H. P. Hofstee, C. R. Johns, T. R. Maeurer, and D. Shippy, "Introduction to the cell multiprocessor," IBM J. Res. Dev., vol. 49, no. 4/5, pp. 589-604, 2005.
10. S. Craven and P. Athanas, "Examining the viability of FPGA supercomputing," EURASIP J. Embedded Syst., vol.2007, no.1, pp. 13-13, 2007.
11. E. Lindholm, J. Nickolls, S. Oberman, and J. Montrym, "Nvidia tesla: A unified graphics and computing architecture," IEEE Micro, vol.28, no.2, pp. 39-55, 2008.
12. NVIDIA, CUDA Programming Guide 2.2, 2009.
13. C. L. Lawson, R. J. Hanson, D. R. Kincaid, and F. T. Krogh, "Basic linear algebra subprograms for fortran usage," ACM Trans. Math. Softw., vol.5, no.3, pp. 308-323, 1979.
14. NVIDIA, cuda CUBLAS Library 2.1, 2008.
15. Intel, Intel Math Kernel Library for Linux* OS, 2009.
16. J. Gustafson and Q. Snell, "Hint: A new way to measure computer performance," Hawaii International Conference on System Sciences, vol.0, p. 392, 1995.
17. J. J. Dongarra, "the linpack benchmark : an explanation," in Proceedings of the 1st International Conference on Supercomputing. NewYork,NY, USA: Springer-Verlag New York, Inc., 1988, pp. 456-474.
18. Intel, thread Affinity Interface. [Online]. Available: http://software.intel.com/en-us/intel-compilers/
19. Z. Fan, F. Qiu, A. Kaufman, and S. Yoakum-Stover, "Gpu cluster for high performance computing," in SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2004, p. 47.
20. S. Barrachina, M. Castillo, F. Igual, R. Mayo, and E. Quintana-Orti, "Evaluation and tuning of the level 3 cublas for graphics processors," Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, pp. 1-8, April 2008.
21. S. Ryoo, C. I. Rodrigues, S. S. Baghsorkhi, S. S. Stone, D. B. Kirk, and W. mei W. Hwu, "Optimization principles and application performance evaluation of a multithreaded gpu using cuda," in PPoPP '08: Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming. New York, NY, USA: ACM, 2008, pp. 73-82.
22. V. Volkov and J. Demmel, "Benchmarking gpus to tune dense linear algebra," in SC, 2008, p. 31.