Optimization principles and application performance evaluation of a multithreaded GPU using CUDA

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn , Issue , 2008, Pages 73-82

  Ryoo, Shane ^a   Rodrigues, Christopher I ^a   Baghsorkhi, Sara S ^a   Stone, Sam S ^a   Kirk, David B ^b   Hwu, Wen Mei W ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b NVIDIA   (United States)

Author keywords

GPU computing; Parallel computing

Indexed keywords

BANDWIDTH; COMPUTER HARDWARE; MULTITASKING; PARALLEL PROCESSING SYSTEMS; PARALLEL PROGRAMMING; PROGRAM PROCESSORS;

APPLICATION DEVELOPERS; APPLICATION PERFORMANCE; CLASSICAL OPTIMIZATION; COMPUTATIONAL POWER; GPU COMPUTING; GRAPHICS HARDWARE; OPTIMIZATION PRINCIPLE; OPTIMIZATION STRATEGY;

GRAPHICS PROCESSING UNIT;

EID: 79959466764     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1345206.1345220     Document Type: Conference Paper

References (28)

1. AMD Stream Processor, http://ati.amd.com/products/ streamprocessor/index. html.
2. CUDA benchmark suite. http://www.crhc.uiuc.edu/impact/cudabench.html.
3. NVIDIA CUDA. http://developer.nvidia.com/object/cuda.html.
4. The PeakStream platform: High productivity software development for multi-core processors. Technical report, 2006.
5. ECE 498AL1: Programming massively parallel processors, Fall 2007. http://courses.ece.uiuc.edu/ece498/al1/.
6. J. C. Adams, W. S. Brainerd, J. T. Martin, B. T. Smith, and J. L. Wagener. Fortran 90 handbook: complete ANSI/ISO reference. Intertext Publications, Inc.,/McGraw-Hill, Inc., 1992.
7. R. Allen and K. Kennedy. Automatic translation of Fortran programs to vector form. ACM Transactions on Programming Langugages and Systems, 9(4): 491-542, 1987. (Pubitemid 18531687)
8. M. J. Atallah, editor. Algorithms and Theory of Computation Handbook. CRC Press LLC, 1998.
9. I. Buck. Brook Specification v0.2, October 2003.
10. D. Callahan, S. Carr, and K. Kennedy. Improving register allocation for subscripted variables. ACM SIGPLAN Notices, 9(4): 328-342, 2004.
11. K. Fatahalian, J. Sugerman, and P. Hanrahan. Understanding the efficiency of GPU algorithms for matrix-matrix multiplication. In Proceedings of the ACM SIGGRAPH/EUROGRAPHICS Conference on Graphics Hardware, pages 133-137, 2004.
12. N. K. Govindaraju, S. Larsen, J. Gray, and D. Manocha. A memory model for scientific algorithms on graphics processors. In Proceedings of the 2006 ACM/IEEE Conference on Supercomputing, number 89, 2006.
13. K. Kennedy and J. R. Allen. Optimizing compilers for modern architectures: a dependence-based approach. Morgan Kaufmann Publishers Inc., 2002.
14. M. S. Lam, E. E. Rothberg, and M. E. Wolf. The cache performance and optimizations of blocked algorithms. In Proceedings of the 4th International Conference on Architectural Support for Programming Languages and Operating Systems, pages 63-74, April 1991.
15. D. B. Loveman. High Performance Fortran. IEEE Parallel & Distributed Technology: Systems & Technology, 1(1): 25-42, 1993.
16. W. R. Mark, R. S. Glanville, K. Akeley, and M. J. Kilgard. Cg: a system for programming graphics hardware in a C-like language. In ACM SIGGRAPH 2003 Papers, pages 896-907, 2003.
17. M. D. McCool, K. Wadleigh, B. Henderson, and H.-Y. Lin. Performance evaluation of GPUs using the RapidMind development platform. In Proceedings of the 2006 ACM/IEEE Conference on Supercomputing, 2006.
18. J. Nickolls and I. Buck. NVIDIA CUDA software and GPU parallel computing architecture. Microprocessor Forum, May 2007.
19. OpenMP Architecture Review Board. OpenMP application program interface, May 2005.
20. J. Owens. Streaming architectures and technology trends. GPU Gems 2, pages 457-470, March 2005.
21. J. D. Owens, D. Luebke, N. Govindaraju, M. Harris, J. Krüger, A. E. Lefohn, and T. J. Purcell. A survey of general-purpose computation on graphics hardware. Computer Graphics Forum, 26(1): 80-113, 2007. (Pubitemid 46481097)
22. S. Ryoo, C. I. Rodrigues, S. S. Stone, S. S. Baghsorkhi, S.-Z. Ueng, and W. W. Hwu. Program optimization study on a 128-core GPU. In The First Workshop on General Purpose Processing on Graphics Processing Units, October 2007.
23. M. Snir, S. W Otto, D. W Walker, J. Dongarra, and S. HussLederman. MPI: The Complete Reference. MIT Press, 1995.
24. J. E. Stone, J. C. Phillips, P. L. Freddolino, D. J. Hardy, L. G. Trabuco, and K. Schulten. Accelerating molecular modeling applications with graphics processors. Journal of Computational Chemistry, 28(16): 2618-2640, December 2007.
25. S. S. Stone, H. Yi, W. W. Hwu, J. P. Haldar, B. P. Sutton, and Z.-P. Liang. How GPUs can improve the quality of magnetic resonance imaging. In The First Workshop on General Purpose Processing on Graphics Processing Units, October 2007.
26. D. Tarditi, S. Puri, and J. Oglesby. Accelerator: Using data parallelism to program GPUs for general-purpose uses. In Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems, pages 325-335, 2006.
27. P. H. Wang, J. D. Collins, G. N. Chinya, H. Jiang, X. Tian, M. Girkar, N. Y. Yang, G.-Y. Lueh, and H. Wang. EXOCHI: architecture and programming environment for a heterogeneous multi-core multithreaded system. In Proceedings of the 2007 ACM SIGPLAN Conference on Programming Language Design and Implementation, pages 156-166, 2007.
28. M. J. Wolfe. Optimizing Supercompilers for Supercomputers. MIT Press, 1990.