Policy-based tuning for performance portability and library co-optimization

2012 Innovative Parallel Computing, InPar 2012

Volumn , Issue , 2012, Pages

  Merrill, Duane ^a   Garland, Michael ^a   Grimshaw, Andrew ^b  

^a NVIDIA   (United States)

^b UNIVERSITY OF VIRGINIA   (United States)

Author keywords

auto tuning; library design; metaprogramming; Performance; performance portability; policy; software reuse

Indexed keywords

AUTOTUNING; LIBRARY DESIGNS; META PROGRAMMING; PERFORMANCE; PERFORMANCE PORTABILITY;

COMPUTER ARCHITECTURE; PARALLEL ARCHITECTURES; PUBLIC POLICY;

COMPUTER SOFTWARE REUSABILITY;

EID: 84870725376     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/InPar.2012.6339597     Document Type: Conference Paper

References (32)

1. Aila, T. and Laine, S. 2009. Understanding the efficiency of ray traversal on GPUs. Proceedings of the Conference on High Performance Graphics 2009 (New York, NY, USA, 2009), 145-149.
2. Ansel, J. et al. 2009. PetaBricks: a language and compiler for algorithmic choice. Proceedings of the 2009 ACM SIGPLAN conference on Programming language design and implementation (New York, NY, USA, 2009), 38-49.
3. Back40 Computing: Fast and efficient software primitives for GPU computing: http://code.google.com/p/back40computing/. Accessed: 2011-08-25.
4. Blelloch, G.E. et al. Solving linear recurrences with loop raking. 416-424.
5. CUDA: http://www.nvidia.com/object/cuda-home-new.html. Accessed: 2011-08-25.
6. cudpp - CUDA Data Parallel Primitives Library - Google Project Hosting: http://code.google.com/p/cudpp/. Accessed: 2011-07-12.
7. Dagum, L. and Menon, R. 1998. OpenMP: an industry standard API for shared-memory programming. IEEE Computational Science and Engineering. 5, (Mar. 1998), 46-55.
8. Dean, J. and Ghemawat, S. 2008. MapReduce: simplified data processing on large clusters. Commun. ACM. 51, 1 (Jan. 2008), 107-113.
9. Demmel, J. et al. 2005. Self-Adapting Linear Algebra Algorithms and Software. Proceedings of the IEEE. 93, 2 (Feb. 2005), 293-312.
10. Devore, J. 1999. Applied statistics for engineers and scientists. Duxbury Press.
11. Fatahalian, K. et al. 2006. Sequoia: programming the memory hierarchy. Proceedings of the 2006 ACM/IEEE conference on Supercomputing (New York, NY, USA, 2006).
12. Frigo, M. 1999. A fast Fourier transform compiler. Proceedings of the ACM SIGPLAN 1999 conference on Programming language design and implementation (New York, NY, USA, 1999), 169-180.
13. Halstead,Jr., R.H. 1985. MULTILISP: a language for concurrent symbolic computation. ACM Trans. Program. Lang. Syst. 7, 4 (Oct. 1985), 501-538.
14. IEEE Computer Society 2009. IEEE Standard VHDL Language Reference Manual. IEEE Std 1076-2008 (Revision of IEEE Std 1076-2002). (2009), c1-626.
15. Klöckner, A. et al. 2011. PyCUDA and PyOpenCL: A scripting-based approach to GPU run-time code generation. Parallel Computing. (Sep. 2011).
16. Kurzak, J. et al. 2011. Autotuning GEMMs for Fermi. Technical Report #245. LAPACK Working Note.
17. Mcgraw, J. et al. 1985. SISAL: Streams and iteration in a single assignment language, language reference manual version 1.2. Lawrence-Livermore- National-Laboratory.
18. Merrill, D. 2011. Allocation-oriented Algorithm Design with Application to GPU Computing. University of Virginia.
19. Merrill, D. and Grimshaw, A. 2011. High Performance and Scalable Radix Sorting: A case study of implementing dynamic parallelism for GPU computing. Parallel Processing Letters. 21, 02 (2011), 245-272.
20. Merrill, D. and Grimshaw, A. 2009. Parallel Scan for Stream Architectures. Technical Report #CS2009-14. Department of Computer Science, University of Virginia.
21. Optimizing parallel reduction in CUDA: 2007. http://developer.download. nvidia.com/compute/cuda/1-1/Website/projects/reduction/doc/reduction.pdf. Accessed: 2009-12-12.
22. Owens, J.D. et al. 2008. GPU Computing. Proceedings of the IEEE. 96, 5 (May. 2008), 879-899.
23. Puschel, M. et al. 2005. SPIRAL: Code Generation for DSP Transforms. Proceedings of the IEEE. 93, 2 (Feb. 2005), 232-275.
24. Rice, H.G. 1953. Classes of Recursively Enumerable Sets and Their Decision Problems. Transactions of the American Mathematical Society. 74, 2 (1953), pp. 358-366.
25. Rogers, H. 1987. Theory of recursive functions and effective computability. MIT Press.
26. Rudy, G. et al. 2011. A programming language interface to describe transformations and code generation. Proceedings of the 23rd international conference on Languages and compilers for parallel computing (Berlin, Heidelberg, 2011), 136-150.
27. Thrust - Code at the speed of light - Google Project Hosting: http://code.google.com/p/thrust/. Accessed: 2011-08-25.
28. Tiwari, A. et al. 2009. A scalable auto-tuning framework for compiler optimization. Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing (Washington, DC, USA, 2009), 1-12.
29. Tzeng, S. et al. 2010. Task management for irregular-parallel workloads on the GPU. Proceedings of the Conference on High Performance Graphics (Aire-la-Ville, Switzerland, Switzerland, 2010), 29-37.
30. Valiant, L.G. 1990. A bridging model for parallel computation. Commun. ACM. 33, 8 (Aug. 1990), 103-111.
31. Volkov, V. and Demmel, J.W. 2008. Benchmarking GPUs to tune dense linear algebra. Proceedings of the 2008 ACM/IEEE conference on Supercomputing (Piscataway, NJ, USA, 2008), 31:1-31:11.
32. Vuduc, R. et al. 2005. OSKI: A library of automatically tuned sparse matrix kernels. Journal of Physics: Conference Series. 16, (Jan. 2005), 521-530.