A memory optimization technique for software managed scratchpad memory in GPUs

2009 IEEE 7th Symposium on Application Specific Processors, SASP 2009

Volumn , Issue , 2009, Pages 43-49

  Moazeni, Maryam ^a   Bui, Alex ^b   Sarrafzadeh, Majid ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

CUDA; GPU computing; Memory optimization

Indexed keywords

APPLICATION PERFORMANCE; BENCHMARK SUITES; CUDA; EXECUTION TIME; GPU COMPUTING; GPU IMPLEMENTATION; GRAPH COLORINGS; MEMORY OPTIMIZATION; MEMORY SPACE; ON CHIPS; REAL-LIFE APPLICATIONS; SCRATCH PAD MEMORY; TRANSFORMATION METHODS;

COMPUTER GRAPHICS EQUIPMENT; COMPUTER SCIENCE; IMAGE PROCESSING; MEDICAL IMAGING; PROGRAM PROCESSORS; SOFTWARE ARCHITECTURE;

OPTIMIZATION;

EID: 70350786536     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SASP.2009.5226334     Document Type: Conference Paper

References (30)

1. D. Manocha, M. C. Lin, N. Govindaraju. GPGPU to Many-Core Processing: Higher Performance for Mass Market Applications. Manycore Computing Workshop, 2007.
2. AMD Stream Processor. http://ati.amd.com/products/streamprocessor/index. html.
3. NVIDIA Corporation. NVIDIA CUDA Programming Guide, version 1.1, 2007.
4. Seiler, L., Carmean, D., Sprangle, E., Forsyth, T., Abrash, M., Dubey, P., Junkins, S., Lake, A., Sugerman, J., Cavin, R., Espasa, R., Grochowski, E., Juan, T., and Hanrahan, P. 2008. Larrabee: a many-core x86 architecture for visual computing. ACM Trans. Graph. 27, 3 (Aug. 2008).
5. J. Nickolls and I. Buck. NVIDIA CUDA software and GPU parallel computing architecture. Microprocessor Forum, May 2007.
6. Kandemir, M. and Choudhary, A. 2002. Compiler-directed scratch pad memory hierarchy design and management. In Proceedings of the 39th Conference on Design Automation (New Orleans, Louisiana, USA, June 10 - 14, 2002). DAC '02. ACM, New York, NY, 628-633.
7. Zhu, J. 2001. Static memory allocation by pointer analysis and coloring. In Proceedings of the Conference on Design, Automation and Test in Europe (Munich, Germany). W. Nebel and A. Jerraya, Eds. Design, Automation, and Test in Europe. IEEE Press, Piscataway, NJ, 785-790.
8. OpenMP Architecture Review Board. OpenMP application program interface, May 2005.
9. J. C. Adams, W. S. Brainerd, J. T. Martin, B. T. Smith, and J. L. Wagener. Fortran 90 handbook: complete ANSI/ISO reference. Intertext Publications, Inc., /McGraw-Hill, Inc., 1992.
10. D. B. Loveman. High Performance Fortran. IEEE Parallel & Distributed Technology: Systems & Technology, 1(1):25-42, 1993.
11. M. Snir, S. W. Otto, D. W. Walker, J. Dongarra, and S. HussLederman. MPI: The Complete Reference. MIT Press, 1995.
12. ArchitecturesA Gholoum, E Sprangle, J Fang, G Wu, X Zhou. Ct: A Flexible Parallel Programming Model for Tera-scale - Intel Whitepaper, October, 2007.
13. P. H. Wang, J. D. Collins, G. N. Chinya, H. Jiang, X. Tian, M. Girkar, N. Y. Yang, G.-Y. Lueh, and H. Wang. EXOCHI: architecture and programming environment for a heterogeneous multi-core multithreaded system. In Proceedings of the 2007 ACM SIGPLAN Conference on Programming Language Design and Implementation, pages 156-166, 2007.
14. S. Ryoo, C. I. Rodrigues, S. S. Stone, S. S. Baghsorkhi, S.-Z. Ueng, J. A. Stratton, and W. mei W. Hwu, "Program optimization space pruning for a multithreaded gpu, " in CGO '08: Proceedings of the sixth annual IEEE/ACM international symposium on Code generation and optimization. New York, NY, USA: ACM, 2008, pp. 195-204.
15. N. K. Govindaraju, S. Larsen, J. Gray, and D. Manocha, "A memory model for scientific algorithms on graphics processors, " in SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM, 2006, p. 89.
16. Ryoo, S., Rodrigues, C. I., Baghsorkhi, S. S., Stone, S. S., Kirk, D. B., and Hwu, W. W. 2008. Optimization principles and application performance evaluation of a multithreaded GPU using CUDA. In Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (Salt Lake City, UT, USA, February 20 - 23, 2008). PPoPP '08. ACM, New York, NY, 73-82.
17. Che, S., Boyer, M., Meng, J., Tarjan, D., Sheaffer, J. W., and Skadron, K. A performance study of general-purpose applications on graphics processors using CUDA. J. Parallel Distrib. Comput. 68, 10 (Oct. 2008), 1370-1380.
18. D. Wilde and S. V. Rajopadhye, "Memory reuse analysis in the polyhedral model, " in Euro-Par '96: Proceedings of the Second International Euro-Par Conference on Parallel Processing. London, UK: SpringerVerlag, 1996, pp. 389-397.
19. Xuejun Yang, Li Wang, Jingling Xue, Yu Deng and Ying Zhang, "Comparability Graph Coloring for Optimizing Utilization of Stream Register Files in Stream Processors", The 14th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2009.
20. P. Briggs, K. D. Cooper, and L. Torczon, "Improvements to graph coloring register allocation, " ACM Trans. Program. Lang. Syst., vol.16, no.3, pp. 428-455, 1994.
21. V. V. Vazirani, Approximation algorithmms. New York, NY, USA: Springer-Verlag New York, Inc., 2001.
22. Shane Ryoo. Program Optimization Strategies for Data-Parallel Many- Core Processors. Ph.D. Dissertation, University of Illinois at Urbana Champaign.
23. O. Christiansen, T.-M. Lee, J. Lie, U. Sinha, and T. F. Chan, "Total variation regularization of matrix-valued images, " International Journal of Biomedical Imaging, vol.2007, 2007.
24. Active Contour and Segmentation Models Using Geometric PDE's for Medical Imaging Tony F. Chan and Luminita A. Vese, in Malladi, R. (Ed.), "Geometric Methods in Bio-Medical Image Processing", Series: Mathematics and Visualization, Springer, 2002, pp. 63-75.
25. B. Fischer and J. Modersitzki, "Curvature based image registration, " J.Math. Imaging Vis., vol.18, no.1, pp. 81-85, 2003.
26. Kindlmann, G.; Whitaker, R.; Tasdizen, T.; Moller, T., "Curvature-based transfer functions for direct volume rendering: methods and applications, " Visualization, 2003. VIS 2003. IEEE, vol., no., pp.513- 520, 24-24 Oct. 2003.
27. Wang, W., Pottmann, H., and Liu, Y. 2006. Fitting B-spline curves to point clouds by curvature-based squared distance minimization. ACM Trans. Graph. 25, 2 (Apr. 2006), 214-238.
28. C. R. Johns and D. A. Brokenshire, "Introduction to the Cell Broadband Engine Architecture", IBM Journal of Research and Development, Vol 51, Number 5, 2007, pp 503-520.
29. Maryam Moazeni, Alex Bui, Majid Sarrafzadeh, "Accelerating Total Variation Regularization for Matrix-Valued Images on GPUs", In the Proceedings of the 2009 ACM International Conference on Computing Frontiers, May 2009.
30. M. Verma and P. Marwedel. Overlay techniques for scratchpad memories in low-power embedded processors. IEEE Transactions on Very Large Scale Integration Systems, 4(8):802815, Aug. 2006.