In-place transposition of rectangular matrices on accelerators

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn , Issue , 2014, Pages 207-218

  Sung, I Jui ^a   Gómez Luna, Juan ^b   González Linares, José María ^c   Guil, Nicolás ^c   Hwu, Wen Mei W ^d  

^a MulticoreWare Inc   (Spain)

^b UNIVERSITY OF CÓRDOBA   (Spain)

^c UNIVERSITY OF MÁLAGA   (Spain)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

GPU; In place; Transposition

Indexed keywords

ASYNCHRONOUS EXECUTIONS; GPU; IN-PLACE; MATRIX TRANSPOSITION; MULTI-THREADED IMPLEMENTATION; PARALLELISM AND LOCALITIES; RECTANGULAR MATRIX; TRANSPOSITION;

BUILDING MATERIALS; COMPUTER PROGRAMMING LANGUAGES; DATA TRANSFER; MATRIX ALGEBRA; PARALLEL PROGRAMMING; PROGRAM PROCESSORS;

ALGORITHMS;

EID: 84896819561     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2555243.2555266     Document Type: Conference Paper

References (27)

1. Frigo, M., Johnson, S.: The design and implementation of fftw3. Proceedings of the IEEE 93(2) (2005) 216-231
2. Kohlhoff, K., Pande, V., Altman, R.: K-means for parallel architectures using all-prefix-sum sorting and updating steps. IEEE Transactions on Parallel and Distributed Systems 24(8) (2013) 1602-1612
3. Goto, K., Geijn, R.A.v.d.: Anatomy of high-performance matrix multiplication. ACM Trans. Math. Softw. 34(3) (May 2008) 12:1-12:25
4. Intel MKL: Intel Math Kernel Library (January 2013)
5. Ruetsch, G., Micikevicius, P.: Optimizing matrix transpose in CUDA. (January 2009)
6. Windley, P.F.: Transposing matrices in a digital computer. The Computer Journal 2(1) (1959) 47-48
7. Berman, M.F.: A method for transposing a matrix. J. ACM 5(4) (October 1958) 383-384
8. Hungerford, T.: Abstract algebra: an introduction. Saunders College Publishing (1997)
9. Sung, I.J.: Data layout transformation through in-placetransposition. PhD thesis, University of Illinois at Urbana- Champaign, Department of Electrical and Computer Engineering (May 2013) http://hdl.handle.net/2142/44300.
10. Karlsson, L.: Blocked in-place transposition with applicationto storage format conversion. Technical report (2009)
11. Gustavson, F., Karlsson, L., Kågström, B.: Parallel and cacheefficient in-place matrix storage format conversion. ACM Transactions on Mathematical Software 38(3) (April 2012) 17:1-17:32
12. Sung, I.J., Liu, G., Hwu, W.M.: DL: A data layout transformation system for heterogeneous computing. In: Innovative Parallel Computing, InPar. (May 2012) 1-11
13. Cate, E.G., Twigg, D.W.: Algorithm 513: Analysis of in-situ transposition [f1]. ACM Trans. Math. Softw. 3(1) (March 1977) 104-110
14. Kaushik, S.D., Huang, C.H., Johnson, J.R., Johnson, R.W., Sadayappan, P.: Efficient transposition algorithms for large matrices. In: Supercomputing. (November 1993)
15. Dotsenko, Y., Baghsorkhi, S.S., Lloyd, B., Govindaraju, N.K.: Auto-tuning of fast fourier transform on graphics processors. In: Proceedings of the 16th ACM symposium on Principles and Practice of Parallel Programming. PPoPP '11, New York, NY, USA, ACM (2011) 257-266
16. Gómez-Luna, J., González-Linares, J.M., Benavides, J.I., Guil, N.: An optimized approach to histogram computation on gpu. Machine Vision and Applications 24(5) (2013) 899-908
17. Van den Braak, G.J., Nugteren, C., Mesman, B., Corporaal, H.: GPU-vote: A framework for accelerating voting algorithms on GPU. In Kaklamanis, C., Papatheodorou, T., Spirakis, P., eds.: Euro-Par Parallel Processing. Volume 7484 of Lecture Notes in Computer Science. (2012) 945-956
18. Knuth, D.E.: The Art of Computer Programming, Volume II: Seminumerical Algorithms, 2nd Edition. Addison-Wesley (1981)
19. Gómez-Luna, J., González-Linares, J.M., Benavides, J.I., Guil, N.: Performance modeling of atomic additions on GPU scratchpad memory. IEEE Transactions on Parallel and Distributed Systems 24(11) (2013) 2273-2282
20. NVIDIA: CUDA C Programming Guide 5.0 (July 2012)
21. Volkov, V., Demmel, J.W.: Benchmarking GPUs to tune dense linear algebra. In: Supercomputing, Piscataway, NJ, USA, IEEE Press (2008) 31:1-31:11
22. Gómez-Luna, J., González-Linares, J.M., Benavides, J.I., Guil, N.: Performance models for asynchronous data transfers on consumer graphics processing units. Journal of Parallel and Distributed Computing 72(9) (2012) 1117 - 1126 Accelerators for High-Performance Computing.
23. Che, S., Sheaffer, J.W., Skadron, K.: Dymaxion: optimizing memory access patterns for heterogeneous systems. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. SC '11, New York, NY, USA, ACM (2011) 13:1-13:11
24. AMD: ATI Stream SDK OpenCL Programming Guide (2010)
25. Catanzaro, B., Keller, A., Garland, M.: A decomposition for in-place matrix transposition. In: Proceedings of the 19th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. PPoPP '14 (February 2014)
26. Boyer, M., Meng, J., Kumaran, K.: Improving GPU performance prediction with data transfer modeling. In: 2013 IEEE 27th International Parallel and Distributed Processing Symposium Workshops PhD Forum (IPDPSW). (2013) 1097-1106
27. Intel: OpenCL design and programming guide for the Intel Xeon Phi coprocessor. (2013)