Scalable multi-GPU 3-D FFT for TSUBAME 2.0 supercomputer

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn , Issue , 2012, Pages

  Nukada, Akira ^a,b   Sato, Kento ^a   Matsuoka, Satoshi ^a,b,c  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^c National Institute of Informatics

Author keywords

[No Author keywords available]

Indexed keywords

ALL-TO-ALL COMMUNICATION; AUTOTUNING; DOUBLE PRECISION; INFINIBAND; INTER-NODE COMMUNICATION; MPI LIBRARIES; MULTI-GPU; MULTIPLE GPUS;

COMMUNICATION; FAST FOURIER TRANSFORMS; PROGRAM PROCESSORS;

SUPERCOMPUTERS;

EID: 84877706293     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2012.100     Document Type: Conference Paper

References (27)

1. J. W. Cooley and J. W. Tukey, "An Algorithm for the Machine Calculation of Complex Fourier Series," Math. Comput., vol. Vol. 19, pp. 297-301, 1965.
2. C. Van Loan, Computational Frameworks for the Fast Fourier Transform. SIAM Press, Philadelphia, PA, 1992.
3. M. Yokokawa, K. Itakura, A. Uno, T. Ishihara, and Y. Kaneda, "16.4-Tflops direct numerical simulation of turbulence by a Fourier spectral method on the Earth Simulator," in Proceedings of the 2002 ACM/IEEE conference on Supercomputing, ser. Supercomputing '02. Los Alamitos, CA, USA: IEEE Computer Society Press, 2002, pp. 1-17. [Online]. Available: http://dl.acm.org/citation.cfm?id=762761.762808
4. R. Chen, L. Li, and Z. Weng, "ZDOCK: an initial-stage protein-docking algorithm." Proteins, vol. 52, no. 1, pp. 80-87, 2003. [Online]. Available: http://www.ncbi.nlm.nih.gov/pubmed/12784371
5. D. Kozakov, R. Brenke, S. R. Comeau, and S. Vajda, "PIPER: An FFT-based protein docking program with pairwise potentials," Proteins: Structure, Function, and Bioinformatics, vol. 65, no. 2, pp. 392-406, 2006. (Pubitemid 44454112)
6. General-Purpose Computation Using Graphics Hardware, "http://www. gpgpu.org/."
7. J. Spitzer, "Implementing a GPU-efficient FFT," in SIGGRAPH Course on Interactive Geometric and Scientific Computations with Graphics Hardware, 2003.
8. K. Moreland and E. Angel, "The FFT on a GPU," in Proceedings of SIGGRAPH/Eurographics Workshop on Graphics Hardware 2003, 2003, pp. 112-119.
9. E. Lindholm, J. Nickolls, S. Oberman, and J. Montrym, "NVIDIA Tesla: A Unified Graphics and Computing Architecture," IEEE Micro, vol. 28, no. 2, pp. 39-55, 2008. (Pubitemid 351796170)
10. A. Nukada, Y. Ogata, T. Endo, and S. Matsuoka, "Bandwidth intensive 3-D FFT kernel for GPUs using CUDA," in SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing. Piscataway, NJ, USA: IEEE Press, 2008, pp. 1-11.
11. V. Volkov and B. Kazian, "Fitting FFT onto the G80 architecture," 2008, http://www.cs.berkeley.edu/~kubitron/courses/cs258- S08/projects/reports/project6-report.pdf.
12. N. K. Govindaraju, B. Lloyd, Y. Dotsenko, B. Smith, and J. Manferdelli, "High Performance Discrete Fourier Transforms on Graphics Processors," in the 2008 ACM/IEEE conference on supercomputing, 2008.
13. A. Nukada and S. Matsuoka, "Auto-tuning 3-D FFT library for CUDA GPUs," in Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, ser. SC '09. New York, NY, USA: ACM, 2009, pp. 30:1-30:10. [Online]. Available: http://doi.acm.org/10.1145/1654059.1654090
14. Y. Dotsenko, S. S. Baghsorkhi, B. Lloyd, and N. K. Govindaraju, "Auto-tuning of fast Fourier transform on graphics processors," in Proceedings of the 16th ACM symposium on Principles and practice of parallel programming, ser. PPoPP '11. New York, NY, USA: ACM, 2011, pp. 257-266. [Online]. Available: http://doi.acm.org/10.1145/1941553.1941589
15. A. Nukada, Y. Maruyama, and S. Matsuoka, "High performance 3-D FFT using multiple CUDA GPUs," in Proceedings of the 5th Annual Workshop on General Purpose Processing with Graphics Processing Units, ser. GPGPU-5. New York, NY, USA: ACM, 2012, pp. 57-63. [Online]. Available: http://doi.acm.org/10. 1145/2159430.2159437
16. C. Calvin, "Implementation of parallel FFT algorithms on distributed memory machines with a minimum overhead of communication," Parallel Comput., vol. 22, no. 9, pp. 1255-1279, Nov. 1996. [Online]. Available: http://dx.doi.org/10.1016/S0167-8191(96)00039-7
17. C. E. Cramer and J. A. Board, "The development and integration of a distributed 3D FFT for a cluster of workstations," in Proceedings of the 4th annual Linux Showcase & Conference - Volume 4, ser. ALS'00. Berkeley, CA, USA: USENIX Association, 2000, pp. 26-26. [Online]. Available: http://dl.acm.org/citation.cfm?id=1268379.1268405
18. M. Eleftheriou, B. G. Fitch, A. Rayshubskiy, T. J. C. Ward, and R. S. Germain, "Scalable framework for 3D FFTs on the Blue Gene/L supercomputer: implementation and early performance measurements," IBM J. Res. Dev., vol. 49, no. 2, pp. 457-464, Mar. 2005. [Online]. Available: http://dx.doi.org/10. 1147/rd.492.0457
19. J. Doi and Y. Negishi, "Overlapping Methods of All-to-All Communication and FFT Algorithms for Torus-Connected Massively Parallel Supercomputers," in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, ser. SC '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 1-9. [Online]. Available: http://dx.doi.org/10.1109/SC.2010.38
20. D. Takahashi, "An implementation of parallel 3-D FFT with 2-D decomposition on a massively parallel cluster of multi-core processors," in Proceedings of the 8th international conference on Parallel processing and applied mathematics: Part I, ser. PPAM'09. Berlin, Heidelberg: Springer-Verlag, 2010, pp. 606-614. [Online]. Available: http://dl.acm.org/citation.cfm?id= 1882792.1882864
21. C. Bell, D. Bonachea, R. Nishtala, and K. Yelick, "Optimizing bandwidth limited problems using one-sided communication and overlap," in Proceedings of the 20th international conference on Parallel and distributed processing, ser. IPDPS'06. Washington, DC, USA: IEEE Computer Society, 2006, pp. 84-84. [Online]. Available: http://dl.acm.org/citation.cfm?id=1898953.1899016
22. F. Hirata, Molecular theory of solvation. Dordrecht, The Netherlands, 2003.
23. T. Imai, A. Kovalenko, F. Hirata, and A. Kidera, "A New Approach for Investigating the Molecular Recognition of Protein: Toward Structure-Based Drug Design Based on the 3D-RISM Theory," J. Am. Chem. Soc., vol. 131, pp. 12 430-12 440, 2009.
24. Y. Kiyota, N. Yoshida, and F. Hirata, "A New Approach for Investigating the Molecular Recognition of Protein: Toward Structure-Based Drug Design Based on the 3D-RISM Theory," J. Comp. Theo. Chem., vol. 7, pp. 3803-3815, 2011.
25. A. Nukada and S. Matsuoka, "NukadaFFT : An auto-tuning FFT library for CUDA GPUs," in NVIDIA GPU Technology Conference 2010 (Research Summit Poster), 2010. [Online]. Available: http://www.nvidia.com/content/GTC/posters/ 2010/U04-NukadaFFT-An-Auto-Tuning-FFT-Library-for-CUDA-GPUs.pdf
26. Y. Chen, X. Cui, and H. Mei, "Large-scale FFT on GPU clusters," in Proceedings of the 24th ACM International Conference on Supercomputing, ser. ICS '10. New York, NY, USA: ACM, 2010, pp. 315-324. [Online]. Available: http://doi.acm.org/10.1145/1810085.1810128
27. K. Czechowski, C. McClanahan, C. Battaglino, K. Iyer, P.-K. Yeung, and R. Vuduc, "Prospects for scalable 3D FFTs on heterogeneous exascale systems," in Proc. of 2011 ACM/IEEE Conf. Supercomputing (SC), Nov. 2011.