Enabling and scaling a global shallow-water atmospheric model on Tianhe-2

Proceedings of the International Parallel and Distributed Processing Symposium, IPDPS

Volumn , Issue , 2014, Pages 745-754

  Xue, Wei ^a   Yang, Chao ^b,c   Fu, Haohuan ^a   Wang, Xinliang ^a   Xu, Yangtong ^a   Gan, Lin ^a   Lu, Yutong ^d   Zhu, Xiaoqian ^d  

^a TSINGHUA UNIVERSITY   (China)

^b INSTITUTE OF SOFTWARE   (China)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^d NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

Author keywords

atmospheric model; Intel MIC architecture; scalability; stencil; Tianhe 2

Indexed keywords

ACCELERATION; ALGORITHMS; DATA TRANSFER; DISTRIBUTED PARAMETER NETWORKS; PROGRAM PROCESSORS; SCALABILITY; SUPERCOMPUTERS;

ATMOSPHERIC DYNAMICS; ATMOSPHERIC MODEL; COMMUNICATION OVERHEADS; DEFENSE TECHNOLOGIES; GLOBAL ATMOSPHERIC MODELS; INTEL MIC ARCHITECTURES; STENCIL; TIANHE-2;

PARALLEL PROCESSING SYSTEMS;

EID: 84906673723     PISSN: 15302075     EISSN: 23321237     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2014.82     Document Type: Conference Paper

References (36)

1. TOP 500, http://www.top500.org/
2. T. Hamada and K. Nitadori, "190 TFlops astrophysical N-body simulation on a cluster of GPUs," in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC '10). Washington, DC, USA: IEEE Computer Society, 2010, pp. 1-9.
3. Q. Hu, N. A. Gumerov, and R. Duraiswami, "Scalable fast multipole methods on distributed heterogeneous architectures," in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC '11). New York, NY, USA: ACM, 2011, pp. 36:1-36:12.
4. M. Bernaschi, M. Bisson, T. Endo, S. Matsuoka, M. Fatica, and S. Melchionna, "Petaflop biofluidics simulations on a two million-core system," in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC '11). New York, NY, USA: ACM, 2011, pp. 4:1-4:12.
5. T. Shimokawabe, T. Aoki, T. Takaki, T. Endo, A. Yamanaka, N. Maruyama, A. Nukada, and S. Matsuoka, "Peta-scale phase-field simulation for dendritic solidification on the TSUBAME 2.0 supercomputer," in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC '11). New York, NY, USA: ACM, 2011, pp. 3:1-3:11.
6. J. M. Levesque, R. Sankaran, and R. Grout, "Hybridizing S3D into an exascale application using OpenACC: an approach for moving to multipetaflops and beyond," In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC '12). Los Alamitos, CA, USA: ACM, 2012 , pp. 15:1-15:11.
7. C. Baker, G. Davidson, T. M. Evans, S. Hamilton, J. Jarrell, and W. Joubert, "High performance radiation transport simulations: preparing for Titan," In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC '12). Los Alamitos, CA, USA, pp. 47:1-47:10.
8. H. Miura, M. Satoh, T. Nasuno, A. T. Noda, and K. Oouchi, "A Madden- Julian Oscillation event realistically simulated by a global cloud-resolving model," Science, vol. 318, pp. 1763-1765, 2007.
9. M. Satoh, T. Matsuno, H. Tomita, H. Miura, T. Nasuno, and S. Iga, "Nonhydrostatic icosahedral atmospheric model (NICAM) for global cloud resolving simulations," J. Comput. Physics, vol. 227 , no.7 pp. 3486-3514, 2008.
10. J. Michalakes and M. Vachharajani, "GPU acceleration of numerical weather prediction," in Proceedings of IEEE International Symposium on Parallel and Distributed Processing (IPDPS 2008), 2008, pp. 1-7.
11. T. Shimokawabe, T. Aoki, C. Muroi, J. Ishida, K. Kawano, T. Endo, A. Nukada, N. Maruyama, and S. Matsuoka, "An 80-fold speedup, 15.0 TFlops full GPU acceleration of non-hydrostatic weather model ASUCA production code," in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC '10). Washington, DC, USA: IEEE Computer Society, 2010, pp. 1-11.
12. M. W. Govett, J. Middlecoff, and T. Henderson, "Running the NIM nextgeneration weather model on GPUs," in Proceedings of 10th IEEE/ACM Int. Conf. Cluster, Cloud and Grid Computing (CCGrid), 2010, pp. 792- 796
13. W. Putman, "Graphics Processing Unit (GPU) Acceleration of the Goddard Earth Observing System Atmospheric Model," NASA Technical Report, Goddard Space Flight Center, 2011, http://ntrs.nasa.gov/search.jsp?R= 20120009084/
14. T. Shimokawabe, T. Aoki, J. Ishida, K. Kawano, and C. Muroi, "145 TFlops performance on 3990 GPUs of TSUBAME 2.0 supercomputer for an operational weather prediction," Procedia Computer Science, vol. 4, pp. 1535 - 1544, 2011, proceedings of the International Conference on Computational Science (ICCS 2011).
15. I. Demeshko, N. Maruyama, H. Tomita, and S. Matsuoka, "Multi-GPU Implementation of the NICAM Atmospheric Model," In Proceedings of Tenth International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Platforms (HeteroPar'2012). Rhodes Island, Greece, pp. 175-184
16. I. Carpenter, R. K. Archibald, K. J. Evans, J. Larkin, P. Micikevicius, M. Norman, J. Rosinski, J. Schwarzmeier, and M. A. Taylor, "Progress towards accelerating HOMME on hybrid multi-core systems," The International Journal of High Performance Computing Applications, vol. 27, no. 3, pp. 335-347.
17. C. Yang,W. Xue, H. Fu, L. Gan, L. Li, Y. Xu, Y. Lu, J. Sun, G. Yang, and W. Zheng, "A peta-scalable CPU-GPU algorithm for global atmospheric simulations," In Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming (PPoPP '13), ACM, New York, NY, USA, pp. 1-12.
18. C. Yang and X.-C. Cai, "Parallel multilevel methods for implicit solution of shallow water equations with nonsmooth topography on the cubedsphere," J. Comput. Phys., vol. 230, pp. 2523-2539, 2011.
19. S. Gottlieb, C.-W. Shu, and E. Tadmor, "Strong stability-preserving highorder time discretization methods," SIAM Review, vol. 43, pp. 89-112, 2001.
20. D. L. Williamson, J. B. Drake, J. J. Hack, R. Jakob, and P. N. Swarztrauber, "A standard test set for numerical approximations to the shallow water equations in spherical geometry," J. Comput. Phys., 102: 211-224, 1992.
21. R. Jakob-Chien, J. J. Hack, and D. L. Williamson, "Spectral transform solutions to the shallow water test set," J. Comput. Phys., 119:164-187, 1995.
22. L.-W. Chang, J. A. Stratton, H.-S. Kim, and W.-M. Hwu, "A scalable, numerically stable, high-performance tridiagonal solver using GPUs," In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC '12), IEEE Computer Society Press, Los Alamitos, CA, USA, pp. 27:1-11.
23. J. Wu and J. Jaja, "High Performance FFT Based Poisson Solver on a CPU-GPU Heterogeneous Platform," In Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing (IPDPS '13), IEEE Computer Society, Washington, DC, USA, 115-125.
24. K. Datta, M. Murphy, V. Volkov, S. Williams, J. Carter, L. Oliker, D. Patterson, J. Shalf, and K. Yelick, "Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures," in Proceedings of the 2008 ACM/IEEE conference on Supercomputing (SC '08). Piscataway, NJ, USA: IEEE Press, 2008, pp. 4:1-4:12.
25. S. Kamil, K. Datta, S. Williams, L. Oliker, J. Shalf, and K. Yelick, "Implicit and explicit optimizations for stencil computations," In Proceedings of the 2006 workshop on Memory system performance and correctness (MSPC '06), pp. 51-60.
26. M. Frigo and V. Strumpen, "The memory behavior of cache oblivious stencil computations," J. Supercomput., vol. 39, no. 2, pp. 93-112, 2007.
27. G. Jin, T. Endo, and S. Matsuoka, "A Multi-Level Optimization Method for Stencil Computation on the Domain that is Bigger than Memory Capacity of GPU," In Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Workshops and PhD Forum (IPDPSW '13), IEEE Computer Society, Washington, DC, USA, 1080-1087.
28. WT Tang, WJ Tan, R. Krishnamoorthy, YW Wong, S.-h. Kuo, RSM Goh, S. J. Turner, and W.-F. Wong, "Optimizing and Auto-Tuning Iterative Stencil Loops for GPUs with the In-Plane Method," In Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing (IPDPS '13), IEEE Computer Society, Washington, DC, USA.
29. A. Nguyen, N. Satish, J. Chhugani, C. Kim, and P. Dubey, "3.5-D blocking optimization for stencil computations on modern CPUs and GPUs," In Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC '10), pp.1-13.
30. M. Christen, O. Schenk, and Y. Cui, "Patus for convenient highperformance stencils: evaluation in earthquake simulations," In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC '12), IEEE Computer Society Press, Los Alamitos, CA, USA, pp. 11:1-10.
31. J. Park, PTP Tang, M. Smelyanskiy, D. Kim, and T. Benson, "Efficient backprojection-based synthetic aperture radar computation with manycore processors," In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC '12), IEEE Computer Society Press, Los Alamitos, CA, USA, pp. 28:1-11.
32. S. J. Pennycook, C. J. Hughes, M. Smelyanskiy, and S. A. Jarvis, "Exploring SIMD for Molecular Dynamics, Using Intel Xeon Processors and Intel Xeon Phi Coprocessors." In Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing (IPDPS '13), IEEE Computer Society, Washington, DC, USA.
33. X. Liu, M. Smelyanskiy, E. Chow, and P. Dubey, "Efficient sparse matrix-vector multiplication on x86-based many-core processors," In Proceedings of the 27th international ACM conference on International conference on supercomputing (ICS '13), ACM, New York, NY, USA, pp. 273-282.
34. A. Heinecke, K. Vaidyanathan, M. Smelyanskiy, A. Kobotov, R. Dubtsov, G. Henry, A. G. Shet, G. Chrysos, and P. Dubey, "Design and Implementation of the Linpack Benchmark for Single and Multinode Systems Based on Intel Xeon Phi Coprocessor." In Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing (IPDPS '13), IEEE Computer Society, Washington, DC, USA.
35. D. Schmidl, T. Cramer, S. Wienke, C. Terboven, and M. S. Müller, "Assessing the Performance of OpenMP Programs on the Intel Xeon Phi", In Proceedings of the Euro-Par 2013, Aachen, Germany, 2013
36. S. Ramos, and T. Hoefler, "Modeling communication in cache-coherent SMP systems: a case-study with Xeon Phi," In Proceedings of the 22nd international symposium on High-performance parallel and distributed computing (HPDC '13). ACM, New York, NY, USA, 97-108.