Porting HPC applications to the cloud: A multi-frontal solver case study

Journal of Computational Science

Volumn 18, Issue , 2017, Pages 106-116

  Balis, Bartosz ^a   Figiela, Kamil ^a   Jopek, Konrad ^a   Malawski, Maciej ^a   Pawlik, Maciej ^a  

^a AGH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Poland)

Author keywords

HPC in the cloud; Mesh based solver; Multi frontal direct solver; Scientific workflows

Indexed keywords

DIGITAL STORAGE; ELECTRIC ARC WELDING;

CLOUD INFRASTRUCTURES; COMPUTATIONAL SCIENCE; DIRECT SOLVERS; FINITE ELEMENT MESHES; MESH-BASED SOLVER; SCIENTIFIC APPLICATIONS; SCIENTIFIC WORKFLOWS; STORAGE ARCHITECTURES;

HEURISTIC METHODS;

EID: 84992390876     PISSN: 18777503     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jocs.2016.09.006     Document Type: Article

References (50)

1. [1] Gupta, A., Kale, L.V., Gioachin, F., March, V., Suen, C.H., Lee, B.-S., Faraboschi, P., Kaufmann, R., Milojicic, D., The who, what, why, and how of high performance computing in the cloud. Cloud Computing Technology and Science (CloudCom), IEEE 5th International Conference on, Vol. 1, 2013, IEEE, 306–314.
2. [2] Thain, D., Tannenbaum, T., Livny, M., Distributed computing in practice: the Condor experience. Concurr. Comput. Pract. Exp. 17:2–4 (2005), 323–356, 10.1002/cpe.938.
3. [3] Taylor, I., Deelman, E., Gannon, D., Shields, M., (eds.) Workflows for E-Science, 2007, Springer, Secaucus, New York, NJ, USA.
4. [4] Marathe, A., Harris, R., Lowenthal, D.K., de Supinski, B.R., Rountree, B., Schulz, M., Yuan, X., A comparative study of high-performance computing on the cloud. Proceedings of the 22nd International Symposium on High-performance Parallel and Distributed Computing, HPDC ‘13, 2013, ACM, New York, NY, USA, 239–250, 10.1145/2462902.2462919.
5. [5] Demkowicz, L., Kurtz, J., Pardo, D., Paszyński, D., Rachowicz, W., Zdunek, A., Computing With HP-Adaptive Finite Element Method. Vol. II. Frontiers: Three Dimensional Elliptic and Maxwell Problems. 2007, Chapmann & Hall/CRC Applied Mathematics & Nonlinear Science.
6. [6] Paszynski, M., Fast Solvers for Mesh-Based Computations. 2015, CRC Press.
7. [7] Duff, I.S., Reid, J.K., The multifrontal solution of indefinite sparse symmetric linear. ACMMathSoft 9:3 (1983), 302–325.
8. [8] Duff, I.S., Reid, J.K., The multifrontal solution of unsymmetric sets of linear equations. SIAM Sci. Stat. 5:3 (1984), 633–641.
9. [9] Obrok, P., Pierzchala, P., Szymczak, A., Paszyński, M., Graph grammar-based multi-thread multi-frontal parallel solver with trace theory-based scheduler. Procedia Comput. Sci. 1:1 (2010), 1993–2001.
10. [10] Paszyński, M., Schaefer, R., Graph grammar-driven parallel partial differential equation solver. Concurr. Comput. Pract. Exp. 22:9 (2010), 1063–1097.
11. [11] Paszynski, M., Pardo, D., Carlos, T.-V., Demkowiczd, L., Calo, V., A parallel direct solver for the self-adaptive HP finite element method. J. Parallel Distrib. Comput. 70:3 (2010), 270–281.
12. [12] Paszyńska, A., Paszyński, M., Pardo, D., Parallel multi-frontal solver for p adaptive finite element modeling of multi-physics computational problems. J. Comput. Sci. 1:1 (2010), 48–54.
13. [13] Balay, S., Abhyankar, S., Adams, M., Brown, J., Brune, P., Buschelman, K., Eijkhout, V., Gropp, W., Kaushik, D., Knepley, M., et al. PETSc Users Manual Revision 3.5, Tech. Rep., Technical Report. 2014, Argonne National Laboratory (ANL).
14. [14] Hénon, P., Ramet, P., Roman, J., Pastix: a high-performance parallel direct solver for sparse symmetric positive definite systems. Parallel Comput. 28:2 (2002), 301–321.
15. [15] Li, X.S., An overview of superLU: algorithms, implementation, and user interface. ACM Trans. Math. Softw. 31:3 (2005), 302–325.
16. [16] Fialko, S., A block sparse shared-memory multifrontal finite element solver for problems of structural mechanics. Comput. Assist. Mech. Eng. Sci., 16(117–131), 2009, 17.
17. [17] Fialko, S., Parfes: a method for solving finite element linear equations on multi-core computers. Adv. Eng. Soft. 41:12 (2010), 1256–1265.
18. [18] Krawezik, G.P., Poole, G., Accelerating the ANSYS direct sparse solver with GPUs. Symposium on Application Accelerators in High Performance Computing (SAAHPC’09), 2009.
19. [19] Sao, P., Vuduc, R., Li, X.S., A distributed CPU–GPU sparse direct solver. Euro-Par 2014 Parallel Processing, 2014, Springer, 487–498.
20. [20] Paszyński, M., Fast Solvers for Mesh-Based Computations. 2016, Taylor & Franics, CRC Press, Secaucus, NJ, USA.
21. [21] Balis, B., Increasing scientific workflow programming productivity with hyperflow. Proceedings of the 9th Workshop on Workflows in Support of Large-Scale Science, WORKS ‘14, 2014, IEEE Press, Piscataway, NJ, USA, 59–69, 10.1109/WORKS.2014.10.
22. [22] Balis, B., Figiela, K., Malawski, M., Jopek, K., Leveraging workflows and clouds for a multi-frontal solver for finite-element meshes. Procedia Comput. Sci. 51 (2015), 944–953.
23. [23] Foster, I., Designing and Building Parallel Programs: Concepts and Tools for Parallel Software Engineering. 1995, Addison-Wesley Longman Publishing Co., Inc. http://portal.acm.org/citation.cfm?id=527029.
24. [24] Karypis, G., Kumar, V., A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20:1 (1998), 359–392, 10.1137/S1064827595287997.
25. [25] AbouEisha, H., Moshkov, M., Calo, V., Paszyński, M., Goik, D., Jopek, K., Dynamic programming algorithm for generation of optimal elimination trees for multi-frontal direct solver over H-refined grids. Procedia Comput. Sci. 29 (2014), 947–959.
26. [26] Paszyńska, A., Paszyński, M., Jopek, K., Wozniak, M., Goik, D., Gurgul, P., AbouEisha, H., Moshkov, M., Calo, V., Lenharth, A., Nguyen, D., Pingali, K., Quasi-optimal elimination trees for 2D grids with singularities. Sci. Progr., 2015, 2015, 18, 10.1155/2015/303024 Article ID 303024.
27. [27] Goik, D., Jopek, K., Paszyński, M., Lenharth, A., Nguyen, D., Pingali, K., Graph grammar based multi-thread multi-frontal direct solver with Galois scheduler. Procedia Comput. Sci. 29 (2014), 960–969.
28. [28] Fialko, S.Y., Stress–strain analysis of thin-walled shells with massive ribs. Int. Appl. Mech. 40:4 (2004), 432–439.
29. [29] Fialko, S., A spare shared-memory multifrontal solver in SCAD software. International Multiconference on Computer Science and Information Technology, IMCSIT, 2008, IEEE, 277–283.
30. [30] Amestoy, P.R., Guermouche, A., L‘Excellent, J.-Y., Pralet, S., Hybrid scheduling for the parallel solution of linear systems. Parallel Comput. 32:2 (2006), 136–156, 10.1016/j.parco.2005.07.004.
31. [31] The Magellan Report on Cloud Computing for Science, Technical Report. 2011, December, U.S. Department of Energy Office of Science Office of Advanced Scientific Computing Research (ASCR) http://science.energy.gov/~/media/ascr/pdf/program-documents/docs/Magellan_Final_Report.pdf.
32. [32] Vöckler, J.S., Juve, G., Deelman, E., Rynge, M., Berriman, B., Experiences using cloud computing for a scientific workflow application. Proceedings of the 2nd International Workshop on SCIENTIFIC CLOUD COMPUTING, ScienceCloud ‘11, 2011, ACM, San Jose, CA, USA, 15–24, 10.1145/1996109.1996114 http://portal.acm.org/citation.cfm?id=1996109.1996114.
33. [33] Juve, G., Deelman, E., Vahi, K., Mehta, G., Berriman, B., Berman, B.P., Maechling, P., Scientific workflow applications on Amazon EC2. 5th IEEE International Conference on EScience Workshops, 2009, IEEE, Oxford, United Kingdom, 59–66, 10.1109/ESCIW.2009.5408002 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5408002.
34. [34] Iosup, A., Ostermann, S., Yigitbasi, N., Prodan, R., Fahringer, T., Epema, D., Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Trans. Parallel Distrib. Syst. 22:6 (2011), 931–945, 10.1109/TPDS.2011.66 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5719609.
35. [35] Wu, D., Liu, X., Hebert, S., Gentzsch, W., Terpenny, J., Performance evaluation of cloud-based high performance computing for finite element analysis. Volume 1A: 35th Computers and Information in Engineering Conference, 2015, ASME, 10.1115/DETC2015-46381 p. V01AT02A043.
36. [36] Mauch, V., Kunze, M., Hillenbrand, M., High performance cloud computing. Future Gener. Comput. Syst. 29:6 (2013), 1408–1416, 10.1016/j.future.2012.03.011 http://www.sciencedirect.com/science/article/pii/S0167739X12000647.
37. [37] Gupta, A., Sarood, O., Kale, L.V., Milojicic, D., Improving HPC application performance in cloud through dynamic load balancing. Proceedings – 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013, 2013, 402–409, 10.1109/CCGrid.2013.65.
38. [38] Gupta, A., Kale, L.V., Milojicic, D., Faraboschi, P., Balle, S.M., HPC-aware VM placement in infrastructure clouds. 2013 IEEE International Conference on Cloud Engineering (IC2E), 2013, IEEE, 11–20, 10.1109/IC2E.2013.38 http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6529263.
39. [39] Ben Belgacem, M., Chopard, B., A hybrid HPC/cloud distributed infrastructure: coupling EC2 cloud resources with HPC clusters to run large tightly coupled multiscale applications. Future Gener. Comput. Syst. 42 (2015), 11–21, 10.1016/j.future.2014.08.003 http://www.sciencedirect.com/science/article/pii/S0167739X14001514.
40. [40] Using Parallel NAEs – Nimbix. https://nimbix.zendesk.com/hc/en-us/articles/201849506-Using-Parallel-NAEs.
41. [41] H. AbouEisha, V. Calo, K. Jopek, M. Moshkov, A. Paszynska, M. Paszynski, M. Skotniczny. Element partition trees for two- and three-dimensional H-refined meshes and their use to optimize direct solver performance, J. Comput. Sci. (submitted for publication).
42. [42] Skotniczny, M., Paszynski, M., Paszynska, A., Bisection Weighted by Element Size Ordering Algorithm for Multi-Frontal Solver Executed Over 3D H Refined Grids. 2016.
43. [43] Aboueisha, H., Jopek, K., Medygrał, B., Nosek, S., Moshkov, M., Paszynska, A., Paszynski, M., Pingali, K., Hybrid direct and iterative solver with library of multi-criteria optimal orderings for H adaptive finite element method computations. Procedia Comput. Sci. 80 (2016), 865–874.
44. [44] Paszynska, A., Jopek, K., Wozniak, M., Paszynski, M., Nguyen, D., Lenerth, A., Pingali, K., Multi-frontal multi-thread direct solver with Galois system for adaptive finite element method. PANACM 2015: 1st Pan-American Congress on Computational Mechanics in Conjunction With the XI Argentine Congress on Computational Mechanics, MECOM, 2015.
45. [45] Paszyński, M., Pardo, D., Calo, V., Direct solvers performance on H-adapted grids. Comput. Math. Appl. 70:3 (2015), 282–295.
46. [46] Balis, B., Figiela, K., Malawski, M., Pawlik, M., Bubak, M., A lightweight approach for deployment of scientific workflows in cloud infrastructures. Parallel Processing and Applied Mathematics, Vol. 9573 of Lecture Notes in Computer Science, 2016, Springer, 281–290.
47. [47] Balis, B., Hyperflow: a model of computation, programming approach and enactment engine for complex distributed workflows. Future Gener. Comput. Syst. 55 (2016), 147–162, 10.1016/j.future.2015.08.015 http://www.sciencedirect.com/science/article/pii/S0167739X15002770.
48. [48] Rodrigo Álvarez, G.P., Östberg, P.-O., Elmroth, E., Antypas, K., Gerber, R., Ramakrishnan, L., HPC system lifetime story: workload characterization and evolutionary analyses on NERSC systems. Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, 2015, ACM, 57–60.
49. [49] Baer, T., Johnson, D., pbsacct: a workload analysis system for PBS-based HPC systems. Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment, 2014, ACM, 42.
50. [50] Mao, M., Humphrey, M., A performance study on the VM startup time in the cloud. IEEE 5th International Conference on Cloud Computing (CLOUD), 2012, IEEE, 423–430.