A repartitioning hypergraph model for dynamic load balancing

Journal of Parallel and Distributed Computing

Volumn 69, Issue 8, 2009, Pages 711-724

  Catalyurek, Umit V ^a,b   Boman, Erik G ^c   Devine, Karen D ^c   Bozdaǧ, Doruk ^b   Heaphy, Robert T ^c   Riesen, Lee Ann ^c  

^a OHIO STATE UNIVERSITY   (United States)

^b Ohio State University   (United States)

^c SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

Distributed memory computers; Dynamic load balancing; Hypergraph partitioning; Parallel algorithms; Scientific computing

Indexed keywords

ADAPTIVE APPLICATION; COMMUNICATION COST; COMPUTATIONAL STRUCTURE; DISTRIBUTED MEMORY COMPUTERS; DYNAMIC LOAD BALANCING; GRAPH-BASED; GRAPH-BASED MODELS; HYPERGRAPH; HYPERGRAPH MODEL; HYPERGRAPH PARTITIONING; LINUX CLUSTERS; LOAD DISTRIBUTIONS; LOAD IMBALANCE; LOAD-BALANCING; MIGRATION COSTS; MULTI-LEVEL IMPLEMENTATION; MULTILEVEL APPROACH; NEW MODEL; OVERALL COSTS; SCIENTIFIC COMPUTING; STATIC LOAD BALANCING; TOTAL COSTS;

COMPUTATION THEORY; COMPUTER OPERATING SYSTEMS; COST REDUCTION; DYNAMIC LOADS; DYNAMIC PROGRAMMING; PARALLEL ALGORITHMS; PARALLEL ARCHITECTURES; PARALLEL PROCESSING SYSTEMS;

DYNAMIC MODELS;

EID: 67349199934     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2009.04.011     Document Type: Article

References (47)

1. Alpert C.J., Caldwell A.E., Kahng A.B., and Markov I.L. Hypergraph partitioning with fixed vertices [vlsi cad]. IEEE Trans. CAD Integrated Circuits Syst. 19 2 (2000) 267-272
2. Aykanat C., Cambazoglu B.B., Findik F., and Kurc T. Adaptive decomposition and remapping algorithms for object-space-parallel direct volume rendering of unstructured grids. J. Parallel Distrib. Comput. 67 1 (2007) 77-99
3. Aykanat C., Cambazoglu B.B., and Uçar B. Multi-level direct k-way hypergraph partitioning with multiple constraints and fixed vertices. J. Parallel Distrib. Comput. 68 5 (2008) 609-625
4. Berger M.J., and Bokhari S.H. A partitioning strategy for nonuniform problems on multiprocessors. IEEE Trans. Comput. C-36 5 (1987) 570-580
5. E. Boman, K. Devine, R. Heaphy, B. Hendrickson, V. Leung, L.A. Riesen, C. Vaughan, U. Catalyurek, D. Bozdag, W. Mitchell, J. Teresco, Zoltan 3.0: Parallel partitioning, load balancing, and data-management services; User's guide, Tech. Report SAND2007-4748, W.Sandia National Laboratories, Albuquerque, NM, 2007. http://www.cs.sandia.gov/Zoltan/ug_html/ug.html
6. E.A. Boucheron, K.H. Brown, K.G. Budge, S.P. Burns, D.E. Carroll, S.K. Carroll, M.A. Christon, R.R. Drake, C.G. Garasi, T.A. Haill, J.S. Peery, S.V. Petney, J. Robbins, A.C. Robinson, R. Summers, T.E. Voth, M.K. Wong, ALEGRA: User input and physics descriptions version 4.2, Tech. Report SAND2002-2775, Sandia National Laboratories, Albuquerque, NM, 2002
7. Bui T., and Jones C. A heuristic for reducing fill in sparse matrix factorization. Proc. 6th SIAM Conf. Parallel Processing for Scientific Computing (1993), SIAM 445-452
8. Bultan T., and Aykanat C. A new mapping heuristic based on mean field annealing. J. Parallel Distrib. Comput. 16 (1992) 292-305
9. Cambazoglu B.B., and Aykanat C. Hypergraph-partitioning-based remapping models for image-space-parallel direct volume rendering of unstructured grids. IEEE Trans. Parallel Distrib. Syst. 18 1 (2007) 3-16
10. Catalyurek U.V., Boman E.G., Devine K.D., Bozdaǧ D., Heaphy R., and Fisk L.A. Hypergraph-based dynamic load balancing for adaptive scientific computations. Proceedings of 21st International Parallel and Distributed Processing Symposium. IPDPS (2007), IEEE
11. Çatalyürek U.V., and Aykanat C. Hypergraph-partitioning based decomposition for parallel sparse-matrix vector multiplication. IEEE Trans. Parallel Distrib. Syst. 10 7 (1999) 673-693
12. U.V. Çatalyürek, C. Aykanat, PaToH: A multilevel hypergraph partitioning tool, Version 3.0, Bilkent University, Department of Computer Engineering, Ankara, 06533 Turkey, 1999. PaToH is available at http://bmi.osu.edu/~umit/software.htm
13. N. Chrisochoides, Multithreaded model for dynamic load balancing parallel adaptive PDE computations, ICASE Report 95-83, ICASE, NASA Langley Research Center, Hampton, VA 23681-0001, Dec. 1995
14. Cybenko G. Dynamic load balancing for distributed memory multiprocessors. J. Parallel Distrib. Comput. 7 (1989) 279-301
15. deCougny H., Devine K., Flaherty J., Loy R., Ozturan C., and Shephard M. Load balancing for the parallel adaptive solution of partial differential equations. Appl. Numer. Math. 16 (1994) 157-182
16. Deerwester S.C., Dumais S.T., Landauer T.K., Furnas G.W., and Harshman R.A. Indexing by latent semantic analysis. J. Amer. Soc. Inform. Sci. 41 6 (1990) 391-407
17. Devine K., Boman E., Heaphy R., Bisseling R., and Catalyurek U. Parallel hypergraph partitioning for scientific computing. Proc. of 20th International Parallel and Distributed Processing Symposium. IPDPS'06 (2006), IEEE
18. Devine K., Boman E., Heaphy R., Hendrickson B., and Vaughan C. Zoltan data management services for parallel dynamic applications. Comput. Sci. Eng. 4 2 (2002) 90-97
19. Devine K., and Flaherty J. Parallel adaptive hp-refinement techniques for conservation laws. Appl. Numer. Math. 20 (1996) 367-386
20. C.M. Fiduccia, R.M. Mattheyses, A linear-time heuristic for improving network partitions, in: Proc. 19th IEEE Design Automation Conf., 1982, pp. 175-181
21. Flaherty J., Loy R., Shephard M., Szymanski B., Teresco J., and Ziantz L. Adaptive local refinement with octree load-balancing for the parallel solution of three-dimensional conservation laws. J. Parallel Distrib. Comput. 47 2 (1998) 139-152
22. Garey M.R., and Johnson D.S. Computers and Intractability (1979), W.H. Freeman and Co., New York, New York
23. Hendrickson B., and Kolda T.G. Graph partitioning models for parallel computing. Parallel Comput. 26 (2000) 1519-1534
24. Hendrickson B., and Leland R. The Chaco User's Guide, Version 2.0 (1995), Sandia National Laboratories, Alburquerque, NM, 87185
25. Hendrickson B., and Leland R. A multilevel algorithm for partitioning graphs. Proc. Supercomputing '95 (1995), ACM
26. B. Hendrickson, R. Leland, R. Van Driessche, Skewed graph partitioning, in: Proc. Eighth SIAM Conf. Parallel Processing for Scientific Computation, March 1997
27. Hu Y.F., Blake R.J., and Emerson D.R. An optimal migration algorithm for dynamic load balancing. Concurrency Pract. Exp. 10 (1998) 467-483
28. Karypis G., and Kumar V. A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20 1 (1998) 359-392
29. G. Karypis, V. Kumar, MeTiS a software package for partitioning unstructured graphs, partitioning meshes, and computing fill-reducing orderings of sparse matrices version 4.0, University of Minnesota, Department of Comp. Sci. and Eng., Army HPC Research Center, Minneapolis, 1998
30. G. Karypis, V. Kumar, R. Aggarwal, S. Shekhar, hMeTiS a hypergraph partitioning package version 1.0.1, University of Minnesota, Department of Comp. Sci. and Eng., Army HPC Research Center, Minneapolis, 1998
31. G. Karypis, K. Schloegel, V. Kumar, Parmetis: Parallel graph partitioning and sparse matrix ordering library, version 3.1. Technical Report, Dept. Computer Science, University of Minnesota, 2003. http://www-users.cs.umn.edu/~karypis/metis/parmetis/download.html
32. Lengauer T. Combinatorial Algorithms for Integrated Circuit Layout (1990), Willey-Teubner, Chichester, U.K.
33. Oliker L., and Biswas R. PLUM: Parallel load balancing for adaptive unstructured mesh es. J. Parallel Distrib. Comput. 51 2 (1998) 150-177
34. Patra A., and Oden J.T. Problem decomposition for adaptive hp finite element methods. J. Comput. Syst. Eng. 6 2 (1995)
35. F. Pelligrini, PT-SCOTCH 5.1 user's guide, Research Rep., LaBRI, 2008
36. J.R. Pilkington, S.B. Baden, Partitioning with spacefilling curves, CSE Technical Report CS94-349, Dept. Computer Science and Engineering, University of California, San Diego, CA, 1994
37. Sadayappan P., Ercal F., and Ramanujam J. Cluster partitioning approaches to mapping parallel programs onto hypercube. Parallel Comput. 13 (1990) 1-16
38. Schloegel K., Karypis G., and Kumar V. Multilevel diffusion algorithms for repartitioning of adaptive meshes. J. Parallel Distrib. Comput. 47 2 (1997) 109-124
39. K. Schloegel, G. Karypis, V. Kumar, A unified algorithm for load-balancing adaptive scientific simulations, in: Proc. Supercomputing, Dallas, 2000
40. Schloegel K., Karypis G., and Kumar V. Wavefront diffusion and LMSR: Algorithms for dynamic repartitioning of adaptive meshes. IEEE Trans. Parallel Distrib. Syst. 12 5 (2001) 451-466
41. Teresco J.D., Beall M.W., Flaherty J.E., and Shephard M.S. A hierarchical partition model for adaptive finite element computation. Comput. Methods Appl. Mech. Engrg. 184 (2000) 269-285
42. Trifunovic A., and Knottenbelt W.J. Parkway 2.0: A parallel multilevel hypergraph partitioning tool. Proc. 19th International Symposium on Computer and Information Sciences. ISCIS 2004. LNCS vol. 3280 (2004), Springer 789-800
43. Walshaw C. The Parallel JOSTLE Library User's Guide, Version 3.0 (2002), University of Greenwich, London, UK
44. Walshaw C., Cross M., and Everett M.G. Parallel dynamic graph partitioning for adaptive unstructured meshes. J. Parallel Distrib. Comput. 47 2 (1997) 102-108
45. M.S. Warren, J.K. Salmon, A parallel hashed oct-tree n-body algorithm, in: Proc. Supercomputing '93, Portland, OR, Nov. 1993
46. Willebeek-LeMair M., and Reeves A.P. Strategies for dynamic load balancing on highly parallel computers. IEEE Trans. Parallel Distrib. Syst. 4 9 (1993) 979-993
47. Williams R. Performance of dynamic load balancing algorithms for unstructured mesh calculations. Concurrency 3 October (1991) 457-481