DistDLB: Improving cosmology SAMR simulations on distributed computing systems through hierarchical load balancing

Journal of Parallel and Distributed Computing

Volumn 66, Issue 5, 2006, Pages 716-731

  Lan, Zhiling ^a,c,d,e   Taylor, Valerie E ^b,d,e,f   Li, Yawei ^a  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c Illinois Institute of Technology   (United States)

^d IEEE   (United States)

^e ACM   (United States)

^f Texas A and M University   (United States)

Author keywords

Cosmology; Distributed computing; Grid computing; Load balancing; Performance; Structured adaptive mesh refinement

Indexed keywords

COSMOLOGY; GRID COMPUTING; LOAD BALANCING; STRUCTURED ADAPTIVE MESH REFINEMENT;

ASTROPHYSICS; COMPUTER SIMULATION; COSTS; ECONOMICS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33645502511     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2006.01.001     Document Type: Article

References (50)

1. S. Baden, N. Chrisochoides, M. Norman, and D. Gannon Structured adaptive mesh refinement (SAMR) grid methods IMA Vol. Math. Appl. 117 1999
2. M. Berger, and P. Colella Local adaptive mesh refinement for shock hydrodynamics J. Comput. Phys. 82 1 1989 64 84
3. R. Biswas, L. Oliker, Experiments with repartitioning and load balancing adaptive meshes, Technical Report, NASA Ames Research Center, 1998.
4. E. Boman, K. Devine, B. Hendrickson, W. Mitchell, M. John, C. Vaughan, Zoltan: a dynamic load-balancing library for parallel applications 〈 http://www.snl.gov/zoltan 〉.
5. G. Bryan Fluid in the universe: adaptive mesh refinement in cosmology Comput. Sci. Eng. 1 2 1999 46 53
6. G. Bryan, T. Abel, and M. Norman Achieving extreme resolution in numerical cosmology using adaptive mesh refinement resolving primordial star formation Proceedings of SC2001 Denver, CO 2001
7. S. Chandra, and M. Parashar Armada an adaptive application-sensitive partitioning framework for SAMR applications Proceedings of the 14th IASTED International Conference on Parallel and Distributed Computing and Systems Cambridge, MA 2002
8. J. Chen, and V. Taylor Parapart: parallel mesh partitioning tool for distributed systems Concurrency: Practice Experience 12 2000 111 123
9. J. Chen, and V. Taylor Part: mesh partitioning for efficient use of distributed systems IEEE Trans. Parallel Distributed Systems 12 2000 111 123
10. G. Cybenko Dynamic load balancing for distributed memory multiprocessors IEEE Trans. Parallel Distributed Systems 7 1989 279 301
11. DARPA Collaborative Advanced Internet Research Network 〈 http://www.isi.edu/CAIRN/ 〉.
12. K.D. Devine, E.G. Boman, R.T. Heaphy, B.A. Hendrickson, J.D. Teresco, J. Faik, J.E. Flaherty, L.G. Gervasio, New challenges in dynamic load balancing, Appl. Numer. Math. 52(2-3) (2005) 133-152.
13. ENZO: cosmological simulation code 〈 http://cosmos.ucsd.edu/enzo/ 〉.
14. C. Farhat A simple and efficient automatic fem domain decomposer Comput. & Structures 28 5 1988 579 602
15. I. Foster, and C. Kesselman The Grid: Blueprint for a New Computing Infrastructure 1999 Morgan Kaufmann Publishers San Francisco, CA
16. Globus Project 〈 http://www.globus.org 〉.
17. HPC Wire Breaking News 〈 http://www.tgc.com/breaking/1593.html 〉.
18. W. Johnson, D. Gannon, and B. Nitzberg Grids as production computing environments: the engineering aspect of NASA's information power grid Proceedings of the 8th IEEE Symposium on High-performance Distributed Computing (HPDC) 1999
19. N. Karonis, B. Toonen, I. Foster, Mpich-g2: a grid-enabled implementation of the message passing interface, J. Parallel Distributed Comput. (2003) 551-563.
20. B. Kernighan, S. Lin, An efficient heuristic procedure for partitioning graphs, Bell System Technical J. (29) (1970) 291-307.
21. S. Kumar, S. Das, and R. Biswas Graph partitioning for parallel applications in heterogeneous grid environments Proceedings of IPDPS'02 2002
22. Z. Lan, V. Taylor, and G. Bryan Dynamic load balancing for adaptive mesh refinement applications improvements and sensitivity analysis Proceedings of IASTED Parallel and Distributed Computing Systems Anaheim, CA 2001
23. Z. Lan, V. Taylor, and G. Bryan Dynamic load balancing of SAMR applications on distributed systems Proceedings of SC2001 Denver, CO 2001
24. Z. Lan, V. Taylor, G. Bryan, A novel dynamic load balancing scheme for parallel systems, J. Parallel Distributed Comput. (2002) 1763-1781.
25. B. Maerten, D. Roose, A. Basermann, J. Fingberg, and G. Lonsdale Drama: a library for parallel dynamic load balancing of finite element applications Proceedings of European Conference on Parallel Processing 1999
26. Nas Parallel Benchmarks 〈 http://www.nas.nasa.gov/Software/NPB/ 〉.
27. H. Neeman, Autonomous hierarchical adaptive mesh refinement for multiscale simulations, Ph.D. Thesis, UIUC, 1996.
28. M. Norman, G. Bryan, Cosmological adaptive mesh refinement, Comput. Astrophys. (1998).
29. L. Oliker, and R. Biswas Plum: parallel load balancing for adaptive refined meshes J. Parallel Distributed Comput. 47 2 1997 109 124
30. ParMETIS 〈 http://www-users.cs.umn.edu/karypis/metis/parmetis/index. html 〉.
31. K. Schloegel, G. Karypis, and V. Kumar Multilevel diffusion schemes for repartitioning of adaptive meshes J. Parallel Distributed Comput. 47 2 1997 109 124
32. K. Schloegel, G. Karypis, and V. Kumar A performance study of diffusive vs. remapped load-balancing schemes Proceedings of Eleventh International Conference on Parallel and Distributed Computing 1998
33. H. Simon, Harp: a dynamic spectral partitioner, J. Parallel Distributed Comput. (1998) 83-96.
34. L. Smarr Toward the 21st century Comm. ACM 40 11 1997 28 32
35. A. Sohn, H. Simon, Jove: a dynamic load balancing framework for adaptive computations on an sp-2 distributed multiprocessor, NJIT CIS Technical Report, New Jersey, 1994.
36. F. Stangenberg, Recognizing and avoiding thrashing in dynamic load balancing, Technical Report, EPCC-SS94-04, September 1994.
37. A.S. Tanenbaum Computer Networks 1996 Prentice-Hall Englewood Cliffs, NJ
38. V. Taylor(PI), I. Foster, J. Mambretti, P. Dinda, X. Sun, A. Choudhary, DOT: distributed optical testbed to facilitate the development of techniques for efficient execution of distributed applications, NSF EIA-0224377, 2002-2004.
39. The ASCI Distributed Resource Management (DRM) Environment 〈 http://www.llnl.gov/asci/pse/hpcs/drm/ 〉.
40. The European DataGrid Project 〈 http://eu-datagrid.web.cern.ch/eu- datagrid/ 〉.
41. The Grid Physics Network(GriPhyN) 〈 http://www.griphyn.org/index.php 〉.
42. The Network for Earthquake Engineering Simulation Grid(NEESgrid) 〈 http://www.neesgrid.org/index.php 〉.
43. The NSF TeraGrid 〈 http://www.teragrid.org 〉.
44. C. Walshaw Jostle: partitioning of unstructured meshes for massively parallel machines Proceedings of the Parallel CFD'94 1994
45. C. Walshaw, and M. Cross Mesh partitioning: a multilevel balancing and refinement algorithm SIAM J. Sci. Comput. 22 1 2000 63 80
46. C. Walshaw, and M. Cross Multilevel mesh partitioning for heterogeneous communication networks Future Generation Comput. Systems 17 5 2001 601 623
47. C. Walshaw, M. Cross, M. Everett, Parallel dynamic graph partitioning for adaptive unstructured meshes, J. Parallel Distributed Comput. (1997) 102-108.
48. M. Willebeek-LeMair, and A. Reeves Strategies for dynamic load balancing on highly parallel computers IEEE Trans. Parallel Distributed Systems 4 9 1993 979 993
49. R. Wolski, N. Spring, J. Hayes, The network weather service: a distributed resource performance forecasting system, J. Future Generation Comput. Systems (1999).
50. Y. Zhang, S. Chandra, S. Hariri, and M. Parashar Autonomic proactive runtime partitioning strategies for SAMR applications Proceedings of the NSF Next Generation Systems Program Workshop IEEE/ACM 18th IPDPS, Santa Fe, NM, USA 2004