K-means clustering for optimal partitioning and dynamic load balancing of parallel hierarchical N-body simulations

Journal of Computational Physics

Volumn 207, Issue 2, 2005, Pages 493-528

  Marzouk, Youssef M ^a,b   Ghoniem, Ahmed F ^a  

^a Massachusetts Institute of Technology Cambridge   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

Hierarchical methods; k means clustering; Load balancing; N body problems; Parallel processing; Particle methods; Three dimensional flow; Transverse jet; Treecode; Vortex methods

Indexed keywords

EFFICIENCY; GRAVITATION; MOLECULAR DYNAMICS; REYNOLDS NUMBER; VORTEX FLOW;

HIERARCHICAL METHOD; K-MEANS++ CLUSTERING; LOAD-BALANCING; N BODY PROBLEM; PARALLEL PROCESSING; PARTICLE METHODS; THREE-DIMENSIONAL FLOW; TRANSVERSE JET; TREECODE; VORTEX METHODS;

ASTROPHYSICS;

EID: 18844422765     PISSN: 00219991     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jcp.2005.01.021     Document Type: Article

References (72)

1. K. Lindsay R. Krasny A particle method and adaptive treecode for vortex sheet motion in three-dimensional flow Journal of Computational Physics 172 2 2001 879-907
2. G.-H. Cottet P.D. Koumoutsakos Vortex methods: Theory and practice 2000 Cambridge University Press Cambridge, MA
3. J. Dubinski A parallel tree code New Astronomy 1 2 1997 133-147
4. L. Ying G. Biros D. Zorin A kernel-independent adaptive fast multipole algorithm in two and three dimensions Journal of Computational Physics 196 2 2004 591-626
5. L. Greengard Fast algorithms for classical physics Science 265 5174 1994 909-914
6. A.W. Appel An efficient program for many-body simulation SIAM Journal on Scientific and Statistical Computing 6 1985 85-103
7. J. Barnes P. Hut A hierarchical O(N log N) force-calculation algorithm Nature 324 6096 1986 446-449
8. L. Greengard V. Rokhlin A fast algorithm for particle simulations Journal of Computational Physics 73 2 1987 325-348
9. M.S. Warren, J.K. Salmon, Astrophysical N-body simulations using hierarchical tree data structures, in: Proceedings of Supercomputing'92, IEEE, 1992, pp. 570-576
10. M.S. Warren J.K. Salmon A portable parallel particle program Computer Physics Communications 87 1-2 1995 266-290
11. Y.M. Marzouk, A.F. Ghoniem, Vorticity formulation for an actuated jet in crossflow, in: 42nd Aerospace Sciences Meeting and Exhibit, No. AIAA-2004-0096, AIAA, 2004
12. Y.M. Marzouk, Vorticity structure and evolution in a transverse jet with new algorithms for scalable particle simulation, Ph.D. thesis, Massachusetts Institute of Technology (June 2004)
13. A. Leonard Computing three-dimensional incompressible flows with vortex elements Annual Review of Fluid Mechanics 17 1985 523-559
14. O.M. Knio A.F. Ghoniem Numerical study of a three-dimensional vortex method Journal of Computational Physics 86 1990 75-106
15. A. Majda A.L. Bertozzi Vorticity and incompressible flow 2001 Cambridge University Press Cambridge; New York
16. E.G. Puckett Vortex methods: An introduction and survey of selected research topics In M.D. Gunzburger R.A. Nicolaides (Eds.) Incompressible computational fluid dynamics: Trends and advances 1993 Cambridge University Press Cambridge; New York 335-407
17. A.J. Chorin Numerical study of slightly viscous flow Journal of Fluid Mechanics 57 1973 785-796
18. L. Rosenhead The formation of vortices from a surface of discontinuity Proceedings of the Royal Society A 134 1931 170-192
19. O. Hald V.M. Delprete Convergence of vortex methods for Euler's equations Mathematics of Computation 32 143 1978 791-809
20. J.T. Beale A. Majda Vortex methods: 1. Convergence in three dimensions Mathematics of Computation 39 159 1982 1-27
21. C. Anderson C. Greengard On vortex methods SIAM Journal on Numerical Analysis 22 1985 413-440
22. A.F. Ghoniem F.S. Sherman Grid-free simulation of diffusion using random-walk methods Journal of Computational Physics 61 1 1985 1-37
23. P. Degond S. Masgallic The weighted particle method for convection-diffusion equations: 1. The case of an isotropic viscosity Mathematics of Computation 53 188 1989 485-507
24. S. Shankar L. van Dommelen A new diffusion procedure for vortex methods Journal of Computational Physics 127 1 1996 88-109
25. S. Mas-Gallic The diffusion velocity method: A deterministic way of moving the nodes for solving diffusion equations Transport Theory and Statistical Physics 31 4-6 2002 595-605
26. P. Ploumhans G.S. Winckelmans Vortex methods for high-resolution simulations of viscous flow past bluff bodies of general geometry Journal of Computational Physics 165 2 2000 354-406
27. M.C. Soteriou A.F. Ghoniem Effects of the free-stream density ratio on free and forced spatially developing shear layers Physics of Fluids 7 8 1995 2036-2051
28. J.D. Eldredge T. Colonius A. Leonard A vortex particle method for two-dimensional compressible flow Journal of Computational Physics 179 2 2002 371-399
29. I. Lakkis A.F. Ghoniem Axisymmetric vortex method for low-Mach number, diffusion-controlled combustion Journal of Computational Physics 184 2 2003 435-475
30. A.J. Chorin J.E. Marsden A mathematical introduction to fluid mechanics 1993 Springer-Verlag Berlin
31. J.K. Salmon M.S. Warren Skeletons from the tree-code closet Journal of Computational Physics 111 1 1994 136-155
32. R.A. Gingold J.J. Monaghan Smoothed particle hydrodynamics: Theory and application to non-spherical stars Monthly Notices of the Royal Astronomical Society 181 2 1977 375-389
33. L. Hernquist N. Katz TreeSPH - a unification of SPH with the hierarchical tree method Astrophysical Journal Supplement Series 70 2 1989 419-446
34. Z.H. Duan R. Krasny An Ewald summation based multipole method Journal of Chemical Physics 113 9 2000 3492-3495
35. Z.H. Duan R. Krasny An adaptive treecode for computing nonbonded potential energy in classical molecular systems Journal of Computational Chemistry 22 2 2001 184-195
36. A.H. Boschitsch M.O. Fenley W.K. Olson A fast adaptive multipole algorithm for calculating screened Coulomb (Yukawa) interactions Journal of Computational Physics 151 1 1999 212-241
37. T. Schlick R.D. Skeel A.T. Brunger L.V. Kale J.A. Board J. Hermans K. Schulten Algorithmic challenges in computational molecular biophysics Journal of Computational Physics 151 1 1999 9-48
38. L. van Dommelen E.A. Rundensteiner Fast, adaptive summation of point forces in the two-dimensional poisson equation Journal of Computational Physics 83 1 1989 126-147
39. C.R. Anderson An implementation of the fast multipole method without multipoles SIAM Journal on Scientific and Statistical Computing 13 4 1992 923-947
40. J.E. Barnes A modified tree code: Don't laugh, it runs Journal of Computational Physics 87 1 1990 161-170
41. A. Grama V. Sarin A. Sameh Improving error bounds for multipole-based treecodes SIAM Journal on Scientific Computing 21 5 2000 1790-1803
42. L. Greengard V. Rokhlin The rapid evaluation of potential fields in three dimensions Lecture Notes in Mathematics 1360 1988 121-141
43. J.H. Strickland R.S. Baty A pragmatic overview of fast multipole methods in: J. Renegar M. Shub S. Smale (Eds.) The mathematics of numerical analysis: 1995 AMS-SIAM summer seminar in applied mathematics 1996 American Mathematical Society Providence, RI 807-830
44. H.G. Petersen D. Soelvason J.W. Perram E.R. Smith The very fast multipole method Journal of Chemical Physics 101 10 1994 8870-8876
45. L. Greengard V. Rokhlin A new version of the fast multipole method for the Laplace equation in three dimensions Acta Numerica 6 1997 229-269
46. H. Cheng L. Greengard V. Rokhlin A fast adaptive multipole algorithm in three dimensions Journal of Computational Physics 155 2 1999 468-498
47. G.S. Winckelmans A. Leonard Contributions to vortex particle methods for the computation of three-dimensional incompressible unsteady flows Journal of Computational Physics 109 2 1993 247-273
48. G.S. Winckelmans J.K. Salmon M.S. Warren A. Leonard B. Jodoin Application of fast parallel and sequential tree codes to computing three-dimensional flows with the vortex element and boundary element methods ESAIM Proceedings: Vortex Flows and Related Numerical Methods II 1 1996 225-240
49. J.K. Salmon M.S. Warren G.S. Winckelmans Fast parallel tree codes for gravitational and fluid dynamical N-body problems International Journal of Supercomputer Applications and High Performance Computing 8 2 1994 129-142
50. D.H. Wee, Y.M. Marzouk, A.F. Ghoniem, Fast, parallel, hierarchical N-body solvers for arbitrary kernel, Reacting Gas Dynamics Laboratory report, MIT, http://centaur.mit.edu/rgd, 2004
51. S. Bhatt, P. Liu, V. Fernandez, N. Zabusky, Tree codes for vortex dynamics: Application of a programming framework, in: Workshop on Solving Irregular Problems on Parallel Machines, International Parallel Processing Symposium, Santa Barbara, CA, 1995
52. M.R. Anderberg Cluster analysis for applications 1973 Academic Press New York
53. R.O. Duda P.E. Hart D.G. Stork Pattern classification 2001 Wiley New York
54. J. MacQueen Some methods for classification and analysis of multivariate observations In: L.M.L. Cam J. Neyman (Eds.) Proceedings of the fifth Berkeley symposium on mathematical statistics and probability vol. 1 1967 University of California Press Berkeley 281-297
55. L. Bottou Y. Bengio Convergence properties of the k-means algorithm Advances in neural information processing systems vol. 7 1995 MIT Press Denver
56. I.S. Dhillon D.S. Modha A data-clustering algorithm on distributed memory multiprocessors In: M.J. Zaki C.-T. Ho (Eds.) Large-scale parallel data mining Lecture notes in artificial intelligence vol. 1759 2000 Springer-Verlag Berlin 245-260
57. D. Pelleg, A. Moore, Accelerating exact k-means algorithms with geometric reasoning, in: KDD-99, in: Proceedings of the Fifth ACM SIGKDD International Conference On Knowledge Discovery and Data Mining, 1999, pp. 277-281
58. Y.M. Marzouk, A.F. Ghoniem, Mechanism of streamwise vorticity formation in a transverse jet, in: 40th Aerospace Sciences Meeting and Exhibit, No. AIAA-2002-1063, AIAA, 2002
59. F. Aurenhammer Voronoi diagrams - a survey of a fundamental geometric data structure ACM Computing Surveys 23 3 1991 345-405
60. J.P. Singh C. Holt T. Totsuka A. Gupta J. Hennessy Load balancing and data locality in adaptive hierarchical N-body methods - Barnes-Hut, fast multipole, and radiosity Journal of Parallel and Distributed Computing 27 2 1995 118-141
61. M.S. Warren, J.K. Salmon, A parallel hashed oct-tree N-body algorithm, in: Proceedings of Supercomputing'93, IEEE, 1993, pp. 12-21
62. H. Samet The design and analysis of spatial data structures Addison-Wesley series in computer science 1990 Addison-Wesley Reading, MA
63. A. Grama V. Kumar A. Sameh Scalable parallel formulations of the Barnes-Hut method for N-body simulations Parallel Computing 24 5-6 1998 797-822
64. S.-H. Teng Provably good partitioning and load balancing algorithms for parallel adaptive N-body simulation SIAM Journal on Scientific Computing 19 2 1998 635-656
65. M. Parashar, J.C. Browne, On partitioning dynamic adaptive grid hierarchies, in: Proceedings of the 29th Annual Hawaii International Conference on System Sciences, 1996, pp. 604-613
66. G. Karypis V. Kumar A fast and high quality multilevel scheme for partitioning irregular graphs SIAM Journal on Scientific Computing 20 1 1998 359-392
67. H.D. Simon S.H. Teng How good is recursive bisection? SIAM Journal on Scientific Computing 18 5 1997 1436-1445
68. T.F. Fric A. Roshko Vortical structure in the wake of a transverse jet Journal of Fluid Mechanics 279 1994 1-47
69. Y.M. Marzouk, A.F. Ghoniem, Vorticity structure and evolution in transverse jets, Journal of Fluid Mechanics (2005), submitted for publication
70. Y.M. Marzouk, A.F. Ghoniem, D. Wee, Simulations of high Reynolds number transverse jets and analysis of the underlying vortical structures, in: 43rd Aerospace Sciences Meeting and Exhibit, No. AIAA-2005-0308, AIAA, 2005
71. A.J. Chorin Hairpin removal in vortex interactions II Journal of Computational Physics 107 1993 1-9
72. W.T. Ashurst E. Meiburg Three-dimensional shear layers via vortex dynamics Journal of Fluid Mechanics 189 1988 87-116