Reinforcement learning and wavelet adapted vortex methods for simulations of self-propelled swimmers

SIAM Journal on Scientific Computing

Volumn 36, Issue 3, 2014, Pages

  Gazzola, Mattia ^a,b   Hejazialhosseini, Babak ^b   Koumoutsakos, Petros ^b  

^a HARVARD UNIVERSITY   (United States)

^b ETH ZURICH   (Switzerland)

Author keywords

Fish schooling; Reinforcement learning; Vortex methods; Wavelet adapted grids

Indexed keywords

COMPUTATIONAL EFFICIENCY; FISH; INCOMPRESSIBLE FLOW; LEARNING ALGORITHMS; NUMERICAL METHODS; VORTEX FLOW;

ADAPTIVITY; BRINKMAN PENALIZATIONS; FISH SCHOOLINGS; FLOW SOLVER; REINFORCEMENT LEARNING ALGORITHMS; REINFORCEMENT LEARNINGS; SPACE AND TIME; VISCOUS INCOMPRESSIBLE FLOWS; VORTEX METHODS; WAVELET ADAPTED GRID;

REINFORCEMENT LEARNING;

EID: 84903585294     PISSN: 10648275     EISSN: 10957200     Source Type: Journal    
DOI: 10.1137/130943078     Document Type: Article

References (58)

1. B. L. Partridge, The structure and function of fish schools, Scientific American, 246 (1982), pp. 114-123.
2. W. D. Hamilton, Geometry for selfish herd, J. Theoret. Biol., 31 (1971), pp. 295-311.
3. S. R. J. Neill and J. M. Cullen, Experiments on whether schooling by their prey affects the hunting behaviour of cephalopods and fish predators, J. Zoology, 172 (1974), pp. 549-569.
4. P. F. Major, Predator-prey interactions in two schooling fishes, Caranx ignobilis and Stolephorus purpureus, Animal Behaviour, 26 (1978), pp. 760-777.
5. J. Lazarus, The early warning function of flocking in birds: An experimental study with captive quelea, Animal Behaviour, 27 (1979), pp. 855-865.
6. L. Landeau and J. Terborgh, Oddity and the "confusion effect" in predation, Animal Behaviour, 34 (1986), pp. 1372-1380.
7. J. R. Krebs, M. H. MacRoberts, and J. M. Cullen, Flocking and feeding in the great tit parus major - an experimental study, Ibis, 114 (1972), pp. 507-530.
8. T. J. Pitcher, A. E. Magurran, and I. J. Winfield, Fish in larger shoals find food faster, Behavioral Ecology Sociobiology, 10 (1982), pp. 149-151.
9. K. S. Norris and C. R. Schilt, Cooperative societies in three-dimensional space: On the origins of aggregations, flocks, and schools, with special reference to dolphins and fish, Ethology Sociobiology, 9 (1988), pp. 149-179.
10. J. Herskin and J. F. Steffensen, Energy savings in sea bass swimming in a school: Measurements of tail beat frequency and oxygen consumption at different swimming speeds, J. Fish Biology, 53 (1998), pp. 366-376.
11. C. M. Breder, Vortices and fish schools, Zoologica New York, 50 (1965), pp. 97-114.
12. V. V. Belyayev and G. V. Zuyev, Hydrodynamic hypothesis of school formation in fishes,Problems of Ichthyology, 9 (1969), pp. 578-584.
13. D. Weihs, Hydromechanics of fish schooling, Nature, 241 (1973), pp. 290-291.
14. P. B. Lissaman and C. A. Shollenberger, Formation flight of birds, Science, 168 (1970), pp. 1003-1005.
15. J. C. Liao, D. N. Beal, G. V. Lauder, and M. S. Triantafyllou, Fish exploiting vortices decrease muscle activity, Science, 302 (2003), pp. 1566-1569.
16. R. W. Whittlesey, S. Liska, and J. O. Dabiri, Fish schooling as a basis for vertical axis wind turbine farm design, Bioinspiration Biomimetics, 5 (2010).
17. J. O. Dabiri, Potential order-of-magnitude enhancement of wind farm power density via counter-rotating vertical-axis wind turbine arrays, J. Renewable Sustainable Energy, 3 (2011), 043104.
18. S. J. Portugal, T. Y. Hubel, J. Fritz, S. Heese, D. Trobe, B. Voelkl, S. Hailes, A. M. Wilson, and J. R. Usherwood, Upwash exploitation and downwash avoidance by flap phasing in ibis formation flight, Nature, 505 (2014), pp. 399-402.
19. S. Nair and E. Kanso, Hydrodynamically coupled rigid bodies, J. Fluid Mech., 592 (2007), pp. 393-411. (Pubitemid 350154134)
20. A. A. Tchieu, D. Crowdy, and A. Leonard, Fluid-structure interaction of two bodies in an inviscid fluid, Physics of Fluids, 22 (2010), 107101.
21. A. A. Tchieu, E. Kanso, and P. K. Newton, The finite-dipole dynamical system, Proc. Roy. Soc. A, 468 (2012), pp. 3006-3026.
22. M. Gazzola, C. Mimeau, A. A. Tchieu, and P. Koumoutsakos, Flow mediated interactions between two cylinders at finite re numbers, Physics of Fluids, 24 (2012), 043103.
23. A. Gilmanov and F. Sotiropoulos, A hybrid cartesian/immersed boundary method for simulating flows with 3d, geometrically complex, moving bodies, J. Comput. Phys., 207 (2005), pp. 457-492. (Pubitemid 40696978)
24. I. Borazjani and F. Sotiropoulos, Numerical investigation of the hydrodynamics of carangiform swimming in the transitional and inertial flow regimes, J. Experimental Biology, 211 (2008), pp. 1541-1558. (Pubitemid 351960091)
25. H. Dong, M. Bozkurttas, R. Mittal, P. Madden, and G. V. Lauder, Computational modeling and analysis of the hydrodynamics of a highly deformable fish pectoral fin, J. Fluid Mech., 645 (2010), pp. 345-373.
26. C. L. Yu, S. C. Ting, M. K. Yeh, and J. T. Yang, Three-dimensional numerical simulation of hydrodynamic interactions between pectoral-fin vortices and body undulation in a swimming fish, Physics of Fluids, 23 (2011), 091901.
27. J. Carling, T. L. Williams, and G. Bowtell, Self-propelled anguilliform swimming: Simultaneous solution of the two-dimensional navier-stokes equations and Newton's laws of motion, J. Experimental Biology, 201 (1998), pp. 3143-3166. (Pubitemid 29020205)
28. M. Bergmann and A. Iollo, Modeling and simulation of fish-like swimming, J. Comput. Phys., 230 (2011), pp. 329-348.
29. J. D. Eldredge, Numerical simulations of undulatory swimming at moderate reynolds number, Bioinspiration Biomimetics, 1 (2006), pp. S19-S24.
30. M. Gazzola, P. Chatelain, W. M. van Rees, and P. Koumoutsakos, Simulations of single and multiple swimmers with non-divergence free deforming geometries, J. Comput. Phys., 230 (2011), pp. 7093-7114.
31. I. Borazjani, F. Sotiropoulos, E. D. Tytell, and G. V. Lauder, Hydrodynamics of the bluegill sunfish c-start escape response: Three-dimensional simulations and comparison with experimental data, J. Experimental Biology, 215 (2012), pp. 671-684.
32. A. A. Shirgaonkar, M. A. Maclver, and N. A. Patankar, A new mathematical formulation and fast algorithm for fully resolved simulation of self-propulsion, J. Comput. Phys., 228 (2009), pp. 2366-2390.
33. S. Kern and P. Koumoutsakos, Simulations of optimized anguilliform swimming, J. Experimental Biology, 209 (2006), pp. 4841-4857. (Pubitemid 46166712)
34. S. E. Hieber and P. Koumoutsakos, An immersed boundary method for smoothed particle hydrodynamics of self-propelled swimmers, J. Comput. Phys., 227 (2008), pp. 8636-8654.
35. M. Gazzola, W. M. Van Rees, and P. Koumoutsakos, C-start: Optimal start of larval fish, J. Fluid Mech., 698 (2012), pp. 5-18.
36. W. M. van Rees, M. Gazzola, and P. Koumoutsakos, Optimal shapes for anguilliform swimmers at intermediate reynolds numbers, J. Fluid Mech., 722 (2013).
37. P. Koumoutsakos, Inviscid axisymmetrization of an elliptical vortex, J. Comput. Phys., 138 (1997), pp. 821-857. (Pubitemid 127170434)
38. C. W. Reynolds, Flocks, herds and schools: A distributed behavioural model, in SIGGRAPH -87: Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, 1987, pp. 71-87.
39. I. D. Couzin and J. Krause, Self-organization and collective behavior in vertebrates, Advances in the Study of Behavior, 32 (2003), pp. 1-75.
40. T. Vicsek, A. Czirok, E. Benjacob, I. Cohen, and O. Shochet, Novel type of phasetransition in a system of self-driven particles, Phys. Rev. Lett., 75 (1995), pp. 1226-1229.
41. M. Ballerini, N. Cabibbo, R. Candelier, A. Cavagna, E. Cisbani, I. Giardina, V. Lecomte, A. Orlandi, G. Parisi, A. Procaccini, M. Viale, and V. Zdravkovic, Interaction ruling animal collective behavior depends on topological rather than metric distance: Evidence from a field study, Proc. Natl. Acad. Sci. USA, 105 (2008), pp. 1232-1237. (Pubitemid 351397036)
42. I. D. Couzin, C. C. Ioannou, G. Demirel, T. Gross, C. J. Torney, A. Hartnett, L. Conradt, S. A. Levin, and N. E. Leonard, Uninformed individuals promote democratic consensus in animal groups, Science, 334 (2011), pp. 1578-1580.
43. I. D. Couzin, J. Krause, R. James, G. D. Ruxton, and N. R. Franks, Collective memory and spatial sorting in animal groups, J. Theoret. Biol., 218 (2002), pp. 1-11.
44. S. V. Viscido, J. K. Parrish, and D. Grunbaum, The effect of population size and number of influential neighbors on the emergent properties of fish schools, Ecological Modelling, 183 (2005), pp. 347-363. (Pubitemid 40257063)
45. T. Vicsek and A. Zafeiris, Collective motion, Phys. Rep., 517 (2012), pp. 71-140.
46. G. H. Cottet and P. Koumoutsakos, Vortex Methods, Theory and Practice, Cambridge University Press, New York, 2000.
47. P. Koumoutsakos, Multiscale flow simulations using particles, Ann. Rev. Fluid Mechanics, 37 (2005), pp. 457-487. (Pubitemid 40301264)
48. J. J. Monaghan, Extrapolating b splines for interpolation, J. Comput. Phys., 60 (1985), pp. 253-262.
49. B. Hejazialhosseini, D. Rossinelli, M. Bergdorf, and P. Koumoutsakos, High order finite volume methods on wavelet-adapted grids with local time-stepping on multicore architectures for the simulation of shock-bubble interactions, J. Comput. Phys., 229 (2010), pp. 8364-8383.
50. D. Rossinelli, B. Hejazialhosseini, M. Bergdorf, and P. Koumoutsakos, Waveletadaptive solvers on multi-core architectures for the simulation of complex systems, Concurrency and Computation: Practice and Experience, 23 (2011), pp. 172-186.
51. J. Barnes and P. Hut, A hierarchical o(n-log-n) force-calculation algorithm, Nature, 324 (1986), pp. 446-449.
52. N. A. Patankar and N. Sharma, A fast projection scheme for the direct numerical simulation of rigid particulate flows, Commun. Numer. Methods Eng., 21 (2005), pp. 419-432. (Pubitemid 41183958)
53. M. Coquerelle and G. H. Cottet, A vortex level set method for the two-way coupling of an incompressible fluid with colliding rigid bodies, J. Comput. Phys., 227 (2008), pp. 9121- 9137.
54. D. Rossinelli, Multiresolution Flow Simulations on Multi/Many-Core Architectures, Ph.D. thesis, ETH Zurich, 2011.
55. C. Watkins and P. Dayan, Q-learning, Machine Learning, 8 (1992), pp. 279-292.
56. S. R. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, MIT Press Cambridge, MA, 1998.
57. M. Gazzola, Simulation, Optimization and Learning of Artificial Swimmers, Ph.D. thesis, ETH Zurich, 2012.
58. U. K. Muller, J. G. M. van den Boogaart, and J. L. van Leeuwen, Flow patterns of larval fish: Undulatory swimming in the intermediate flow regime, J. Experimental Biology, 211 (2008), pp. 196-205.