Real-time feedback-controlled robotic fish for behavioral experiments with fish schools

Proceedings of the IEEE

Volumn 100, Issue 1, 2012, Pages 150-163

  Swain, Daniel T ^a   Couzin, Iain D ^b   Leonard, Naomi Ehrich ^a  

^a Princeton University   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

Collective decision making; cyber physical systems (CPSs); feedback control; fish schooling; real time; robotics; video processing

Indexed keywords

ANIMALS; COGNITIVE SYSTEMS; CYBER PHYSICAL SYSTEM; DECISION MAKING; EMBEDDED SYSTEMS; FEEDBACK; FEEDBACK CONTROL; IMAGE PROCESSING; REAL TIME SYSTEMS; ROBOTICS; TANKS (CONTAINERS); VIDEO SIGNAL PROCESSING;

COLLECTIVE DECISION MAKING; CYBER PHYSICAL SYSTEMS (CPSS); FISH SCHOOLINGS; REAL TIME; VIDEO PROCESSING;

FISH;

EID: 84155172783     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2011.2165449     Document Type: Article

References (52)

1. A. J. W. Ward, D. J. T. Sumpter, I. D. Couzin, P. J. B. Hart, and J. Krause, "Quorum decision-making facilitates information transfer in fish shoals," Proc. Nat. Acad. Sci., vol. 105, no. 19, pp. 6948-6953, 2008. (Pubitemid 351754510)
2. J. J. Faria, J. R. G. Dyer, R. O. Clèment, I. D. Couzin, N. Holt, A. J. W. Ward, D. Waters, and J. Krause, "A novel method for investigating the collective behaviour of fish: Introducing 'Robofish'," Behav. Ecol. Sociobiol., vol. 64, pp. 1211-1218, 2010.
3. J. K. Parrish and L. Edelstein-Keshet, "Complexity, pattern and evolutionary trade-offs in animal aggregation," Science, vol. 284, pp. 99-101, 1999. (Pubitemid 29282054)
4. W. D. Hamilton, "Geometry for the selfish herd," J. Theor. Biol., vol. 31, pp. 295-311, 1971.
5. R. Vabo and L. Nottestad, "An individual-based model of fish school reactions: Predicting antipredator behaviour as observed in nature," Fisheries Oceanogr., vol. 6, pp. 155-171, 1997. (Pubitemid 27513859)
6. J. Krause and G. D. Ruxton, Living in Groups. Oxford, U.K.: Oxford Univ. Press, 2002.
7. I. D. Couzin, "Collective cognition in animal groups," Trends Cogn. Sci., vol. 13, no. 1, pp. 36-43, 2009.
8. D. A. Paley, N. E. Leonard, R. Sepulchre, D. Grunbaum, and J. K. Parrish, "Oscillator models and collective motion: Spatial patterns in the dynamics of engineered and biological networks," IEEE Control Syst. Mag., vol. 27, no. 4, pp. 89-105, Aug. 2007.
9. N. E. Leonard, D. Paley, F. Lekien, R. Sepulchre, D. M. Fratantoni, and R. Davis, "Collective motion, sensor networks, and ocean sampling," Proc. IEEE, vol. 95, no. 1, pp. 48-74, Jan. 2007.
10. C. M. Breder, "Equations descriptive of fish schools and other animal aggregations," Ecology, vol. 35, no. 3, pp. 361-370, 1954.
11. I. D. Couzin and J. Krause, "Self-organization and collective behavior in vertebrates," Adv. Study Behavior, vol. 32, pp. 1-75, 2003.
12. B. Partridge and T. Pitcher, "The sensory basis of fish schools: Relative roles of lateral line and vision," J. Comparat. Physiol. A, Neuroethol. Sensory Neural Behav. Physiol., vol. 135, pp. 315-325, 1980.
13. R. Tegeder and J. Krause, "Density dependence and numerosity in fright stimulated aggregation behaviour of shoaling fish," Phil. Trans. R. Soc. B, vol. 350, pp. 381-390, 1995. (Pubitemid 3018286)
14. S. Viscido, J. Parrish, and D. Grunbaum, "Individual behavior and emergent properties of fish schools: A comparison of observation and theory," Mar. Ecol. Progr. Ser., vol. 273, pp. 239-249, 2004. (Pubitemid 38889503)
15. D. J. Hoare, I. D. Couzin, J.-G. J. Godin, and J. Krause, "Context-dependent group size choice in fish," Animal Behavior, vol. 67, pp. 155-164, 2004. (Pubitemid 38204050)
16. E. Hensor, I. D. Couzin, R. James, and J. Krause, "Modelling density-dependent fish shoal distributions in the laboratory and field," Oikos, vol. 110, pp. 344-352, 2005. (Pubitemid 40831902)
17. J. Gautrais, C. Jost, M. Soria, A. Campo, S. Motsch, R. Fournier, S. Blanco, and G. Theraulaz, "Analyzing fish movement as a persistent turning walker," Math. Biol., vol. 58, pp. 429-445, 2009.
18. J. Krause, A. F. T. Winfield, and J.-L. Deneubourg, "Interactive robotics in experimental biology," Trends Ecol. Evol., vol. 26, no. 7, pp. 369-375, 2011.
19. J. Halloy, G. Sempo, G. Caprari, C. Rivault, M. Asadpour, F. Tache, I. Said, V. Durier, S. Canonge, J.M. Ame, C. Detrain, N. Correll, A. Martinoli, F. Mondada, R. Siegwart, and J. L. Deneubourg, "Social integration of robots into groups of cockroaches to control self-organized choices," Science, vol. 318, pp. 1155-1158, 2007. (Pubitemid 350134901)
20. M. Milinski, J. H. Luth, R. Eggler, and G. A. Parker, "Cooperation under predation risk: Experiments on costs and benefits," Proc. R. Soc. Lond. B, vol. 264, pp. 831-837, 1997.
21. M. Aureli, V. Kopman, and M. Porfiri, "Free-locomotion of underwater vehicles actuated by ionic polymer metal composites," IEEE/ASME Trans. Mechatronics, vol. 15, no. 4, pp. 603-614, Aug. 2010.
22. E. Morais, M. F. Campos, F. Padua, and R. Carceroni, "Particle filter-based predictive tracking for robust fish counting," in Proc. XVIII Brazilian Symp. Comput. Graph. Image Process., 2005, pp. 367-374.
23. S. Butail and D. A. Paley, "3D reconstruction of fish schooling kinematics from underwater video," in Proc. IEEE Int. Conf. Robot. Autom., 2010, pp. 2438-2443.
24. A. Feldman, M. Hybinette, T. Balch, and R. Cavallaro, "The multi-ICP tracker: An online algorithm for tracking multiple interacting targets," J. Field Robot., 2012, to be published.
25. A. D. Straw, K. Branson, T. R. Neumann, and M. H. Dickinson, "Multi-camera real-time three-dimensional tracking of multiple flying animals," J. R. Soc. Interface, vol. 8, no. 56, pp. 395-409, Jul. 2010.
26. K. Branson, A. A. Robie, J. Bender, P. Perona, and M. Dickinson, "High-throughput ethomics in large groups of drosophila," Nature Methods, vol. 6, pp. 451-457, 2009.
27. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum-likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc., B, vol. 39, no. 1, pp. 1-38, 1977.
28. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon Press, 1995.
29. H. W. Kuhn, "The Hungarian method for the assignment problem," Naval Res. Logist. Quart., vol. 2, pp. 83-97, 1955.
30. J. Munkres, "Algorithms for the assignment and transportation problems," J. Soc. Indust. Appl. Math., vol. 5, no. 1, pp. 32-38, Mar. 1957.
31. M. Isard and J. MacCormick, "BraMBLe: A Bayesian multi-blob tracker," in Proc. IEEE Int. Conf. Comput. Vis., 2001, pp. 34-41.
32. Z. Khan, T. Balch, and F. Dellaert, "An MCMC-based particle filter for tracking multiple interacting targets," in Proc. Eur. Conf. Comput. Vis., 2004, pp. 279-290.
33. S. J. Julier and J. K. Uhlmann, "A new extension of the Kalman filter to nonlinear systems," in Proc. 11th Int. Symp. Aerosp./Defense Sens. Simul. Controls, pp. 182-193, 1997.
34. E. A. Wan and R. V. D. Merwe, "The unscented Kalman filter for nonlinear estimation," in Proc. Adaptive Syst. Signal Process. Commun. Control Symp., 2000, pp. 153-158.
35. Merlin Systems Corp., Merlin Robotics, 2011. [Online]. Available: http://www.merlinsystemscorp.co.uk/index.php/e-shop/merlin-robotics.html.
36. SmoothOn, Inc., 2011. [Online]. Available: http://www.smooth-on.com
37. Allied Vision Technologies, Guppy F-080: FireWire Camera, 2011. [Online]. Available: http://www.alliedvisiontec.com/us/products/cameras/firewire/guppy/f- 080bc.html.
38. D. T. Swain, MADTraC Framework Source Documentation, 2011. [Online]. Available: http://poincare.princeton.edu/MADTraC/docs/.
39. G. Bradski, OpenCV (Open Computer Vision) Library, Mar. 2011. [Online]. Available: http://opencv.willowgarage.com/wiki/Welcome.
40. M. Isard and A. Blake, "CondensationVConditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, 1998. (Pubitemid 128523364)
41. F. Chang, C.-J. Chen, and C.-J. Lu, "A linear-time component-labeling algorithm using contour tracing technique," Comput. Vis. Image Understand., vol. 93, no. 2, pp. 206-220, 2004.
42. D. Weihs, "The mechanism of rapid starting of slender fish," Biorheology, vol. 10, pp. 343-350, 1973.
43. P. W.Webb and J. M. Skadsen, "Strike attacks of Esox," Can. J. Zoology, vol. 58, pp. 1462-1469, 1980.
44. J. A. Bilmes, "A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models," Dept. Electr. Eng. Comput. Sci., Univ. California Berkeley, Berkeley, CA, Tech. Rep. TR-97-021, Apr. 1998.
45. I. D. Dinov, Expectation Maximization and Mixture Modeling Tutorial. UC Los Angeles: Statistics Online Computation Resource, 2008. [Online]. Available: http://www.escholarship. org/uc/item/1rb70972.
46. M.-K. Hu, "Visual pattern recognition by moment invariants," IRE Trans. Inf. Theory, vol. 8, no. 2, pp. 179-187, Feb. 1962.
47. J. Prokop and A. P. Reeves, "A survey of moment-based techniques for unoccluded object representation and recognition," in Proc. Graph. Models Image Process., 1992, pp. 438-460. (Pubitemid 23379858)
48. A. de Froment, Personal communication, 2009.
49. B. P. Gerkey, C Implementation of the Hungarian Method, 2008. [Online]. Available: http://robotics.stanford.edu/gerkey/tools/hungarian.html.
50. S. H. Strogatz, "From Kuramoto to Crawford: Exploring the onset of synchronization in populations of coupled oscillators," Physica D, vol. 143, pp. 1-20, 2000.
51. H. Edelsbrunner, D. G. Kirkpatrick, and R. Seidel, "On the shape of a set of points in the plane," IEEE Trans. Inf. Theory, vol. IT-29, no. 4, pp. 551-559, Jul. 1983.
52. Y. Katz, C. Ioannou, K. Tunstrom, C. Huepe, and I. D. Couzin, "Inferring the structure and dynamics of interactions in schooling fish," Proc. Nat. Acad. Sci., 2011.