Three-dimensional tracking and behaviour monitoring of multiple fruit flies

Journal of the Royal Society Interface

Volumn 10, Issue 78, 2013, Pages

  Ardekani, Reza ^a   Biyani, Anurag ^a   Dalton, Justin E ^c   Saltz, Julia B ^a,d   Arbeitman, Michelle N ^c   Tower, John ^a   Nuzhdin, Sergey ^a   Tavaré, Simon ^a,b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c FLORIDA STATE UNIVERSITY COLLEGE OF MEDICINE   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Drosophila behaviour monitoring; Featureless multi target tracking; Social behaviour studies; Three dimensional reconstruction

Indexed keywords

BIOPHYSICS; BIOTECHNOLOGY;

CALIBRATED CAMERAS; DATA ASSOCIATION; DROSOPHILA MELANOGASTER; FRUIT FLIES; HUNGARIAN ALGORITHM; MULTI-TARGET TRACKING; QUANTITATIVE DATA; SOCIAL BEHAVIOUR; SOCIAL INTERACTIONS; SYSTEM'S PERFORMANCE; THREE DIMENSIONAL SPACE; THREE-DIMENSIONAL ENVIRONMENT; THREE-DIMENSIONAL RECONSTRUCTION; THREE-DIMENSIONAL TRACKING;

THREE DIMENSIONAL;

ALGORITHM; ANIMAL BEHAVIOR; ARTICLE; BEHAVIORAL SCIENCE; DATA ANALYSIS; DROSOPHILA MELANOGASTER; NONHUMAN; SOCIAL BEHAVIOR; ANIMAL; INSTRUMENTATION; METHODOLOGY; PHYSIOLOGY; VIDEORECORDING;

ALGORITHMS; ANIMALS; BEHAVIOR, ANIMAL; DROSOPHILA MELANOGASTER; VIDEO RECORDING;

EID: 84871317479     PISSN: 17425689     EISSN: 17425662     Source Type: Journal    
DOI: 10.1098/rsif.2012.0547     Document Type: Article

References (44)

1. Partridge BL, Pitcher T, Cullen M, Wilson J. 1980 Behavioral ecology and sociobiology. The three-dimensional structure of fish schools. Behav. Ecol. Sociobiol. 288, 277-288. (doi:10.1007/BF00292770)
2. Kane AS, Salierno JD, Gipson GT, Molteno TCA, Hunter C. 2004 A video-based movement analysis system to quantify behavioral stress responses of fish. Water Res. 38, 3993-4001. (doi:10.1016/j.watres.2004.06.028)
3. Zhou J, Clark CM. 2006 Autonomous fish tracking by ROV using monocular camera. In CRV06: Proc. Third Canadian Conf. on Computer and Robot Vision, Quebec City, Canada, June 2006, pp. 68-76. Washington, DC: IEEE.
4. Wark AR, Greenwood AK, Taylor EM, Yoshida K, Peichel C. 2011 Heritable differences in schooling behavior among threespine stickleback populations revealed by a novel assay. PLoS ONE 6, e18151. (doi:10.1371/journal.pone. 0018316)
5. Butail S, Paley D. 2012 Three-dimensional reconstruction of the fast-start swimming kinematics of densely schooling fish. J. R. Soc. Interface 9, 77-88. (doi:10.1098/rsif.2011.0113)
6. Branson K, Belongie S. 2005 Tracking multiple mouse contours (without too many samples). IEEE Comp. Soc. Conf. on Computer Vision Pattern Recognition, San Diego, CA, 20-26 June 2005, pp. 1039-1046. Washington, DC: IEEE.
7. Spink AJ, Tegelenbosch RA, Buma MO, Noldus LP. 2001 The EthoVision video tracking system: a tool for behavioral phenotyping of transgenic mice. Physiol. Behav. 73, 731-744. (doi:10.1016/S0031-9384(01)00530-3)
8. Pistori H, Odakura VVVA, Monteiro JBO, Gonçalves WN, Roel AR, de Andrade Silva J, Machado BB. 2010 Mice and larvae tracking using a particle filter with an auto-adjustable observation model. Pattern Recognit. Lett. 31, 337-346. (doi:10.1016/j.patrec.2009.05.015)
9. Ballerini M. et al. 2008 Empirical investigation of Starling flocks: a benchmark study in collective animal behaviour. Anim. Behav. 76, 201-215. (doi:10.1016/j.anbehav.2008.02.004)
10. Cavagna A, Giardina L, Orlandi A, Parisi G, Procaccini A. 2008 The STARFLAG handbook on collective animal behaviour. II. Three-dimensional analysis. Anim. Behav. 76, 237-248. (doi:10.1016/j.anbehav.2008.02.003)
11. Betke M, Hirsh D, Bagchi A, Hristov N, Makris N, Kunz T. 2007 Tracking large variable numbers of objects in clutter. In IEEE Conf. on Computer Vision and Pattern Recognition, 2007 (CVPR07), Minneapolis, MN, 18-23 June 2007, pp. 1-8. Washington, DC: IEEE.
12. Theriault D, Wu Z, Hristov N, Swartz S. 2010 Reconstruction and analysis of 3D trajectories of Brazilian free-tailed bats in flight. In 20th Int. Conf. on Pattern Recognition, (figure 2), Istanbul, Turkey, August 2010, pp. 1-4. Washington, DC: IEEE.
13. Tian X. 2006 Direct measurements of the kinematics and dynamics of bat flight. Bioinspir. Biomimetics 1, S10-S18. (doi:10.1088/1748-3182/1/4/S02)
14. Rayner J. 1985 Three-dimensional reconstruction of animal flight paths and the turning flight of microchiropteran bats. J. Exp. Biol. 265, 247-265.
15. Veeraraghavan A, Chellappa R, Srinivasan M. 2008 Shape-and-behavior encoded tracking of bee dances. IEEE Trans. Pattern Anal. Mach. Intell. 30, 463-476. (doi:10.1109/TPAMI.2007.70707)
16. Khan Z, Balch T, Dellaert F. 2005 MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1805-1819. (doi:10.1109/TPAMI.2005.223)
17. Khan Z, Balch T, Dellaert F. 2006 MCMC data association and sparse factorization updating for real time multitarget tracking with merged and multiple measurements. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1960-1972. (doi:10.1109/TPAMI.2006.247)
18. Ramazani R, Krishnan H, Bergeson S, Atkinson N. 2007 Computer automated movement detection of the analysis of behavior. J. Neurosci. Methods 167, 171-179. (doi:10.1016/j.jneumeth.2007.01.005)
19. Grover D, Tower J, Tavaré S. 2008 O fly, where art thou? J. R. Soc. Interface 5, 1181-1191. (doi:10.1098/rsif.2007.1333)
20. Branson K, Robie A, Bender J, Perona P, Dickinson MH. 2009 High-throughput ethomics in large groups of Drosophila. Nat. Methods 6, 451-457. (doi:10.1038/nmeth.1328)
21. Dankert H, Wang L, Hoopfer ED, Anderson DJ, Perona P. 2009 Automated monitoring and analysis of social behavior in Drosophila. Nat. Methods 6, 297-303. (doi:10.1038/nmeth.1310)
22. Straw AD, Branson K, Neumann T. R, Dickinson MH. 2010 Multi-camera real-time three-dimensional tracking of multiple flying animals. J. R. Soc. Interface 8, 395-409. (doi:10.1098/rsif.2010.0230)
23. Wu H, Zhao Q, Zou D, Chen Y. 2011 Automated 3D trajectory measuring of large numbers of moving particles. Opt. Express 19, 7646-7663. (doi:10.1364/OE.19.007646)
24. Inan O, Marcu O, Sanchez M, Bhattacharya S, Kovacs G. 2011 A portable system for monitoring the behavioral activity of Drosophila. J. Neurosci. Methods 202, 45-52. (doi:10.1016/j.jneumeth.2011.08.039)
25. Kohlhoff K, Jahn T, Lomas D, Dobson C, Crawther D, Vendruscolo M. 2011 The iFly system for automated locomotor and behavioural analysis of Drosophila melanogaster. Integr. Biol. 3, 755-760. (doi:10.1039/c0ib00149j)
26. Reiser M. 2009 The ethomics era? Nat. Methods 6, 413-414. (doi:10.1038/nmeth0609-413)
27. Anonymous. 2009 No fruit fly an island?. Nat. Methods 6, 395. (doi:10.1038/nmeth0609-395)
28. Zou D, Chen YQ. 2009 Acquiring 3D motion trajectories of large numbers of swarming animals. In IEEE Int. Conf. on Computer Vision (ICCV) Workshop on Video Oriented Object and Event Classification, Kyoto, Japan, September 2009, pp. 593-600. Washington, DC: IEEE.
29. Kuo Ch, Huang C, Nevatia R. 2010 Multi-target tracking by on-line learned discriminative appearance models. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, June 2010, pp. 685-692. Washington, DC: IEEE.
30. Zhou SK, Chellappa R, Moghaddam B. 2004 Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Trans. Image Process. 13, 1491-506. (doi:10.1109/TIP.2004.836152)
31. Hartley RI, Zisserman A. 2004 Multiple view geometry in computer vision, 2nd edn. Cambridge, UK: Cambridge University Press.
32. Wu Z, Hristov N, Hedrick T, Kunz T, Betke M. 2010 Tracking a large number of objects from multiple views. In IEEE Int. Conf. on Computer Vision (ICCV), Kyoto, Japan, September 2009, pp. 1546-1553. Washington, DC: IEEE.
33. Zou D, Zhao Q, Wu HS, Chen YQ. 2009 Reconstructing 3D motion trajectories of particle swarms by global correspondence selection. In IEEE Int. Conf. on Computer Vision (ICCV). Workshop on video oriented object and event classification, Kyoto, Japan, September 2009, pp. 1578-1585. Washington, DC: IEEE.
34. Eshel R, Moses Y. 2008 Homography based multiple camera detection and tracking of people in a dense crowd. In 2008 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR08), Anchorage, AK, June 2008, pp. 1-8. Washington, DC: IEEE.
35. Zou S, Liedo P, Altamirano-Robles L, Cruz-Enriquez J, Morice A, Ingram D, Kaub K, Papadopoulos N, Carey J. 2011 Recording lifetime behavior and movement in an invertebrate model. PLoS ONE 6, pe18151. (doi:10.1371/journal.pone. 0018151)
36. Piccardi M. 2004 Background subtraction techniques: a review. In 2004 IEEE Int. Conf. Systems, Man and Cybernetics, The Hague, The Netherlands, 10-13 October 2004, pp. 3099-3104. Washington, DC: IEEE.
37. Koller D, Weber J, Huang T, Malik J, Ogasawara G, Rao B, Russell S. 1994 Towards robust automatic traffic scene analysis in real-time. In Proc. of Int. Conf. on Pattern Recognition (ICPR), Jerusalem, Israel, October 1994, pp. 126-131. Washington, DC: IEEE.
38. Blackman S. 2004 Multiple hypothesis tracking for multiple target tracking. IEEE A&E Syst. Mag. 19, 5-18.
39. Greenspan R, Freveur J. 2000 Courtship in Drosophila. Annu. Rev. Genet. 34, 205-232. (doi:10.1146/annurev.genet.34.1.205)
40. Burkard R, Dell'Amico M, Martello S. 2009 Assignment problems, 1st edn. Philadelphia, PA: SIAM.
41. Zhang Z. 2000 A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1330-1334. (doi:10.1109/34.888718)
42. Perera AGA, Srinivas C, Hoogs A, Brooksby G, Hu W. 2006 Multi-object tracking through simultaneous long occlusions and split-merge conditions. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR06), New York, NY, 17-22 June 2006, pp. 666-673. Washington, DC: IEEE.
43. Platt J. 1998 Sequential minimal optimization: a fast algorithm for training support vector machines. Technical report: MSR-TR-98-14. Microsoft Research, Seattle, WA.
44. Nilsen S, Chan Y, Huber R, Kravitz E. 2004 Gender-selective patterns of aggressive behavior in Drosophila melanogaster. Proc. Natal Acad. Sci. USA 33, 12342-12347. (doi:10.1073/pnas.0404693101)