Toward a science of computational ethology

Neuron

Volumn 84, Issue 1, 2014, Pages 18-31

  Anderson, David J ^a,b   Perona, Pietro ^b  

^a California Institute of Technology   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGGRESSION; ANIMAL BEHAVIOR; AUTOMATION; COMPUTATIONAL ETHOLOGY; COMPUTER PROGRAM; COPULATION; COURTSHIP; DROSOPHILA MELANOGASTER; ETHOLOGY; LICKING; MATHEMATICAL MODEL; MATING; NERVE CELL NETWORK; NONHUMAN; PHENOMENOLOGY; REVIEW; SOCIAL BEHAVIOR; STIMULUS RESPONSE; VIDEORECORDING; ANIMAL; ARTIFICIAL INTELLIGENCE; BIOLOGY; PHYSIOLOGY; PROCEDURES; TRENDS;

ANIMALS; ARTIFICIAL INTELLIGENCE; BEHAVIOR, ANIMAL; COMPUTATIONAL BIOLOGY; ETHOLOGY; NERVE NET;

EID: 84907963420     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2014.09.005     Document Type: Review

References (114)

1. Albrecht D.R., Bargmann C.I. High-content behavioral analysis of Caenorhabditis elegans in precise spatiotemporal chemical environments. Nat. Methods 2011, 8:599-605.
2. Anderson D.J., Adolphs R. A framework for studying emotions across species. Cell 2014, 157:187-200.
3. Anonymous Geneticist seeks engineer: must like flies and worms. Nat. Methods 2007, 4:463.
4. Arakawa T., Tanave A., Ikeuchi S., Takahashi A., Kakihara S., Kimura S., Sugimoto H., Asada N., Shiroishi T., Tomihara K., et al. A male-specific QTL for social interaction behavior in mice mapped with automated pattern detection by a hidden Markov model incorporated into newly developed freeware. J.Neurosci. Methods 2014, 234:127-134.
5. Asahina K., Watanabe K., Duistermars B.J., Hoopfer E., González C.R., Eyjólfsdóttir E.A., Perona P., Anderson D.J. Tachykinin-expressing neurons control male-specific aggressive arousal in Drosophila. Cell 2014, 156:221-235.
6. Bar-Shalom Y. Tracking and data association 1987, Academic Press Professional, Inc., San Diego.
7. Bath D.E., Stowers J.R., Hörmann D., Poehlmann A., Dickson B.J., Straw A.D. FlyMAD: rapid thermogenetic control of neuronal activity in freely walking Drosophila. Nat. Methods 2014, 11:756-762.
8. Belongie S., Branson K., Dollár P., Rabaud V. Monitoring animal behavior in the smart vivarium. Workshop on Measuring Behavior 2005, Wageningen, The Netherlands.
9. Bentley D., Konishi M. Neural control of behavior. Annu. Rev. Neurosci. 1978, 1:35-59.
10. Berman, G.J., Choi, D.M., Bialek, W., and Shaevitz, J.W. (2013). Mapping the stereotyped behaviour of freely-moving fruit flies. arXiv, arXiv:1310.4249, http://arxiv.org/abs/1310.4249.
11. Borst A. Drosophila's view on insect vision. Curr. Biol. 2009, 19:R36-R47.
12. Branson, K., and Belongie, S. (2005). Tracking multiple mouse contours (without too many samples). In IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1, 1039-1046.
13. Branson K., Robie A.A., Bender J., Perona P., Dickinson M.H. High-throughput ethomics in large groups of Drosophila. Nat. Methods 2009, 6:451-457.
14. Bregler, C., and Malik, J. (1998). Tracking people with twists and exponential maps. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 8-15.
15. Brown A.E., Yemini E.I., Grundy L.J., Jucikas T., Schafer W.R. A dictionary of behavioral motifs reveals clusters of genes affecting Caenorhabditis elegans locomotion. Proc. Natl. Acad. Sci. USA 2013, 110:791-796.
16. Bui T.V., Akay T., Loubani O., Hnasko T.S., Jessell T.M., Brownstone R.M. Circuits for grasping: spinal dI3 interneurons mediate cutaneous control of motor behavior. Neuron 2013, 78:191-204.
17. Burgos-Artizzu, X.P., Dollár, P., Lin, D., Anderson, D.J., and Perona, P. (2012). Social behavior recognition in continuous video. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1322-1329.
18. Button K.S., Ioannidis J.P., Mokrysz C., Nosek B.A., Flint J., Robinson E.S., Munafò M.R. Power failure: why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 2013, 14:365-376.
19. Card G., Dickinson M. Performance trade-offs in the flight initiation of Drosophila. J.Exp. Biol. 2008, 211:341-353.
20. Chen S., Lee A.Y., Bowens N.M., Huber R., Kravitz E.A. Fighting fruit flies: a model system for the study of aggression. Proc. Natl. Acad. Sci. USA 2002, 99:5664-5668.
21. Coifman B., Beymer D., McLauchlan P., Malik J. A real-time computer vision system for vehicle tracking and traffic surveillance. Transportation Research Part C: Emerging Technologies 1998, 6:271-288.
22. Collett M., Collett T.S. How do insects use path integration for their navigation?. Biol. Cybern. 2000, 83:245-259.
23. Crawley J.N., Szara S., Pryor G.T., Creveling C.R., Bernard B.K. Development and evaluation of a computer-automated color TV tracking system for automatic recording of the social and exploratory behavior of small animals. J.Neurosci. Methods 1982, 5:235-247.
24. Dankert H., Wang L., Hoopfer E.D., Anderson D.J., Perona P. Automated monitoring and analysis of social behavior in Drosophila. Nat. Methods 2009, 6:297-303.
25. de Chaumont F., Coura R.D., Serreau P., Cressant A., Chabout J., Granon S., Olivo-Marin J.-C. Computerized video analysis of social interactions in mice. Nat. Methods 2012, 9:410-417. 10.1038/nmeth.1924.
26. Del Vecchio, D., Murray, R.M., and Perona, P. (2002). Primitives for human motion: A dynamical approach. In Procedures of IFAC World Congress, Barcelona, Spain.
27. Del Vecchio D., Murray R., Perona P. Decomposition of human motion into dynamics based primitives with application to drawing tasks. Automatica 2003, 39:2085-2098.
28. Dell A.I., Bender J.A., Branson K., Couzin I.D., de Polavieja G.G., Noldus L.P., Pérez-Escudero A., Perona P., Straw A.D., Wikelski M., Brose U. Automated image-based tracking and its application in ecology. Trends Ecol. Evol. 2014, 29:417-428.
29. Desland F.A., Afzal A., Warraich Z., Mocco J. Manual versus Automated Rodent Behavioral Assessment: Comparing Efficacy and Ease of Bederson and Garcia Neurological Deficit Scores to an Open Field Video-Tracking System. J Cent Nerv Syst Dis 2014, 6:7-14.
30. Dickinson M.H., Farley C.T., Full R.J., Koehl M.A., Kram R., Lehman S. How animals move: an integrative view. Science 2000, 288:100-106.
31. Dickson B.J. Wired for sex: the neurobiology of Drosophila mating decisions. Science 2008, 322:904-909.
32. Dierick H.A. A method for quantifying aggression in male Drosophila melanogaster. Nat. Protoc. 2007, 2:2712-2718.
33. Dollár P., Rabaud V., Cottrell G., Belongie S. Behavior recognition via sparse spatio-temporal features. IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance 2005, 65-72.
34. Egelhaaf M., Hausen K., Reichardt W., Wehrhahn C. Visual course control in flies relies on neuronal computation of object and background motion. Trends Neurosci. 1988, 11:351-358.
35. Eyjolfsdottir, E.A., Branson, S., Branson, K., Burgos-Artizzu, X.P., Hoopfer, E.D., Schor, J., Anderson, D.J., and Perona, P. (2014). Detecting actions of social fruit flies. In Proceedings of the European Conference on Computer Vision (ECCV2014).
36. Farrell M.S., Roth B.L. Pharmacosynthetics: Reimagining the pharmacogenetic approach. Brain Res. 2013, 1511:6-20.
37. Feng Z., Cronin C.J., Wittig J.H., Sternberg P.W., Schafer W.R. An imaging system for standardized quantitative analysis of C. elegans behavior. BMC Bioinformatics 2004, 5:115.
38. Fontaine E., Burdick J., Barr A. Automated tracking of multiple C. elegans. Conf Proc IEEE Eng Med Biol Soc. 2006, 2006:3716-3719.
39. Fontaine E., Lentink D., Kranenbarg S., Müller U.K., van Leeuwen J.L., Barr A.H., Burdick J.W. Automated visual tracking for studying the ontogeny of zebrafish swimming. J.Exp. Biol. 2008, 211:1305-1316.
40. Fontaine E.I., Zabala F., Dickinson M.H., Burdick J.W. Wing and body motion during flight initiation in Drosophila revealed by automated visual tracking. J.Exp. Biol. 2009, 212:1307-1323.
41. Frye M.A., Dickinson M.H. Closing the loop between neurobiology and flight behavior in Drosophila. Curr. Opin. Neurobiol. 2004, 14:729-736.
42. Gomes R., Krause A., Perona P. Discriminative clustering by regularized information maximization. Advances in Neural Information Processing Systems 2010, 23.
43. Gomez-Marin A., Partoune N., Stephens G.J., Louis M., Brembs B. Automated tracking of animal posture and movement during exploration and sensory orientation behaviors. PLoS ONE 2012, 7:e41642.
44. Goncalves L., di Bernardo E., Perona P. Movemes for modeling biological motion perception. Seeing, Thinking and Knowing Theory and Decision Library A 2004, 38:143-170.
45. Götz K.G. Course-control, metabolism and wing interference during ultralong thethered flight in melanogaster. J.Exp. Biol. 1987, 128:35-46.
46. Green J., Collins C., Kyzar E.J., Pham M., Roth A., Gaikwad S., Cachat J., Stewart A.M., Landsman S., Grieco F., et al. Automated high-throughput neurophenotyping of zebrafish social behavior. J.Neurosci. Methods 2012, 210:266-271.
47. Hall J.C. The mating of a fly. Science 1994, 264:1702-1714.
48. Hamada F.N., Rosenzweig M., Kang K., Pulver S.R., Ghezzi A., Jegla T.J., Garrity P.A. An internal thermal sensor controlling temperature preference in Drosophila. Nature 2008, 454:217-220.
49. Hamblen M., Zehring W.A., Kyriacou C.P., Reddy P., Yu Q., Wheeler D.A., Zwiebel L.J., Konopka R.J., Rosbash M., Hall J.C. Germ-line transformation involving DNA from the period locus in Drosophila melanogaster: overlapping genomic fragments that restore circadian and ultradian rhythmicity to per0 and per- mutants. J.Neurogenet. 1986, 3:249-291.
50. Hartley R., Zisserman A. Multiple view geometry in computer vision 2003, Cambridge University Press, Cambridge.
51. Harvey C.D., Collman F., Dombeck D.A., Tank D.W. Intracellular dynamics of hippocampal place cells during virtual navigation. Nature 2009, 461:941-946.
52. Hashemi J., Tepper M., Vallin Spina T., Esler A., Morellas V., Papanikolopoulos N., Egger H., Dawson G., Sapiro G. Computer vision tools for low-cost and noninvasive measurement of autism-related behaviors in infants. Autism Res. Treat. 2014, 2014:935686.
53. Heisenberg M., Wolf R. Vision in: Genetics of Microbehavior 1984, Springer Verlag, Berlin.
54. Hoyer S.C., Eckart A., Herrel A., Zars T., Fischer S.A., Hardie S.L., Heisenberg M. Octopamine in male aggression of Drosophila. Curr. Biol. 2008, 18:159-167.
55. Huang K.-M., Cosman P., Schafer W.R. Automated detection and analysis of foraging behavior in Caenorhabditis elegans. J.Neurosci. Methods 2008, 171:153-164.
56. Inagaki H.K., Jung Y., Hoopfer E.D., Wong A.M., Mishra N., Lin J.Y., Tsien R.Y., Anderson D.J. Optogenetic control of Drosophila using a red-shifted channelrhodopsin reveals experience-dependent influences on courtship. Nat. Methods 2014, 11:325-332.
57. Insel T.R., Winslow J.T. Central administration of oxytocin modulates the infant rat's response to social isolation. Eur. J. Pharmacol. 1991, 203:149-152.
58. Iyengar A., Imoehl J., Ueda A., Nirschl J., Wu C.-F. Automated quantification of locomotion, social interaction, and mate preference in Drosophila mutants. J.Neurogenet. 2012, 26:306-316.
59. Jhuang H., Garrote E., Mutch J., Yu X., Khilnani V., Poggio T., Steele A.D., Serre T. Automated home-cage behavioural phenotyping of mice. Nat Commun 2010, 1:68.
60. Kabra M., Robie A.A., Rivera-Alba M., Branson S., Branson K. JAABA: interactive machine learning for automatic annotation of animal behavior. Nat. Methods 2013, 10:64-67.
61. Karbowski J., Schindelman G., Cronin C.J., Seah A., Sternberg P.W. Systems level circuit model of C. elegans undulatory locomotion: mathematical modeling and molecular genetics. J.Comput. Neurosci. 2008, 24:253-276.
62. Kato S., Xu Y., Cho C.E., Abbott L.F., Bargmann C.I. Temporal responses of C. elegans chemosensory neurons are preserved in behavioral dynamics. Neuron 2014, 81:616-628.
63. Kerr J.N., Denk W. Imaging invivo: watching the brain in action. Nat. Rev. Neurosci. 2008, 9:195-205.
64. Khan Z., Balch T., Dellaert F. MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27:1805-1819.
65. Kitamoto T. Conditional modification of behavior in Drosophila by targeted expression of a temperature-sensitive shibire allele in defined neurons. J.Neurobiol. 2001, 47:81-92.
66. Klapoetke N.C., Murata Y., Kim S.S., Pulver S.R., Birdsey-Benson A., Cho Y.K., Morimoto T.K., Chuong A.S., Carpenter E.J., Tian Z., et al. Independent optical excitation of distinct neural populations. Nat. Methods 2014, 11:338-346.
67. Kohlhoff K.J., Jahn T.R., Lomas D.A., Dobson C.M., Crowther D.C., Vendruscolo M. The iFly tracking system for an automated locomotor and behavioural analysis of Drosophila melanogaster. Integr. Biol. 2011, 3:755-760.
68. Land M.F., Collett T. Chasing behaviour of houseflies (fannia canicularis). J.Comp. Physiol. 1974, 89:331-357.
69. Levitis D.A., Lidicker W.Z., Freund G. Behavioural biologists don't agree on what constitutes behaviour. Anim. Behav. 2009, 78:103-110.
70. Lin J.Y., Knutsen P.M., Muller A., Kleinfeld D., Tsien R.Y. ReaChR: a red-shifted variant of channelrhodopsin enables deep transcranial optogenetic excitation. Nat. Neurosci. 2013, 16:1499-1508.
71. Luo L., Callaway E.M., Svoboda K. Genetic dissection of neural circuits. Neuron 2008, 57:634-660.
72. Luo L., Gershow M., Rosenzweig M., Kang K., Fang-Yen C., Garrity P.A., Samuel A.D. Navigational decision making in Drosophila thermotaxis. J.Neurosci. 2010, 30:4261-4272.
73. Metz H.A., Dienske H., de Jonge G., Putters F.A. Continuous-time Markov chains as models for animal behaviour. Bull. Math. Biol. 1983, 45:643-658.
74. Mizutani A., Chahl J.S., Srinivasan M.V. Insect behaviour: Motion camouflage in dragonflies. Nature 2003, 423:604.
75. Moorman S., Mello C.V., Bolhuis J.J. From songs to synapses: molecular mechanisms of birdsong memory. Molecular mechanisms of auditory learning in songbirds involve immediate early genes, including zenk and arc, the ERK/MAPK pathway and synapsins. Bioessays 2011, 33:377-385.
76. Müller M., Wehner R. Path integration in desert ants, Cataglyphis fortis. Proc. Natl. Acad. Sci. USA 1988, 85:5287-5290.
77. Nitabach M.N., Taghert P.H. Organization of the Drosophila circadian control circuit. Curr. Biol. 2008, 18:R84-R93.
78. Noldus L.P., Spink A.J., Tegelenbosch R.A. EthoVision: a versatile video tracking system for automation of behavioral experiments. Behav. Res. Methods Instrum. Comput. 2001, 33:398-414.
79. Ohayon S., Avni O., Taylor A.L., Perona P., Roian Egnor S.E. Automated multi-day tracking of marked mice for the analysis of social behaviour. J.Neurosci. Methods 2013, 219:10-19.
80. Pan S.J., Yang Q. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 2010, 22:1345-1359.
81. Pérez-Escudero A., Vicente-Page J., Hinz R.C., Arganda S., de Polavieja G.G. idTracker: tracking individuals in a group by automatic identification of unmarked animals. Nat. Methods 2014, 11:743-748.
82. Pham J., Cabrera S.M., Sanchis-Segura C., Wood M.A. Automated scoring of fear-related behavior using EthoVision software. J.Neurosci. Methods 2009, 178:323-326.
83. Rabiner L., Juang B. An introduction to hidden Markov models. IEEE ASSP Magazine 1986, (January 1986):4-16.
84. Reichardt W., Poggio T. Visual control of orientation behaviour in the fly. Part I. A quantitative analysis. Q.Rev. Biophys. 1976, 9:311-375. 428-438.
85. Reid R.C. From functional architecture to functional connectomics. Neuron 2012, 75:209-217.
86. Reiser M.B., Dickinson M.H. A modular display system for insect behavioral neuroscience. J.Neurosci. Methods 2008, 167:127-139.
87. Rihel J., Prober D.A., Schier A.F. Monitoring sleep and arousal in zebrafish. Methods Cell Biol. 2010, 100:281-294.
88. Shotton J., Sharp T., Kipman A., Fitzgibbon A., Finocchio M., Blake A., Cook M., Moore R. Real-time human pose recognition in parts from single depth images. Communications of the ACM 2013, 56:116-124.
89. Siegel R.W., Hall J.C. Conditioned responses in courtship behavior of normal and mutant Drosophila. Proc. Natl. Acad. Sci. USA 1979, 76:3430-3434.
90. Silasi G., Boyd J.D., Ledue J., Murphy T.H. Improved methods for chronic light-based motor mapping in mice: automated movement tracking with accelerometers, and chronic EEG recording in a bilateral thin-skull preparation. Front Neural Circuits 2013, 7:123.
91. Simonetta S.H., Golombek D.A. An automated tracking system for Caenorhabditis elegans locomotor behavior and circadian studies application. J.Neurosci. Methods 2007, 161:273-280.
92. Simpson J.H. Mapping and manipulating neural circuits in the fly brain. Adv. Genet. 2009, 65:79-143.
93. Sokolowski M.B. Drosophila: Genetics meets behavior. Nat Rev Genet. 2001, 2:879-890.
94. Spink A.J., Tegelenbosch R.A., Buma M.O., Noldus L.P. The EthoVision video tracking system-a tool for behavioral phenotyping of transgenic mice. Physiol. Behav. 2001, 73:731-744.
95. Straw A.D., Branson K., Neumann T.R., Dickinson M.H. Multi-camera real-time three-dimensional tracking of multiple flying animals. J.R. Soc. Interface 2011, 8:395-409.
96. Swierczek N.A., Giles A.C., Rankin C.H., Kerr R.A. High-throughput behavioral analysis in C. elegans. Nat. Methods 2011, 8:592-598.
97. Tataroglu O., Emery P. Studying circadian rhythms in Drosophila melanogaster. Methods 2014, 68:140-150.
98. Tecott L.H., Nestler E.J. Neurobehavioral assessment in the information age. Nat. Neurosci. 2004, 7:462-466.
99. Tinbergen N. The Study of Instinct 1951, Clarendon Press/Oxford University Press, Oxford.
100. Tinbergen N. On aims and methods of ethology. Z.Tierpsychol. 1963, 20:410-433.
101. Tinbergen N., Perdeck A.C. On the stimulus situation releasing the begging response in the newly hatched herring gull chick (larus argentatus argentatus pont.). Behaviour 1950, 3:1-39.
102. Tsai H.-Y., Huang Y.-W. Image tracking study on courtship behavior of Drosophila. PLoS ONE 2012, 7:e34784.
103. Veeraraghavan A., Chellappa R., Srinivasan M. Shape-and-behavior encoded tracking of bee dances. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30:463-476.
104. Vogelstein J.T., Park Y., Ohyama T., Kerr R.A., Truman J.W., Priebe C.E., Zlatic M. Discovery of brainwide neural-behavioral maps via multiscale unsupervised structure learning. Science 2014, 344:386-392.
105. von Philipsborn A.C., Liu T., Yu J.Y., Masser C., Bidaye S.S., Dickson B.J. Neuronal control of Drosophila courtship song. Neuron 2011, 69:509-522.
106. Wehrhahn C., Poggio T., Buelthoff H. Tracking and chasing in houseflies (musca). Biol. Cybern. 1982, 45:123-130.
107. Weissbrod A., Shapiro A., Vasserman G., Edry L., Dayan M., Yitzhaky A., Hertzberg L., Feinerman O., Kimchi T. Automated long-term tracking and social behavioural phenotyping of animal colonies within a semi-natural environment. Nat Commun 2013, 4:2018.
108. Williams H. Birdsong and singing behavior. Ann. N Y Acad. Sci. 2004, 1016:1-30.
109. Wolf F.W., Rodan A.R., Tsai L.T.-Y., Heberlein U. High-resolution analysis of ethanol-induced locomotor stimulation in Drosophila. J.Neurosci. 2002, 22:11035-11044.
110. Yamamoto D., Koganezawa M. Genes and circuits of courtship behaviour in Drosophila males. Nat. Rev. Neurosci. 2013, 14:681-692.
111. Yamato, J., Ohya, J., and Ishii, K. (1992). Recognizing human action in time-sequential images using hidden markov model. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 379-385.
112. Yemini E., Jucikas T., Grundy L.J., Brown A.E., Schafer W.R. A database of Caenorhabditis elegans behavioral phenotypes. Nat. Methods 2013, 10:877-879.
113. Yizhar O., Fenno L.E., Davidson T.J., Mogri M., Deisseroth K. Optogenetics in neural systems. Neuron 2011, 71:9-34.
114. Zabala F., Polidoro P., Robie A., Branson K., Perona P., Dickinson M.H. A simple strategy for detecting moving objects during locomotion revealed by animal-robot interactions. Curr. Biol. 2012, 22:1344-1350.