Wildlife@Home: Combining crowd sourcing and volunteer computing to analyze avian nesting video

Proceedings - IEEE 9th International Conference on e-Science, e-Science 2013

Volumn , Issue , 2013, Pages 107-115

  Desell, Travis ^a   Bergman, Robert ^a   Goehner, Kyle ^a   Marsh, Ronald ^a   Vanderclute, Rebecca ^a   Ellis Felege, Susan ^b  

^a University of North Dakota   (United States)

^b UNIVERSITY OF NORTH DAKOTA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CAMERAS; MAMMALS;

CAMERA TECHNOLOGY; COMPUTER VISION TECHNIQUES; CROWD SOURCING; DENSE VEGETATION; NESTING STRATEGIES; ROBUST SOLUTIONS; USER OBSERVATIONS; VOLUNTEER COMPUTING;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84893488110     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/eScience.2013.50     Document Type: Conference Paper

References (62)

1. W. A. Cox, M. S. Pruett, T. J. Benson, J. C. Scott, and F. R. Thompson, "Development of camera technology for monitoring nests, " Video surveillance of nesting birds. Studies in Avian Biology, vol. 43, pp. 185- 210, 2012.
2. S. N. Ellis-Felege and J. P. Carroll, "Gamebirds and nest cameras: present and future, " Video surveillance of nesting birds. Studies in Avian Biology, vol. 43, pp. 35-44, 2012.
3. D. Weinland, R. Ronfard, and E. Boyer, "A survey of vision-based methods for action representation, segmentation and recognition, " Computer Vision and Image Understanding, vol. 115, no. 2, pp. 224 - 241, 2011. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S1077314210002171.
4. T. B. Moeslund, A. Hilton, and V. Kruger, "A survey of advances in vision-based human motion capture and analysis, " Computer Vision and Image Understanding, vol. 104, no. 23, pp. 90 - 126, 2006. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S1077314206001263.
5. H. Ishii, M. Ogura, S. Kurisu, A. Komura, A. Takanishi, N. Iida, and H. Kimura, "Development of autonomous experimental setup for behavior analysis of rats, " in Intelligent Robots and Systems, 2007. IROS 2007. IEEE/RSJ International Conference on, 29 2007-nov. 2 2007, pp. 4152 -4157.
6. W. Goncalves, J. Monteiro, J. de Andrade Silva, B. Machado, H. Pistori, and V. Odakura, "Multiple mice tracking using a combination of particle filter and k-means, " in Computer Graphics and Image Processing, 2007. SIBGRAPI 2007. XX Brazilian Symposium on, oct. 2007, pp. 173 -178.
7. H. Pistori, V. V. V. A. Odakura, J. B. O. Monteiro, W. N. Goncalves, A. R. Roel, J. de Andrade Silva, and B. B. Machado, "Mice and larvae tracking using a particle filter with an auto-adjustable observation model, " Pattern Recognition Letters, vol. 31, no. 4, pp. 337 - 346, 2010. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0167865509001330.
8. Y. Nie, I. Ishii, K. Yamamoto, K. Orito, and H. Matsuda, "Real-time scratching behavior quantification system for laboratory mice using high-speed vision, " Journal of Real-Time Image Processing, vol. 4, pp. 181-190, 2009, 10.1007/s11554-009-0111-7. [Online]. Available: http://dx.doi.org/10.1007/ s11554-009-0111-7.
9. Y. Nie, I. Ishii, K. Yamamoto, T. Takaki, K. Orito, and H. Matsuda, "High-speed video analysis of laboratory rats behaviors in forced swim test, " in Automation Science and Engineering, 2008. CASE 2008. IEEE International Conference on, aug. 2008, pp. 206 -211.
10. T. Mukhina, S. Bachurin, N. Lermontova, and N. Zefirov, "Versatile computerized system for tracking and analysis of water maze tests, " Behavior Research Methods, vol. 33, pp. 371-380, 2001, 10.3758/BF03195391. [Online]. Available: http://dx.doi.org/10.3758/BF03195391.
11. S. N. Fry, N. Rohrseitz, A. D. Straw, and M. H. Dickinson, "Trackfly: Virtual reality for a behavioral system analysis in free-flying fruit flies, " Journal of Neuroscience Methods, vol. 171, no. 1, pp. 110 - 117, 2008. [Online]. Available: http://www.sciencedirect.com/science/article/ pii/S0165027008001210.
12. H. Dankert, L. Wang, E. D. Hoopfer, D. J. Anderson, and P. Perona, "Automated monitoring and analysis of social behavior in drosophila, " Nature Methods, 2009.
13. K. Branson, A. Robie, J. Bender, P. Perona, and M. Dickinson, "Highthroughput ethomics in large groups of drosophilia, " Nature Methods, 2009.
14. D. Huang, K. Meyers, S. Henry, F. De la Torre, and C. Horn, "Non-rigid tracking of musk shrews in video for detection of emetic episodes, " in Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on, june 2011, pp. 17 -23.
15. D. Huang, K. Meyers, S. Henry, F. D. la Torre, and C. C. Horn, "Computerized detection and analysis of cancer chemotherapy-induced emesis in a small animal model, musk shrew, " Journal of Neuroscience Methods, vol. 197, no. 2, pp. 249 - 258, 2011. [Online]. Available: http://www. sciencedirect.com/science/article/pii/S0165027011001270.
16. M. M. Naeini, G. Dutton, K. Rothley, and G. Mori, "Action recognition of insects using spectral clustering, " in In IAPR Conference on Machine Vision Applications, 2007.
17. J. Shi and J. Malik, "Normalized cuts and image segmentation, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, pp. 888-905, 2000.
18. J. Carpenter, P. Clifford, and P. Fearnhead, "Improved particle filter for nonlinear problems, " Radar, Sonar and Navigation, IEE Proceedings -, vol. 146, no. 1, pp. 2 -7, feb 1999.
19. F. Dellaert, D. Fox, W. Burgard, and S. Thrun, "Monte carlo localization for mobile robots, " in Robotics and Automation, 1999. Proceedings. 1999 IEEE International Conference on, vol. 2, 1999, pp. 1322 -1328.
20. N. Gordon, D. Salmond, and A. Smith, "Novel approach to nonlinear/non-gaussian bayesian state estimation, " Radar and Signal Processing, IEE Proceedings F, vol. 140, no. 2, pp. 107 -113, apr 1993.
21. M. Isard and A. Blake, "Contour tracking by stochastic propagation of conditional density, " in Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I, ser. ECCV '96. London, UK, UK: Springer-Verlag, 1996, pp. 343-356. [Online]. Available: http://dl.acm.org/ citation.cfm?id=645309.648900.
22. Z. Khan, T. Balch, and F. Dellaert, "Mcmc-based particle filtering for tracking a variable number of interacting targets, " Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 27, no. 11, pp. 1805 -1819, nov. 2005.
23. A. Veeraraghavan, R. Chellappa, and M. Srinivasan, "Shape- andbehavior encoded tracking of bee dances, " Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 30, no. 3, pp. 463 -476, march 2008.
24. Z. Khan, T. Balch, and F. Dellaert, "A rao-blackwellized particle filter for eigentracking, " in Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, vol. 2, june-2 july 2004, pp. 980 - 986 Vol.2.
25. A. Cangar, T. Leroy, M. Guarino, E. Vranken, R. Fallon, J. Lenehan, J. Mee, and D. Berckmans, "Automatic real-time monitoring of locomotion and posture behaviour of pregnant cows prior to calving using online image analysis, " Computers and Electronics in Agriculture, vol. 64, no. 1, pp. 53 - 60, 2008. [Online]. Available: http://www.sciencedirect.com/science/article/pii/ S0168169908001373.
26. R. Tillett, C. Onyango, and J. Marchant, "Using model-based image processing to track animal movements, " Computers and Electronics in Agriculture, vol. 17, no. 2, pp. 249 - 261, 1997. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0168169996013087.
27. R. Farah, J. Langlois, and G. Bilodeau, "Rat: Robust animal tracking, " in Robotic and Sensors Environments (ROSE), 2011 IEEE International Symposium on, sept. 2011, pp. 65 -70.
28. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features, " in Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005. 2nd Joint IEEE International Workshop on, oct. 2005, pp. 65 - 72.
29. S. Belongie, K. Branson, P. Dollar, and V. Rabaud, "Monitoring animal behavior in the smart vivarium, " in Measuring Behavior, Wageningen, NL, 2005, pp. 70-72.
30. H. Jhuang, E. Garrote, N. Edelman, T. Poggio, A. Steele, and T. Serre, "Trainable, vision-based automated home cage behavioral phenotyping, " in Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, ser. MB '10. New York, NY, USA: ACM, 2010, pp. 331-334. [Online]. Available: http://doi.acm.org/10.1145/1931344.1931377.
31. H. Jhuang, E. Garrote, N. Edelman, T. Poggio, A. Steele, and T. Serre "Vision-based automated recognition of mice home-cage behaviors." in Workshop: Visual Observation and Analysis of Animal and Insect Behavior, in conjunction with International Conference on Pattern Recognition (ICPR), 2010.
32. H. Jhuang, E. Garrote, X. Yu, V. Khilnani, T. Poggio, A. D. Steele, and T. Serre, "Automated home-cage behavioural phenotyping of mice." Nature communications, vol. 1, no. 6, p. 68, 2010. [Online]. Available: http://www.nature.com/doifinder/10.1038/ncomms1064.
33. D. Tweed and A. Calway, "Tracking many objects using subordinated condensation, " in Proceedings of the British Machine Vision Conference, P. Rosin and D. Marshall, Eds. BMVA Press, October 2002, pp. 283-292. [Online]. Available: http://www.cs.bris.ac.uk/Publications/Papers/1000674.pdf.
34. M. Betke, D. Hirsh, A. Bagchi, N. Hristov, N. Makris, and T. Kunz, "Tracking large variable numbers of objects in clutter, " in Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, june 2007, pp. 1 -8.
35. A. Ernst and C. Kublbeck, "Fast face detection and species classification of african great apes, " in Advanced Video and Signal-Based Surveillance (AVSS), 2011 8th IEEE International Conference on, 30 2011-sept. 2 2011, pp. 279 -284.
36. J. Wawerla, S. Marshall, G. Mori, K. Rothley, and P. Sabzmeydani, "Bearcam: Automated wildlife monitoring at the arctic circle, " Mach. Vision Appl., vol. 20, no. 5, pp. 303-317, Jun. 2009. [Online]. Available: http://dx.doi.org/10.1007/s00138-008-0128-0.
37. P. Sabzmeydani and G. Mori, "Detecting pedestrians by learning shapelet features, " in Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, june 2007, pp. 1 -8.
38. P. Viola and M. Jones, "Robust real-time object detection, " in International Journal of Computer Vision, 2001.
39. N. Cole, "Maximum likelihood fitting of tidal streams with application to the sagittarius dwarf tidal tails, " Ph.D. dissertation, Rensselaer Polytechnic Institute, 2009.
40. N. Cole, H. Newberg, M. Magdon-Ismail, T. Desell, K. Dawsey, W. Hayashi, J. Purnell, B. Szymanski, C. A. Varela, B. Willett, and J. Wisniewski, "Maximum likelihood fitting of tidal streams with application to the sagittarius dwarf tidal tails, " Astrophysical Journal, vol. 683, pp. 750-766, 2008.
41. T. Desell, B. A. Willet, M. Arsenault, H. Newberg, M. Magdon-Ismail, B. Szymanski, and C. Varela, "Evolving n-body simulations to determine the origin and structure of the milky way galaxy's halo using volunteer computing, " in The IPDPS'11 Fifth Workshop on Desktop Grids and Volunteer Computing Systems (PCGrid 2011), 2011.
42. T. Desell, L. Newberg, M. Magdon-Ismail, B. K. Szymanski, and W. Thompson, "Finding protein binding sites using volunteer computing grids, " in 2nd International Congress on Computer Applications and Computational Science (CACS 2011), November 2011.
43. S. Pellicer, N. Ahmed, Y. Pan, and Y. Zheng, "Gene sequence alignment on a public computing platform, " in Parallel Processing, 2005. ICPP 2005 Workshops. International Conference Workshops on, june 2005, pp. 95 - 102.
44. C. Mony, M. Garbey, M. Smaoui, and M.-L. Benot, "Large scale parameter study of an individual-based model of clonal plant with volunteer computing, " Ecological Modelling, vol. 222, no. 4, pp. 935 - 946, 2011. [Online]. Available: http://www.sciencedirect.com/science/article/pii/ S0304380010005557.
45. A. L. Beberg, D. L. Ensign, G. Jayachandran, S. Khaliq, and V. S. Pande, "Foldinghome: Lessons from eight years of volunteer distributed computing, " Parallel and Distributed Processing Symposium, International, pp. 1-8, 2009.
46. I. J. General, E. K. Asciutto, and J. D. Madura, "Structure of aqueous sodium perchlorate solutions, " The Journal of Physical Chemistry B, vol. 112, no. 48, pp. 15417-15425, 2008. [Online]. Available: http://pubs.acs.org/doi/abs/10.1021/jp806269w.
47. C. B. Ries, "Comsolgrid - A framework for performing large-scale parameter studies using comsol multiphysics and the berkeley open infrastructure for network computing (BOINC), " Applied Sciences, p. 8, 2010.
48. J. A. Lopez-Perez, J. Salt, and E. Ros, "Distributed computing and farm management with application to the search for heavy gauge bosons using the atlas experiment at the lhc (cern). oai:cds.cern.ch:1115355, " Ph.D. dissertation, Valencia (Spain), University of Valencia, Valencia (Spain), 2008, presented on 21 Jan 2008.
49. C. Christensen, T. Aina, and D. Stainforth, "The challenge of volunteer computing with lengthy climate model simulations, " in e-Science and Grid Computing, 2005. First International Conference on, july 2005, pp. 8 -15.
50. D. P. Anderson, "Volunteer computing: The ultimate cloud, " Crossroads, vol. 16, no. 3, pp. 7-10, 2010.
51. D. P. Anderson, E. Korpela, and R. Walton, "High-performance task distribution for volunteer computing." in The First International Conference on e-Science and Grid Techniques (e-Science 2005), 2005, pp. 196-203.
52. C. J. Lintott, K. Schawinski, A. Slosar, K. Land, S. Bamford, D. Thomas, M. J. Raddick, R. C. Nichol, A. Szalay, D. Andreescu, P. Murray, and J. Vandenberg, "Galaxy zoo: morphologies derived from visual inspection of galaxies from the sloan digital sky survey, " Monthly Notices of the Royal Astronomical Society, vol. 389, no. 3, pp. 1179-1189, 2008. [Online]. Available: http://dx.doi.org/10.1111/j.1365-2966.2008.13689.x.
53. C. Lintott, K. Schawinski, S. Bamford, A. Slosar, K. Land, D. Thomas, E. Edmondson, K. Masters, R. C. Nichol, M. J. Raddick, A. Szalay, D. Andreescu, P. Murray, and J. Vandenberg, "Galaxy zoo 1: data release of morphological classifications for nearly 900, 000 galaxies, " Monthly Notices of the Royal Astronomical Society, vol. 410, no. 1, pp. 166-178, 2011. [Online]. Available: http://dx.doi.org/10.1111/j.1365-2966.2010.17432.x.
54. J. e. a. Adelman-McCarthy, "The 6th Sloan Digital Sky Survey Data Release, http://www.sdss.org/dr6/, " July 2007, apJS, in press, arXiv/0707.3413.
55. D. A. Fischer, M. E. Schwamb, K. Schawinski, C. Lintott, J. Brewer, M. Giguere, S. Lynn, M. Parrish, T. Sartori, R. Simpson, A. Smith, J. Spronck, N. Batalha, J. Rowe, J. Jenkins, S. Bryson, A. Prsa, P. Tenenbaum, J. Crepp, T. Morton, A. Howard, M. Beleu, Z. Kaplan, N. vanNispen, C. Sharzer, J. DeFouw, A. Hajduk, J. P. Neal, A. Nemec, N. Schuepbach, and V. Zimmermann, "Planet hunters: The first two planet candidates identified by the public using the kepler public archive data, " Monthly Notices of the Royal Astronomical Society, vol. 419, no. 4, pp. 2900-2911, 2012. [Online]. Available: http://dx.doi.org/10.1111/j.1365-2966.2011.19932.x.
56. Lion Research Center, University of Minnesota, [Accessed Online, 2012] http://www.snapshotserengeti.org/.
57. R. Bonney, C. B. Cooper, J. Dickinson, S. Kelling, T. Phillips, K. V. Rosenberg, and J. Shirk, "A developing tool for expanding science knowledge and scientific literacy, " BioScience, vol. 59, pp. 977-984, 2009.
58. M. A. Voss and C. B. Cooper, "Using a free online citizen-science project to teach observation and quantification of animal behavior, " American Biology Teacher, vol. 72, pp. 437-443, 2012.
59. M. A. Voss, Personal communication, 2012.
60. H. Bay, T. Tuytelaars, and L. Van-Gool, "Surf: Speeded up robust features, " Computer Vision-ECCV 2006, pp. 404-417, 2006.
61. "OpenCV, " [Accessed Online, 2012] http://opencv.org/.
62. A. Abdel-Hakim and A. Farag, "Csift: A sift descriptor with color invariant characteristics, " in Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, vol. 2. IEEE, 2006, pp. 1978-1983.