Surpassing Humans and Computers with JELLYBEAN: Crowd-Vision-Hybrid Counting Algorithms

Proceedings of the 3rd AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2015

Volumn , Issue , 2015, Pages 178-187

  Sarma, Akash Das ^a   Jain, Ayush ^b   Nandi, Arnab ^c   Parameswaran, Aditya ^b   Widom, Jennifer ^a  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION; IMAGE ENHANCEMENT;

COMPUTER VISION ALGORITHMS; COMPUTER VISION TECHNIQUES; HEALTH SURVEILLANCES; HYBRID MODE; LABELED TRAINING DATA; LOW-COSTS; NEAR-OPTIMAL; PROPERTY; STAND-ALONE MODES; SURVEILLANCE SECURITIES;

MILITARY APPLICATIONS;

EID: 85046972725     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1609/hcomp.v3i1.13234     Document Type: Conference Paper

References (31)

1. Ahuja, N., and Todorovic, S. 2007. Extracting texels in 2.1 d natural textures. In ICCV 2007, 1–8. IEEE.
2. Beucher, S., and Meyer, F. 1992. The morphological approach to segmentation: the watershed transformation. Optical Engineering-New York-Marcel Dekker Incorporated- 34:433–433.
3. Borodin, A. 1998. Online computation and competitive analysis, volume 2.
4. Cheng, J., and Bernstein, M. S. 2015. Flock: Hybrid crowd-machine learning classifiers. In CSCW’15.
5. Cho, S.-Y.; Chow, T. W.; and Leung, C.-T. 1999. A neural-based crowd estimation by hybrid global learning algorithm. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on 29(4):535–541.
6. Coffman Jr, E. G.; Garey, M. R.; and Johnson, D. S. 1996. Approximation algorithms for bin packing: a survey. In Approximation algorithms for NP-hard problems, 46–93. PWS Publishing Co.
7. Dyer, M., and Frieze, A. 1985. On the complexity of partitioning graphs into connected subgraphs. Discrete Applied Mathematics 10(2):139–153.
8. Everingham, M.; Eslami, S. A.; Van Gool, L.; Williams, C. K.; Winn, J.; and Zisserman, A. 2014. The pascal visual object classes challenge: A retrospective. International Journal of Computer Vision 111(1):98–136.
9. Forsyth, D. A., and Ponce, J. 2003. Computer Vision: A Modern Approach.
10. Ghosh, A.; Kale, S.; and McAfee, P. 2011. Who moderates the moderators?: crowdsourcing abuse detection in user-generated content. In EC, 2011, 167–176. ACM.
11. Idrees, H.; Saleemi, I.; Seibert, C.; and Shah, M. 2013. Multisource multi-scale counting in extremely dense crowd images. In CVPR. IEEE.
12. Karger, D. R.; Oh, S.; and Shah, D. 2011. Iterative learning for reliable crowdsourcing systems. In NIPS, 1953–1961.
13. Lasecki, W. S.; Song, Y. C.; Kautz, H.; and Bigham, J. P. 2013. Real-time crowd labeling for deployable activity recognition. In CSCW, 2013. ACM.
14. Lehmussola, A.; Ruusuvuori, P.; Selinummi, J.; Huttunen, H.; and Yli-Harja, O. 2007. Computational framework for simulating fluorescence microscope images with cell populations. Medical Imaging, IEEE Transactions on 26(7).
15. Lempitsky, V., and Zisserman, A. 2010. Learning to count objects in images. In Advances in Neural Information Processing Systems, 1324–1332.
16. Liu, X.; Tu, P. H.; Rittscher, J.; Perera, A.; and Krahnstoever, N. 2005. Detecting and counting people in surveillance applications. In AVSS, 2005, 306–311. IEEE.
17. Loukas, C. G.; Wilson, G. D.; Vojnovic, B.; and Linney, A. 2003. An image analysis-based approach for automated counting of cancer cell nuclei in tissue sections. Cytometry part A 55(1):30–42.
18. Luengo-Oroz, M. A.; Arranz, A.; and Frean, J. 2012. Crowdsourcing malaria parasite quantification: an online game for analyzing images of infected thick blood smears. Journal of medical Internet research 14(6).
19. Marana, A.; Velastin, S.; Costa, L.; and Lotufo, R. 1997. Estimation of crowd density using image processing. In Image Processing for Security Applications (Digest No.: 1997/074), IEE Colloquium on, 11–1. IET.
20. Nattkemper, T. W.; Wersing, H.; Schubert, W.; and Ritter, H. 2002. A neural network architecture for automatic segmentation of fluorescence micrographs. Neurocomputing 48(1):357–367.
21. NBC News. 2005. Exhibit traces the history of the voting rights act. In nbcnews.com/id/8839169/ns/us news-life/t/exhibit-traces-history-voting-rights-act.
22. Parameswaran, A. G.; Garcia-Molina, H.; Park, H.; Polyzotis, N.; Ramesh, A.; and Widom, J. 2012. Crowdscreen: Algorithms for filtering data with humans. In SIGMOD, 2012, 361–372. ACM.
23. Qin, C.; Bao, X.; Roy Choudhury, R.; and Nelakuditi, S. 2011. Tagsense: a smartphone-based approach to automatic image tagging. In MobiSys, 1–14. ACM.
24. Rabaud, V., and Belongie, S. 2006. Counting crowded moving objects. In CVPR, 2006, volume 1, 705–711. IEEE.
25. Ribeiro, F.; Florencio, D.; and Nascimento, V. 2011. Crowdsourcing subjective image quality evaluation. In ICIP, 3097–3100. IEEE.
26. Russell, J.; Couturier, S.; Sopuck, L.; and Ovaska, K. 1996. Post-calving photo-census of the rivière george caribou herd in july 1993. Rangifer 16(4):319–330.
27. Sarma, A. D.; Jain, A.; Nandi, A.; Parameswaran, A.; and Widom, J. 2015. Surpassing humans and computers with JELLYBEAN: Crowd-vision-hybrid counting algorithms. Technical report, Stanford University.
28. Sheng, V. S.; Provost, F.; and Ipeirotis, P. G. 2008. Get another label? improving data quality and data mining using multiple, noisy labelers. In Proceedings of the 14th ACM SIGKDD, 614–622. ACM.
29. Sorokin, A., and Forsyth, D. 2008. Utility data annotation with amazon mechanical turk. In CVPR Workshops.
30. Szeliski, R. 2010. Computer vision: Algorithms and Applications. Springer Science & Business Media.
31. Zhu, X., and Ramanan, D. 2012. Face detection, pose estimation, and landmark localization in the wild. In CVPR, 2012, 2879–2886. IEEE.