Collecting and annotating human activities in web videos

ICMR 2014 - Proceedings of the ACM International Conference on Multimedia Retrieval 2014

Volumn , Issue , 2014, Pages 377-384

  Heilbron, Fabian Caba ^a   Niebles, Juan Carlos ^a  

^a UNIVERSIDAD DEL NORTE   (Colombia)

Author keywords

Computer vision; Crowdsourcing; Human activitity recognition; Video annotation; Video retrieval

Indexed keywords

ALGORITHMS; COMPUTER VISION;

AGGLOMERATIVE CLUSTERING; AMAZON MECHANICAL TURKS; COMPUTER VISION ALGORITHMS; CROWDSOURCING; HUMAN ACTIVITITY RECOGNITION; TEMPORAL LOCALIZATION; VIDEO ANNOTATIONS; VIDEO RETRIEVAL;

VIDEO RECORDING;

EID: 84899741623     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2578726.2578775     Document Type: Conference Paper

References (36)

1. J. D. Abernethy and R. M. Frongillo. A collaborative mechanism for crowd-sourcing prediction problems. In NIPS. 2011.
2. K. Ali, D. Hasler, and F. Fleuret. Flowboost: Appearance learning from sparsely annotated video. In CVPR, 2011.
3. S. Cooper, F. Khatib, A. Treuille, J. Barbero, J. Lee, M. Beenen, A. Leaver-Fay, D. Baker, Z. Popović, et al. Predicting protein structures with a multiplayer online game. Nature, 466(7307):756-760, 2010.
4. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. ImageNet: A Large-Scale Hierarchical Image Database. In CVPR, 2009.
5. P. Dollár, C. Wojek, B. Schiele, and P. Perona. Pedestrian detection: A benchmark. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 304-311. IEEE, 2009.
6. R. B. Fisher. The pets04 surveillance ground-truth data sets. Proc. 6th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, 2004.
7. R. G. Gomes, P. Welinder, A. Krause, and P. Perona. Crowd-clustering. In J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, editors, Advances in Neural Information Processing Systems 24, pages 558-566. 2011.
8. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri. Actions as space-time shapes. Transactions on Pattern Analysis and Machine Intelligence, 29(12):2247-2253, December 2007.
9. J. Howe. The rise of crowd sourcing. Wired magazine, 14(6):1-4, 2006.
10. P. Ipeirotis, F. Provost, V. Sheng, and J. Wang. Repeated labeling using multiple noisy labelers. Data Mining and Knowledge Discovery, 2013.
11. P. G. Ipeirotis, F. Provost, and J. Wang. Quality management on amazon mechanical turk. In Proceedings of the ACM SIGKDD workshop on Human Computation (HCOMP 2010), pages 64-67. ACM, 2010.
12. D. R. Karger, S. Oh, and D. Shah. Iterative learning for reliable crowdsourcing systems. In J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, editors, Advances in Neural Information Processing Systems 24, pages 1953-1961. 2011.
13. A. Kittur, E. H. Chi, and B. Suh. Crowdsourcing user studies with mechanical turk. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 453-456. ACM, 2008.
14. D. Klein, S. D. Kamvar, and C. D. Manning. From instance-level constraints to space-level constraints: Making the most of prior knowledge in data clustering. 2002.
15. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre. Hmdb: a large video database for human motion recognition. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 2556-2563. IEEE, 2011.
16. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8. IEEE, 2008.
17. H. Liu, R. Feris, and M. Sun. Benchmarking human activity recognition. CVPR Tutorial, CVPR, 2012.
18. J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videosâǍIJin the wildâǍİ. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 1996-2003. IEEE, 2009.
19. M. Marszalek, I. Laptev, and C. Schmid. Actions in context. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 2929-2936. IEEE, 2009.
20. D. Mihalcik and D. Doermann. The design and implementation of viper. Technical report, 2003.
21. G. A. Miller. Wordnet: a lexical database for english. Communications of the ACM, 38(11):39-41, 1995.
22. L.-V. Nguyen-Dinh, C. Waldburger, D. Roggen, and G. Tröster. Tagging human activities in video by crowdsourcing. In Proceedings of the ACM International Conference on Multimedia Retrieval (ICMR 2013), Apr. 2013.
23. J. C. Niebles, C.-W. Chen, and L. Fei-Fei. Modeling temporal structure of decomposable motion segments for activity classification. In ECCV, 2010.
24. V. C. Raykar and S. Yu. Ranking annotators for crowdsourced labeling tasks. In J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, editors, Advances in Neural Information Processing Systems 24, pages 1809-1817. 2011.
25. M. Rodriguez, J. Ahmed, and M. Shah. Action mach a spatiotemporal maximum average correlation height filter for action recognition. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8, 2008.
26. S. Sadanand and J. J. Corso. Action bank: A high-level representation of activity in video. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 1234-1241. IEEE, 2012.
27. C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: a local svm approach. In Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, volume 3, pages 32-36. IEEE, 2004.
28. K. Soomro, A. R. Zamir, and M. Shah. Ucf101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402, 2012.
29. C. Sun, I. Junejo, and H. Foroosh. Action recognition using rank-1 approximation of joint self-similarity volume. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 1007-1012. IEEE, 2011.
30. P. Venetis and H. Garcia-Molina. Quality control for comparison microtasks. In Proceedings of the First International Workshop on Crowdsourcing and Data Mining, pages 15-21. ACM, 2012.
31. S. Vijayanarasimhan, P. Jain, and K. Grauman. Far-sighted active learning on a budget for image and video recognition. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 3035-3042. IEEE, 2010.
32. L. Von Ahn, B. Maurer, C. McMillen, D. Abraham, and M. Blum. recaptcha: Human-based character recognition via web security measures. Science, 321(5895):1465-1468, 2008.
33. C. Vondrick, D. Patterson, and D. Ramanan. Efficiently scaling up crowdsourced video annotation. International Journal of Computer Vision, 2013.
34. C. Wah. Crowdsourcing and its applications in computer vision. University of California, San Diego, 2006.
35. YouTube. Youtube statistics.
36. J. Yuen, B. Russell, C. Liu, and A. Torralba. Labelme video: building a video database with human annotations. In ICCV, 2009.