Web-based classifiers for human action recognition

IEEE Transactions on Multimedia

Volumn 14, Issue 4 PART1, 2012, Pages 1031-1045

  Ikizler Cinbis, Nazli ^a   Sclaroff, Stan ^b  

^a HACETTEPE UNIVERSITY   (Turkey)

^b BOSTON UNIVERSITY   (United States)

Author keywords

Computer vision; image retrieval; statistical learning

Indexed keywords

ACTION MODELS; ACTION RECOGNITION; ACTION RECOGNITION SYSTEMS; CLASSIFICATION TIME; CLEAN UP; EXPERIMENTAL EVIDENCE; GENERIC DATABASE; GENERIC METHOD; HUMAN INTERVENTION; HUMAN POSE; HUMAN-ACTION RECOGNITION; INTERNET SEARCH ENGINE; KEYPOSES; RETRIEVAL PROCEDURES; STATISTICAL LEARNING; TEMPORAL ORDERING; TRAINING SETS; VIDEO DATA;

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; GESTURE RECOGNITION; IMAGE RETRIEVAL; KNOWLEDGE MANAGEMENT; SEARCH ENGINES; WEBSITES;

MOTION ESTIMATION;

EID: 84864131989     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2187180     Document Type: Article

References (56)

1. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local svm approach," in Proc. ICPR, 2004, pp. 32-36.
2. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-Time shapes," in Proc. ICCV, 2005, vol. 2, pp. 1395-1402.
3. J. C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-Temporal words," in Proc. BMVC, 2006, pp. 1249-1258.
4. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action recognition," presented at the ICCV, Rio de Janeiro, Brazil, 2007.
5. T. K. Kim, S. F. Wong, and R. Cipolla, "Tensor canonical correlation analysis for action classification," presented at the CVPR,Minneapolis, MN, 2007.
6. K. Schindler and L. van Gool, "Action snippets: How many frames does human action recognition require?," presented at the CVPR, Anchorage, AK, 2008.
7. D. Tran and A. Sorokin, "Human activity recognition with metric learning," in Proc. ECCV, 2008, pp. 548-561.
8. C. Thurau and V. Hlavac, "Pose primitive based human action recognition in videos or still images," presented at the CVPR, Anchorage, AK, 2008.
9. D. Weinland and E. Boyer, "Action recognition using exemplar-based embedding," presented at the CVPR, Anchorage, AK, 2008.
10. N. Ikizler-Cinbis, R. G. Cinbis, and S. Sclaroff, "Learning actions from the web," in Proc. Int. Conf. Comput. Vis., 2009, pp. 995-1002.
11. J. C. Niebles, B. Han, A. Ferencz, and L. Fei-Fei, "Extracting moving people from internet videos," in Proc. ECCV, 2008, pp. 527-540.
12. J. Liu, J. Luo, andM. Shah, "Recognizing realistic actions from videos "in the wild"," in Proc. CVPR, 2009, pp. 1996-2003.
13. G. Wang and D. Forsyth, "Object image retrieval by exploiting online knowledge resources," presented at the CVPR, Anchorage, AK, 2008.
14. L.-J. Li, G. Wang, and L. Fei-Fei, "Optimol: Automatic online object picture collection via incremental model learning," presented at the CVPR, Minneapolis, MN, 2007.
15. F. Schroff, A. Criminisi, and A. Zisserman, "Harvesting image databases from the web," presented at the ICCV, Rio de Janeiro, Brazil, 2007.
16. S. Vijayanarasimhan and K. Grauman, "Keywords to visual categories: Multiple-instance learning for weakly supervised object categorization," presented at the CVPR, Anchorage, AK, 2008.
17. R. Fergus, L. Fei-Fei, P. Perona, and A. Zisserman, "Learning object categories from google's image search," in Proc. 10th Int. Conf. Comput. Vis., Beijing, China, Oct. 2005, vol. 2, pp. 1816-1823.
18. T. Berg and D. A. Forsyth, "Animals on the web," in Proc. CVPR, 2006, pp. 1463-1470.
19. K. Wnuk and S. Soatto, "Filtering internet image search results towards keyword based category recognition," presented at the IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, 2008.
20. T. Berg and A. Berg, "Finding iconic images," presented at the 2nd Internet Vis. Workshop IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Miami, FL, 2009.
21. B. Ni, Z. Song, and S. Yan, "Web image and video mining towards universal and robust age estimator," IEEE Trans. Multimedia, vol. 13, no. 6, pp. 1217-1229, Dec. 2011.
22. R. Negoescu, B. Adams, D. Phung, S. Venkatesh, and D. Gatica-Perez, "Flickr hypergroups," in Proc. ACM MM, 2009, pp. 813-816.
23. R. Negoescu, B. Adams, D. Phung, S. Venkatesh, and D. Gatica-Perez, "Learning visual contexts for image annotation from flickr groups," IEEE Trans. Multimedia, vol. 13, no. 2, pp. 330-341, Apr. 2011.
24. G. Wang, D. Hoiem, and D. Forsyth, "Learning image similarity from flickr groups using stochastic intersection kernel machines," in Proc. ICCV, 2009, pp. 428-435.
25. X. Li, L. Chen, L. Zhang, F. Lin, andW.-Y. Ma, "Image annotation by large-scale content-based image retrieval," in Proc. ACM MM, 2006.
26. X. Li, C. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting," IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Nov. 2009.
27. X.-J. Wang, L. Zhang, X. Li, and W.-Y. Ma, "Annotating images by mining image search results," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1919-1932, Nov. 2008.
28. L. Duan, D. Xu, I. Tsang, and J. Luo, "Visual event recognition in videos by learning fromweb data," presented at the CVPR, San Francisco, CA, 2010.
29. Y.Wang, H. Jiang,M. S. Drew, Z.-N. Li, and G. Mori, "Unsupervised discovery of action classes," in Proc. CVPR, 2006, pp. 1654-1661.
30. B. Yao and L. Fei-Fei, "Grouplet: A structured image representation for recognizing human and object interactions," presented at the 23rd IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, Jun. 2010.
31. P. Felzenszwalb, D.McAllester, and D. Ramanan, "A discriminatively trained, multiscale, deformable part model," presented at the CVPR, Anchorage, AK, 2008.
32. P. Dollár, B. Babenko, S. Belongie, P. Perona, and Z. Tu, "Multiple component learning for object detection," in Proc. ECCV, 2008, pp. 211-224.
33. A. Bissacco, M.-H. Yang, and S. Soatto, "Detecting humans via their pose," in Proc. NIPS, 2006, pp. 169-176.
34. R. Okada and S. Soatto, "Relevant feature selection for human pose estimation and localization in cluttered images," in Proc. ECCV, 2008, pp. 434-445.
35. R. Poppe, "A survey on vision-based human action recognition," Image Vis. Comput., vol. 28, pp. 976-990, Jun. 2010.
36. D. Weinland, R. Ronfard, and E. Boyer, "A survey of vision-based methods for action representation, segmentation and recognition," CVIU, vol. 115, pp. 224-241, Feb. 2011.
37. Y. Ke, R. Sukthankar, and M. Hebert, "Event detection in crowded videos," presented at the Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, 2007.
38. K. Mikolajczyk and H. Uemura, "Action recognition with motion-Appearance vocabulary forest," presented at the CVPR, Anchorage, AK, 2008.
39. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," presented at the CVPR, Anchorage, AK, 2008.
40. N. Ikizler and D. Forsyth, "Searching for complex human activities with no visual examples," IJCV, vol. 80, no. 3, pp. 337-357, 2008.
41. O. Duchenne, I. Laptev, J. Sivic, F. Bach, and J. Ponce, "Automatic annotation of human actions in video," in Proc. ICCV, 2009, pp. 1491-1498.
42. S. Zanetti, L. Zelnik-Manor, and P. Perona, "A walk through the web's video clips," presented at the 1st IEEE Workshop Internet Vis. in CVPR, Anchorage, AK, 2008.
43. V. W. Zheng, D. H. Hu, and Q. Yang, "Cross-domain activity recognition," in Proc. 11th Int. Conf. Ubiquitous Comput., 2009, Ser. Ubicomp '09, pp. 61-70.
44. W. Bian, D. Tao, and Y. Rui, "Cross-domain human action recognition," IEEE Trans. Syst., Man, Cybern., Part B-Cybern., vol. 42, no. 2, pp. 298-307, Apr. 2011.
45. A. Torralba, R. Fergus, andW. T. Freeman, "80 million tiny images: A large dataset for non-parametric object and scene recognition," PAMI, vol. 30, no. 11, pp. 1958-1970, 2008.
46. J. Ponce, T. L. Berg, M. Everingham, D. Forsyth, M. Hebert, S. Lazebnik, M. Marszalek, C. Schmid, C. Russell, A. Torralba, C. Williams, J. Zhang, and A. Zisserman, "Dataset issues in object recognition," in Towards Category-Level Object Recognition. New York: Springer, 2006, pp. 29-48.
47. Z. Zhang and D. Tao, "Slow feature analysis for human action recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 436-450, Mar. 2012.
48. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. CVPR, 2005, pp. I: 886-I: 893.
49. D. Martin, C. Fowlkes, and J. Malik, "Learning to detect natural image boundaries using local brightness, color and texture cues," PAMI, vol. 26, no. 5, pp. 530-549, 2004.
50. D. Lee and H. Seung, "Algorithms for non-negative matrix factorization," in Proc. NIPS, 2001, pp. 556-562.
51. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
52. J. Shi and C. Tomasi, "Good features to track," in Proc. CVPR, 1994, pp. 593-600.
53. N. Ikizler-Cinbis and S. Sclaroff, "Object, scene and actions: Combining multiple features for human action recognition," in Proc. ECCV, 2010, pp. 494-507.
54. R. Hamid, A. Johnson, S. Batta, A. Bobick, C. Isbell, and G. Coleman, "Detection and explanation of anomalous activities: Representing activities as bags of event n-grams," in Proc. CVPR, 2005, vol. 1, pp. 1031-1038.
55. A. Vedaldi and A. Zisserman, "Efficient additive kernels via explicit feature maps," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3539-3546.
56. N.Guan, D. Tao, Z. Luo, and B.Yuan, "Non-negative patch alignment framework," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1218-1230, Aug. 2011.