Boosted exemplar learning for action recognition and annotation

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 7, 2011, Pages 853-866

  Zhang, Tianzhu ^a,b   Liu, Jing ^a,b   Liu, Si ^a,b   Xu, Changsheng ^a,b   Lu, Hanqing ^a,b  

^a INSTITUTE OF AUTOMATION   (China)

^b China Singapore Institute of Digital Media   (Singapore)

Author keywords

Action annotation; action recognition; AdaBoost; mi SVM; multiple instance learning (MIL)

Indexed keywords

ACTION ANNOTATION; ACTION RECOGNITION; CO-OCCURRENCE; DATA SETS; DISTANCE MEASURE; EUCLIDEAN SPACES; EXEMPLAR LEARNING; HUMAN-ACTION RECOGNITION; IMAGE SETS; MI-SVM; MULTIPLE-INSTANCE LEARNING; OPTIMIZATION FORMULATIONS; RESEARCH TOPICS; TIME RESOLUTION; VISUAL APPEARANCE; YOUTUBE;

ADAPTIVE BOOSTING; ALGORITHMS; COMPUTER VISION; GESTURE RECOGNITION; MOTION ESTIMATION; USER INTERFACES; VISUALIZATION;

FEATURE EXTRACTION;

EID: 79960160111     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2133090     Document Type: Article

References (39)

1. J. K. Aggarwal and Q. Cai, "Human motion analysis: A review," Comput. Vision Image Understand., vol. 73, no. 3, pp. 428-440, 1999.
2. T. B. Moeslund, A. Hilton, and V. Kr̈uger, "A survey of advances in vision-based human motion capture and analysis," Comput. Vision Image Understand., vol. 104, no. 2, pp. 90-126, 2006. (Pubitemid 44573873)
3. S. Carlsson and J. Sullivan, "Action recognition by shape matching to key frames," in Proc. Workshop Models Versus Exemplars Comput. Vision, Dec. 2001, pp. 263-270.
4. D. Weinland, E. Boyer, and R. Ronfard, "Action recognition from arbitrary views using 3-D exemplars," in Proc. ICCV, 2007, pp. 1-7.
5. K. Schindler and L. van Gool, "Action snippets: How many frames does human action recognition require?" in Proc. CVPR, 2008, pp. 1-8.
6. C. Thurau and V. Hlavac, "Pose primitive based human action recognition in videos or still images," in Proc. CVPR, 2008, pp. 1-8.
7. D. Weinland and E. Boyer, "Action recognition using exemplar-based embedding," in Proc. CVPR, 2008, pp. 1-7.
8. N. I. Cinbis, R. G. Cinbis, and S. Sclaroff, "Learning actions from the Web," in Proc. ICCV, 2009, pp. 995-1002.
9. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. ICCV, 2005, pp. 1395-1402. (Pubitemid 44042342)
10. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local SVM approach," in Proc. ICPR, 2004, pp. 32-36.
11. J. Niebles and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," in Proc. BMVC, 2006, pp. 299-318.
12. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action," in Proc. ICCV, 2007, pp. 1-8.
13. T. K. Kim, S. F. Wong, and R. Cipolla, "Tensor canonical correlation analysis for action classification," in Proc. CVPR, 2007, pp. 1-8.
14. D. Tran and A. Sorokin, "Human activity recognition with metric learning," in Proc. ECCV, 2008, pp. 548-561.
15. V. Athitsos and S. Sclaroff, "Estimating 3-D hand pose from a cluttered image," in Proc. CVPR, 2003, pp. 432-439.
16. K. Toyama and A. Blake, "Probabilistic tracking in a metric space," in Proc. ICCV, 2001, pp. 50-57. (Pubitemid 32795040)
17. T. Zhang, J. Liu, S. Liu, Y. Ouyang, and H. Lu, "Boosted exemplar learning for human action recognition," in Proc. Workshop Video-Oriented Object Event Classification Conjunction ICCV, 2009, pp. 538-545.
18. Y. Guo, Y. Shan, H. Sawhney, and R. Kumar, "PEET: Prototype embedding and embedding transition for matching vehicles over disparate viewpoints," in Proc. CVPR, 2007, pp. 1-8.
19. Y. Wang, H. Jiang, M. S. Drew, Z.-N. Li, and G. Mori, "Unsupervised discovery of action classes," in Proc. CVPR, 2006, pp. 1654-1661. (Pubitemid 44931517)
20. Y. Dedeoglu, B. Toreyin, U. Gudukbay, and A. Cetin, "Silhouette- based method for object classification and human action recognition in video," in Proc. HCI, 2006, pp. 64-77. (Pubitemid 44059048)
21. A. M. Elgammal, V. D. Shet, Y. Yacoob, and L. S. Davis, "Learning dynamics for exemplar-based gesture recognition," in Proc. CVPR, 2003, pp. 571-578.
22. A. Fathi and G. Mori, "Human pose estimation using motion exemplars," in Proc. ICCV, 2007, pp. 1-8.
23. J. Liu, J. Luo, and M. Shah, "Recognizing realistic actions from videos in the wild," in Proc. CVPR, 2009, pp. 1996-2003.
24. J. Liu, Y. Yang, and M. Shah, "Learning semantic visual vocabularies using diffusion distance," in Proc. CVPR, 2009, pp. 461-468.
25. Y. Hu, L. Cao, F. Lv, S. Yan, Y. Gong, and T. Huang, "Action detection in complex scenes with spatial and temporal ambiguities," in Proc. IEEE Int. Conf. Comput. Vision, Sep.-Oct. 2009, pp. 128-135.
26. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2003.
27. MOSEK Optimization Software [Online]. Available: http://www.mosek. com
28. T. Dietterich, R. Lathrop, and T. Lozano-Perez, "Solving the multipleinstance problem with axis parallel rectangles," Artif. Intell., vol. 89, nos. 1-2, Jan. 1997, pp. 31-71. (Pubitemid 127412230)
29. S. Andrews, I. Tsochantaridis, and T. Hofmann, "Support vector machines for multiple-instance learning," in Proc. NIPS, 2002, pp. 561-568.
30. J. Friedman, T. Hastie, and R. Tibshirani, "Additive logistic regression: A statistical view of boosting," Ann. Statist., vol. 28, p. 2000, 1998.
31. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Patt. Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002. (Pubitemid 34448769)
32. L. Wang and D. Suter, "Recognizing human activities from silhouettes: Motion subspace and factorial discriminative graphical model," in Proc. CVPR, 2007, pp. 1-8.
33. S. Ali, A. Basharat, and M. Shah, "Chaotic invariants for human action recognition," in Proc. ICCV, 2007, pp. 1-8.
34. P. Sabzmeydani and G. Mori, "Detecting pedestrians by learning shapelet features," in Proc. CVPR, 2007, pp. 1-8.
35. S. Ali and M. Shah, "Human action recognition in videos using kinematic features and multiple instance learning," IEEE Trans. Patt. Anal. Mach. Intell., vol. 32, no. 2, pp. 288-303, Feb. 2010.
36. J. Liu and M. Shah, "Learning human actions via information maximization," in Proc. CVPR, 2008, pp. 1-8.
37. J. C. Niebles, B. Han, A. Ferencz, and L. Fei-Fei, "Extracting moving people from Internet videos," in Proc. ECCV, 2008, pp. 527-540.
38. P. Felzenszwalb, D. McAllester, and D. Ramanan, "A discriminatively trained, multiscale, deformable part model," in Proc. CVPR, 2008, pp. 1-8.
39. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. CVPR, 2005, pp. 886-893. (Pubitemid 43897286)