Hierarchical filtered motion for action recognition in crowded videos

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 42, Issue 3, 2012, Pages 313-323

  Tian, Yingli ^a   Cao, Liangliang ^b   Liu, Zicheng ^c   Zhang, Zhengyou ^c  

^a CITY COLLEGE OF NEW YORK   (United States)

^b United States of America   (United States)

^c MICROSOFT RESEARCH   (United States)

Author keywords

Action classification; action detection; crowded videos; hierarchical filtered motion (HFM); motion history image (MHI)

Indexed keywords

ACTION RECOGNITION; BACKGROUND MOTION; CROWDED VIDEOS; DATA SETS; DETECTION EXPERIMENTS; HARRIS CORNERS; HIERARCHICAL FILTERED MOTION (HFM); HIGH INTENSITY; HISTOGRAMS OF ORIENTED GRADIENTS; INTENSITY IMAGES; INTEREST POINTS; LOCAL MOTIONS; LOCAL REGION; MICROSOFT RESEARCHES; MOTION FIELDS; MOTION HISTORY IMAGES; SMOOTHING FILTERS; SPATIAL MOTIONS; TEMPORAL FEATURES;

EXPERIMENTS; PIXELS; SCANNING; STATISTICAL TESTS;

CLASSIFICATION (OF INFORMATION);

EID: 84860220275     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2011.2149519     Document Type: Article

References (60)

1. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes", in Proc. IEEE Conf. Comput. Vis., Oct. 2005, vol. 2, pp. 1395-1402. (Pubitemid 44042342)
2. M. Blaschko and C. Lampert, "Learning to localize objects with structured output regression", in Proc. Eur. Conf. Comput. Vis., 2008, pp. 2-15.
3. O. Boiman and M. Irani, "Detecting irregularities in images and in video", in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2005, vol. 1, pp. 462-469. (Pubitemid 44054993)
4. A. F. Bobick and J. W. Davis, "The recognition of human movement using temporal templates", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, Mar. 2001, pp. 257-267. (Pubitemid 32286632)
5. L. Cao, Z. Liu, and T. S. Huang, "Cross-dataset action detection", in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 1998-2005.
6. L. Cao, Y. Tian, Z. Liu, B. Yao, Z. Zhang, and T. Huang, "Action detection using multiple spatial-temporal interest point features", in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2010, pp. 340-345.
7. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection", in Proc. Comput. Vis. Pattern Recog., 2005, pp. 886-893. (Pubitemid 43897286)
8. J. W. Davis, "Hierarchical motion history images for recognizing human motion", in Proc. IEEE Workshop Detection Recog. Events Video, 2001, pp. 39-46.
9. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features", in Proc. Int. Conf. Comput. Vis. Workshop Visual Surveillance Performance Eval. Tracking Surveillance, Oct. 2005, pp. 65-72. (Pubitemid 46178025)
10. A. Fathi and G. Mori, "Action recognition by learning mid-level motion features", in Proc. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
11. Y. Hu, L. Cao, F. Lv, S. Yan, Y. Gong, and T. S. Huang, "Action detection in complex scenes with spatial and temporal ambiguities", in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 128-135.
12. A. Gilbert, J. Illingworth, and R. Bowden, "Scale invariant action recognition using compound featuresmined from dense spatio-temporal corners", in Proc. Eur. Conf. Comput. Vis., 2008, pp. 222-233.
13. C. Harris and M. Stephens, "A combined corner and edge detector", in Proc. Alvey Vis. Conf., 1988, pp. 189-192.
14. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action recognition", in Proc. Int. Conf. Comput. Vis., 2007, pp. 1-8.
15. X. Ji and H. Liu, "Advances in view-invariant human motion analysis: A review", IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 40, no. 1, pp. 13-24, Jan. 2010.
16. I. Junejo, E. Dexter, I. Laptev, and P. Perez, "View-independent action recognition from temporal self-similarities", IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 172-185, Jan. 2011.
17. M. B. Kaaniche and F. Bremond, "Gesture recognition by learning local motion signatures", in Proc. Comput. Vis. Pattern Recog., 2010, pp. 2745-2752.
18. Y. Ke, R. Sukthankar, and M. Hebert, "Event detection in crowded videos", in Proc. Int. Conf. Comput. Vis., 2007, pp. 1-8.
19. A. Kovashka and K. Grauman, "Learning a hierarchy of discriminative space-time neighborhood features for human action recognition", in Proc. Comput. Vis. Pattern Recog., 2010, pp. 2046-2053.
20. C. Lampert, M. Blaschko, and T. Hofmann, "Beyond sliding windows: Object localization by efficient subwindow search", in Proc. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
21. I. Laptev and T. Lindeberg, "Space-time interest points", in Proc. Int. Conf. Comput. Vis., 2003, pp. 432-439.
22. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies", in Proc. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
23. G. Lavee, E. Rivlin, and M. Rudzsky, "Understanding video events: A survey of methods for automatic interpretation of semantic occurrences in video", IEEE Trans. Syst., Man, Cybern., C, Appl. Rev., vol. 39, no. 5, pp. 489-504, Sep. 2009.
24. N. Li, C. Chen, Q. Wang, M. Song, D. Tao, and X. Li, "Avatar motion control by natural body movement via camera", Neurocomputing, vol. 72, nos. 1-3, pp. 648-652, 2008.
25. J. Liu, S. Ali, and M. Shah, "Recognizing human actions using multiple features", in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun., 2008, pp. 1-8.
26. J. Liu and M. Shah, "Learning human actions via information maximization", in Proc. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
27. J. Liu, J. Luo, and M. Shah, "Recognizing realistic actions from videosin the wild", in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2009, pp. 1996-2003.
28. M. Marszałek, I. Laptev, and C. Schmid, "Actions in context", in Proc. Comput. Vis. Pattern Recog., 2009, pp. 2929-2936.
29. D. G. Lowe, "Distinctive image features from scale-invariant keypoints", Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
30. R. Mattivi and L. Shao, "Human action recognition using LBP-TOP as sparse spatio-temporal feature descriptor", in Proc. Comput. Analysis Images Patterns, 2009, pp. 740-747.
31. H. Meng, N. Pears, and C. Bailey, "Motion feature combination for human action recognition in video", in Computer Vision and Computer Graphics. Theory and Applicatrion, J. Braz, A. Ranchordas, H. Araújo, and J. Pereira, Eds. Berlin, Heidelberg: Springer, 2009, pp. 151-163.
32. R. Messing, C. Pal, and H. Kauze, "Activity recognition using the velocity histories of tracked keypoints", in Proc. Int. Conf. Comput. Vis., 2009, pp. 104-111.
33. K. Mikolajczyk and H. Uemura, "Action recognition with motion-appearance vocabulary forest", in Proc. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
34. M. Nicolescu and G. Medioni, "A voting-based computational framework for visual motion analysis and interpretation", IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 739-752, May 2005. (Pubitemid 40608406)
35. J. C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words", Int. J. Comput. Vis., vol. 79, no. 3, pp. 299-318, 2008.
36. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatio-temporal salient points for visual recognition of human actions", IEEE Trans. Syst., Man, Cybern., B, vol. 36, no. 3, pp. 710-719, Jun. 2005.
37. Y. Pang, X. Li, Y. Yuan, D. Tao, and J. Pan, "Fast haar transform based feature extraction for face representation and recognition", IEEE Trans. Inf. Forensics Security, vol. 4, no. 3, pp. 441-450, Sep. 2009.
38. Y. Pang, Y. Yuan, and X. Li, "Gabor-based region covariance matrices for face recognition", IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 7, pp. 989-993, Jul. 2008.
39. Y. Pang, Y. Yuan, and X. Li, "Effective feature extraction in high-dimensional space", IEEE Trans. Syst., Man, Cybern, B, vol. 38, no. 6, pp. 1652-1656, Dec. 2008.
40. Y. Pang, Y. Yuan, X. Li, and J. Pan, "Efficient HOG human detection", Signal Process., vol. 91, no. 4, pp. 773-781, 2011.
41. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixturemodels", Digital Signal Process., vol. 10, pp. 19-41, 2000. (Pubitemid 30592166)
42. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local SVM approach", in Proc. Int. Conf. Pattern Recog., 2004, pp. 32-36.
43. J. Shen, D. Tao, and X. Li, "Modality mixture projections for semantic video event detection", IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1587-1596, Nov. 2008.
44. J. Sun, X. Wu, S. Yan, L. Cheong, T. Chua, and J. Li, "Hierarchical spatiotemporal context modeling for action recognition", in Proc. Comput. Vis. Pattern Recog., 2009, pp. 2004-2011.
45. Y. Tian, R. Feris, H. Liu, A. Hampapur, and M. Sun, "Robust detection of abandoned and removed objects in complex surveillance videos", IEEE Trans. Syst., Man, Cybern, C: Appl. Rev., 2010, to be published.
46. H. Wang, M. Ullah, A. Klaser, I. Laptev, and C. Schmid, "Evaluation of local spatio-temporal features for action recognition", in Proc. Brit. Machine Vis. Conf. (BMVC), 2009, pp. 127-138.
47. P. Wang, G. D. Abowd, and J. M. Rehg, "Quasi-periodic event analysis for social game retrieval", in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 112-119.
48. Y. Wang and G. Mori, "Hidden part models for human action recognition: Probabilistic versus max-margin", IEEE Trans. Pattern Anal. Mach. Intell., 2011, to be published.
49. D. Weinland, R. Ronfard, and E. Boyer, "Free viewpoint action recognition using motion history volumes", Comput. Vis. Image Understanding, vol. 104, no. 2, pp. 249-257, Nov. 2006. (Pubitemid 44573869)
50. S. Wong, T. Kim, and R. Cipolla, "Learning motion categories using both semantic and structural information", in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2007, pp. 1-6.
51. J. Wu, A. Osuntogun, T. Choudhury, M. Philipose, and J. Rehg, "A scalable approach to activity recognition based on object use", in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, 1-8.
52. S. Yan, X. Zhou, M. Liu, M. Hasegawa-Johnson, and T. Huang, "Regression from patch-kernel", in Proc. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
53. B. Yao and S. Zhu, "Learning deformable action templates from cluttered videos", in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 1507-1514.
54. J. Yin and Y. Meng, "Human activity recognition in video using a hierarchical probabilistic latent model", in Proc. Comput. Vis. Pattern Recog., 2010, pp. 15-20.
55. J. Yuan, Z. Liu, and Y. Wu, "Discriminative subvolume search for efficient action detection", in Proc. Comput. Vis. Pattern Recog., 2009, pp. 2442-2449.
56. Y. Yuan, Y. Pang, J. Pan, and X. Li, "Scene segmentation based on IPCA for visual surveillance", Neurocomputing, vol. 72, no. 10-12, pp. 2450-2454, 2009.
57. Y. Yuan and Y. Pang, "Discriminant adaptive edge weights for graph embedding", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar./Apr. 2008, pp. 1993-1996.
58. H. Zhou, Y. Yuan, Y. Zhang, and C. Shi, "Non-rigid object tracking in complex scenes", Pattern Recog. Lett., vol. 30, no. 2, pp. 98-102, 2009.
59. G. Zhu, M. Yang, K. Yu, W. Xu, and Y. Gong, "Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor", in Proc. ACM Int. Conf. Multimedia, 2009, pp. 165-174.
60. MSR Action Dataset II. (2010). [Online]. Available: http://research. microsoft.com/en-us/um/people/zliu/ActionRecoRsrc/YingLi