A heat-map-based algorithm for recognizing group activities in videos

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 11, 2013, Pages 1980-1992

  Lin, Weiyao ^a   Chu, Hang ^a   Wu, Jianxin ^b   Sheng, Bin ^a   Chen, Zhenzhong ^c  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b NANJING UNIVERSITY   (China)

^c NEC Corporation of America   (United States)

Author keywords

Activity recognition; group activity; heat map; surface matching

Indexed keywords

ACTIVITY RECOGNITION; GROUP ACTIVITIES; GROUP ACTIVITY RECOGNITION; HEAT MAPS; HEAT SOURCES; MOTION INFORMATION; SURFACE MATCHING;

ALGORITHMS; PATTERN RECOGNITION;

IMAGE MATCHING;

EID: 84887597255     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2269780     Document Type: Article

References (31)

1. R. Fisher, G. Milne, S. Blunsden, and E. Andrade. (2007). BEHAVE Dataset [Online]. Available: http://homepages.inf.ed.ac.uk/rbf/BEHAVE
2. Y. Zhou, S. Yan, and T. Huang, "Pair-activity classification by bitrajectory analysis," in Proc. IEEE Conf. CVPR, 2008, pp. 1-8.
3. B. Ni, S. Yan, and A. Kassim, "Recognizing human group activity with localized causalities," in Proc. IEEE CVPR, 2009, pp. 1470-1477.
4. Z. Cheng, L. Qin, Q. Huang, S. Jiang, and Q. Tian, "Group activity recognition by Gaussian process estimation," in Proc. Int. Conf. Pattern Recognition (ICPR), 2010, pp. 3228-3231.
5. Y. Chen, W. Lin, H. Li, H. Luo, Y. Tao, and D. Liu, "A new packagegroup-transmission-based algorithm for human activity recognition in videos," in Proc. IEEE VCIP, 2011, pp. 1-4.
6. W. Lin, M.-T. Sun, R. Poovendran, and Z. Zhang, "Group event detection with a varying number of group members for video surveillance," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 8, pp. 1057-1067, Aug. 2010.
7. C. Goodall. "Procrustes methods in the statistical analysis of shape," J. R. Stat. Soc., vol. 53, no. 3, pp. 285-339, 1991.
8. Y. Fang, M. Sun, M. Kim, and K. Ramani, "Heat-mapping: A robust approach toward perceptually consistent mesh segmentation," in Proc. IEEE Conf. CVPR, 2011, pp. 2145-2152.
9. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-574, May 2003.
10. H. Carslaw and J. Jaeger, Conduction of Heat in Solids. Oxford, U.K.: Oxford Univ. Press, 1986.
11. A. Girgensohn, F. Shipman, and L. Wilcox, "Determining activity patterns in retail spaces through video analysis," in Proc. ACM Multimedia, 2008, pp. 889-892.
12. W. A. Hoff and J. W. Howard, "Activity recognition in a dense sensor network," in Proc. Int. Conf. SNA, 2009, pp. 67-72.
13. T. F. Cootes and C. J. Taylor, "Statistical models of appearance for computer vision," Image Sci. Biomed. Eng., Univ. Manchester, Manchester, U.K, Tech. Rep., 2004.
14. T. Hastie, R. Tibshirani, and J. H. Friedman, The Elements of Statistical Learning. New York, NY, USA: Springer, 2003.
15. W. Lin, M.-T. Sun, R. Poovendran, and Z. Zhang, "Activity recognition using a combination of category components and local models for video surveillance," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 8, pp. 1128-1139, Aug. 2008.
16. C. Chang and C. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, pp. 1-27, 2011.
17. C. Wang, J. Zhang, J. Pu, X. Yuan, and L. Wang, "Chrono-gait image: A novel temporal template for gait recognition," in Proc. ECCV, 2010, pp. 257-270.
18. L. Bao and S. Intille, "Activity recognition from user-annotated acceleration data," in Proc. Int. Conf. Pervasive Computing PERVASIVE, vol. 3001. 2004, pp. 1-17.
19. C. Rao, M. Shah, and T. Syeda-Mahmood, "Action recognition based on view invariant spatio-temporal analysis," in Proc. ACM Multimedia, 2003, pp. 518-527.
20. R. Mehran, A. Oyama, and M. Shah, "Abnormal crowd behavior detection using social force model," in Proc. IEEE Conf. CVPR, 2009, pp. 935-942.
21. J. Zhao, Y. Xu, X. Yang, and Q. Yan, "Crowd instability analysis using velocity-field based social force model," in Proc. VCIP, 2011, pp. 1-4.
22. N. Papanikolopoulos. (2009). Unusual Crowd Activity Dataset [Online]. Available: http://mha.cs.umn.edu/Movies/Crowd-Activity-All.avi
23. X. Cui, Q. Liu, M. Gao, and D. N. Metaxas, "Abnormal detection using interaction energy potentials," in Proc. IEEE Conf. CVPR, 2011, pp. 3161-3167.
24. B. Zhan, D. N. Monekosso, P. Remagnino, S. A. Velastin, and L. Xu, "Crowd analysis: A survey," Mach. Vision Appl., vol. 19, pp. 345-357, 2008.
25. J. C. S. Jacques Junior, S. R. Musse, and C. R. Jung, "Crowd analysis using computer vision techniques," Signal Process. Mag., vol. 27, pp. 66-77, 2010.
26. X. Su, W. Lin, X. Zhen, X. Han, H. Chu, and X. Zhang, "A new localmain-gradient-orientation HOG and contour differences based algorithm for object classification," in Proc. IEEE ISCAS, 2013, pp. 21-24.
27. H. Chu, W. Lin, J. Wu, X. Zhou, Y. Chen, and H. Li, "A new heat-mapbased algorithm for human group activity recognition," in Proc. ACM Multimedia, 2012, pp. 1069-1072.
28. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Imaging Understanding Workshop, 1981, pp. 121-130.
29. S. Chiappino, P. Morerio, L. Marcenaro, E. Fuiano, G. Repetto, and C. S. Regazzoni, "A multi-sensor cognitive approach for active security monitoring of abnormal overcrowding situations," in Proc. Int. Conf. Information Fusion (FUSION), 2012, pp. 2215-2222.
30. G. Wu, Y. Xu, X. Yang, Q. Yan, and K. Gu, "Robust object tracking with bidirectional corner matching and trajectory smoothness algorithm," in Proc. Int. Workshop Multimedia Signal Processing, 2012, pp. 294-298.
31. R. Hess and A. Fern, "Discriminatively trained particle filters for complex multi-object tracking," in Proc. IEEE Conf. CVPR, 2009, pp. 240-247.