Detecting group activities with multi-camera context

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 5, 2013, Pages 856-869

  Zha, Zheng Jun ^a   Zhang, Hanwang ^a   Wang, Meng ^b   Luan, Huanbo ^a   Chua, Tat Seng ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b University of Technology   (China)

Author keywords

Activity detection; context; group activity; human activity

Indexed keywords

ACTIVITY DETECTION; CONTEXT; GROUP ACTIVITIES; HUMAN ACTIVITIES; HUMAN-ACTIVITY DETECTION; MULTI-CAMERA SURVEILLANCE; SMART SURVEILLANCE; SPATIO TEMPORAL FEATURES;

CAMERAS; GRAPHIC METHODS; MONITORING; PATTERN RECOGNITION; TOPOLOGY; VIDEO CAMERAS;

SECURITY SYSTEMS;

EID: 84877290219     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2012.2226526     Document Type: Article

References (48)

1. P. Turaga, R. Chellappa, V. Subrahmanian, and O. Udrea, "Machine recognition of human activities: A survey," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1473-1488, Nov. 2008.
2. R. Poppe, "A survey on vision-based human action recognition," Image Vision Comput., vol. 28, no. 6, pp. 976-990, 2010.
3. J. K. Aggarwal and M. S. Ryoo, "Human activity analysis: A review," ACM Comput. Survey, vol. 43, no. 3, pp. 16:1-16:43, 2011.
4. Y. Ke, R. Sukthankar, and M. Hebert, "Event detection in crowded videos," in Proc. IEEE Int. Conf. Comput. Vision, Jun. 2007, pp. 1-8.
5. S. Ali and M. Shah, "Human action recognition in videos using kinematic features and multiple instance learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 2, pp. 288-303, Feb. 2010.
6. G. Zhu, M. Yang, K. Yu, W. Xu, and Y. Gong, "Detecting video events based on action recognition in complex scenes using spatiotemporal descriptor," in Proc. ACM Int. Conf. Multimedia, 2009, pp. 165-174.
7. M. Chen and A. Hauptmann, "Mosift: Recognizing human actions in surveillance videos," Tech. Rep. CMU-CS-09-161, Carnegie Mellon University, Pittsburgh, PA, 2009.
8. TRECVid 2010 Evaluation for Surveillance Event Detection [Online]. Available: http://www.itl.nist.gov/
9. C. C. Loy, T. Xiang, and S. Gong, "Multi-camera activity correlation analysis," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 1988-1995.
10. X. Wang, K. Tieu, and E. Grimson, "Correspondence-free activity analysis and scene modeling in multiple camera views," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 56-71, Jan. 2010.
11. E. Zelniker, S. Gong, and T. Xiang, "Global abnormal behaviour detection using a network of CCTV cameras," in Proc. IEEE Int. Workshop Visual Surveillance, Oct. 2008, pp. 1473-1488.
12. C. Loy, T. Xiang, and S. Gong, "Modelling activity global temporal dependencies using time delayed probabilistic graphical model," in Proc. IEEE Int. Conf. Comput. Vision, Sep. 2009, pp. 120-127.
13. G. Denina, B. Bhanu, H. Nguyen, C. Ding, A. Kamal, C. Ravishankar, A. Roy-Chowdhury, A. Ivers, and B. Varda, "Videoweb dataset for multicamera activities and non-verbal communication," Distributed Video Sensor Networks, 2011, pp. 325-347 2000.
14. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu, "Action recognition by dense trajectories," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 3169-3176.
15. Y. Hu, L. Cao, F. Lv, S. Yan, Y. Gong, and T. Huang, "Action detection in complex scenes with spatial and temporal ambiguities," in Proc. Int. Conf. Comput. Vision, 2009, pp. 128-135.
16. M. Takahashi, M. Fujii, M. Shibata, and S. Satoh, "Robust recognition of specific human behaviors in crowded surveillance video sequences," EURASIP J. Advances Signal Process., vol. 2010, p. 13, Feb. 2010.
17. H. Wang, M. Ullah, A. Klaser, I. Laptev, and C. Schmid, "Evaluation of local spatiotemporal features for action recognition," in Proc. Brit. Mach. Vision Conf., 2009, pp. 1-9.
18. D. Weinland, R. Ronfard, and E. Boyer, "Free viewpoint action recognition using motion history volumes," Comput. Vision Image Understanding, vol. 104, nos. 2-3, pp. 249-257, 2006. (Pubitemid 44573869)
19. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatiotemporal features," in Proc. IEEE Workshop Visual Surveillance Performance Evaluation Tracking Surveillance, Jan. 2005, pp. 65-72. (Pubitemid 46178025)
20. P. Scovanner, S. Ali, and M. Shah, "A 3-dimensional SIFT descriptor and its application to action recognition," in Proc. ACM Int. Conf. Multimedia, 2007, pp. 357-360.
21. O. Chomat and J. Crowley, "Probabilistic recognition of activity using local appearance," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 1999, pp. 36-41.
22. L. Zelnik-Manor and M. Irani, "Event-based analysis of video," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2001, pp. 123-130.
23. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2005, pp. 2247-2253.
24. I. Laptev and T. Lindeberg, "Space-time interest points," in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2003, pp. 432-439.
25. A. Yilmaz and M. Shah, "Actions sketch: A novel action representation," in Proc. IEEE Int. Conf. Comput. Vision, Jun. 2005, pp. 432-439.
26. M. S. Ryoo and J. K. Aggarwal, "Spatiotemporal relationship match: Video structure comparison for recognition of complex human activities," in Proc. Int. Conf. Comput. Vision, 2009, pp. 984-989.
27. L. Ballan, M. Bertini, A. D. Bimbo, L. Seidenari, and G. Serra, "Recognizing human actions by fusing spatiotemporal appearance and motion descriptors," in Proc. Int. Conf. Image Process., 2009, pp. 3533- 3536.
28. M. Marszalek, I. Laptev, and C. Schmid, "Actions in context," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 2929-2936.
29. B. Ni, S. Yan, and A. Kassim, "Recognizing human group activities with localized causalities," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 1470-1477.
30. T. Lan, Y.Wang,W. Yang, and G. Mori, "Beyond actions: Discriminative models for contextual group activities," in Proc. Advances Neural Inform. Process. Syst., 2010, pp. 1216-1224.
31. W. Choi, K. Shahid, and S. Savarese, "What are they doing? Collective activity classification using spatiotemporal relationship among people," in Proc. Int. Conf. Comput. Vision Workshops, 2009, pp. 1282-1289.
32. J. Niebles, C. Chen, and L. Fei-Fei, "Modeling temporal structure of decomposable motion segments for activity classification," in Proc. Eur. Conf. Comput. Vision, 2010, pp. 392-405.
33. G. Zhu, S. Yan, T. Han, and C. Xu, "Generative group activity analysis with quaternion descriptor," in Proc. Int. Conf. Multimedia Modeling, 2011, pp. 1-11.
34. T. Xiang and S. Gong, "Activity based surveillance video content modelling," Pattern Recognit., vol. 41, no. 7, pp. 2309-2326, 2008.
35. M. S. Ryoo and J. K. Aggarwal, "Stochastic representation and recognition of high-level group activities," Int. J. Comput. Vision, vol. 93, no. 2, pp. 183-200, 2011.
36. K. Tieu, G. Dalley, and W. Grimson, "Inference of non-overlapping camera network topology by measuring statistical dependence," in Proc. Int. Conf. Comput. Vision, 2005, pp. 1842-1849. (Pubitemid 44042400)
37. D. Makris, T. Ellis, and J. Black, "Bridging the gaps between cameras," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2004, pp. 205-210.
38. M. Chang, N. Krahnstoever, S. Lim, and T. Yu, "Group level activity recognition in crowded environments across multiple cameras," in Proc. Int. Conf. Advanced Video Signal Based Surveillance, 2010, pp. 56-63.
39. Z. Zivkovic and F. van der Heijden, "Efficient adaptive density estimation per image pixel for the task of background subtraction," Pattern Recognit. Lett., vol. 27, no. 7, pp. 773-780, 2006. (Pubitemid 43374860)
40. S. Salve and K. Jondhale, "Shape matching and object recognition using shape contexts," in Proc. IEEE Int. Conf. Comput. Sci. Inform. Technol., 2010, pp. 471-474.
41. J. Yamato, J. Ohya, and K. Ishii, "Recognizing human action in timesequential images using hidden markov model," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 1992, pp. 379-385.
42. A. Quattoni, S. Wang, L.-P. Morency, M. Collins, and T. Darrell, "Hidden conditional random fileds," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1848-1852, Oct. 2007.
43. C. Yu and T. Joachims, "Learning structural SVMS with latent variables," in Proc. Int. Conf. Mach. Learning, Jun. 2009, pp. 1169-1176.
44. T. Do and T. Artieres, "Large margin training for hidden Markov models with partially observed states," in Proc. Int. Conf. Mach. Learning, 2009, pp. 265-272.
45. O. Duchenne, I. Laptev, J. Sivic, F. Bach, and J. Ponce, "Automatic annotation of human actions in video," in Proc. Int. Conf. Comput. Vision, 2009, pp. 1491-1498.
46. M. Merler, B. Huang, L. Xie, G. Hua, and A. Natsev, "Semantic model vectors for complex video event recognition," IEEE Trans. Multimedia, vol. 14, no. 1, pp. 88-101, 2012.
47. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
48. C.-C. Chang and C.-J. Lin. (2001). Libsvm: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/ cjlin/libsvm