Learning Person-Person Interaction in Collective Activity Recognition

IEEE Transactions on Image Processing

Volumn 24, Issue 6, 2015, Pages 1905-1918

  Chang, Xiaobin ^a,b   Zheng, Wei Shi ^a,c   Zhang, Jianguo ^d  

^a SUN YAT SEN UNIVERSITY   (China)

^b SYSU CMU Shunde International Joint Research Institute   (China)

^c Guangdong Province Key Laboratory of Computational Science   (China)

^d UNIVERSITY OF DUNDEE   (United Kingdom)

Author keywords

action analysis; collective activity recognition; interaction modeling

Indexed keywords

ATOMS;

ACTION ANALYSIS; ACTIVITY INSTANCES; COLLECTIVE ACTIVITY RECOGNITION; INTERACTION MATRICES; INTERACTION MODEL; INTERACTION PATTERN; LEARNING-BASED APPROACH; LOW-RANK REPRESENTATIONS;

PATTERN RECOGNITION;

ACTIMETRY; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; HUMAN; HUMAN RELATION; PHOTOGRAPHY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SOCIAL BEHAVIOR;

ACTIGRAPHY; ALGORITHMS; ARTIFICIAL INTELLIGENCE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INTERPERSONAL RELATIONS; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SOCIAL BEHAVIOR;

EID: 84927158524     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2409564     Document Type: Article

References (43)

1. Collective Activity Dataset. [Online]. Available: http://www.eecs.umich.edu/vision/activity-dataset.html, accessed Sep. 2013.
2. Dataset: A Unified Framework for Multi-Target Tracking and Collective Activity Recognition. [Online]. Available: http://wwwpersonal.umich.edu/~wgchoi/eccv12/wongun-eccv12.html, accessed Feb. 2014.
3. M. R. Amer and S. Todorovic, "A chains model for localizing participants of group activities in videos," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 786-793.
4. M. R. Amer, S. Todorovic, A. Fern, and S.-C. Zhu, "Monte Carlo tree search for scheduling activity recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1353-1360.
5. M. R. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu, "Cost-sensitive top-down/bottom-up inference for multiscale activity recognition," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 187-200.
6. B. Antic and B. Ommer, "Learning latent constituents for recognition of group activities in video," in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 33-47.
7. S.-H. Bae and K.-J. Yoon, "Robust online multiobject tracking with data association and track management," IEEE Trans. Image Process., vol. 23, no. 7, pp. 2820-2833, Jul. 2014.
8. M. B. Blaschko, J. A. Shelton, A. Bartels, C. H. Lampert, and A. Gretton, "Semi-supervised kernel canonical correlation analysis with application to human fMRI," Pattern Recognit. Lett., vol. 32, no. 11, pp. 1572-1583, 2011.
9. Z. Cheng, L. Qin, Q. Huang, S. Yan, and Q. Tian, "Recognizing human group action by layered model with multiple cues," Neurocomputing, vol. 136, pp. 124-135, Jul. 2014.
10. W. Choi and S. Savarese, "A unified framework for multi-target tracking and collective activity recognition," in Proc. 12th Eur. Conf. Comput. Vis., vol. 4. 2012, pp. 215-230.
11. W. Choi and S. Savarese, "Understanding collective activities of people from videos," IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 6, pp. 1242-1257, Jun. 2014.
12. W. Choi, K. Shahid, and S. Savarese, "What are they doing?: Collective activity classification using spatio-temporal relationship among people," in Proc. IEEE 12th Int. Conf. Comput. Vis. Workshops, Sep./Oct. 2009, pp. 1282-1289.
13. W. Choi, K. Shahid, and S. Savarese, "Learning context for collective activity recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 3273-3280.
14. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. 2nd Joint IEEE Int. Workshop Vis. Surveill. Perform. Eval. Tracking Surveill., Oct. 2005, pp. 65-72.
15. T. Evgeniou and M. Pontil, "Regularized multi-task learning," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 109-117.
16. P. Felzenszwalb, D. McAllester, and D. Ramanan, "A discriminatively trained, multiscale, deformable part model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
17. K. Fukunaga, Introduction to Statistical Pattern Recognition. San Diego, CA, USA: Academic Press Professional, Inc., 1990, p. 592.
18. K. N. Tran, A. Gala, I. A. Kakadiaris, and S. K. Shah, "Activity analysis in crowded environments using social cues for group discovery and human interaction modeling," Pattern Recognit. Lett., vol. 44, pp. 49-57, Jul. 2014.
19. W. Ge, R. T. Collins, and R. B. Ruback, "Vision-based analysis of small groups in pedestrian crowds," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 5, pp. 1003-1016, May 2012.
20. A. Heili, A. López-Méndez, and J. M. Odobez, "Exploiting long-term connectivity and visual motion in CRF-based multi-person tracking," IEEE Trans. Image Process., vol. 23, no. 7, pp. 3040-3056, Jul. 2014.
21. J.-F. Hu, W.-S. Zheng, J. Lai, S. Gong, and T. Xiang, "Exemplar-based recognition of human-object interactions," IEEE Trans. Circuits Syst. Video Technol., to be published.
22. Y. Kong, Y. Jia, and Y. Fu, "Interactive phrases: Semantic descriptions for human interaction recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 9, pp. 1775-1788, Sep. 2014.
23. T. Lan, Y. Wang, W. Yang, and G. Mori, "Beyond actions: Discriminative models for contextual group activities," in Advances in Neural Information Processing Systems. Red Hook, NY, USA: Curran & Associates Inc., 2010, pp. 1216-1224.
24. T. Lan, Y. Wang, W. Yang, S. N. Robinovitch, and G. Mori, "Discriminative latent models for recognizing contextual group activities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 8, pp. 1549-1562, Aug. 2012.
25. J. Leskovec, D. Chakrabarti, J. Kleinberg, C. Faloutsos, and Z. Ghahramani, "Kronecker graphs: An approach to modeling networks," J. Mach. Learn. Res., vol. 11, pp. 985-1042, Mar. 2010.
26. R. Li, R. Chellappa, and S. K. Zhou, "Recognizing interactive group activities using temporal interaction matrices and their Riemannian statistics," Int. J. Comput. Vis., vol. 101, no. 2, pp. 305-328, 2013.
27. W. Lin, H. Chu, J. Wu, B. Sheng, and Z. Chen, "A heat-map-based algorithm for recognizing group activities in videos," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 11, pp. 1980-1992, Nov. 2013.
28. L. Liu, L. Shao, F. Zheng, and X. Li, "Realistic action recognition via sparsely-constructed Gaussian processes," Pattern Recognit., vol. 47, no. 12, pp. 3819-3827, Dec. 2014.
29. Y. Ma and P. Cisar, "Event detection using local binary pattern based dynamic textures," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2009, pp. 38-44.
30. M. Rodriguez, J. Sivic, I. Laptev, and J.-Y. Audibert, "Data-driven crowd analysis in videos," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1235-1242.
31. L. Shao, S. Jones, and X. Li, "Efficient search and localization of human actions in video databases," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 3, pp. 504-512, Mar. 2014.
32. L. Shao, X. Zhen, D. Tao, and X. Li, "Spatio-temporal Laplacian pyramid coding for action recognition," IEEE Trans. Cybern., vol. 44, no. 6, pp. 817-827, Jun. 2014.
33. S. Todorovic, "Human activities as stochastic Kronecker graphs," in Proc. 12th Eur. Conf. Comput. Vis., vol. 2. 2012, pp. 130-143.
34. A. Vedaldi and B. Fulkerson. (2008). VLFeat: An Open and Portable Library of Computer Vision Algorithms. [Online]. Available: http://www.vlfeat.org/
35. J. Wan, V. Athitsos, P. Jangyodsuk, H. J. Escalante, Q. Ruan, and I. Guyon, "CSMMI: Class-specific maximization of mutual information for action and gesture recognition," IEEE Trans. Image Process., vol. 23, no. 7, pp. 3152-3165, Jul. 2014.
36. H. Wang, A. Kläser, C. Schmid, and C.-L. Liu, "Action recognition by dense trajectories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 3169-3176.
37. H. Wang, C. Yuan, W. Hu, H. Ling, W. Yang, and C. Sun, "Action recognition using nonnegative action component representation and sparse basis selection," IEEE Trans. Image Process., vol. 23, no. 2, pp. 570-581, Feb. 2014.
38. Z. Wang, Q. Shi, C. Shen, and A. van den Hengel, "Bilinear programming for human activity recognition with unknown MRF graphs," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 1690-1697.
39. J.-S. Wu, W.-S. Zheng, and J.-H. Lai, "Approximate kernel competitive learning," Neural Netw., vol. 63, pp. 117-132, Mar. 2015.
40. C.-N. J. Yu and T. Joachims, "Learning structural SVMs with latent variables," in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 1169-1176.
41. J. Zhang and S. Gong, "Action categorization by structural probabilistic latent semantic analysis," Comput. Vis. Image Understand., vol. 114, no. 8, pp. 857-864, 2010.
42. J. Zhang and S. Gong, "Action categorization with modified hidden conditional random field," Pattern Recognit., vol. 43, no. 1, pp. 197-203, 2010.
43. X. Zhen, L. Shao, and X. Li, "Action recognition by spatio-temporal oriented energies," Inf. Sci., vol. 281, pp. 295-309, Oct. 2014.