Recognizing human group action by layered model with multiple cues

Neurocomputing

Volumn 136, Issue , 2014, Pages 124-135

  Cheng, Zhongwei ^a   Qin, Lei ^b   Huang, Qingming ^a,b   Yan, Shuicheng ^c   Tian, Qi ^d  

^a UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^d One UTSA Circle   (United States)

Author keywords

Action style; Gaussian processes; Group shape; Human group action; Layered model; Motion trajectory

Indexed keywords

GAUSSIAN DISTRIBUTION;

ACTION STYLE; GAUSSIAN PROCESSES; GROUP ACTIONS; GROUP SHAPE; LAYERED MODEL; MOTION TRAJECTORIES;

GAUSSIAN NOISE (ELECTRONIC);

ARTICLE; ASSOCIATION; GROUP DYNAMICS; HUMAN; HUMAN ACTIVITIES; MEASUREMENT ACCURACY; MOVEMENT PERCEPTION; NORMAL DISTRIBUTION; PRIORITY JOURNAL; PROBABILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; VALIDITY; VISUAL DISCRIMINATION; VISUAL INFORMATION; VISUAL MEMORY;

EID: 84897929160     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.01.019     Document Type: Article

References (38)

1. Aggarwal J., Ryoo M. Human activity analysis. a review. ACM Comput. Surv. (CSUR) 2011, 43(3):16.
2. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: Proceedings of the 17th International Conference on Pattern Recognition (ICPR 2004), vol. 3, IEEE, 2004, pp. 32-36.
3. M.S. Ryoo, J.K. Aggarwal, UT-Interaction Dataset, ICPR contest on Semantic Description of Human Activities (SDHA), 2010. http://cvrc.ece.utexas.edu/SDHA2010/Human_Interaction.html.
4. B. Ni, S. Yan, A. Kassim, Recognizing human group activities with localized causalities, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2009), IEEE, 2009, pp. 1470-1477.
5. M. Rodriguez, J. Sivic, I. Laptev, J.-Y. Audibert, Data-driven crowd analysis in videos, in: 2011 IEEE International Conference on Computer Vision (ICCV), 2011, pp. 1235-1242, http://dx.doi.org/10.1109/ICCV.2011.6126374.
6. Niebles J., Wang H., Fei-Fei L. Unsupervised learning of human action categories using spatial-temporal words. Int. J. Comput. Vis. 2008, 79(3):299-318.
7. Ali S., Shah M. Human action recognition in videos using kinematic features and multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(2):288-303.
8. M. Ryoo, J. Aggarwal, Spatio-temporal relationship match: video structure comparison for recognition of complex human activities, in: 2009 IEEE 12th International Conference on Computer Vision, IEEE, 2009, pp. 1593-1600.
9. Solmaz B., Moore B., Shah M. Identifying behaviors in crowd scenes using stability analysis for dynamical systems. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 34(10):2064-2070.
10. M. Rodriguez, J. Sivic, I. Laptev, J. Audibert, Data-driven crowd analysis in videos, in: 2011 IEEE International Conference on Computer Vision (ICCV), IEEE, 2011, pp. 1235-1242.
11. V. Mahadevan, W. Li, V. Bhalodia, N. Vasconcelos, Anomaly detection in crowded scenes, in: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2010, pp. 1975-1981.
12. S.M. Khan, M. Shah, Detecting group activities using rigidity of formation, in: Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05), ACM, New York, NY, USA, 2005, pp. 403-406, http://dx.doi.org/10.1145/1101149.1101237.
13. W. Choi, K. Shahid, S. Savarese, What are they doing? Collective activity classification using spatio-temporal relationship among people, in: 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), IEEE, 2009, pp. 1282-1289.
14. T. Lan, Y. Wang, W. Yang, G. Mori, Beyond actions: discriminative models for contextual group activities, in: Advances in Neural Information Processing Systems (NIPS), 2010.
15. Zhu G., Yan S., Han T., Xu C. Generative group activity analysis with quaternion descriptor. Adv. Multimed. Model. 2011, 1-11.
16. W. Choi, K. Shahid, S. Savarese, Learning context for collective activity recognition, in: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2011, pp. 3273-3280.
17. H. Chu, W. Lin, J. Wu, X. Zhou, Y. Chen, H. Li, A new heat-map-based algorithm for human group activity recognition, in: Proceedings of the 20th ACM International Conference on Multimedia (MM '12), ACM, New York, NY, USA, 2012, pp. 1069-1072. http://dx.doi.org/10.1145/2393347.2396385.
18. W. Choi, S. Savarese, A unified framework for multi-target tracking and collective activity recognition, Computer Vision-ECCV 2012, Springer, Berlin, Heidelberg, 2012, pp. 215-230, .
19. Cristani M., Raghavendra R., Bue A.D., Murino V. Human behavior analysis in video surveillance. a social signal processing perspective. Neurocomputing 2013, 100(0):86-97.
20. Zniga M.D., Brmond F., Thonnat M. Hierarchical and incremental event learning approach based on concept formation models. Neurocomputing 2013, 100(0):3-18.
21. Dore A., Regazzoni C. Interaction analysis with a Bayesian trajectory model. IEEE Intell. Syst. 2010, 25(3):32-40. 10.1109/MIS.2010.37.
22. J. Sivic, A. Zisserman, Video google: a text retrieval approach to object matching in videos, in: Proceedings of the Ninth IEEE International Conference on Computer Vision, IEEE, 2003, pp. 1470-1477.
23. Wang J.M., Fleet D.J., Hertzmann A. Gaussian process dynamical models for human motion. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30(2):283-298.
24. Rasmussen C., Williams C. Gaussian Processes for Machine Learning 2006, vol. 1. MIT Press, Cambridge, MA.
25. Rasmussen C., Nickisch H. Gaussian processes for machine learning (gpml) toolbox. J. Mach. Learn. Res. 2010, 11:3011-3015.
26. C. Thurau, V. Hlavác, Pose primitive based human action recognition in videos or still images, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), IEEE, 2008, pp. 1-8.
27. V. Delaitre, I. Laptev, J. Sivic, Recognizing human actions in still images: a study of bag-of-features and part-based representations, in: Proceedings of the British Machine Vision Conference, 2010, pp. 97-1.
28. W. Yang, Y. Wang, G. Mori, Recognizing human actions from still images with latent poses, in: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2010, pp. 2030-2037.
29. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 1, IEEE, 2005, pp. 886-893.
30. Jolliffe I. Principal Component Analysis 2005, John Wiley & Sons, Ltd, .
31. Siagian C., Itti L. Rapid biologically-inspired scene classification using features shared with visual attention. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(2):300-312.
32. Delaunay B. Sur la sphere vide. Izv. Akad. Nauk SSSR, Otdelenie Matematicheskii i Estestvennyka Nauk 1934, 7(793-800):1-2.
33. Chang C.-C., Lin C.-J. LIBSVM. a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2:27:1-27:27. Software Available at URL: http://www.csie.ntu.edu.tw/cjlin/libsvm.
34. P. Gehler, S. Nowozin, On feature combination for multiclass object classification, in: 2009 IEEE 12th International Conference on Computer Vision, IEEE, 2009, pp. 221-228.
35. Wang S., Huang Q., Jiang S., Tian Q. S3mkl: scalable semi-supervised multiple kernel learning for real-world image applications. IEEE Trans. Multimed. 2012, 14(4):1259-1274.
36. S.V.N. Vishwanathan, Z. Sun, N. Theera-Ampornpunt, M. Varma, Multiple kernel learning and the SMO algorithm, in: Advances in Neural Information Processing Systems, 2010.
37. Blunsden, Scott, and R. B. Fisher. "The BEHAVE video dataset: ground truthed video for multi-person behavior classification." Annals of the BMVA 2010, no. 4 (2010): 1-12.
38. Laptev I. On space-time interest points. Int. J. Comput. Vis. 2005, 64(2):107-123.