Recognizing interactive group activities using temporal interaction matrices and their riemannian statistics

International Journal of Computer Vision

Volumn 101, Issue 2, 2013, Pages 305-328

  Li, Ruonan ^a   Chellappa, Rama ^b   Zhou, Shaohua Kevin ^c  

^a HARVARD UNIVERSITY   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c SIEMENS CORPORATE RESEARCH   (United States)

Author keywords

Activity recognition; Event analysis

Indexed keywords

ACTIVITY ANALYSIS; ACTIVITY RECOGNITION; BIOLOGICAL MONITORING; DESCRIPTORS; DOMAIN KNOWLEDGE; EVENT ANALYSIS; GROUP ACTIVITIES; HUMAN ACTIONS; INTERACTION MATRICES; INTERACTIVE GROUPS; MAXIMUM A POSTERIORI; MOTION PATTERN; MULTI-MODAL; POINT TRAJECTORY; PROBABILITY DENSITIES; SPATIAL TEMPORALS; STATISTICAL PROPERTIES;

BAYESIAN NETWORKS; COORDINATION REACTIONS; IMAGE RECOGNITION; MOTION ESTIMATION; TIME AND MOTION STUDY;

PATIENT MONITORING;

EID: 84873158443     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-012-0573-0     Document Type: Article

References (50)

1. Aggarwal, J. K., & Ryoo, M. S. (2011). Human activity analysis: a review. ACM Computing Surveys, 43(3).
2. Amari, S., & Nagaoka, H. (2000). Methods of information geometry. London: Oxford University Press.
3. Amer, M., & Todorovic, S. (2011). A chains model for localizing group activities in videos. In IEEE international conference on computer vision, Barcelona, Spain.
4. Choi, W., Shahid, K., & Savarese, S. (2009). What are they doing?: Collective activity classification using spatio-temporal relationship among people. In 9th international workshop on visual surveillance, Kyoto, Japan.
5. Choi, W., Shahid, K., & Savarese, S. (2011). Learning context for collective activity recognition. In IEEE conference on computer vision and pattern recognition, Colorado Springs, CO.
6. Cutler, R., & Davis, L. (2000). Robust real-time periodic motion detection, analysis, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 781-796.
7. Dollar, P., Rabaud, V., Cottrell, G., & Belongie, S. (2005). Behavior recognition via sparse spatio-temporal features. In Joint IEEE international workshop on visual surveillance and performance evaluation of tracking and surveillance, Beijing, China.
8. Dryden, I. L., & Mardia, K. V. (1998). Statistical shape analysis. New York: Wiley.
9. Felzenszwalb, P., Girshick, R., McAllester, D., & Ramanan, D. (2010). Object detection with discriminatively trained part based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9), 1627-1645.
10. Gong, S., & Xiang, T. (2003). Recognition of group activities using dynamic probabilistic networks. In IEEE international conference on computer vision, Nice, France.
11. Grant, M., & Boyd, S. (2011). CVX: Matlab software for disciplined convex programming, version 1.21. http://cvxr.com/cvx.
12. Hakeem, A., & Shah, M. (2007). Learning, detection and representation of multi-agent events in videos. Artificial Intelligence, 171, 586-605.
13. Hongeng, S., & Nevatia, R. (2001). Multi-agent event recognition. In IEEE international conference on computer vision, Vancouver, BC.
14. Hoogs, A., Bush, S., Brooksby, G., Perera, A., Dausch, M., & Krahnstoever, N. (2008). Detecting semantic group activities using relational clustering. In IEEE workshop on motion and video computing, Copper Mountain, CO.
15. Huang, C., Shih, H., & Chao, C. (2006). Semantic analysis of soccer video using dynamic bayesian network. IEEE Transactions on Multimedia, 8(4), 749-760.
16. Intille, S., & Bobick, A. (2001). Recognizing planned, multiperson action. Computer Vision and Image Understanding, 81, 414-445.
17. Ivanov, Y., & Bobick, A. (2000). Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 852-872.
18. Joo, S., & Chellappa, R. (2007). A multiple-hypothesis approach for multiobject visual tracking. IEEE Transactions on Image Processing, 16(11), 2849-2854.
19. Junejo, I. N., Dexter, E., Laptev, I., & Perez, P. (2011). View independent action recognition from temporal self-similarities. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 172-185.
20. Kass, R., & Vos, P. (1997). Geometric foundations of asymptotic inference. New York: Wiley.
21. Khan, S. M., & Shah, M. (2005). Detecting group activities using rigidity of formation. In ACM multimedia, Singapore.
22. Kim, K., Lee, D., & Essa, I. (2012). Detecting regions of interest in dynamic scenes with camera motions. In IEEE conference on computer vision and pattern recognition, Providence, RI.
23. Kim, M., & Pavlovic, V. (2006). Discriminative learning of mixture of bayesian network classifiers for sequence classification. In IEEE conference on computer vision and pattern recognition, New York, NY.
24. Klaser, A., Marszalek, M., & Schmid, C. (2008). A spatio-temporal descriptor based on 3d gradients. In British machine vision conference, Leeds, UK.
25. Kuhn, H. W. (1955). The Hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2, 83-97.
26. Lan, T., Wang, Y., Yang, W., & Mori, G. (2010). Beyond actions: discriminative models for contextual group activities. In Neural information processing systems, Vancouver, BC.
27. Laptev, I. (2005). On space-time interest points. International Journal of Computer Vision, 64, 107-123.
28. Lazarescu, M., & Venkatesh, S. (2003). Using camera motion to identify different types of American football plays. In IEEE international conference on multimedia and expo, Baltimore, MD (pp. 181-184).
29. Li, R., Chellappa, R., & Zhou, S. (2009). Learning multi-modal densities on discriminative temporal interaction manifold for group activity recognition. In IEEE conference on computer vision and pattern recognition, Miami, FL.
30. libSVM: http://www.csie.ntu.edu.tw/~cjlin/libsvm/ (2012).
31. Liu, T., Ma, W., & Zhang, H. (2005). Effective feature extraction for play detection in American football video. In Multimedia modeling, Melbourne, Australia.
32. Liu, X., & Chua, C. (2006). Multi-agent activity recognition using observation decomposed hidden Markov models. Image and Vision Computing, 24(2), 166-175.
33. Ma, X., Bashir, F., Khokhar, A., & Schonfeld, D. (2009). Event analysis based on multiple interactive motion trajectories. IEEE Transactions on Circuits and Systems for Video Technology, 19, 397-406.
34. Moeslund, T. B., Hilton, A., & Kruger, V. (2006). A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104, 90-126.
35. Morariu, V., & Davis, L. (2011). Multi-agent event recognition in structured scenarios. In IEEE conference on computer vision and pattern recognition, Colorado Springs, CO.
36. Ni, B., Yan, S., & Kassim, A. (2009). Recognizing human group activities by localized causalities. In IEEE conference on computer vision and pattern recognition, Miami, FL.
37. Pennec, X. (2006). Intrinsic statistics on riemannian manifolds: basic tools for geometric measurements. Journal of Mathematical Imaging and Vision, 25(1), 127-154.
38. Perse, M., Kristan, M., Kovacic, S., Vuckovic, G., & Pers, J. (2009). A trajectory-based analysis of coordinated team activity in a basketball game. Computer Vision and Image Understanding, 113(5), 612-621.
39. Poppe, R. (2010). A survey on vision-based human action recognition. Image and Vision Computing, 28(6), 976-990.
40. Rosset, S., & Segal, E. (2002). Boosting density estimation. In Neural information processing systems, Vancouver, BC.
41. Ryoo, M. S., & Aggarwal, J. K. (2009). Spatio-temporal relationship match: video structure comparison for recognition of complex human activities. In IEEE international conference on computer vision, Japan, Kyoto.
42. Ryoo, M. S., & Aggarwal, J. K. (2011). Stochastic representation and recognition of high-level group activities. International Journal of Computer Vision, 93, 183-200.
43. Scovanner, P., Ali, S., & Shah, M. (2007). A 3-dimensional sift descriptor and its application to action recognition. In ACM multimedia, Augsburg, Germany.
44. Srivastava, A., Jermyn, I., & Joshi, S. (2007). Riemannian analysis of probability density functions with applications in vision. In IEEE conference on computer vision and pattern recognition, Minneapolis, MN.
45. Swears, E., & Hoogs, A. (2009). Learning and recognizing American football plays. In Snowbird learning workshop, Snowbird, UT.
46. Vaswani, N., Roy-Chowdhury, A., & Chellappa, R. (2005). Shape activity: a continuous-state HMM for moving/deforming shapes with application to abnormal activity detection. IEEE Transactions on Image Processing, 14, 1603-1616.
47. Veeraraghavan, A., Chellappa, R., & Srinivasan, M. (2008). Shape and behavior encoded tracking of bee dances. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(3), 463-476.
48. Yilmaz, A., Javed, O., & Shah, M. (2006). Object tracking: a survey. ACM Computing Surveys, 38(4), 1-45.
49. Zhang, D., Gatica-Perez, D., Bengio, S., & McCowan, I. (2006). Modeling individual and group actions in meetings with layered HMMs. IEEE Transactions on Multimedia, 8, 509-520.
50. Zhou, Y., Yan, S., & Huang, T. S. (2008). Pair-activity classification by bi-trajectories analysis. In IEEE conference on computer vision and pattern recognition, Anchorage, AK.