Two-person interaction recognition via spatial multiple instance embedding

Journal of Visual Communication and Image Representation

Volumn 32, Issue , 2015, Pages 63-73

  Sener, Fadime ^a   Ikizler Cinbis, Nazli ^b  

^a BILKENT UNIVERSITY   (Turkey)

^b HACETTEPE UNIVERSITY   (Turkey)

Author keywords

Activity recognition; Human actions; Human interaction recognition; Human interactions; Multiple instance learning; Spatial embedding; Video analysis; Video retrieval

Indexed keywords

IMAGE RECOGNITION; MOTION ESTIMATION;

ACTIVITY RECOGNITION; HUMAN ACTIONS; HUMAN INTERACTION RECOGNITION; HUMAN INTERACTIONS; MULTIPLE INSTANCE LEARNING; SPATIAL EMBEDDING; VIDEO ANALYSIS; VIDEO RETRIEVAL;

LEARNING SYSTEMS;

EID: 84939198832     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2015.07.016     Document Type: Article

References (57)

1. J. Aggarwal, and M. Ryoo Human activity analysis: a review ACM Comput. Surv. 43 3 2011 16:1 16:43
2. S. Ali, and M. Shah Human action recognition in videos using kinematic features and multiple instance learning IEEE Trans. Pattern Anal. Mach. Intell. 32 2 2010 288 303
3. J. Amores Multiple instance classification: review, taxonomy and comparative study Artif. Intell. 201 2013 81 105
4. S. Andrews, I. Tsochantaridis, and T. Hofmann Support vector machines for multiple-instance learning S. Becker, S. Thrun, K. Obermayer, Advances in Neural Information Processing Systems vol. 15 2003 MIT Press 577 584
5. B. Babenko, M.H. Yang, and S. Belongie Visual tracking with online multiple instance learning IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 2011
6. C.C. Chang, and C.J. Lin LIBSVM: a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 2011 27:1 27:27 Software available at < http://www.csie.ntu.edu.tw/cjlin/libsvm >
7. Y. Chen, J. Bi, and J.Z. Wang Miles: multiple-instance learning via embedded instance selection IEEE TPAMI 28 12 2006 1931 1947
8. W. Choi, S. Savarese, A unified framework for multi-target tracking and collective activity recognition, in: ECCV, 2012, pp. 215-230.
9. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: CVPR, 2005, pp. I: 886-893.
10. A. Datta, M. Shah, N. da Vitoria Lobo, Person-on-person violence detection in video data, in: ICPR, 2002, pp. I: 433-438.
11. V. Delaitre, I. Laptev, J. Sivic, Recognizing human actions in still images: a study of bag-of-features and part-based representations, in: BMVC, 2010.
12. G. Doran, and S. Ray A theoretical and empirical analysis of support vector machine methods for multiple-instance classification Mach. Learn. 97 1-2 2014 79 102
13. A. Fathi, J.K. Hodgins, and J.M. Rehg Social interactions: a first-person perspective CVPR 2012 IEEE 1226 1233
14. P.F. Felzenszwalb, R.B. Girshick, D.A. McAllester, and D. Ramanan Object detection with discriminatively trained part-based models IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1627 1645
15. A. Gaidon, Z. Harchaoui, C. Schmid, Recognizing activities with cluster-trees of tracklets, in: BMVC 2012 - British Machine Vision Conference, 2012, pp. 30.1-30.13.
16. A. Gaidon, Z. Harchaoui, and C. Schmid Activity representation with motion hierarchies Int. J. Comput. Vis. 107 3 2014 219 238
17. C. van Gemeren, R.T. Tan, R. Poppe, R.C. Veltkamp, Dyadic interaction detection from pose and flow, in: Human Behavior Understanding Workshop, 2014, pp. 101-115.
18. A. Gupta, A. Kembhavi, and L. Davis Observing human-object interactions: using spatial and functional compatibility for recognition IEEE Trans. Pattern Anal. Mach. Intell. 31 10 2009 1775 1789
19. T. Grtner, P.A. Flach, A. Kowalczyk, and A.J. Smola Multi-instance kernels In Proc. 19th International Conf. on Machine Learning 2002 Morgan Kaufman 179 186
20. M. Hoai, A. Zisserman, Talking heads: detecting humans and recognizing their interactions, in: IEEE Conference on Computer Vision and Pattern Recognition, 2014.
21. N. Ikizler-Cinbis, and S. Sclaroff Object recognition and localization via spatial instance embedding International Conference on Pattern Recognition (ICPR) 2010 IEEE 452 455
22. N. Ikizler-Cinbis, S. Sclaroff, Object, scene and actions: combining multiple features for human action recognition, in: ECCV, 2010, pp. 494-507.
23. Y. Kong, Y. Jia, Y. Fu, Learning human interaction by interactive phrases, in: Proceedings of European Conference on Computer Vision, ECCV, 2012, pp. 300-313.
24. T. Lan, L. Sigal, and G. Mori Social roles in hierarchical models for human activity recognition CVPR 2012 IEEE 1354 1361
25. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: CVPR, 2008.
26. C. Leistner, A. Saffari, H. Bischof, MILForests: multiple-instance learning with randomized trees, in: ECCV, 2010.
27. M. Marin-Jimenez, R. Muoz-Salinas, E. Yeguas-Bolivar, and N. Prez de la Blanca Human interaction categorization by using audio-visual cues Mach. Vis. Appl. 25 1 2014 71 84
28. M. Marin-Jimenez, E. Yeguas, and N.P. de la Blanca Exploring stip-based models for recognizing human interactions in tv videos Pattern Recognit. Lett. 34 15 2013 1819 1828
29. M. Marin-Jimenez, A. Zisserman, M. Eichner, and V. Ferrari Detecting people looking at each other in videos Int. J. Comput. Vis. 106 3 2013 282 296
30. O. Maron, T. Lozano-Pérez, A framework for multiple-instance learning, in: Proceedings of the 1997 Conference on Advances in Neural Information Processing Systems 10, NIPS '97, 1998, pp. 570-576.
31. S. Mukherjee, S.K. Biswas, and D.P. Mukherjee Recognizing interactions between human performers by dominating pose doublet Mach. Vis. Appl. 25 4 2014 1033 1052
32. S. Park, and J.K. Aggarwal Simultaneous tracking of multiple body parts of interacting persons Comput. Vis. Image Underst. 102 1 2006 1 21
33. A. Patron-Perez, M. Marszalek, I. Reid, and A. Zisserman Structured learning of human interactions in tv shows IEEE Trans. Pattern Anal. Mach. Intell. 34 12 2012 2441 2453
34. A. Patron-Perez, M. Marszalek, A. Zisserman, I. Reid, High five: recognising human interactions in TV shows, in: British Machine Vision Conference, 2010.
35. R. Poppe A survey on vision-based human action recognition Image Vis. Comput. 28 6 2010 976 990
36. K. Prabhakar, J.M. Rehg, Categorizing turn-taking interactions, in: ECCV (5), 2012, pp. 383-396.
37. A. Prest, C. Schmid, and V. Ferrari Weakly supervised learning of interactions between humans and objects IEEE TPAMI 34 2012 601 614
38. M. Raptis, L. Sigal, Poselet key-framing: a model for human activity recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
39. M.S. Ryoo, J. Aggarwal, Spatio-temporal relationship match: video structure comparison for recognition of complex human activities, in: 2009 IEEE 12th International Conference on Computer Vision, 2009, pp. 1593-1600.
40. M.S. Ryoo, J.K. Aggarwal, UT-Interaction Dataset, ICPR contest on Semantic Description of Human Activities (SDHA), 2010. < http://cvrc.ece.utexas.edu/SDHA2010/Human-Interaction.html >.
41. S. Sadanand, J.J. Corso, Action bank: a high-level representation of activity in video, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2012.
42. M.A. Sadeghi, A. Farhadi, Recognition using visual phrases, in: CVPR. IEEE, 2011.
43. M. Sapienza, F. Cuzzolin, and P. Torr Learning discriminative spacetime action parts from weakly labelled videos Int. J. Comput. Vis. 2013 1 18
44. B. Solmaz, S.M. Assari, and M. Shah Classifying web videos using a global video descriptor Mach. Vis. Appl. 24 7 2013 1473 1485
45. A. Vahdat, B. Gao, M. Ranjbar, G. Mori, A discriminative key pose sequence model for recognizing human interactions, in: Eleventh IEEE International Workshop on Visual Surveillance, 2011.
46. D. Waltisberg, A. Yao, J. Gall, L. Van Gool, Variations of a hough-voting action recognition system, in: ICPR, 2010.
47. H. Wang, A. Kläser, C. Schmid, C.L. Liu, Action recognition by dense trajectories, in: IEEE Conference on Computer Vision & Pattern Recognition, 2011, pp. 3169-3176.
48. H. Wang, C. Schmid, Action recognition with improved trajectories, in: IEEE International Conference on Computer Vision (ICCV), 2013.
49. J. Wang, J.D. Zucker, Solving the multiple-instance problem: a lazy learning approach, in: In Proc. 17th International Conf. on Machine Learning, 2000, pp. 1119-1125.
50. D. Weinland, R. Ronfard, and E. Boyer A survey of vision-based methods for action representation, segmentation and recognition Comput. Vis. Image Underst. 115 2 2011 224 241
51. Y. Yang, S. Baker, A. Kannan, and D. Ramanan Recognizing proxemics in personal photos CVPR 2012 IEEE 3522 3529
52. B. Yao, L. Fei-Fei, Grouplet: a structured image representation for recognizing human and object interactions, in: The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, CA, 2010.
53. G. Yu, J. Yuan, and Z. Liu Propagative hough voting for human activity recognition Computer Vision ECCV 2012 2012 Springer-Verlag 693 706
54. K. Yun, J. Honorio, D. Chattopadhyay, T. Berg, D. Samaras, Two-person interaction detection using body-pose features and multiple instance learning, in: Computer Vision and Pattern Recognition Workshops (CVPRW), 2012, pp. 28-35.
55. C. Zhang, J.C. Platt, and P.A. Viola Multiple instance boosting for object detection Y. Weiss, B. Schölkopf, J. Platt, Advances in Neural Information Processing Systems vol. 18 2006 MIT Press 1417 1424
56. Y. Zhang, X. Liu, M.C. Chang, W. Ge, T. Chen, Spatio-temporal phrases for activity recognition, in: Proceedings of the 12th European Conference on Computer Vision, ECCV'12, vol. Part III, 2012, pp. 707-721.
57. Z.H. Zhou, Y.Y. Sun, Y.F. Li, Multi-instance learning by treating instances as non-i.i.d. samples, in: Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, 2009, pp. 1249-1256.