Selective spatio-temporal interest points

Computer Vision and Image Understanding

Volumn 116, Issue 3, 2012, Pages 396-410

  Chakraborty, Bhaskar ^a   Holte, Michael B ^b   Moeslund, Thomas B ^b   Gonzàlez, Jordi ^a  

^a Campus UAB ^*  (Spain)

^b AALBORG UNIVERSITY   (Denmark)

Author keywords

Action recognition; Bag of words; Complex scenes; Local descriptors; Multiple actors; Spatio temporal interest points; Support vector machines

Indexed keywords

ACTION RECOGNITION; BAG OF WORDS; COMPLEX SCENES; LOCAL DESCRIPTORS; MULTIPLE ACTORS; SPATIO-TEMPORAL; SUPPORT VECTOR;

BENCHMARKING; GESTURE RECOGNITION; IMAGE RECOGNITION; MOTION ESTIMATION;

SUPPORT VECTOR MACHINES;

EID: 84856080935     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2011.09.010     Document Type: Article

References (79)

1. T. Moeslund, A. Hilton, and V. Krüger A survey of advances in vision-based human motion capture and analysis CVIU 104 2-3 2006 90 126 (Pubitemid 44573873)
2. R. Poppe A survey on vision-based human action recognition IVC 28 6 2010 976 990
3. D. Weinland, R. Ronfard, E. Boyer, A survey of vision-based methods for action representation, segmentation and recognition, INRIA Report RR-7212, 2010, pp. 54-111.
4. S. Ali, A. Basharat, M. Shah, Chaotic invariants for human action recognition, in: ICCV, 2007.
5. N. Nguyen, D. Phung, S. Venkatesh, H. Bui, Learning and detecting activities from movement trajectories using the hierarchical hidden markov model, in: CVPR, 2005.
6. A. Galata, N. Johnson, and D. Hogg Learning variable-length markov models of behavior CVIU 81 3 2001 398 413 (Pubitemid 32415983)
7. O. Boiman, M. Irani, Detecting irregularities in images and in video, in: ICCV, 2005.
8. M. Rodriguez, J. Ahmed, M. Shah, Action mach: a spatio-temporal maximum average correlation height filter for action recognition, in: CVPR, 2008.
9. N. Ikizler, D. Forsyth, Searching video for complex activities with finite state models, in: CVPR, 2007.
10. L. Zelnik-Manor, and M. Irani Statistical analysis of dynamic actions PAMI 28 9 2006 1530 1535 (Pubitemid 44132659)
11. C. Thurau, V. Hlavac, Pose primitive based human action recognition in videos or still images, in: CVPR, 2008.
12. W. Yang, Y. Wang, G. Mori, Recognizing human actions from still images with latent poses, in: CVPR, 2010.
13. M. Bregonzio, J. Li, S. Gong, T. Xiang, Discriminative topics modelling for action feature selection and recognition, in: BMVC, 2010.
14. Z. Jiang, Z. Lin, L. Davis, A tree-based approach to integrated action localization, recognition and segmentation, in: ECCV Workshops, 2010.
15. T. Kim, S. Wong, R. Cipolla, Tensor canonical correlation analysis for action classification, in: CVPR, 2007.
16. Z. Lin, Z. Jiang, L. Davis, Recognizing actions by shape-motion prototype trees, in: ICCV, 2009.
17. Y.M. Lui, J.R. Beveridge, M. Kirby, Action classification on product manifolds, in: CVPR, 2010.
18. F. Nater, H. Grabner, L.V. Gool, Exploiting simple hierarchies for unsupervised human behavior analysis, in: CVPR, 2010.
19. K. Schindler, L. van Gool, Action snippets: How many frames does human action recognition require, in: CVPR, 2008.
20. X. Wu, W. Liang, Y. Jia, Incremental discriminative-analysis of canonical correlations for action recognition, in: ICCV, 2009.
21. M. Yang, F. Lv, W. Xu, K. Yu, Y. Gong, Human action detection by boosting efficient motion features, in: ICCV, 2009.
22. A. Yao, J. Gall, L.V. Gool, A hough transform-based voting framework for action recognition, in: CVPR, 2010.
23. L. Cao, Z. Liu, T. Huang, Cross-dataset action detection, in: CVPR, 2010.
24. O. Duchenne, I. Laptev, J. Sivic, F. Bach, J. Ponce, Automatic annotation of human actions in video, in: ICCV, 2009.
25. A. Gilbert, J. Illingworth, R. Bowden, Action recognition using mined hierarchical compound features, PAMI 99, preprints.
26. A. Gilbert, J. Illingworth, R. Bowden, Fast realistic multi-action recognition using mined dense spatio-temporal features, in: ICCV, 2009.
27. D. Han, L. Bo, C. Sminchisescu, Selection and context for action recognition, in: ICCV, 2009.
28. M.B. Kaâniche, F. Brémond, Gesture recognition by learning local motion signatures, in: CVPR, 2010.
29. A. Kovashka, K. Grauman, Learning a hierarchy of discriminative space-time neighborhood features for human action recognition, in: CVPR, 2010.
30. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: CVPR, 2008.
31. J. Liu, Y. Yang, M. Shah, Learning semantic visual vocabularies using diffusion distance, in: CVPR, 2009.
32. J. Liu, J. Luo, M. Shah, Recognizing realistic actions from videos "in the wild", in: CVPR, 2009, the YouTube dataset is available at < http://www.cs.ucf.edu/∼liujg/YouTube-Action-dataset.html >.
33. J. Liu, M. Shah, Learning human actions via information maximization, in: CVPR, 2008.
34. M. Marszalek, I. Laptev, C. Schmid, Actions in context, in: CVPR, 2009, the Hollywood 2 dataset is available at < http://www.irisa.fr/vista/actions/ hollywood2 >.
35. J. Niebles, H. Wang, and L. Fei-Fei Unsupervised learning of human action categories using spatial-temporal words IJCV 79 3 2008 299 318
36. K. Prabhakar, S. Oh, P. Wang, G. Abowd, J. Rehg, Temporal causality for the analysis of visual events, in: CVPR, 2010.
37. S. Sadek, A. Al-Hamadi, B. Michaelis, U. Sayed, Toward robust action retrieval in video, in: BMVC, 2010.
38. B. Saghafi, E. Farahzadeh, D. Rajan, A. Sluzek, Embedding visual words into concept space for action and scene recognition, in: BMVC, 2010.
39. L. Shao, R. Gao, A wavelet based local descriptor for human action recognition, in: BMVC, 2010.
40. X. Sun, M. Chen, A. Hauptmann, Action recognition via local descriptors and holistic features, in: CVPR, 2009.
41. H. Uemura, S. Ishikawa, K. Mikolajczyk, Feature tracking and motion compensation for action recognition, in: BMVC, 2008, the Multi-KTH dataset is available at < http://www.openvisor.org/video-details.asp?idvideo=303 >.
42. M. Ullah, S. Parizi, I. Laptev, Improving bag-of-features action recognition with non-local cues, in: BMVC, 2010.
43. H. Wang, M. Ullah, A. Kläser, I. Laptev, C. Schmid, Evaluation of local spatio-temporal features for action recognition, in: BMVC, 2009.
44. T. Yu, T. Kim, R. Cipolla, Real-time action recognition by spatiotemporal semantic and structural forests, in: BMVC, 2010.
45. I. Laptev, T. Lindeberg, Space-time interest points, in: ICCV, 2003.
46. C. Harris, M. Stephens, A combined corner and edge detector, in: Alvey Vision Conference, 1988.
47. P. Dollàr, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: VS-PETS, 2005.
48. H. Jhuang, T. Serre, L. Wolf, T. Poggio, A biologically inspired system for action recognition, in: ICCV, 2007.
49. A. Oikonomopoulos, I. Patras, and M. Pantic Spatiotemporal salient points for visual recognition of human actions SMC-B 36 3 2006 710 719 (Pubitemid 43811326)
50. G. Willems, T. Tuytelaars, L.V. Gool, An efficient dense and scale-invariant spatio-temporal interest point detector, in: ECCV, 2008.
51. S. Wong, R. Cipolla, Extracting spatiotemporal interest points using global information, in: ICCV, 2007.
52. P. Beaudet, Rotationally invariant image operators, in: ICPR, 1978.
53. T. Lindeberg Feature detection with automatic scale selection IJCV 30 2 1998 79 116 (Pubitemid 128517917)
54. C. Schmid, R. Mohr, and C. Bauckhage Evaluation of interest point detectors IJCV 37 2 2000 151 172
55. P. Turcot, D.G. Lowe, Better matching with fewer features: The selection of useful features in large database recognition problems, in: ICCV Workshops, 2009.
56. A. Kläser, M. Marszalek, C. Schmid, A spatio-temporal descriptor based on 3d-gradients, in: BMVC, 2008.
57. J. Koenderink, and A.V. Doorn Representation of local geometry in the visual system Biological Cybernetics 55 1987 367 375 (Pubitemid 17030735)
58. I. Laptev, T. Lindeberg, Local descriptors for spatio-temporal recognition, in: First International Workshop on Spatial Coherence for Visual Motion Analysis, 2004.
59. P. Scovanner, S. Ali, M. Shah, A 3-dimensional sift descriptor and its application to action recognition, in: ACM International Conference on Multimedia, 2007.
60. H. Bay, T. Tuytelaars, L.V. Gool, Surf: speeded up robust features, in: ECCV, 2006.
61. D. Lowe Distinctive image features from scale-invariant keypoints IJCV 60 2 2004 91 110
62. I. Laptev, B. Caputo, C. Schüldt, and T. Lindeberg Local velocity-adapted motion events for spatio-temporal recognition IJCV 108 3 2007 207 229 (Pubitemid 350016963)
63. J. Yuan, Z. Liu, Y. Wu, Discriminative subvolume search for efficient action detection, in: CVPR, 2009, the MSR dataset is available at < http://www.research.microsoft.com/en-us/um/people/zliu/ActionRecoRsrc >.
64. P. Matikainen, M. Hebert, R. Sukthankar, Representing pairwise spatial and temporal relations for action recognition, in: ECCV, 2010, pp. 508-521.
65. C. Schüldt, I. Laptev, B. Caputo, Recognizing human actions: A local svm approach, in: ICPR, 2004, the KTH dataset is available at < http://www.nada.kth.se/cvap/actions >.
66. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri Actions as space-time shapes PAMI 29 12 2007 2247 2253 the Weizmann dataset is available at < http://www.wisdom.weizmann.ac.il/∼vision/SpaceTimeActions.html > (Pubitemid 350124072)
67. Y. Ke, R. Sukthankar, M. Hebert, Event detection in crowded videos, in: ICCV, 2007, the CMU dataset instructions are available at < http://www.cs.cmu.edu/∼yke/video/#Dataset >.
68. The CVC dataset is available at < http://www.iselab.cvc.uab.es/files/ Tools/Cvc-ActionDataSet/index.htm >.
69. E. Soria, J. Martin, R. Magdalena, M. Martinez, A. Serrano, Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global, 2009, Chapter 11, pp. 242-264.
70. C.B. Do, and A.Y. Ng Transfer learning for text classification Journal of Advances in Neural Information Processing Systems 18 2006 299 306
71. C. Grigorescu, N. Petkov, and M.A. Westenberg Contour and boundary detection improved by surround suppression of texture edges IVC 22 8 2004 609 622
72. J. Fan, Y. Wu, S. Dai, Discriminative spatial attention for robust tracking, in: ECCV, 2010, pp. 480-493.
73. V. Mahadevan, and N. Vasconcelos Spatiotemporal saliency in dynamic scenes IEEE Transactions on Pattern Analysis and Machine Intelligence 32 2010 171 177
74. D. Gao, S. Han, and N. Vasconcelos Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2009 989 1005
75. L. Bretzner, and T. Lindeberg Feature tracking with automatic selection of spatial scales CVIU 71 3 1998 385 392 (Pubitemid 128423973)
76. I. Laptev On space-time interest points IJCV 64 2/3 2005 107 123 (Pubitemid 41314645)
77. N. Slonim, N. Tishby, Agglomerative information bottleneck, in: NIPS, 1999.
78. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, 2001. < http://www.csie.ntu.edu.tw/∼cjlin/libsvm >.
79. R.O. Duda, and P.E. Hart Use of the hough transformation to detect lines and curves in pictures Communications of the ACM 15 1 1972 11 15