Soft-assignment random-forest with an application to discriminative representation of human actions in videos

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 27, Issue 4, 2013, Pages

  Burghouts, Gertjan J ^a  

^a TNO   (Netherlands)

Author keywords

Human action detection; Random forest; Soft assignment; Spatio temporal interest points; Support vector machine

Indexed keywords

DEGREE OF UNCERTAINTY; DETECTION ACCURACY; DISCRIMINATIVE POWER; HUMAN ACTION DETECTIONS; RANDOM FORESTS; ROBUST APPROACHES; SOFT ASSIGNMENT; SPATIO-TEMPORAL INTEREST POINTS;

BINARY TREES; SUPPORT VECTOR MACHINES;

DECISION TREES;

EID: 84881026318     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001413500092     Document Type: Article

References (41)

1. A. Agarwal and B. Triggs, Multilevel image coding with hyperfeatures, Int. J. Comput. Vis. 78(1) (2008) 15-27.
2. S. Ali and M. Shah, Floor fields for tracking in high density crowd scenes, European Conf. Computer Vision (Heidelberg, Germany, 2008), pp. 1-14.
3. D. Batra, R. Sukthankar and T. Chen, Learning class-specific affinities for image labelling, Int. Conf. Computer Vision and Pattern Recognition (Anchorage, USA, 2008), pp. 1-8.
4. A. Bosch, A. Zisserman and X. Munoz, Scene classification using a hybrid generative/discriminative approach, IEEE Trans. Pattern Anal. Mach. Intell. 30(4) (2008) 712-727.
5. M. Bosch-Jorge, A.-J. Snchez-Salmern and C. Ricolfe-Viala, Visual-based human action recognition on smart phones based on 2D and 3D descriptors, Int. J. Pattern Recogn. Artif. Intell. 26(8) (2012) 1-16.
6. L. Breiman, Random forests, Mach. Learn. 45(1) (2001) 5-32.
7. G. J. Burghouts and K. Schutte, Correlations between 48 human actions improve their performance, Int. Conf. Pattern Recognition (Tsukuba, Japan, 2012), pp. 3515-3818.
8. G. J. Burghouts and K. Schutte, Spatio-temporal layout of human actions for improved bag-of-words action detection, Pattern Recogn. Lett. (2013) in press.
9. G. J. Burghouts, K. Schutte, H. Bouma and R.J.M. den Hollander, Selection of negative samples and two-stage combination of multiple features for action detection in thousands of videos, Mach. Vis. Appl. (2013) in press.
10. C.-C. Chang and C. -J. Lin, LIBSVM: A library for support vector machines (2001), available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
11. L. Gorelick, M. Blank, E. Shechtmanm, M. Irani and R. Basri, Actions as space-time shapes, IEEE Trans. Pattern Anal. Mach. Intell. 29(12) (2012) 2247-2253.
12. T. Guha and R. K. Ward, Learning sparse representations for human action recognition, IEEE Trans. Pattern Anal. Mach. Intell. 34(8) (2012) 1576-1588.
13. A. Gupta, P. Srinivasan, J. Shi and L. S. Davis, Understanding videos, constructing plots: learning a visually grounded storyline model from annotated videos, Int. Conf. Computer Vision and Pattern Recognition (Miami, USA, 2009), pp. 2012-2019.
14. P. Hanckmann, K. Schutte and G. J. Burghouts, Automated textual descriptions for a wide range of video events with 48 human actions, Int. Workshop on Video Event Categorization, Tagging and Retrieval (Firenze, Italy, 2012), pp. 372-380.
15. N. Japkowicz and S. Stephen, The class imbalance problem: A systematic study, Intell. Data Anal 6(5) (2002) 429-449.
16. Y.-G. Jiang, C.-W. Ngo and J. Yang, Towards optimal bag-of-features for object categorization and semantic video retrieval, Int. Conf. Image and Video Retrieval (Amsterdam, The Netherlands, 2007), pp. 494-501.
17. M. I. Jordan, A statistical approach to decision tree modeling, COLT '94: Proc. Seventh Annual Conf. Computational Learning Theory, New York, NY, USA (ACM Press, 1994) pp. 13-20.
18. F. Jurie and B. Triggs, Creating efficient codebooks for visual recognition, Int. Conf. Computer Vision (Beijing, China, 2005), pp. 604-610.
19. I. Laptev, On space-time interest points, Int. J. Comput. Vis. 64(2-3) (2005) 107-123.
20. I. Laptev, M. Marszalek, C. Schmid and B. Rozenfeld, Learning realistic human actions from movies, Int. Conf. Computer Vision and Pattern Recognition (Anchorage, USA, 2008), pp. 1-8.
21. S. Lazebnik, C. Schmid and J. Ponce, Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories, Int. Conf. Computer Vision and Pattern Recognition (New York, USA, 2006), pp. 2169-2178.
22. J. Liu, J. Luo and M. Shah, Recognizing realistic actions from videos in the wild', Int. Conf. Computer Vision and Pattern Recognition (Miami, USA, 2009), pp. 1996-2003.
23. F. Moosmann, B. Triggs and F. Jurie, Randomized clustering forests for building fast and discriminative visual vocabularies, Neural Inf. Process. Syst. 6 (2006).
24. F. Perronnin, Universal and adapted vocabularies for generic visual categorization, IEEE Trans. Pattern Anal. Mach. Intell. 30(7) (2008) 1243-1256.
25. J. Philbin, O. Chum, M. Isard, J. Sivic and A. Zisserman, Lost in quantization: Improving particular object retrieval in large scale image databases, Int. Conf. Computer Vision and Pattern Recognition (Anchorage, USA, 2008), pp. 1-8.
26. M. S. Ryoo, Human activity prediction: Early recognition of ongoing activities from streaming videos, Int. Conf. Computer Vision (Barcelona, Spain, 2011), pp. 1036-1043.
27. M. S. Ryoo, C. -C. Chen, J. K. Aggarwal and A. Roy-Chowdhury, An overview of contest on semantic description of human activities, Int. Conf. Pattern Recognition (Istanbul, Turkey, 2010), pp. 270-285.
28. S. Sadanand and J. J.Corso,Action bank:Ahigh-level representation of activity in video, Int. Conf. Computer Vision and Pattern Recognition (Providence, USA, 2012), pp. 1234-1241.
29. C. Schuldt, I. Laptev and B. Caputo, Recognizing human actions: A local SVM approach, Int. Conf. Pattern Recognition (Cambridge, UK, 2004), pp. 32-36.
30. B. Silverman and P. Green, Density Estimation for Statistics and Data Analysis (Chapmann and Hall, London, 1986).
31. J. Sivic and A. Zisserman, Video google: A text retrieval approach to object matching in videos, Int. Conf. Computer Vision (Nice, France, 2003), pp. 1470-1477.
32. T. Tuytelaars and C. Schmid, Vector quantizing feature space with a regular lattice, Int. Conf. Computer Vision (Rio de Janeiro, Brazil, 2007), pp. 1-8.
33. J. R. R. Uijlings, A. W. M. Smeulders and R. J. H. Scha, The visual extent of an object suppose we know the object locations, Int. J. Comput. Vis. 96(1) (2012) 46-63.
34. K. E. A. van de Sande, T. Gevers and C. G. M. Snoek, Evaluating color descriptors for object and scene recognition, IEEE Trans. Pattern Anal. Mach. Intell. 32(9) (2010) 1582-1596.
35. J. C. van Gemert, C. J. Veenman, A.W.M. Smeulders and J.M. Geusebroek, Visual word ambiguity, IEEE Trans. Pattern Anal. Mach. Intell. 32(7) (2011) 1271-1283.
36. visint.org, development kit of the recognition task (2011).
37. D. Waltisberg, A. Yao, J. Gall and L. Van Gool, Variations of a Hough-voting action recognition system, Int. Conf. Pattern Recognition (Istanbul, Turkey, 2010), pp. 306-312.
38. H. Wang, M. M. Ullah, A. Klser, I. Laptev and C. Schmid, Evaluation of local spatiotemporal features for action recognition, British Machine Vision Conf. (2009).
39. D. Weinland, E. Boyer and R. Ronfard, Action recognition from arbitrary views using 3D exemplars, IEEE Conf. Computer Vision (Rio de Janeiro, Brazil, 2007), pp. 1-8.
40. X. Wu, D. Xu, L. Duan and J. Luo, Action recognition using context and appearance distribution features, IEEE Conf. Computer Vision and Pattern Recognition (CVPR) (Colorado Springs, USA, 2011), pp. 489-496.
41. J. Zhang, M. Marszalek, S. Lazebnik and C. Schmid, Local features and kernels for classification of texture and object categories: A comprehensive study, Int. J. Comput. Vis. 73(2) (2007) 213-238.