Simultaneous segmentation and classification of human actions in video streams using deeply optimized Hough transform

Pattern Recognition

Volumn 47, Issue 12, 2014, Pages 3807-3818

  Chan Hon Tong, Adrien ^a   Achard, Catherine ^b,c   Lucat, Laurent ^a  

^a DIF   (France)

^b CNRS   (France)

^c SORBONNE UNIVERSITÉ   (France)

Author keywords

Classification; Hough; Human actions; Segmentation; Video streams

Indexed keywords

CLASSIFICATION (OF INFORMATION); HOUGH TRANSFORMS; IMAGE SEGMENTATION; VIDEO STREAMING;

HOUGH; HUMAN ACTIONS; HUMAN ACTIVITY RECOGNITION; STATE-OF-THE-ART PERFORMANCE; TEMPORAL DOMAIN; TEMPORAL LOCALIZATION;

IMAGE RECOGNITION;

EID: 84907883543     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.05.010     Document Type: Article

References (50)

1. J. Aggarwal, M.S. Ryoo, Human activity analysis: a review, ACM Comput. Surv. (2011).
2. K.P. Bennett, and O.L. Mangasarian Robust linear programming discrimination of two linearly inseparable sets Optim. Methods Softw. 1992 10.1080/10556789208805504
3. D.J. Berndt, J. Clifford, Using dynamic time warping to find patterns in time series, in: KDD Workshop, 1994.
4. S. Chakrabartty, and G. Cauwenberghs Gini support vector machine quadratic entropy based robust multiclass probability regression J. Mach. Learn. 2007
5. C.-C. Chang, C.-J. Lin, Libsvm: a library for support vector machines, ACM Trans. Intell. Syst. Technol. (2011). http://dx.doi.org/10.1145/1961189.1961199.
6. O. Chapelle, and S.S. Keerthi Efficient algorithms for ranking with svms Inf. Retr. 2010 10.1007/s10791-009-9109-9
7. J.M. Chaquet, E.J. Carmona, and A. Fernández-Caballero A survey of video datasets for human action and activity recognition Comput. Vis. Image Understand. 2013 10.1016/j.cviu.2013.01.013
8. C. Cortes, and V. Vapnik Support-vector networks J. Mach. Learn. 1995 10.1023/A:1022627411411
9. P. Cottone, G.L. Re, G. Maida, M. Morana, Motion sensors for activity recognition in an ambient-intelligence scenario, in: Smart Environments and Ambient Intelligence Workshop, 2013. http://dx.doi.org/10.1109/PerComW.2013.6529573.
10. K. Crammer, and Y. Singer On the algorithmic implementation of multiclass kernel-based vector machines J. Mach. Learn. Res. 2002
11. M. Devanne, H. Wannous, S. Berretti, P. Pala, M. Daoudi, A. Del Bimbo, Space-time pose representation for 3d human action recognition, in: International Conference on Image Analysis and Processing Workshop, 2013. http://dx.doi.org/10.1007/978-3-642-41190-849.
12. R. Girshick, J. Shotton, P. Kohli, A. Criminisi, A. Fitzgibbon, Efficient regression of general-activity human poses from depth images, in: International Conference on Computer Vision, 2011. http://dx.doi.org/10.1109/ICCV.2011.6126270.
13. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri Actions as space-time shapes Trans. Pattern Anal. Mach. Intell. 2007 10.1109/TPAMI.2007.70711
14. J. Han, L. Shao, D. Xu, and J. Shotton Enhanced computer vision with microsoft kinect sensor a review Trans. Cybern. 2013 10.1109/TCYB.2013.2265378
15. M. Hoai, Z. Lan, F. De la Torre, Joint segmentation and classification of human actions in video, in: International Conference on Computer Vision and Pattern Recognition, 2011. http://dx.doi.org/10.1109/CVPR.2011.5995470.
16. T. Joachims, T. Finley, and C.-N.J. Yu Cutting-plane training of structural svms Mach. Learn. 2009 10.1007/s10994-009-5108-8
17. N. Karmarkar, A new polynomial-time algorithm for linear programming, In: symposium on Theory of computing, 1984. http://dx.doi.org/10.1145/800057.808695.
18. J. Lafferty, A. McCallum, F.C. Pereira, Conditional random fields: probabilistic models for segmenting and labeling sequence data, in: International Conference on Machine Learning, 2001.
19. K. Lai, J. Konrad, P. Ishwar, A gesture-driven computer interface using kinect, in: Symposium Image Analysis and Interpretation, 2012. http://dx.doi.org/10.1109/SSIAI.2012.6202484.
20. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: International Conference on Computer Vision and Pattern Recognition, 2008. http://dx.doi.org/10.1109/CVPR.2008.4587756.
21. B. Leibe, A. Leonardis, B. Schiele, Combined object categorization and segmentation with an implicit shape model, in: European Conference on Computer Vision - Workshop, 2004.
22. S.-Y. Lin, C.-K. Shie, S.-C. Chen, M.-S. Lee, Y.-P. Hung, Human action recognition using action trait code, in: International Conference on Pattern Recognition, 2012.
23. J. Liu, J. Luo, M. Shah, Recognizing realistic actions from videos "in the wild", in: International Conference on Computer Vision and Pattern Recognition, 2009. http://dx.doi.org/10.1109/CVPR.2009.5206744.
24. F. Lv, R. Nevatia, and M. Lee 3d human action recognition using spatio-temporal motion templates Comput. Vis. Hum.-Comput. Interact. 2005 10.1007/1157342512
25. S. Maji, J. Malik, Object detection using a max-margin Hough transform, in: International Conference on Computer Vision and Pattern Recognition, 2009. http://dx.doi.org/10.1109/CVPR.2009.5206693.
26. L.-P. Morency, A. Quattoni, T. Darrell, Latent-dynamic discriminative models for continuous gesture recognition, in: International Conference on Computer Vision and Pattern Recognition, 2007. http://dx.doi.org/10.1109/CVPR.2007.383299.
27. B. Ni, G. Wang, P. Moulin, Rgbd-hudaact: a color-depth video database for human daily activity recognition, in: International Conference on Computer Vision Workshop, 2011. http://dx.doi.org/10.1109/ICCVW.2011.6130379.
28. S. Oh, J. Rehg, T. Balch, and F. Dellaert Learning and inferring motion patterns using parametric segmental switching linear dynamic systems Int. J. Comput. Vis. 2008 10.1007/s11263-007-0062-z
29. M. Popa, A.K. Koc, L.J. Rothkrantz, C. Shan, P. Wiggers, Kinect sensing of shopping related actions, in: Constructing Ambient Intelligence, 2012. http://dx.doi.org/10.1007/978-3-642-31479-716.
30. R. Poppe A survey on vision-based human action recognition Image Vis. Comput. 2010 10.1016/j.imavis.2009.11.014
31. M. Raptis, D. Kirovski, H. Hoppe, Real-time classification of dance gestures from skeleton animation, in: ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2011. http://dx.doi.org/10.1145/2019406.2019426.
32. S. Roweis, and Z. Ghahramani A unifying review of linear Gaussian models J. Neural Comput. 1999 10.1162/089976699300016674
33. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local svm approach, in: International Conference on Pattern Recognition, 2004. http://dx.doi.org/10.1109/ICPR.2004.1334462.
34. J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, R. Moore, Real-time human pose recognition in parts from single depth images, in: International Conference on Computer Vision and Pattern Recognition, 2011. http://dx.doi.org/10.1109/CVPR.2011.5995316.
35. J. Sivic, A. Zisserman, Video google: a text retrieval approach to object matching in videos, in: International Conference on Computer Vision, 2003. http://dx.doi.org/10.1109/ICCV.2003.1238663.
36. Y. Song, L.-P. Morency, R. Davis, Action recognition by hierarchical sequence summarization, in: International Conference on Computer Vision and Pattern Recognition, 2013. http://dx.doi.org/10.1109/CVPR.2013.457.
37. J. Sun, X. Wu, S. Yan, L. Cheong, T. Chua, J. Li, Hierarchical spatio-temporal context modeling for action recognition, in: International Conference on Computer Vision and Pattern Recognition, 2009. http://dx.doi.org/10.1109/CVPR.2009.5206721.
38. J. Sung, C. Ponce, B. Selman, A. Saxena, Human activity detection from RGBD images, in: AAAI Workshop, 2011.
39. M. Tenorth, J. Bandouch, M. Beetz, The TUM kitchen data set of everyday manipulation activities for motion tracking and action recognition, in: International Conference on Computer Vision Workshops, 2009. http://dx.doi.org/10.1109/ICCVW.2009.5457583.
40. T.T. Thanh, F. Chen, K. Kotani, H.-B. Le, Extraction of discriminative patterns from skeleton sequences for human action recognition, in: International Conference on Computing and Communication Technologies, Research, Innovation, and Vision for the Future, 2012. http://dx.doi.org/10.1109/rivf.2012.6169822.
41. I. Theodorakopoulos, D. Kastaniotis, G. Economou, and S. Fotopoulos Pose-based human action recognition via sparse representation in dissimilarity space J. Vis. Commun. Image Represent. 2013 10.1016/j.jvcir.2013.03.008
42. H. Wang, A. Kläser, C. Schmid, L. Cheng-Lin, Action recognition by dense trajectories, in: International Conference on Computer Vision and Pattern Recognition, 2011. http://dx.doi.org/10.1109/CVPR.2011.5995407.
43. J. Wang, Z. Liu, Y. Wu, J. Yuan, Mining actionlet ensemble for action recognition with depth cameras, in: International Conference on Computer Vision and Pattern Recognition, 2012. http://dx.doi.org/10.1109/CVPR.2012.6247813.
44. Y. Wang, G. Mori, Max-margin hidden conditional random fields for human action recognition, in: International Conference on Computer Vision and Pattern Recognition, 2009. http://dx.doi.org/10.1109/CVPR.2009.5206709.
45. A.S. Willsky, E.B. Sudderth, M.I. Jordan, E.B. Fox, Nonparametric Bayesian learning of switching linear dynamical systems, in: Advances in Neural Information Processing Systems, 2008. http://dx.doi.org/10.1109/TSP.2010.2102756.
46. P. Wohlhart, S. Schulter, M. Kostinger, P. Roth, H. Bischof, Discriminative Hough forests for object detection, in: British Machine Vision Conference, 2012. http://dx.doi.org/10.5244/C.26.40.
47. Wouter, E. Josemansand Gwenn, K. Ben, Fusion of color and depth camera data for robust fall detection, in: International Conference on Computer Vision Theory and Application, 2013. http://dx.doi.org/10.5220/0004213406080613.
48. L. Xia, C.-C. Chen, J. Aggarwal, View invariant human action recognition using histograms of 3d joints, in: International Conference on Computer Vision and Pattern Recognition Workshops, 2012. http://dx.doi.org/10.1109/CVPRW.2012.6239233.
49. A. Yao, J. Gall, G. Fanelli, L. Van Gool, Does human action recognition benefit from pose estimation?, in: British Machine Vision Conference, 2011. http://dx.doi.org/10.5244/C.25.67.
50. Y. Zhang, T. Chen, Implicit shape kernel for discriminative learning of the Hough transform detector, in: British Machine Vision Conference, 2010. http://dx.doi.org/10.5244/C.24.105.