Human action recognition in still images using action poselets and a two-layer classification model

Journal of Visual Languages and Computing

Volumn 28, Issue , 2015, Pages 163-175

  Ko, Byoung Chul ^a   Hong, JuneHyeok ^a   Nam, Jae Yeal ^a  

^a Keimyung University   (South Korea)

Author keywords

Action recognition; OCS LBP; Random forest; Spatial poselet activation vector; Two layer classification model

Indexed keywords

EID: 84922582275     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2015.01.003     Document Type: Article

References (41)

1. I. Laptev, T. Lindeberg, Space-time interest points, in: Proceedings of the IEEE International Conference on Computer Vision, ICCV2003, 2003, pp. 432-439.
2. Luo Q., Kong X., Zeng G., Fan J. Human action detection via boosted local motion histogram. Mach. Vis. Appl. 2010, 21(3):377-389.
3. Zhen X., Shao L., Tao D., Li X. Embedding motion and structure features for action recognition. IEEE Trans. Circuits Syst. Video Technol. 2013, 23(7):1182-1190.
4. N. Ikizler, R.G. Cinbis, S. Pehlivan, P. Duygulu, Recognizing actions from still images, in: Proceedings of the International Conference of Pattern Recognition, ICPR2008, 2008, pp. 1-4.
5. P. Ronald, P. Mannes, Example-based Pose Estimation in Monocular Images Using Compact Fourier descriptors, Technical Report, TR-CTIT-05-49, University of Twente, 2005, pp. 1-19.
6. Gupta A., Kembhavi A., Davis L.S. Observing human-object interactions: using spatial and functional compatibility for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31(10):1775-1789.
7. G. Shakhnarovich, P. Viola, R. Darrell, Fast pose estimation with parameter-sensitive hashing, in: Proceedings of the IEEE International Conference on Computer Vision, ICCV2003, 2003, pp. 750-757.
8. R. Poppe, M. Poel, Comparison of silhouette shape descriptors for example-based human pose recovery, in: Proceedings of the International Conference on Automatic Face and Gesture Recognition, FG2006, 2006, pp. 541-546.
9. Y. Wang, H. Jiang, M.S. Drew, Z.N. Li, G. Mori, Unsupervised discovery of action classes, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR2006, 2006, pp. 1654-1661.
10. Felzenszwalb P.F., Huttenlocher D.P. Pictorial structures for object recognition. Int. J. Comput. Vis. 2005, 61(1):55-79.
11. X. Ren, A.C. Berg, J. Malik, Recovering human body configurations using pairwise constraints between parts, in: Proceedings of the IEEE International Conference on Computer Vision, ICCV2005, 2005, pp. 824-831.
12. C. Thurau, V. Hlavac, Pose primitive based human action recognition in videos or still images, in: Proceedings of the IAPR International Conference on Pattern Recognition, ICPR2008, 2008, pp. 1-8.
13. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR2005, 2005, pp.886-893.
14. V. Delaitre, I. Laptev, J. Sivic, Recognizing human action in still images: a study of bag-of-features and partial-based representations, in: Proceedings of the British Machine Vision Conference, BMCV2010, 2010, pp. 1-11.
15. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, Real-time human pose recognition in parts from single depth images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition CVPR2011, 2011, pp. 1297-1304.
16. W. Yang, Y. Wang, G. Mori, Recognizing human actions from still images with latent poses, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition CVPR2010, 2010, pp. 2030-2037.
17. S. Maji, L. Bourdev, J. Malik. Action recognition from a distributed representation of pose and appearance, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR2011, 2011, pp. 3177-3184.
18. G. Sharma, F. Jurie, C. Schmid, Expanded parts model for human attribute and action recognition in still images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR2013, 2013, pp. 1-8.
19. B. Yao, X. Jiang, A. Khosla, A.L. Lin, L. Guibas, L. Fei-Fei, Human action recognition by learning bases of action attributes and parts, in: Proceedings of the IEEE Conference on Computer Vision, ICCV2011, 2011, pp.1331-1338.
20. Khan F.S., Anwer R.M., Weijer J., Bagdanov A.D., Lopez A.M., Felsberg M. Coloring action recognition in still images. Int. J. Comput. Vis. 2013, 105(3):205-221.
21. V. Dalaitre, J. Sivic, I. Laptev, Learning person-object interactions for action recognition in still images, in: Proceedings of the Advances in Neural Information Processing Systems, NIPS2011, 2011, pp. 1503-1511.
22. Y. Zheng, Y.-J. Zhang, X. Li, B.D. Liu, Action recognition in still images using a combination of human pose and context information, in: Proceedings of the IEEE International Conference on Image Processing, ICIP2012, 2012, pp. 785-788.
23. L. Bourdev, S. Maji, T. Brox, J. Malik, Detecting people using mutually consistent poselet activations, in: Proceedings of the European Conference on Computer Vision, ECCV2010, 2010, pp. 168-181.
24. M.P. Dubuisson, A.K. Jain, A modified Hausdorff distance for object matching, in: Proceedings of the IAPR International Conference on Pattern Recognition, ICPR2010, 1994, pp. 566-568.
25. Ko B.C., Kim S.H., Nam J.Y. X-ray image classification using random forests with local wavelet-based CS-local binary patterns. J. of Digital Imaging 2011, 24(6):1141-1151.
26. Son J.E.0, Ko B.C., Nam J.Y. Medical image classification and retrieval using BoF feature histogram. KIPS Trans. Software Data Eng. 2013, 2(4):273-280.
27. L. Bourdev, J. Malik, Poselets: body part detectors trained using 3d human pose annotations, in: Proceedings of the IEEE Conference on Computer Vision, ICCV2009, 2009, pp.1365-1372.
28. Lubomir Bourdev, Subhransu Maji, Jitendra Malik, Describing people: a poselet-based approach to attribute classification, in: Proceedings of the IEEE Conference on Computer Vision, ICCV2011, 2011, pp. 1543-1550.
29. T. Brox, L. Bourdev, S. Maji, J. Malik, Object segmentation by alignment of poselet activations to image contours, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR2011, 2011, pp. 2225-2232.
30. Wang Y., Tran D., Liao Z., Forsyth D. Discriminative hierarchical part-based models for human parsing and action recognition. J. Mach. Learn. Res. 2012, 13(1):3075-3102.
31. Sim D.G., Kwon O.K., Park R.H. Object matching algorithms using robust Hausdorff distance measures. IEEE Trans. Image Process. 1999, 8(3):425-429.
32. Ko B.C., Kim D.Y., Jung J.H., Nam J.Y. Three-level cascade of random forests for rapid human detection. Opt. Eng. 2013, 52(2):1-11.
33. T. Ahonen, A. Hadid, M. Pietikäinen, Face recognition with local binary patterns, in: Proceedings of the European Conference on Computer Vision, ECCV2004, 2004, pp. 469-481.
34. Heikkilä M., Pietikäinen M., Schmid C. Description of interest regions with local binary patterns. Pattern Recogn. 2009, 42(3):425-436.
35. C. Gu, P. Arbelaez, Y. Lin, K. Yu, J. Malik, Multi-component models for object detection, in: Proceedings of the European Conference on Computer Vision, ECCV2012, 2012, pp. 445-458.
36. Bishop C.M. Pattern Recognition and Machine Learning 2006, Springer, Singapore. first ed.
37. Breiman L. Random forests. Mach. Learn. 2001, 45(1):5-32.
38. A. Saffari, C. Leistner, J. Santner, M. Godec, On-line random forests, in: Proceedings of the IEEE Conference on Computer Vision Workshops, ICCVW2009, 2009, pp. 1393-1400.
39. Ko B.C., Park J.O., Nam J.Y. Spatiotemporal bag-of-features for early wildfire smoke detection. Image Vis. Comput. 2013, 31(10):786-795.
40. J.H. Jung, B.C. Ko, J.Y. Nam, Y.D. Joo, Multi-view object detection using region-based random forest classifiers, in: Proceedings of the IADIS International Conference Computer Graphics, Visualization, Computer Vision and Image Processing, CGVCVIP2013, 2013, pp. 129-132.
41. Everingham M., Gool L.V., Williams C.K.I., Winn J., Zisserman A. The PASCAL visual object classes (VOC) challenge. Int. J. Comput. Vis. 2010, 88(2):303-338.