Unified framework for human behaviour recognition: An approach using 3D Zernike moments

Neurocomputing

Volumn 100, Issue , 2013, Pages 107-116

  Bouziane, A ^a,b   Chahir, Y ^a   Molina, M ^a   Jouen, F ^c  

^a UNIVERSITÉ DE CAEN   (France)

^b UNIVERSITY OF BORDJ BOU ARRERIDJ   (Algeria)

^c PSL RESEARCH UNIVERSITY   (France)

Author keywords

3D Zernike moment; Graph based learning; Hand gesture; High dimensional data; Human action; Manifold; Regularization on graphs; Spectral graph embedding; Video analysis

Indexed keywords

GRAPH EMBEDDINGS; GRAPH-BASED LEARNING; HAND GESTURE; HIGH DIMENSIONAL DATA; HUMAN ACTIONS; MANIFOLD; REGULARIZATION ON GRAPHS; VIDEO ANALYSIS; ZERNIKE MOMENTS;

FACE RECOGNITION; FEATURE EXTRACTION; SOCIAL SCIENCES; THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO CAMERAS; VIDEO RECORDING;

BEHAVIORAL RESEARCH;

ACCURACY; ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; BEHAVIOR; BEHAVIORAL SCIENCE; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; DATA BASE; GESTURE; HAND MOVEMENT; HUMAN; HUMAN ACTIVITIES; HUMAN EXPERIMENT; IMAGE ANALYSIS; KERNEL METHOD; PHYSICAL ACTIVITY; PRIORITY JOURNAL; STATISTICAL PARAMETERS; THREE DIMENSIONAL ZERNIKE MOMENT; VALIDATION PROCESS; VIDEORECORDING; VISUAL AID;

EID: 84868628116     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.12.042     Document Type: Article

References (41)

1. A. Anjum, J.K. Aggarwal, Segmentation and recognition of continuous human activity, in: IEEE Workshop on Detection and Recognition of Events in Video'01., IEEE Computer Society, 2001, pp. 28-28.
2. H. Fujiyoshi, A.J.Lipton, Real-time human motion analysis by image skeletonization, in: Proceedings of IEEE WACV98, IEEE Computer Society, 1998, pp. 15-21.
3. M. Ahmad, S.-W. Lee, Hmm-based human action recognition using multiview image sequences, in: Proceedings of the 18th International Conference on Pattern Recognition, vol. 01, ICPR '06, IEEE Computer Society, Washington, DC, USA, 2006, pp. 263-266.
4. L.N, Gaussian process latent variable models for visualization of high dimensional data, in: NIPS, 2003.
5. Lawrence N., Hyvarinen A. Probabilistic non-linear principal component analysis with Gaussian process latent variable models. J. Mach. Learn. Res. 2005, 6:1783-1816.
6. C.H. Ek, P.H.S. Torr, N.D. Lawrence, Gaussian process latent variable models for human pose estimation, in: Proceedings of the 4th International Conference on Machine Learning for Multimodal Interaction, MLMI'07, Springer-Verlag, Berlin, Heidelberg, 2008, pp. 132-143.
7. Wang J.M., Fleet D.J., Hertzmann A. Gaussian process dynamical models for human motion. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30:283-298.
8. R. Urtasun, 3D people tracking with Gaussian process dynamical models, in: CVPR, CVPR, 2006, pp. 238-245.
9. A.A. Efros, A.C. Berg, G. Mori, J. Malik, Recognizing action at a distance, in: Proceedings of the Ninth IEEE International Conference on Computer Vision, ICCV '03, vol. 2, IEEE Computer Society, Washington, DC, USA, 2003, pp. 726-733.
10. L. Zelnik-manor, M. Irani, Event-based analysis of video, in: 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kuai, HI, USA, pp. 123-130.
11. G. Zhu, M. Yang, K. Yu, W. Xu, Y. Gong, Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor, in: Proceedings of the 17th ACM International Conference on Multimedia, MM '09, ACM, New York, NY, USA, 2009, pp. 165-174.
12. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local svm approach, in: Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04), ICPR '04, vol. 03, IEEE Computer Society, Washington, DC, USA, 2004, pp. 32-36.
13. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, in: Proceedings of the Tenth IEEE International Conference on Computer Vision, ICCV '05, IEEE Computer Society, Washington, DC, USA, 2005, pp. 1395-1402.
14. Bobick A.F., Davis J.W. The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23:257-267.
15. Pavlovic V., Sharma R., Huang T. Visual interpretation of hand gestures for human-computer interaction. A review. IEEE Trans. Pattern Anal. Mach. Intell. 1997, 19:677-695.
16. Y. Wu, J. Y. Lin, T.S. Huang, Capturing natural hand articulation, in: Proceedings of the 8th International Conference on Computer Vision, Vancouver, Canada II, 2001, pp. 426-432.
17. Q. Chen, N.D. Georganas, E.M. Petriu, Real-time vision based hand gesture recognition using haar-like features, in: Proceeding of the IEEE Instrumentation and Measurement Technology Conference Proceedings, May 1-3, 2007, Warsaw, pp.1-6, http://dx.doi.org/10.1109/IMTC.2007.379068.
18. C. Chang, I. Chen, Y. Huang, Hand pose recognition using curvature scale space, IEEE International Conference on Pattern Recognition, 2002.
19. Rosales R., Athitsos V., Sigal L., Sclaroff S. 3D hand pose reconstruction using specialized mappings. IEEE International Conference on Computer Vision 2001, 378-385.
20. L. Bretzner, I. Laptev, T. Lindberg, Hand gesture recognition using multi-scale color features, hierarchical models and particle filtering, IEEE International Conference on Automatic Face and Gesture Recognition, 2002.
21. Boykov Y., Kolmogorov V. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26:1124-1137.
22. Y. Boykov, V. Kolmogorov, Computing geodesics and minimal surfaces via graph cuts, in: ICCV, 2003, pp. 26-33.
23. Y. Chahir, M. Molina, F. Jouen, B. Safadi, Haptic gesture analysis and recognition, IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008.
24. N. Canterakis, 3D zernike moments and zernike affine invariants for 3D image analysis and recognition, in: In 11th Scandinavian Conference on Image Analysis, 1999, pp. 85-93.
25. Boaz N., Lafon S., Coifman R. Diffusion maps, spectral clustering and eigenfunctions of fokker-planck operators. Neural Inf. Process. Syst. 2005, 18.
26. Lafon S., Keller Y., Coifman R. Data fusion and multicue data matching by diffusion maps. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28:1784-1797.
27. Nadler B., Lafon S., Coifman R., Kevrekidis I.G. Diffusion maps-a probabilistic interpretation for spectral embedding and clustering algorithms. Principal Manifolds for Data Visualization and Dimension Reduction 2007, Springer. A.N. Gorban, B. Kegl, D. Zinovyev (Eds.).
28. Cattell R.B. The scree test for the number of factors. Multivar. Behav. Res. 1966, 245-276.
29. G. Raiche, M. Riopel, J.G. Blais, Non graphical solutions for the Cattell's scree test, International Annual Meeting of the Psychometric Society, 2006.
30. P. Arias, G. Randall, G. Sapiro, Connecting the out-of-sample and pre-image problems in kernel methods, in: Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, 2007.
31. Ghoniem M., Chahir Y., Elmoataz A. Nonlocal video denoising, simplification and inpainting using discrete regularization on graphs. J. Signal Process. 2010, 90:2445-2455.
32. Elmoataz A., Lezoray O., Bougleux S. Nonlocal discrete regularization on weighted graphs: a framework for image and manifold processing. IEEE Trans. Image Process. 2008, 17:1047-1060.
33. Boyce J., Hossack W. Moment invariants for pattern recognition. Pattern Recogn. Lett. 1983, 1:451-456.
34. Teh C.-H., Chin R.T. On image analysis by the methods of moments. IEEE Trans. Pattern Anal. Mach. Intell. 1988, 10:496-513.
35. Xinghua S., Mingyu C., Hauptmann A. Action recognition via local descriptors and holistic features. Computer Vision and Pattern Recognition Workshop 2009, 0:58-65.
36. R. Vezzani, D. Baltieri, R. Cucchiara, Hmm based action recognition with projection histogram features, in: Proceedings of the 20th International Conference on Recognizing Patterns in Signals, Speech, Images, and Videos, ICPR'10, Springer-Verlag, Berlin, Heidelberg, 2010, pp. 286-293.
37. V. Kellokumpu, G. Zhao, M. Pietikäinen, Recognition of human actions using texture descriptors, Machine Vision and Applications 22 (5) (2011) 767-780. http://dx.doi.org/10.1007/s00138-009-0233-8.
38. Dhillon P., Nowozin S., Lampert C. Combining appearance and motion for human action classification in videos. Computer Vision and Pattern Recognition Workshop 2009, 22-29.
39. L. Costantini, L. Seidenari, G. Serra, L. Capodiferro, A. Del Bimbo, Space-time zernike moments and pyramid kernel descriptors for action classification, in: ICIAP (2), Lecture Notes in Computer Science, Springer, 2011, pp. 199-208.
40. L. Ballan, M. Bertini, A. Del Bimbo, L. Seidenari, G. Serra, Recognizing human actions by fusing spatio-temporal appearance and motion descriptors, in: Proceedings of the 16th IEEE International Conference on Image Processing, ICIP'09, IEEE Press, Piscataway, NJ, USA, 2009, pp. 3533-3536.
41. Lederman S., Klatzky R.R.L. Hand movements: a window into haptic object recognition. Cognitive Psychology 1987, 19:342-368.