Inverse dynamics for action recognition

IEEE Transactions on Cybernetics

Volumn 43, Issue 4, 2013, Pages 1226-1236

  Mansur, Al ^a   Makihara, Yasushi ^a   Yagi, Yasushi ^a  

^a OSAKA UNIVERSITY   (Japan)

Author keywords

Action recognition; Dynamics feature; Hidden Markov model (HMM); Physics based model

Indexed keywords

ACTION RECOGNITION; CARNEGIE MELLON UNIVERSITY; CLASSIFICATION FRAMEWORK; CLASSIFICATION PERFORMANCE; GROUND REACTION FORCES; HUMAN-ACTION RECOGNITION; LOW-DIMENSIONAL REPRESENTATION; PHYSICS-BASED MODELING;

BIOPHYSICS; CLASSIFICATION (OF INFORMATION); DYNAMICS; GESTURE RECOGNITION; HIDDEN MARKOV MODELS; IMAGE RECOGNITION; KINEMATICS;

MOTION ESTIMATION;

AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BIOMECHANICS; HUMAN; MARKOV CHAIN; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PROCEDURES; VIDEORECORDING;

BIOMECHANICAL PHENOMENA; HUMANS; MARKOV CHAINS; MODELS, BIOLOGICAL; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; VIDEO RECORDING;

EID: 84890347265     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2226879     Document Type: Article

References (55)

1. L. Wang and D. Sutar, "Recognizing human activities from silhouettes: Motion subspace and factorial discriminative graphical model," in Proc. IEEE CVPR, 2007, pp. 1-8.
2. D. Weinland and E. Boyer, "Action recognition using exemplar-based embedding," in Proc. IEEE CVPR, 2008, pp. 1-7.
3. D. Tran and A. Sorokin, "Human activity recognition with metric learning," in Proc. ECCV, 2008, pp. 548-561.
4. S. Ali and M. Shah, "Human action recognition in videos using kinematic features and multiple instance learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 2, pp. 288-303, Feb. 2010.
5. R. Messing, C. Pal, and H. Kautz, "Activity recognition using the velocity histories of tracked keypoints," in Proc. ICCV, 2009, pp. 104-111.
6. J. Sun, X. Wu, S. Yan, L. Cheng, T. Chua, and J. Li, "Hierarchical spatio-temporal context modelling for action recognition," in Proc. IEEE CVPR, 2009, pp. 2004-2011.
7. A. Bissacco, A. Chiuso, and S. Soatto, "Classification and recognition of dynamical models: The role of phase, independent components, kernels and optimal transport," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 11, pp. 1958-1972, Nov. 2007.
8. R. Poppe, "A survey on vision-based human action recognition," Image Vis. Comput., vol. 28, no. 6, pp. 976-990, Jun. 2010.
9. Y. Sheikh, M. Sheikh, and M. Shah, "Exploring the space of a human action," in Proc. IEEE ICCV, 2005, pp. 144-149.
10. N. Ikizler and D. Forsyth, "Searching video for complex activities with finite state models," in Proc. IEEE CVPR, 2007, pp. 1-8.
11. F. Lv and R. Nevatia, "Single view human action recognition using key pose matching and Viterbi path searching," in Proc. IEEE CVPR, 2007, pp. 1-8.
12. P. Natarajan and R. Nevatia, "View and scale invariant action recognition using multiview shape-flow models," in Proc. IEEE CVPR, 2008, pp. 1-8.
13. C. Fanti, L. Zelnik-Manor, and P. Perona, "Hybrid models for human motion recognition," in Proc. IEEE ICCV, 2005, pp. 1166-1173.
14. A. Yilmaz and M. Shah, "Recognizing human actions in videos acquired by uncalibrated moving cameras," in Proc. IEEE ICCV, 2005, pp. 150-157.
15. S. Ali, A. Basharat, and M. Shah, "Chaotic invariants for human action recognition," in Proc. IEEE ICCV, 2007, pp. 1-8.
16. Y. Shen and H. Foroosh, "View-invariant action recognition from point triplets," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1898-1905, Oct. 2009.
17. J. Shotton, A.W. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. IEEE CVPR, 2011, pp. 1297-1304.
18. I. Oikonomidis, N. Kyriazis, and A. Argyros, "Efficient model-based 3d tracking of hand articulations using Kinect," in Proc. British Mach. Vis. Conf., 2011, pp. 101.1-101.11.
19. M. Ye, X. Wang, R. Yang, L. Ren, and M. Pollefeys, "Accurate 3d body pose estimation from a single depth image," in Proc. ICCV, 2011, pp. 1-7.
20. M. Vondrak, L. Sigal, and O. C. Jenkins, "Physical simulation for probabilistic motion tracking," in Proc. IEEE CVPR, 2008, pp. 1-8.
21. M. Brubaker and D. J. Fleet, "The kneed walker for human pose tracking," in Proc. IEEE CVPR, 2008, pp. 1-8.
22. M. Brubaker, L. Sigal, and D. Fleet, "Estimating contact dynamics," in Proc. IEEE ICCV, 2009, pp. 2389-2396.
23. C. Liu, A. Hertzmann, and Z. Popovic, "Learning physics based motion style with nonlinear inverse optimization," ACM Trans. Graph. (SIGGRAPH), vol. 24, no. 3, pp. 1071-1081, Jul. 2005.
24. A. Mansur, Y. Makihara, and Y. Yagi, "Action recognition using dynamics features," in Proc. IEEE ICRA, 2011, pp. 4020-4025.
25. P. Turaga, R. Chellappa, V. Subrahmanian, and O. Udrea, "Machine recognition of human activities: A survey," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1473-1488, Nov. 2008.
26. J. Yamato, J. Ohya, and K. Ishii, "Recognizing human action in time sequential images using hidden Markov model," in Proc. IEEE CVPR, 1992, pp. 379-385.
27. T. Starner and A. Pentland, "Visual recognition of American sign language using hidden Markov model," in Proc. Int. Workshop Autom. Face Gesture Recognit., 1995, pp. 1-52.
28. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. ICCV, 2005, pp. 1395-1402.
29. A. Yilmaz and M. Shah, "Actions sketch: A novel action representation," in Proc. IEEE CVPR, 2005, pp. 984-989.
30. E. Shechtman and M. Irani, "Space-time behavior based correlation," in Proc. IEEE CVPR, 2005, pp. 405-412.
31. A. Oikonomopoulous, I. Patras, and M. Pantic, "Spatiotemporal saliency for human action recognition," in Proc. IEEE Int. Conf. Multimedia Expo, 2005, pp. 1-4.
32. J. C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," in Proc. BMVC, 2006, pp. 1249-1258.
33. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. IEEE Int. Workshop VSPETS, 2005, pp. 65-72.
34. I. Laptev and T. Lindeberg, "Space time interest points," in Proc. IEEE ICCV, 2003, pp. 432-439.
35. I. Laptev and P. Pérez, "Retrieving actions in movies," in Proc. IEEE ICCV, 2007, pp. 1-8.
36. A. Kläser, M. Marszalek, and C. Schmid, "A spatio-temporal descriptor based on 3d-gradients," in Proc. BMVC, 2008, pp. 1-10.
37. H. Wang, M. M. Ullah, A. Kläser, I. Laptev, and C. Schmid, "Evaluation of local spatio-temporal features for action recognition," in Proc. BMVC, 2009, pp. 1-11.
38. L. Shao and R. Mattivi, "Feature detector and descriptor evaluation in human action recognition," in Proc. ACM Int. CIVR, 2010, pp. 477-484.
39. A. F. Bobick and J. Davis, "An appearance-based representation of action," in Proc. CVPR, 1996, pp. 307-312.
40. A. F. Bobick, "Movement, activity, and action: The role of knowledge in the perception of motion," Philos. Trans. Roy. Soc. Lond. B, vol. 352, no. 1358, pp. 1257-1265, Aug. 1997.
41. M. Yang, F. Lv, W. Xu, K. Yu, and Y. Gong, "Human action detection by boosting efficient motion features," in Proc. IEEE ICCV Workshop, 2009, pp. 522-529.
42. A. F. Bobick and J.W. Davis, "The recognition of human movement using temporal templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 257-267, Mar. 2001.
43. J. Kilner, J.-Y. Guillemaut, and A. Hilton, "3D action matching with key-pose detection," in Proc. IEEE ICCV Workshop Search 3D Video, 2009, pp. 1-8.
44. S. Moustakidis, J. Theocharis, and G. Giakas, "Subject recognition based on ground reaction force measurements of gait signals," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 6, pp. 1476-1485, Dec. 2008.
45. A. Y. Yang, R. Jafari, S. S. Sastry, and R. Bajcsy, "Distributed recognition of human actions using wearable motion sensor networks," J. Ambient Intell. Smart Environ., vol. 1, no. 2, pp. 103-115, Apr. 2009.
46. N. Ravi, N. Dandekar, P. Mysore, and M. Littman, "Activity recognition from accelerometer data," in Proc. 17th Conf. Innov. Appl. Artif. Intell., 2005, pp. 1541-1546.
47. P. de Leva, "Adjustments to Zatsiorsky-Seluyanov's segment inertia parameters," J. Biomech., vol. 29, no. 9, pp. 1223-1230, Sep. 1996.
48. B. Rosenhahn and T. Brox, "Scaled motion dynamics for markerless motion capture," in Proc. IEEE CVPR, 2007, pp. 1-8.
49. A. Balan, L. Sigal, M. J. Black, J. Davis, and H. Haussecker, "Detailed human shape and pose from images," in Proc. IEEE CVPR, 2007, pp. 1-8.
50. Online. Available: http://mocap.cs.cmu.edu/
51. Online. Available: http://www.am.sanken.osaka-u.ac.jp/~mansur/dataset. html
52. Online. Available: http://www.ipisoft.com/
53. M. Bregonzio, S. Gong, and T. Xiang, "Recognising action as clouds of space-time interest points," in Proc. IEEE CVPR, 2009, pp. 1948-1955.
54. Q. V. Le, W. Y. Zou, S. Y. Yeung, and A. Y. Ng, "Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis," in Proc. IEEE CVPR, 2011, pp. 3361-3368.
55. W. Li, Z. Zhang, and Z. Liu, "Action recognition based on a bag of 3D points," in Proc. IEEE CVPR Workshop, 2010, pp. 9-14.