Interactive human pose and action recogniton using dynamical motion primitives

International Journal of Humanoid Robotics

Volumn 4, Issue 2, 2007, Pages 365-385

  Jenkins, Odest Chadwicke ^a   Serrano, Germán González ^b   Loper, Matthew M ^a  

^a Brown Univerity   (United States)

^b EPFL   (Switzerland)

Author keywords

Action recognition; Markerless motion capture; Motor primitives; Pose estimation

Indexed keywords

ACTION RECOGNITION; MARKERLESS MOTION CAPTURE; MOTOR PRIMITIVES; POSE ESTIMATION;

COMPUTER VISION; DECISION MAKING; KINEMATICS; MOTION PLANNING; ROBOTICS;

MOTION ESTIMATION;

EID: 34447331277     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843607001060     Document Type: Article

References (30)

1. T. Fong, I. Nourkbaksh and K. Daoutenhahn, A survey of socially interactive robots: Concepts, design and applications, Carnegie Mellon University Robotics Institute, Pittsburgh, PA, Technical Report CMU-RI-TR02-29 (November 2002).
2. O. C. Jenkins and M. J. Matarić, Performance-derived behavior vocabularies: Data-driven acqusition of skills from motion, Int. J. Humanoid Robot. 1(2) (2004) 237-288.
3. M. Isard and A. Blake, Condensation - Conditional density propagation for visual tracking, Int. J. Comput. Vision 29(1) (1998) 5-28.
4. S. Thrun, W. Burgard and D. Fox, Probabilistic Robotics (MIT Press, Cambridge, MA, 2005).
5. M. J. Matarić, Sensory-motor primitives as a basis for imitation: Linking perception to action and biology to robotics, in Imitation in Animals and Artifacts, eds. C. Nehaniv and K. Dautenhahn (MIT Press, 2002), pp. 392-422.
6. F. Mussa-Ivaldi and E. Bizzi, Motor learning through the combination of primitives, Phil. Trans. R. Soc. Lond. B 355 (2000) 1755-1769.
7. N. Hogan, The mechanics of posture and movement, Biol. Cybernet. 52 (1985) 315-331.
8. G. Rizzolatti, L. Gadiga, V. Gallese and L. Fogassi, Premotor cortex and the recognition of motor actions, Cogn. Brain Res. 3 (1996) 131-141.
9. O. C. Jenkins and M. J. Matarić, A spatio-temporal extension to isomap nonlinear dimension reduction, in Int. Cont. Machine Learning (ICML), Banff, Alberta, Canada, (ACM Press, 2004), p. 56.
10. N. Kojo, T. Inamura, K. Okada and M. Inaba, Gesture recognition for humanoids using proto-symbol space, in IEEE Int. Conf. Humanoid Robots (Humanoids 2006), Detroit, USA (IEEE Press, 2006), pp. 76-81.
11. A. J. Ijspeert, J. Nakanishi and S. Schaal, Trajectory formation for imitation with nonlinear dynamical systems, in IEEE Intelligent Robots and Systems (IROS 2001), Maui, Hawaii, USA (IEEE Press, 2001), pp. 752-757.
12. D. C. Bentivegna and C. G. Atkeson, Learning from observation using primitives, in IEEE Int. Conf. Robotics and Automation, Seoul, Korea (IEEE Press, 2001), pp. 1988-1993.
13. R. A. Grupen, M. Huber, J. A. Coehlo Jr. and K. Souccar, A basis for distributed control of manipulation tasks, IEEE Expert 10(2) (1995) 9-14.
14. R. Platt, A. H. Fagg and R. R. Grupen, Manipulation gaits: Sequences of grasp control tasks, in IEEE Cont. Robotics and Automation, New Orleans, LA, USA (IEEE Press, 2004), pp. 801-806.
15. S. Knoop, S. Vacek and R. Dillmann, Sensor fusion for 3D human body tracking with an articulated 3D body model, in IEEE Int. Conf. Robotics and Automation, Orlando, Florida, USA (IEEE Press, 2006), pp. 1686-1691.
16. R. Urtasun, D. J. Fleet, A. Hertzmann and P. Fua, Priors for people tracking from small training sets, in Int. Conf. Computer Vision (ICCV), Vol. 1, Beijing, China (IEEE Press, 2005), pp. 403-410.
17. L. Kovar and M. Gleicher, Automated extraction and parameterization of motions in large data sets, ACM Trans. Graph. 23(3) (2004) 559-568.
18. J. Deutscher, A. Blake and I. Reid, Articulated body motion capture by annealed particle filtering, in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Vol. 2, Hilton Head, SC, USA (IEEE Press, 2000), pp. 126-133.
19. L. Sigal, S. Bhatia, S. Roth, M. J. Black and M. Isard, Tracking loose-limbed people, in Computer Vision and Pattern Recognition (CVPR), Vol. 1, Washington D. C., USA (IEEE Press, 2004), pp. 421-428.
20. E. B. Sudderth, A. T. Ihler, W. T. Freeman and A. S. Willsky, Nonparametric belief propagation, in CVPR, Vol. 1, Madison, Wisconsin, USA (IEEE Computer Society, 2003), pp. 605-612.
21. T. Darrell and A. Pentland, Active gesture recognition using learned visual attention, in Advances in Neural Information Processing Systems, eds. D. S. Touretzky, M. C. Mozer and M. E. Hasselmo, Vol. 8 (MIT Press, 1996), pp. 858-864.
22. D. Ramanan and D. A. Forsyth, Automatic annotation of everyday movements, in Neural Information Processing Systems (NIPS), Vancouver and Whistler, Canada (MIT Press, 2003), pp. 1547-1554.
23. J. Wang, D. J. Fleet and A. Hertzmann, Gaussian process dynamical models, in Neural Information Processing Systems (NIPS), Vancouver and Whistler, Canada (MIT Press, 2003), pp. 1441-1448.
24. E. Huber and D. Kortenkamp, A behavior-based approach to active stereo vision for mobile robots, Eng. Appl. Artif. Intell. 11 (1998) 229-243.
25. H. D. Yang, A. Y. Park and S. W. Lee, Gesture spotting and recognition for human-robot interaction, IEEE Trans. Robot. 23 (2007) 256-270.
26. C. Rose, M. F. Cohen and B. Bodenheimer, Verbs and adverbs: Multidimensional motion interpolation, IEEE Comput. Graph. Appl. 18(5) (1998) 32-40.
27. N. R. Howe, M. E. Leventon and W. T. Freeman, Bayesian reconstruction of 3D human motion from single-camera video, Advances in Neural Information Processing Systems (NIPS), Vancouver and Whistler, Canada (MIT Press, 2000).
28. E. Ong, A. Hilton and A. Micilotta, Viewpoint invariant exemplar-based 3D human tracking, Comput. Vision Image Understand. 104(2) (2006) 178-189.
29. P. Wrotek, O. Jenkins and M. McGuire, Dynamo: Dynamic data-driven character control with adjustable balance, in Proc. Sandbox Symp. Video Games, Boston, MA, USA (ACM Press, 2006).
30. M. Nicolescu, O. Jenkins and A. Olenderski, Learning behavior fusion estimation from demonstration, in IEEE Int. Symp. Robot and Human Interactive Communication (RO-MAN 2006), Hatfield, United Kingdom (IEEE Press, 2006), pp. 340-345.