From motion capture to action capture: A review of imitation learning techniques and their application to VR-based character animation

Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Volumn , Issue , 2006, Pages 145-154

  Jung, Bernhard ^a   Amor, Heni Ben ^a   Heumer, Guido ^a   Weber, Matthias ^a  

^a TU BERGAKADEMIE FREIBERG   (Germany)

Author keywords

Action capture; Character animation; Imitation learning; Motion capture; Virtual reality

Indexed keywords

ANIMATION; IMAGE ACQUISITION; ROBOTICS; THREE DIMENSIONAL COMPUTER GRAPHICS; USER INTERFACES; VIRTUAL REALITY;

ACTION CAPTURE; ACTION REPRESENTATIONS; CHARACTER ANIMATION; MOTION CAPTURE;

LEARNING SYSTEMS;

EID: 34547467245     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1180495.1180526     Document Type: Conference Paper

References (29)

1. J. Aleotti, S. Caselli, and M. Reggiani. Leveraging on a Virtual Environment for Robot Programming by Demonstration. In IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems IROS 2003, Workshop on Robot Programming by Demonstration, Las Vegas (USA), 2003.
2. A. Alissandrakis, C. L. Nehaniv, and K. Dautenhahn. Imitation with ALICE: Learning to Imitate Corresponding Actions Across Dissimilar Embodiments. IEEE Trans. Systems, Man and Cybernetics, 32(4):482-296, 2002.
3. M. A. Arbib. The mirror system, imitation, and the evolution of language. In Dautenhahn and Nehaniv [7].
4. P. Bakker and Y. Kuniyoshi. Robot see, Robot do: An Overview of Robot Imitation. In AISB96 Workshop: Learning in Robots and Animals, pages 3-11, 1996.
5. A. Billard and R. Siegwart, editors. Special Issue on Robot Learning from Demonstration, volume 47 of Robotics and Autonomous Systems, 2004.
6. D. Buchsbaum and B. Blumberg. Imitation as a First Step to Social Learning In Synthetic Characters: A Graph-based Approach. In SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pages 9-18, New York, NY, USA, 2005. ACM Press.
7. K. Dautenhahn and C. Nehaniv, editors. Imitation in Animals and Artifacts. MIT Press, 2002.
8. R. Dillmann, M. Ehrenmann, P. Steinhaus, O. Rogalla, and R. Zöllner. Human Friendly Programming of Humanoid Robots: The German Collaborative Research Center. In IARP 2002, 2002.
9. M. Gleicher. Retargetting Motion to New Characters. In SIGGRAPH'98 Conference Proceedings, Computer Graphics Annual Conference Series, pages 33-42. ACM, 1998.
10. G. Heumer, H. Ben Amor, M. Weber, and B. Jung. Calibration-free Recognition of Grasp Types - A Comparison of Classification Methods. In Proceedings Dritter Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR, 2006.
11. A. Ijspeert, J. Nakanishi, and S. Schaal. Movement Imitation with Nonlinear Dynamical Systems in Humanoid Robots. In IEEE International Conference on Robotics and Automation, 2002.
12. S. Kopp and O. Graeser. Imitation Learning and Response Facilitation in Embodied Agents. In Intelligent Virtual Agents 2006, LNAI, pages 28-41. Springer-Verlag, Berlin, 2006.
13. L. Kovar, M. Gleicher, and F. Pighin. Motion Graphs. ACM Transactions on Graphics, 21(3), 2002.
14. M. Mataric. Getting Humanoids to Move and Imitate. IEEE Intelligent Systems, pages 18-24, July/August 2000.
15. M. Mataric. Sensory-motor primitives as a basis for learning by imitation: Linking perception to action and biology to robotics. In Dautenhahn and Nehaniv [7].
16. A. N. Meltzoff. The Human Infant as Imitative Generalist: A 20-year Progress Report on Infant Imitation with Implications for Comparative Psychology. In Social Learning in Animals: The Roots of Culture, pages 347-370, 1996.
17. J. Nakanishi, J. Morimoto, G. Endo, G. Cheng, S. Schaal, and M. Kawato. Learning from Demonstration and Adaptation of Biped Locomotion. Robotics and Autonomous Systems, 47(2-3):79-91, 2004.
18. C. Nehaniv and K. Dautenhahn. The Correspondence Problem. In Dautenhahn and Nehaniv [7], pages 41-61.
19. E. Oztop and M. Arbib. Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics, 87:116-140, 2002.
20. J. Piaget. Play, Dreams and Imitation in Childhood. New York: W. W. Norton, 1962.
21. R. Rao, A. P. Shon, and A. N. Meltzoff. A Bayesian Model of Imitation in Infants and Robots. In Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions, 2004.
22. C. Reynolds. Flocks, Herds and Schools: A Distributed Behavioural Model. Computer Graphics, 21(4):25-34, 1987.
23. G. Rizzolatti, L. Fogassi, and V. Gallese. Neurophysiological Mechanisms Underlying the Understanding and Imitation of Action. Nature Reviews Neuroscience, pages 661-770, September 2001.
24. G. Schlesinger. Der Mechanische Aufbau der Kunstlichen Glieder. In M. Borchardt et al., editors, Ersatzglieder und Arbeitshilfen für Kriegsbeschädigte und Unfallverletzte, pages 321-661. Springer-Verlag: Berlin, Germany, 1919.
25. C. Taylor and R. Schwarz. The Anatomy and Mechanics of the Human Hand. Artificial Limbs, 2:22-35, 1955.
26. E. L. Thorndike. Animal Intelligence: An Experimental Study of the Associative Processes in Animals. Psychological Review Monographs, 8, 1898.
27. B. Tomlinson. From Linear to Interactive Animation: How Autonomous Characters Change the Process and Product of Animating. ACM Computers In Entertainment, 3(1), 2005.
28. A. Witkin and M. Kass. Spacetime Constraints. In SIGGRAPH'88 Conference Proceedings, volume 22, pages 159-168. ACM, 1988.
29. V. B. Zordan, A. Majkowska, B. Chiu, and M. Fast. Dynamic Response for Motion Capture Animation. ACM Transactions on Graphics, 24(3):697-701, 2005.