Mimetic communication model with compliant physical contact in human-humanoid interaction

International Journal of Robotics Research

Volumn 29, Issue 13, 2010, Pages 1684-1704

  Lee, Dongheui ^a   Ott, Christian ^b   Nakamura, Yoshihiko ^c  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b GERMAN AEROSPACE CENTER DLR   (Germany)

^c UNIVERSITY OF TOKYO   (Japan)

Author keywords

imitation learning; impedance control; marker control; Mimetic communication; physical human robot interaction

Indexed keywords

HUMAN -ROBOT INTERACTIONS; IMITATION LEARNING; IMPEDANCE CONTROL; MARKER CONTROL; MIMETIC COMMUNICATION;

ANTHROPOMORPHIC ROBOTS; COMMUNICATION; HUMAN COMPUTER INTERACTION; INFORMATION THEORY; MAN MACHINE SYSTEMS; MOTION CONTROL; VIRTUAL REALITY;

HUMAN ROBOT INTERACTION;

EID: 78650346167     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364910364164     Document Type: Article

References (70)

1. Albu-Schäffer, A., Eiberger, O., Grebenstein, M., Haddadin, S., Ch. Ott, Wimboeck, T., Wolf, S., and Hirzinger, G. (2008). Soft robotics: From torque feedback controlled lightweight robots to intrinsically compliant systems. Robotics and Automation Magazine, 15 (3). 20-30.
2. Albu-Schäffer, A., Ott, Ch., Frese, U., and Hirzinger, G. (2003). Cartesian impedance control of redundant robots: Recent results with the DLR-light-weight-arms. IEEE International Conference on Robotics and Automation, 3704-3709.
3. Arnold, V. (1989). Mathematical Methods of Classical Mechanics, 2 nd edition. Berlin, Springer.
4. Asfour, T., Gyarfas, F., Azad, P., and Dillmann, R. (2006). Imitation learning of dual-arm manipulation tasks in humanoid robots. IEEE-RAS International Conference on Humanoid Robots, pp. 40-47.
5. Bicchi, A. and Tonietti, G. (2004). Dealing with the safety-performance tradeoff in robot arm design and control: fast and "soft-arm" tactics. IEEE Robotics and Automation Magazine, pp. 22-33.
6. Billard, A., Calinon, S., Dillmann, R., and Schaal, S. (2008). Robot Programming by Demonstration (Handbook of Robotics), Siciliano, B. and Khatib, O. (eds.). Berlin, Springer.
7. Billard, A., Calinon, S., and Guenter, F. (2006). Discriminative and adaptive imitation in uni-manual and bi-manual tasks. Robotics and Autonomous Systems, 54: 370-384.
8. Billard, A. and Dautenhahn, K. (1998). Grounding communication in autonomwous robots: experimetnal study. Robotics and Autonomous Systems, 24: 71-79.
9. Billard, A. and Hayes, G. (1998). Drama, a connectionist architecture for control and learning in autonomous robots. Adaptive Behaviour Journal, 7 (2). 35-64.
10. Breazeal, C. and Scassellati, B. (2002). Robots that imitate humans. Trends in Cognitive Science, 6 (11). 481-487.
11. Calinon, S. and Billard, A. (2007). Active teaching in robot programming by demonstration. IEEE International Conference on Robot and Human Interactive Communication, pp. 702-707.
12. Calinon, S. and Billard, A. (2008). A probabilistic programming by demonstration framework handling constraints in joint space and task space. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 367-372.
13. Calinon, S., Evrard, P., Gribovskaya, E., Billard, A., and Kheddar, A. (2009). Learning collaborative manipulation tasks by demonstration using a haptic interface. IEEE International Conference of Advanced Robotics.
14. Cheng, G., Hyon, S.-H., Morimoto, J., Ude, A., Colvin, G., Scroggin, W., and Jacobsen, S.C. (2006). CB: a humanoid research platform for exploring neuroscience. IEEE-RAS International Conference on Humanoid Robots.
15. Cox, M. and Cox, M. (2001). Multidimensional Scaling. London, Chapman and Hall.
16. Dariush, B., Gienger, M., Jian, B., Goerick, C., and Fujimura, K. (2008). Whole body humanoid control from human motion descriptors. IEEE International Conference on Robotics and Automation, pp. 2677-2684.
17. Demircan, E., Sentis, L., Sapio, V.D., and Khatib, O. (2008). Human motion reconstruction by direct control of marker trajectories. Advances in Robot Kinematics (ARK).
18. Dempster, A., Laird, N., and Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39 (1). 1-38.
19. Dillmann, R. (2004). Teaching and learning of robot tasks via observation of human performance. Robotics and Autonomous Systems, 47: 109-116.
20. Dixon, K.R., Dolan, J.M., and Khosla, P.K. (2004). Predictive robot programming: theoretical and experimental analysis. The International Journal of Robotics Research, 23: 955-973.
21. Donald, M. (1991). Origins of the Modern Mind. Cambridge, MA, Harvard University Press.
22. Eggert, D.W., Lorusso, A., and Fisher, R.B. (1997). Estimating 3-d rigid body transformations: a comparison of four major algorithms. Machine Vision and Applications, 9: 272-290.
23. Fod, A., Matari, M., and Jenkins, O. (2002). Automated derivation of primitives for movement classification. Autonomous Robots, 12 (1). 39-54.
24. Gallese, V., Fadiga, L., Fogassi, L., and Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119: 593-609.
25. Harville, D. (1997). Matrix Algebra from a Statistician's Perspective. Berlin, Springer.
26. Hirzinger, G., Sporer, N., Albu-Schäffer, A., Hähnle, M., Krenn, R., Pascucci, A., and Schedl, M. (2002). DLR's torque-controlled light weight robot III - are we reaching the technological limits now? IEEE International Conference on Robotics and Automation, pp. 1710-1716.
27. Hogan, N. (1985). Impedance control: an approach to manipulation, part I-theory. ASME Journal of Dynamic Systems, Measurement, and Control, 107: 1-7. (Pubitemid 15513933)
28. Horn, B.K.P. (1987). Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America, 4: 629-642.
29. Hunt, K. and Crossley, F. (1975). Coefficient of restitution interpreted as damping in vibroimpact. Transactions of the ASME: Journal of Applied Mechanics, 42: 440-445.
30. Ijspeert, A.J., Nakanishi, J., and Schaal, S. (2002). Movement imitation with nonlinear dynamical systems in humanoid robots. IEEE International Conference on Robotics and Automation, pp. 1398-1403.
31. Inamura, T., Nakamura, Y., and Toshima, I. (2004). Embodied symbol emergence based on mimesis theory. The International Journal of Robotics Research, 23 (4). 363-377.
32. Inamura, T., Tanie, H., and Nakamura, Y. (2003). From stochastic motion generation and recognition to geometric symbol development and manipulation. IEEE-RSJ International Conference on Humanoid Robots, 1b-02.
33. Janus, B. and Nakamura, Y. (2005). Unsupervised probabilistic segmentation of motion data for mimesis modeling. the 12th IEEE International Conference on Advanced Robotics, pp. 411-417.
34. Kanehiro, F., Suleiman, W., Lamiraux, F., Yoshida, E., and Laumond, J.-P. (2008). Integrating dynamics into motion planning for humanoid robots. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 660-667.
35. Khatib, O. (1987). A unified approach for motion and force control of robot manipulators: the operational space formulation. IEEE Journal of Robotics and Automation, 3 (1). 1115-1120.
36. Kosuge, K. and Hirata, Y. (2004). Human-robot interaction. IEEE International Conference on Robotics and Biomimetics, pp. 8-11.
37. Kuffner, J., Nishiwaki, K., Kagami, S., Inaba, M., and Inoue, H. (2001). Motion planning for humanoid robots under obstacle and dynamic balance constraints. IEEE International Conference on Robotics and Automation, pp. 692-698.
38. Kuli, D., Takano, W., and Nakamura, Y. (2007 a). Incremental on-line hierarchical clustering of whole body motion patterns. IEEE International Symposium on Robot and Human Interactive Communication.
39. Kuli, D., Takano, W., and Nakamura, Y. (2007 b). Representability of human motions by factorial hidden Markov models. IEEE/RSJ International Conference on Intelligent Robots and Systems.
40. Kuli, D., Takano, W., and Nakamura, Y. (2008). Combining automated on-line segmentation and incremental clustering for whole body motions. IEEE International Conference on Robotics and Automation, pp. 2591-2598.
41. Kunori, H., Lee, D., and Nakamura, Y. (2009). Associating and reshaping of whole body motions for object manipulation. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5240-5247.
42. Lee, D., Kuli, D., and Nakamura, Y. (2008 a). Missing motion data recovery using factorial hidden markov models. IEEE International Conference on Robotics and Automation, pp. 1722-1728.
43. Lee, D., Kunori, H., and Nakamura, Y. (2008 b). Association of whole body motion from tool knowledge for humanoid robots. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2867-2874.
44. Lee, D. and Nakamura, Y. (2005). Mimesis from partial observations. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1911-1916.
45. Lee, D. and Nakamura, Y. (2010). Mimesis model from partial observations for a humanoid robot. The International Journal of Robotics Research, 29 (1). 60-80.
46. Lee, D., Ott, C., and Nakamura, Y. (2009). Mimetic communication with impedance control for physical human-robot interaction. IEEE International Conference on Robotics and Automation, pp. 1535-1542.
47. Marhefka, D.W. and Orin, D.E. (1999). A compliant contact model with nonlinear damping for simulation of robotic systems. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 29 (6). 565-572.
48. Murray, R., Li, Z., and Sastry, S. (1994). A Mathematical Introduction to Robotic Manipulation. Boca Raton, FL, CRC Press.
49. Nagai, Y., Hosoda, K., Morita, A., and Asada, M. (2003). A constructive model for the development of joint attention. Connection Science, 15 (4). 211-229.
50. Nakamura, Y., Takano, W., and Yamane, K. (2005). Mimetic communication theory for humanoid robots interacting with humans. International Symposium of Robotics Research, pp. 12-15.
51. Nakamura, Y. and Yamane, K. (2000). Dynamics computation of structure-varying kinematic chains and its application to human figures. IEEE Transactions on Robotics, 16 (2). 124-134.
52. Nakaoka, S., Nakazawa, A., Kanahiro, F., Kaneko, K., Morisawa, M., and Ikeuchi, K. (2005). Task model of lower body motion for a biped humanoid robot to imitate human dances. IEEE/ RSJ International Conference on Intelligent Robots and Systems, pp. 2769-2774.
53. Okada, M., Tatani, K., and Nakamura, Y. (2002). Polynomial design of the nonlinear dynamics for the brain-like information processing of whole body motion. IEEE International Conference on Robotics and Automation, pp. 1410-1415.
54. Ott, C., Lee, D., and Nakamura, Y. (2008). Motion capture based human motion recognition and imitation by direct marker control. IEEE-RAS International Conference on Humanoid Robots, pp. 399-405.
55. Ott, Ch., Eiberger, O., Friedl, W., Bäuml, B., Hillenbrand, U., Borst, C. h., Albu-Schäffer, A., Brunner, B., Hirschmüller, H., Kielhöfer, S., Konietschke, R., Suppa, M., Wimböck, T., Zacharias, F., and Hirzinger, G. (2006). A humanoid two-arm system for dexterous manipulation. IEEE-RAS International Conference on Humanoid Robots, pp. 276-283.
56. Peters, J., Vijayakumar, S., and Schaal, S. (2003). Reinforcement Learning for Humanoid Robotics.
57. Pollard, N., Hodgins, J., Riley, M., and Atkeson, C. (2002). Adapting human motion for the control of a humanoid robot. IEEE International Conference on Robotics and Automation, pp. 1390-1397.
58. Rabiner, L.R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings IEEE, 77 (2). 257-286.
59. Rizzolatti, G. and Arbib, M. (1998). Language within our grasp. Trend in Neurosciences, 21: 151-152.
60. Rizzolatti, G. and Craighero, L. (2004). The mirror-neuron system. Annual Reviews of Neuroscience, 27: 169-192.
61. Rizzolatti, G., Fadiga, L., Gallese, V., and Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 3: 131-141. (Pubitemid 26094162)
62. Santis, A.D., Siciliano, B., Luca, A.D., and Bicchi, A. (2008). An atlas of physical humanrobot interaction. Mechanism and Machine Theory, 43 (3). 25327 0.
63. Schaal, S. (1999). Is imitation learning the route to humanoid robots ? Trends in Cognitive Sciences, 3 (6). 233-242.
64. Schaal, S., Ijspeert, A., and Billard, A. (2003). Computational approaches to motor learning by imitation. Philosophical Transaction of the Royal Society of London: Series B, Biological Sciences, 358: 537-547.
65. Shibata, T., Tashima, T., and Tanie, K. (1999). Emergence of emotional behavior through physical interaction between human and robot. IEEE International Conference on Robotics and Automation, pp. 2868-2873.
66. Sumioka, H., Yoshikawa, Y., and Asada, M. (2008). Learning of joint attention from detecting causality based on transfer entropy. Journal of Robotics and Mechatronics, 20 (3). 378-385.
67. Takano, W. and Nakamura, Y. (2006). Humanoid robot's autonomous acquisition of proto-symbols through motion segmentation. IEEE-RAS International Conference on Humanoid Robots, pp. 425-431.
68. Takano, W., Yamane, K., Sugihara, T., Yamamoto, K., and Nakamura, Y. (2006). Primitive communication based on motion recognition and generation with hierarchical mimesis model. IEEE International Conference on Robotics and Automation, pp. 3602-3609.
69. Tani, J. and Ito, M. (2003). Self-organization of behavioral primitives as multiple attractor dynamics: a robot experiment. IEEE Transactions on Systems, Man, and Cybernetics. Part A: Systems and Humans, 33 (4). 481-488.
70. Zinn, M., Khatib, O., Roth, B., and Salisbury, J. (2004). A new actuation concept for human-friendly robot design: Playing it safe. IEEE Robotics and Automation Magazine, pp. 12-21.