Learning full-body motions from monocular vision: Dynamic imitation in a humanoid robot

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2007, Pages 240-246

  Cole, Jeffrey B ^a   Grimes, David B ^a   Rao, Rajesh P N ^a  

^a University of Washington   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER NETWORKS; COMPUTER VISION; IMAGE PROCESSING; INTELLIGENT ROBOTS; INTELLIGENT SYSTEMS; MOTORS; PHOTOGRAPHY; ROBOTICS; THREE DIMENSIONAL; VIDEO RECORDING;

MOTOR COMMANDS;

ROBOT PROGRAMMING;

EID: 51349135744     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2007.4399578     Document Type: Conference Paper

References (25)

1. R. P. Rao, A. Shon, and A. Meltzoff, "A bayesian model of imitation in infants and robots," in Imitation and Social Learning in Robots, Humans, and Animals. Cambridge University Press, 2005.
2. M. Y. Kuniyoshi and H. Inoue, "Learning by watching: Extracting reusable task knowledge from visual observation of human performance" ieee transaction on robotics and automation, vol.10, no.6, pp.799-822, dec., 1994."
3. C. Atkeson and S. Schaal, "Robot learning from demonstration," pp. 12-20, 1997.
4. K. Yamane and Y. Nakamura, "Dynamics filter - concept and implementation of on-line motion generator for human figures," IEEE Transactions on Robotics and Automation, vol. 19, no. 3, pp. 421-432, 2003.
5. T. Inamura, I. Toshima, and Y Nakamura. "Acquiring motion elements for bi-directional computation of motion recognition and generation," in Siciliano, B., Dario, P., Eds., Experimental Robotics VIII. Springer, 2003, pp. 372-381.
6. Y Takahashi, K. Hikita, and M. Asada, "Incremental purposive behavior acquisition based on self-interpretation of instructions by coach," in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2003, pp. 686-693.
7. Y. Katsu and N. Yoshihiko, "Dynamics filter-concept and implementation of online motion generator for human figures," IEEE Transactions on Robotics and Automation, vol. 19, pp. 421-432, 2003.
8. Y. N. M. Okada, K. Tatani, "Polynomial design of the nonlinear dynamics for the brain-like information processing of the whole body motion," in IEEE International Conference on Robotics and Automation, 2002, pp. 1410-1415.
9. A. Billard and M. Mataric, "Learning human arm movements by imitation: Evaluation of a biologically-inspired connectionist architecture," Robotics and Autonomous Systems, no. 941, 2001.
10. S. Calinon, F. Guenter. and A. Billard, "On learning, representing and generalizing a task in a humanoid robot," IEEE Transactions on Systems, Man and Cybernetics, Part B. Special issue on robot learning by observation, demonstration and imitation, vol. 37, no. 2, pp. 286-298, 2007.
11. D. Hogg, "Model-based vision: A program to see a walking person," Image Vision Computing, vol. 5, no. 20, 1983.
12. K. Rohr, "Towards model-based recognition of human movements in image sequences," CVGIP: Image Underst., vol. 59, no. 1, pp. 94-115, 1994.
13. D. M. Gavrila and L. S. Davis, "3-d model-based tracking of humans in action: a multi-view approach," in CVPR '96: Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96). IEEE Computer Society, 1996, p. 73.
14. I. A. Kakadiaris and D. Metaxas, "Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, CVPR. Los Alamitos, California, U.S.A.: IEEE Computer Society, 18-20 1996, pp. 81-87. [Online]. Available: citeseer.ist.psu.edu/kakadiaris96modelbased.html
15. S. X. Ju, M. J. Black, and Y. Yacoob, "Cardboard people: A parameterized model of articulated image motion," in FG '96: Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96). IEEE Computer Society, 1996, p. 38.
16. L. Sigal, S. Bhatia, S. Roth, M. J. Black, and M. Isard, "Tracking loose-limbed people," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, vol. I, June 2004, pp. 421-428.
17. D. Ramanan and D. A. Forsyth, "Finding and tracking people from the bottom up," in Conference on Computer Vision and Pattern Recognition, vol. II. IEEE Computer Society, June 2003, pp. 467-474. [Online]. Available: http://citeseer.ist.psu.edu/ramanan03finding.html
18. V. Pavlovic, J. M. Rehg, T.-J. Cham, and K. P. Murphy, "A dynamic bayesian network approach to figure tracking using learned dynamic models," in ICCV (1), 1999, pp. 94-101. [Online]. Available: citeseer.ist.psu. edu/pavlovic99dynamic.html
19. C. Bregler and J. Malik, "Tracking people with twists and exponential maps," in Conference on Computer Vision and Pattern Recognition, vol. I. IEEE Computer Society, June 1998, pp. 8-15. [Online]. Available: http://citeseer.ist.psu.edu/context/2038698/0
20. J. Lee, J. Chai, P. Reitsma, J. Hodgins, and N. Pollard, "Interactive control of avatars animated with human motion data," 2002. [Online]. Available: citeseer.ist.psu.edu/lee02interactive.html
21. Y. N. Dongheui Lee, "Mimesis scheme using a monocular vision system on a humanoid," in Robotics and Automation, 2007 IEEE International Conference on, 2007, pp. 2162-2168.
22. D. B. Grimes, R. Chalodhorn, and R. P. N. Rao, "Dynamic imitation in a humanoid robot through nonparametric probabilistic inference," in Proceedings of Robotics: Science and Systems (RSS'06). Cambridge, MA: MIT Press, 2006.
23. D. B. Grimes, D. R. Rashid, and R. P. N. Rao, "Learning nonparametric models for probabilistic imitation," in Advances in Neural Information Processing Systems 19 (NIPS'06). Cambridge, MA: MIT Press, 2007.
24. E. B. Sudderth, A. T. Ihler, W. T. Freeman, and A. S. Willsky, "Nonparametric belief propagation." in CVPR (1), 2003, pp. 605-612.
25. C. E. Rasmusen and C. Williams, Gaussian Processes for Machine Learning. Cambridge, MA, USA: MIT Press, 2006.