Learning to select and generalize striking movements in robot table tennis

International Journal of Robotics Research

Volumn 32, Issue 3, 2013, Pages 263-279

  Mülling, Katharina ^a,b   Kober, Jens ^a,b   Kroemer, Oliver ^b   Peters, Jan ^a,b  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

generalizing movements; motor skill learning; robot learning; robot table tennis

Indexed keywords

ANTHROPOMORPHIC ROBOT ARM; GENERALIZING MOVEMENTS; HITTING MOVEMENTS; MACHINE LEARNING APPROACHES; MOTOR PRIMITIVES; MOTOR SKILL LEARNING; PHYSICAL INTERACTIONS; TABLE-TENNIS;

DYNAMICAL SYSTEMS; LEARNING SYSTEMS; ROBOT LEARNING; SPORTS; TEACHING;

HUMAN ROBOT INTERACTION;

EID: 84876259942     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364912472380     Document Type: Article

References (50)

1. Acosta L, Rodrigo J, Mendez J, Marchial G, Sigut M. Ping-pong player prototype. IEEE Robotics and Automation Magazine. 2003 ; 10 (4). 44-52
2. Andersson R A Robot Ping-pong Player: Experiment in Real-time Intelligent Control. Cambridge, MA: MIT Press ; 1988 :
3. Argall B, Chernova S, Veloso M, Browning B. A survey of robot learning from demonstration. Robotics and Autonomous System. 2009 ; 57: 469-483
4. Billard A, Calinon S, Dillmann R, Schaal S Robot Programming by Demonstration. New York: Springer ; 2008: 1371-1394.
5. Bishop C Pattern Recognition and Machine Learning. New York: Springer ; 2006 :
6. Bishop C, Tipping M Bayesian Regression and Classification. IOS Press ; 2003: 267-289.
7. Bitzer S, Howard M, Vijayakumar S. Using dimensionality reduction to exploit constraints in reinforcement learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) ; 2010 ; 2010.
8. Calinon S, Guenter F, Billard A. On learning, representing, and generalizing a task in a humanoid robot. IEEE Transactions on Systems, Man and Cybernetics. 2007 ; 32: 286-298
9. Chiappa S, Kober J, Peters J. Using bayesian dynamical systems for motion template libraries. Advances in Neural Information Processing Systems (NIPS). 2008 ; vol. 22 :
10. Fässler H, Beyer HA, Wen JT. A robot ping pong player: optimized mechanics, high performance 3D vision, and intelligent sensor control. Robotersysteme. 1990 ; 6: 161-170
11. Flash T, Hogan N. The coordination of arm movements: an experimentally confirmed mathematical model. Journal of Neurosciences. 1985 ; 5: 1688-1703
12. Giszter S, Moxon K, Rybak I J C. Neurobiological and neurorobotic approaches to control architectures for a humanoid motor system. Intelligent Systems and their Applications. 2000 ; 15: 64-69
13. Guenter F, Hersch M, Calinon S, Billard A. Reinforcement learning for imitating constrained reaching movements. Advanced Robotics. 2007 ; 21 (13). 1521-1544
14. Hartley J. Toshiba progress towards sensory control in real time. The Industrial Robot. 1987 ; 14: 50-52
15. Hashimoto H, Ozaki F, Asano K, Osuka K. Development of a ping pong robot system using 7 degrees of freedom direct drive. Industrial Applications of Robotics and Machine Vision (IECON). 1987 ;: 608-615
16. Huang Y, Xu D, Tan M, Su H. Trajectory prediction of spinning ball for ping-pong robot. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems ; 2011 ; 2011. 3434.
17. Ijspeert AJ, Nakanishi J, Schaal S. Movement imitation with nonlinear dynamical systems in humanoid robots. IEEE International Conference on Robotics and Automation (ICRA) ; 2002 ; 2002.
18. International Table Tennis Federation (2011) Table tennis rules. http://www.ittf.com/ittf-handbook/hb.asp?s-number=2.
19. Jacobs R, Jordan M, Nowlan S, Hilton G. Adaptive mixures of local experts. Neural Computation. 1991 ; 3: 79-87
20. Knight J, Lowery D. Pingpong-playing robot controlled by a microcomputer. Microprocessors and Microsystems. 1986 ; 10: 332-335
21. Kober J, Mohler B, Peters J. Learning perceptual coupling for motor primitives. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) ; 2008 ; 2008.
22. Kober J, Muelling K, Kroemer O, Lampert C, Schölkopf B, Peters J. Movement templates for learning of hitting and batting. IEEE International Conference on Robotics and Automation (ICRA) ; 2010 ; 2010.
23. Kober J, Peters J. Policy search for motor primitives in robotics. Advances in Neural Information Processing Systems (NIPS). 2009 ; vol. 21 :
24. Kober J, Wilhelm A, Oztop E, Peters J. Reinforcement learning to adjust parametrized motor primitives to new situations. Autonomous Robots. 2012 ;:
25. Kroemer O, Detry R, Piater J, Peters J. Grasping with vision descriptors and motor primitives. Proceedings of the International Conference on Informatics in Control, Automation and Robotics (ICINCO) ; 2010 ; 2010.
26. Lai C, Tsay J. Self-learning for a humanoid robot ping-pong player. Advanced Robotics. 2011 ; 25: 1183-1208
27. Lampert C, Peters J. Real-time detection of colored objects in multiple camera streams with off-the-shelf hardware components. Journal of Real-Time Image Processing. 2012 ; 7: 31-41
28. Miyamoto H, Schaal S, Gadolfo F, et al. A Kendama learning robot based on bi-directional theory. Neural Networks. 1996 ; 9: 1281-1302
29. Miyazaki F, Matsushima M, Takeuchi M Advances in Robot Control. New York: Springer ; 2005: 3137-341.
30. Muelling K, Kober J, Kroemer O, Peters J. Learning to select and generalize striking movements in robot table tennis. Proceedings of the AAAI 2012 Fall Symposium on robots that Learn Interactively from Human Teachers ; 2012 ; 2012.
31. Muelling K, Kober J, Peters J. Learning table tennis with a mixture of motor primitives. 10th IEEE-RAS International Conference on Humanoid Robots (HUMANOIDS) ; 2010 ; 2010.
32. Muelling K, Kober J, Peters J. A biomimetic approach to robot table tennis. Adaptive Behavior. 2011 ; 19: 359-376
33. Nakanishi J, Morimoto J, Endo G, Cheng G, Schaal S, Kawato M. Learning from demonstration and adaption of biped locomotion. Robotics and Autonomous Systems. 2004 ; 47 (2-3). 79-91
34. Ning K, Kulvicius T, Tamosiunaite M, Wörgötter F. Accurate position and velocity control for trajectories based on dynamic movement primitives. IEEE International Conference on Robotics and Automation (ICRA) ; 2011 Shanghai, China ; 2011. 5006.
35. Park D, Hoffmann H, Pastor P, Schaal S. Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields. IEEE International Conference on Humanoid Robots (Humanoids) ; 2008 ; 2008. 91.
36. Peters J, Schaal S. Policy gradient methods for robotics. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) ; 2006 ; 2006.
37. Peters J, Schaal S. Natural actor-critic. Neurocomputing. 2008 a ; 71: 1180-1190
38. Peters J, Schaal S. Reinforcement learning of motor skills with policy gradients. Neural Networks. 2008 b ; 21: 682-697
39. Pongas D, Billard A, Schaal S. Rapid synchronization and accurate phase-locking of rhythmic motor primitives. IEEE/RSJ International Conference Intelligent Robots and Systems ; 2005 ; 2005. 2911.
40. Rasmussen C, Williams C Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press ; 2006 :
41. Schaal S. Is imitation learning the route to humanoid robots?. Trends in Cognitive Sciences. 1999 ; 6: 233-242
42. Schaal S, Atkeson CG, Vijayakumar S. Scalable techniques from nonparameteric statistics for real-time robot learning. Applied Intelligence. 2002 ; 1: 49-60
43. Schaal S, Ijspeert A, Billard A. Computational approaches to motor learning by imitation. Philosophical Transaction of the Royal Society of London: Series B, Biological Sciences. 2003 a ; 358: 537-547
44. Schaal S, Mohajerian P, Ijspeert A. Dynamics systems vs. optimal control - a unifying view. Progress in Brain Research. 2007 ; 165: 425-445
45. Schaal S, Peters J, Nakanishi J, Ijspeert A. Learning motor primitives. International Symposium on Robotics Research (ISRR) ; 2003 b ; 2003 b.
46. Ude A, Gams A, Asfour T, Morimoto J. Task-specific generalization of discrete and periodic dynamic movement primitives. IEEE Transactions on Robotics. 2010 ; 26: 800-815
47. Wang Z, Deisenroth M, Amor H, Vogt D, Schoelkopf B, Peters J. Probabilistic modeling of human movements for intention inference. Proceedings of Robotics: Science and Systems (RSS). 2012 ;:
48. Wikipedia (2012) Fosbury Flop. http://en.wikipedia.org/wiki/Fosbury-Flop.
49. Williams B, Toussaint M, Storkey A. Modelling motion primitives and their timing in biologically executed movements. Advances in Neural Information Processing Systems (NIPS). 2008 ; vol. 20: 1609-1616
50. Zhang Z, Xu D, Tau M. Visual measurements and prediction of ball trajectory for table tennis robot. IEEE Transactions on Instrumentation and Measurements. 2010 ; 59: 3195-3205