Probabilistic movement modeling for intention inference in human-robot interaction

International Journal of Robotics Research

Volumn 32, Issue 7, 2013, Pages 841-858

  Wang, Zhikun ^a,b   Mülling, Katharina ^a,b   Deisenroth, Marc Peter ^b   Ben Amor, Heni ^b   Vogt, David ^c   Schölkopf, Bernhard ^a   Peters, Jan ^a,b  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^c TU BERGAKADEMIE FREIBERG   (Germany)

Author keywords

Approximate inference; Gaussian process; intention inference

Indexed keywords

ACTION RECOGNITION; APPROXIMATE INFERENCE; GAUSSIAN PROCESSES; INFERENCE ALGORITHM; INTENTION INFERENCE; ON-LINE ALGORITHMS; REAL TIME CONSTRAINTS; ROBOTICS APPLICATIONS;

ALGORITHMS; ANTHROPOMORPHIC ROBOTS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); HUMAN ROBOT INTERACTION; MAN MACHINE SYSTEMS;

INFERENCE ENGINES;

EID: 84879913764     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364913478447     Document Type: Conference Paper

References (60)

1. Abbeel P, Ng A. Apprenticeship learning via inverse reinforcement learning. International Conference on Machine Learning ; 2004 ; 2004..
2. Anderson R A Robot Ping-Pong Player: Experiment in Real-time Intelligent Control. Cambridge, MA: MIT Press ; 1988:
3. Andrieu C, De Freitas N, Doucet A, Jordan M. An introduction to MCMC for machine learning. Machine Learning. 2003 ; 50: 5-43
4. Baker C, Saxe R, Tenenbaum J. Action understanding as inverse planning. Cognition. 2009 ; 113 (3). 329-349
5. Baker C, Tenenbaum J, Saxe R. Bayesian models of human action understanding. Advances in Neural Information Processing Systems. 2006 ;:
6. Bandyopadhyay T, Won KS, Frazzoli E, Hsu D, Lee WS, Rus D. Intention-aware motion planning. International Workshop on the Algorithmic Foundations of Robotics ; 2012 ; 2012..
7. Billingsley J. Machineroe joins new title fight. Practical Robotics. 1984 ;: 14-16
8. Bishop C Pattern Recognition and Machine Learning. New York: Springer ; 2006:
9. Bitzer S, Vijayakumar S. Latent spaces for dynamic movement primitives. IEEE-RAS International Conference on Humanoid Robots ; 2009 IEEE ; 2009. 574.
10. ChangCCLinCJ (2011) LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology2: 27:1-27:27. Software available at http://www.csie.ntu.edu.tw/∼cjlin/libsvm.
11. Damianou A, Titsias M, Lawrence N. Variational Gaussian process dynamical systems. Advances in Neural Information Processing Systems. 2011 ;:
12. Deisenroth M Efficient Reinforcement Learning using Gaussian Processes. KIT Scientific Publ ; 2010:
13. Deisenroth M, Huber M, Hanebeck U. Analytic moment-based Gaussian process filtering. International Conference on Machine Learning ; 2009 ; 2009..
14. Deisenroth M, Ohlsson H. A general perspective on Gaussian filtering and smoothing. American Control Conference ; 2011 ; 2011..
15. Deisenroth M, Turner R, Huber M, Hanebeck U, Rasmussen C. Robust filtering and smoothing with Gaussian processes. Transactions on Automatic Control. 2012 ; 57: 1865-1871
16. Ding C, Peng H. Minimum redundancy feature selection from microarray gene expression data. Journal of Bioinformatics and Computational Biology. 2005 ; 3: 185-205
17. Fässler H, Beyer H, Wen J. A robot ping pong player: optimized mechanics, high performance 3D vision, and intelligent sensor control. Robotersysteme. 1990 ; 6: 161-170
18. Friesen A, Rao R. Gaze following as goal inference: A Bayesian model. Annual Conference of the Cognitive Science Society ; 2011 ; 2011..
19. Ghahramani Z, Roweis S. Learning nonlinear dynamical systems using an em algorithm. Advances in Neural Information Processing Systems. 1999 ;:
20. Hauser K. Recognition, prediction, and planning for assisted teleoperation of freeform tasks. Proceedings of Robotics: Science & Systems. 2012 ;:
21. Huang Y, Xu D, Tan M, Su H. Adding active learning to LWR for ping-pong playing robot. IEEE Transactions on Control Systems Technology. 2013 ;:
22. Ijspeert A, Nakanishi J, Schaal S. Movement imitation with nonlinear dynamical systems in humanoid robots. IEEE International Conference on Robotics and Automation ; 2002 ; 2002..
23. Jenkins O, Serrano G, Loper M. Interactive human pose and action recognition using dynamical motion primitives. International Journal of Humanoid Robotics. 2007 ; 4: 365-386
24. Khan M, Mohamed S, Marlin B, Murphy K. A stick-breaking likelihood for categorical data analysis with latent Gaussian models. International Conference on Artificial Intelligence and Statistics ; 2012 ; 2012..
25. Ko J, Fox D. GP-BayesFilters: Bayesian filtering using Gaussian process prediction and observation models. Autonomous Robots. 2009 ; 27: 75-90
26. Ko J, Fox D. Learning GP-BayesFilters via Gaussian process latent variable models. Autonomous Robots. 2011 ; 30: 3-23
27. Kuderer M, Kretzschmar H, Sprunk C, Burgard W. Feature-based prediction of trajectories for socially compliant navigation. Proceedings of Robotics: Science & Systems. 2012 ;:
28. Kurniawati H, Du Y, Hsu D, Lee W. Motion planning under uncertainty for robotic tasks with long time horizons. The International Journal of Robotics Research. 2011 ; 30: 308-323
29. Lampert CH, Peters J. Real-time detection of colored objects in multiple camera streams with off-the-shelf hardware components. Journal of Real-Time Image Processing. 2012 ; 7: 31-41
30. Lawrence N. Gaussian process latent variable models for visualization of high dimensional data. Advances in Neural Information Processing Systems. 2004 ;:
31. Lawrence N. Probabilistic non-linear principal component analysis with Gaussian process latent variable models. The Journal of Machine Learning Research. 2005 ; 6: 1783-1816
32. Liao L, Patterson D, Fox D, Kautz H. Learning and inferring transportation routines. Artificial Intelligence. 2007 ; 171: 311-331
33. Matsushima M, Hashimoto T, Takeuchi M, Miyazaki F. A learning approach to robotic table tennis. IEEE Transactions on Robotics. 2005 ; 21: 767-771
34. Møller M. A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks. 1993 ; 6: 525-533
35. Mülling K, Kober J, Kroemer O, Peters J. Learning to select and generalize striking movements in robot table tennis. The International Journal of Robotics Research. 2013 ;:
36. Mülling K, Kober J, Peters J. A biomimetic approach to robot table tennis. Adaptive Behavior. 2011 ; 19: 359-376
37. Pentland A, Liu A. Modeling and prediction of human behavior. Neural Computation. 1999 ; 11: 229-242
38. Quiñonero-Candela J, Girard A, Larsen J, Rasmussen C. Propagation of uncertainty in Bayesian kernel models - application to multiple-step ahead forecasting. IEEE International Conference on Acoustics, Speech, and Signal Processing ; 2003 ; 2003..
39. Quiñonero-Candela J, Rasmussen C. A unifying view of sparse approximate Gaussian process regression. The Journal of Machine Learning Research. 2005 ; 6: 1939-1959
40. Ramanantsoa M, Durey A. Towards a stroke construction model. International Journal of Table Tennis Science. 1994 ; 2: 97-114
41. Rao R, Shon A, Meltzoff A Imitation and Social Learning in Robots, Humans, and Animals. Cambridge: Cambridge University Press ; 2004: 217-247.
42. Rasmussen C, Williams C Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press ; 2006:
43. Schölkopf B, Smola A Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press ; 2001:
44. Shotton J, Fitzgibbon A, Cook M, et al. Real-time human pose recognition in parts from single depth images. IEEE Conference on Computer Vision and Pattern Recognition ; 2011 ; 2011..
45. Simon M Understanding Human Action: Social Explanation and the Vision of Social Science. State University of New York Press ; 1982:
46. Snelson E, Ghahramani Z. Sparse Gaussian processes using pseudo-inputs. Advances in Neural Information Processing Systems. 2006 ;:
47. Turner R, Deisenroth M, Rasmussen C. State-space inference and learning with Gaussian processes. International Conference on Artificial Intelligence and Statistics ; 2010 ; 2010..
48. van der Maaten L, Postma E, van den Herik J. Dimensionality reduction: A comparative review. Journal of Machine Learning Research. 2009 ; 10: 1-41
49. Vasquez D, Fraichard T, Aycard O, Laugier C. Intentional motion on-line learning and prediction. Machine Vision and Applications. 2008 ; 19: 411-425
50. Vasquez D, Fraichard T, Laugier C. Growing hidden Markov models: An incremental tool for learning and predicting human and vehicle motion. The International Journal of Robotics Research. 2009 ; 28: 1486-1506
51. Wang J, Fleet D, Hertzmann A. Gaussian process dynamical models for human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2008 ; 30: 283-298
52. Wang Y, Won K, Hsu D, Lee W. Monte Carlo Bayesian reinforcement learning. International Conference on Machine Learning ; 2012 a ; 2012 a..
53. Wang Z, Boularias A, Mülling K, Peters J. Balancing safety and exploitability in opponent modeling. AAAI Conference on Artificial Intelligence ; 2011 a ; 2011 a..
54. Wang Z, Deisenroth M, Amor H, Vogt D, Schölkopf B, Peters J. Probabilistic modeling of human movements for intention inference. Proceedings of Robotics: Science and Systems. 2012 b ;:
55. Wang Z, Lampert C, Mülling K, Schölkopf B, Peters J. Learning anticipation policies for robot table tennis. IEEE/RSJ International Conference on Intelligent Robots and Systems ; 2011 b ; 2011 b..
56. Williams A, Ward P, Knowles J, Smeeton N. Anticipation skill in a real-world task: Measurement, training, and transfer in tennis. Journal of Experimental Psychology. 2002 ; 8: 259
57. Yang P, Xu D, Wang H, Zhang Z. Control system design for a 5-DOF table tennis robot. International Conference on Control Automation Robotics & Vision ; 2010 ; 2010. 1731.
58. Ziebart B, Dey A, Bagnell J. Probabilistic pointing target prediction via inverse optimal control. ACM International Conference on Intelligent User Interfaces ; 2012 ; 2012. 1.
59. Ziebart B, Maas A, Bagnell J, Dey A. Maximum entropy inverse reinforcement learning. AAAI Conference on Artificial Intelligence ; 2008 ; 2008. 1433.
60. Ziebart B, Ratliff N, Gallagher G, et al. Planning-based prediction for pedestrians. IEEE/RSJ International Conference on Intelligent Robots and Systems ; 2009 ; 2009. 3931.