Learning predictive models of a depth camera & manipulator from raw execution traces

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2014, Pages 4021-4028

  Boots, Byron ^a   Byravan, Arunkumar ^a   Fox, Dieter ^a  

^a University of Washington   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CAMERAS; RANDOM PROCESSES; ROBOTICS; STOCHASTIC SYSTEMS;

CONTROLLED STOCHASTIC PROCESS; EXECUTION TRACE; GENERATIVE MODEL; HIGH-DIMENSIONAL; OBSERVATION SPACE; PREDICTIVE MODELING; PREDICTIVE MODELS; PREDICTIVE STATE REPRESENTATION;

MANIPULATORS;

EID: 84929192339     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2014.6907443     Document Type: Conference Paper

References (37)

1. B. Kuipers,"The map-learning critter," Tech. Rep. , 1985
2. M. Hersch, E. L. Sauser, and A. Billard,"Online learning of the body schema." I. J. Humanoid Robotics, vol. 5, no. 2, pp. 161-181, 2008
3. J. Sturm, C. Plagemann, and W. Burgard,"Unsupervised body scheme learning through self-perception." in ICRA. IEEE, 2008, pp. 3328-3333
4. J. Sturm, C. Plagemann, and W. Burgard,"Body schema learning for robotic manipulators from visual self-perception," Journal of Physiology-Paris, vol. 103, no. 3-5, pp. 220-231, Sept. 2009, neurorobotics
5. M. Deisenroth and D. Fox,"Learning to control a low-cost manipulator using data-efficient reinforcement learning," in Proc. of Robotics: Science and Systems (RSS), 20e11
6. M. Littman, R. Sutton, and S. Singh,"Predictive representations of state," in Advances in Neural Information Processing Systems (NIPS), 2002
7. S. Singh, M. James, and M. Rudary,"Predictive state representations: A new theory for modeling dynamical systems," in Proc. UAI, 2004
8. M. Rudary, S. Singh, and D. Wingate,"Predictive linear-Gaussian models of stochastic dynamical systems," in Proc. UAI, 2005
9. Y. Bengio and P. Frasconi,"An Input Output HMM Architecture," in Advances in Neural Information Processing Systems, 1995
10. B. Boots, S. M. Siddiqi, and G. J. Gordon,"Closing the learningplanning loop with predictive state representations," in Proceedings of Robotics: Science and Systems VI, 2010
11. B. Boots, A. Gretton, and G. J. Gordon,"Hilbert Space Embeddings of Predictive State Representations," in Proc. UAI, 2013
12. D. Wingate and S. Singh,"On discovery and learning of models with predictive representations of state for agents with continuous actions and observations," in Proc. AAMAS, 2007
13. S. C. Ong, Y. Grinberg, and J. Pineau,"Mixed observability predictive state representations," 2013
14. W. L. Hamilton, M. M. Fard, and J. Pineau,"Modelling sparse dynamical systems with compressed predictive state representations," in Proceedings of the 30th International Conference on Machine Learning (ICML-13), S. Dasgupta and D. Mcallester, Eds., vol. 28, no. 1. JMLR Workshop and Conference Proceedings, 2013, pp. 178-186
15. A. Censi and R. M. Murray,"Bootstrapping bilinear models of robotic sensorimotor cascades," in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, May 2011
16. A. Censi and R. M. Murray,"Bootstrapping sensorimotor cascades: A group-Theoretic perspective," in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Francisco, CA, September 2011
17. A. Censi and R. M. Murray,"Learning diffeomorphism models of robotic sensorimotor cascades," in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Saint Paul, MN, May 2012
18. L. Ljung, System Identification: Theory for the user, 2nd ed. Prentice Hall, 1999
19. P. Van Overschee and B. De Moor, Subspace Identification for Linear Systems: Theory, Implementation, Applications. Kluwer, 1996
20. T. Katayama, Subspace Methods for System Identification: A Realization Approach. Springer, 2005
21. B. Kuipers, R. Browning, B. Gribble, M. Hewett, and E. Remolina,"The spatial semantic hierarchy," Artificial Intelligence, vol. 119, pp. 191-233, 2000
22. J. Modayil,"Discovering sensor space: Constructing spatial embeddings that explain sensor correlations," in International Conference on Development and Learning, 2010
23. A. M. Dearden and Y. Demiris,"Learning forward models for robots," in IJCAI, 2005, pp. 1440-1445
24. S. Ulbrich, V. Ruiz, T. Asfour, C. Torras, and R. Dillmann,"Kinematic bzier maps," IEEE Transactions on Systems, Man, and Cybernetics, vol. 42, no. 4, pp. 1215-1230, 2012
25. H. Jaeger,"Observable operator models for discrete stochastic time series," Neural Computation, vol. 12, pp. 1371-1398, 2000
26. J. M. Wang, D. J. Fleet, and A. Hertzmann,"Gaussian process dynamical models," in In NIPS. MIT Press, 2006, pp. 1441-1448
27. B. Boots and G. Gordon,"An online spectral learning algorithm for partially observable nonlinear dynamical systems," in Proc. of the 25th National Conference on Artificial Intelligence (AAAI-2011), 2011
28. L. Song, B. Boots, S. M. Siddiqi, G. J. Gordon, and A. J. Smola,"Hilbert space embeddings of hidden Markov models," in Proc. 27th Intl. Conf. on Machine Learning (ICML), 2010
29. A. Anandkumar, R. Ge, D. Hsu, S. M. Kakade, and M. Telgarsky,"Tensor decompositions for learning latent variable models," CoRR, vol. abs/1210.7559, 2012
30. J. Pearl, Causality: models, reasoning, and inference. Cambridge University Press, 2000
31. M. Bowling, P. McCracken, M. James, J. Neufeld, and D. Wilkinson,"Learning predictive state representations using non-blind policies," in Proc. ICML, 2006
32. A. Smola, A. Gretton, L. Song, and B. Scholkopf,"A Hilbert space embedding for distributions," in Algorithmic Learning Theory, ser. Lecture Notes on Computer Science, E. Takimoto, Ed. Springer, 2007
33. B. Sriperumbudur, A. Gretton, K. Fukumizu, G. Lanckriet, and B. Scholkopf,"Injective Hilbert space embeddings of probability measures," 2008
34. K. Fukumizu, L. Song, and A. Gretton,"Kernel bayes rule," in Advances in Neural Information Processing Systems 24, J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, Eds., 2011, pp. 1737-1745
35. M. Krainin, P. Henry, X. Ren, and D. Fox,"Manipulator and object tracking for in-hand 3d object modeling," Int. J. Rob. Res., vol. 30, no. 11, pp. 1311-1327, Sept. 2011
36. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. New York, NY, USA: Cambridge University Press, 2004
37. S. Grunewalder, G. Lever, L. Baldassarre, M. Pontil, and A. Gretton,"Modelling transition dynamics in MDPs with RKHS embeddings," CoRR, vol. abs/1206.4655, 2012