State Representation Learning in Robotics: Using Prior Knowledge about Physical Interaction

Robotics: Science and Systems

Volumn , Issue , 2014, Pages

  Jonschkowski, Rico ^a   Brock, Oliver ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AIR NAVIGATION; REINFORCEMENT LEARNING; ROBOTICS;

APPROACHES TO LEARNING; HIGH-DIMENSIONAL; LEARN+; MOVING OBJECTS; NAVIGATION TASKS; PHYSICAL INTERACTIONS; PHYSICAL WORLD; PRIOR-KNOWLEDGE; STATE REPRESENTATION; TASK RELEVANT;

ROBOTS;

EID: 84961612003     PISSN: None     EISSN: 2330765X     Source Type: Conference Proceeding    
DOI: 10.15607/RSS.2014.X.019     Document Type: Conference Paper

References (30)

1. Yoshua Bengio, Aaron C. Courville, and Pascal Vincent. Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8):1798–1828, 2013.
2. Byron Boots, Sajid M. Siddiqi, and Geoffrey J. Gordon. Closing the learning-planning loop with predictive state representations. International Journal of Robotics Research, 30(7):954–966, 2011.
3. Michael Bowling, Ali Ghodsi, and Dana Wilkinson. Action respecting embedding. In 22nd International Conference on Machine Learning (ICML), pages 65–72, 2005.
4. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493–2537, 2011.
5. Siegmund Duell, Steffen Udluft, and Volkmar Sterz-ing. Solving partially observable reinforcement learning problems with recurrent neural networks. In Neural Networks: Tricks of the Trade, volume 7700 of Lecture Notes in Computer Science, pages 709–733. Springer Berlin Heidelberg, 2012.
6. Raia Hadsell, Sumit Chopra, and Yann LeCun. Dimensionality reduction by learning an invariant mapping. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pages 1735– 1742, 2006.
7. Sebastian Höfer, Manfred Hild, and Matthias Kubisch. Using slow feature analysis to extract behavioural manifolds related to humanoid robot postures. In 10th International Conference on Epigenetic Robotics, pages 43–50, 2010.
8. Marcus Hutter. Feature reinforcement learning: Part I: Unstructured MDPs. Journal of Artificial General Intelligence, 1:3–24, 2009.
9. Odest Chadwicke Jenkins and Maja J. Matarić. A spatio-temporal extension to isomap nonlinear dimension reduction. In 21st International Conference on Machine Learning (ICML), page 56, 2004.
10. Nikolay Jetchev, Tobias Lang, and Marc Toussaint. Learning grounded relational symbols from continuous data for abstract reasoning. In Autonomous Learning Workshop at the IEEE International Conference on Robotics and Automation, 2013.
11. Rico Jonschkowski and Oliver Brock. Learning task-specific state representations by maximizing slowness and predictability. In 6th International Workshop on Evolutionary and Reinforcement Learning for Autonomous Robot Systems (ERLARS), 2013.
12. Jens Kober, J. Andrew Bagnell, and Jan Peters. Reinforcement learning in robotics: A survey. International Journal of Robotics Research, 32(11):1238–1274, 2013.
13. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS), pages 1106–1114, 2012.
14. Joseph B. Kruskal. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika, 29(1):1–27, 1964.
15. Sascha Lange, Martin Riedmiller, and Arne Voigtländer. Autonomous reinforcement learning on raw visual input data in a real world application. In International Joint Conference on Neural Networks (IJCNN), pages 1–8, 2012.
16. Robert Legenstein, Niko Wilbert, and Laurenz Wiskott. Reinforcement learning on slow features of high-dimensional input streams. PLoS Computational Biology, 6(8):e1000894, 2010.
17. Michael L. Littman, Richard S. Sutton, and Satinder Singh. Predictive representations of state. In Advances in Neural Information Processing Systems (NIPS), pages 1555–1561, 2002.
18. Matthew Luciw and Juergen Schmidhuber. Low complexity proto-value function learning from sensory observations with incremental slow feature analysis. In 22nd International Conference on Artificial Neural Networks and Machine Learning (ICANN), pages 279–287, 2012.
19. Sridhar Mahadevan and Mauro Maggioni. Proto-value functions: A laplacian framework for learning representation and control in markov decision processes. Journal of Machine Learning Research, 8(10):2169–2231, 2007.
20. Ishai Menache, Shie Mannor, and Nahum Shimkin. Basis function adaptation in temporal difference reinforcement learning. Annals of Operations Research, 134:215–238, 2005.
21. Justus Piater, Sébastien Jodogne, Renaud Detry, Dirk Kraft, Norbert Krüger, Oliver Kroemer, and Jan Peters. Learning visual representations for perception-action systems. International Journal of Robotics Research, 30(3): 294–307, 2011.
22. Martin Riedmiller. Neural fitted Q iteration – first experiences with a data efficient neural reinforcement learning method. In 16th European Conference on Machine Learning (ECML), pages 317–328, 2005.
23. Sam T. Roweis and Lawrence K. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323–2326, 2000.
24. Frank Seide, Gang Li, and Dong Yu. Conversational speech transcription using context-dependent deep neural networks. In Interspeech, pages 437–440, 2011.
25. Roger N. Shepard. Toward a universal law of generalization for psychological science. Science, 237(4820): 1317–1323, 1987.
26. Satinder P. Singh, Tommi Jaakkola, and Michael I. Jordan. Reinforcement learning with soft state aggregation. In Advances in Neural Information Processing Systems (NIPS), pages 361–368, 1995.
27. Nathan Sprague. Predictive projections. In 21st International Joint Conference on Artificial Intelligence (IJCAI), pages 1223–1229, 2009.
28. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
29. Joshua B. Tenenbaum, Vin De Silva, and John C. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319–2323, 2000.
30. Laurenz Wiskott and Terrence J. Sejnowski. Slow feature analysis: unsupervised learning of invariances. Neural Computation, 14(4):715–770, 2002.