Learning visual predictive models of physics for playing billiards

4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings

Volumn , Issue , 2016, Pages

  Fragkiadaki, Katerina ^a   Agrawal, Pulkit ^a   Levine, Sergey ^a   Malik, Jitendra ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GOAL DIRECTED; INTERNAL MODELING; INTERNAL SIMULATIONS; PHYSICAL LAWS; PREDICTIVE MODELS; TARGET POSITION; TRANSLATIONAL INVARIANCE;

INTELLIGENT AGENTS;

EID: 85083954419     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Bhat, Kiran S., Seitz, Steven M., and Popovic, Jovan. Computing the physical parameters of rigid-body motion from video. In Heyden, Anders, Sparr, Gunnar, Nielsen, Mads, and Johansen, Peter (eds.), ECCV (1), volume 2350 of Lecture Notes in Computer Science, pp. 551–565. Springer, 2002. ISBN 3-540-43745-2. URL http://dblp.uni-trier.de/db/conf/eccv/eccv2002-1.html#BhatSP02.
2. Boots, Byron, Byravan, Arunkumar, and Fox, Dieter. Learning predictive models of a depth camera & manipulator from raw execution traces. In 2014 IEEE International Conference on Robotics and Automation, ICRA 2014, Hong Kong, China, May 31 - June 7, 2014, pp. 4021–4028, 2014. doi: 10.1109/ICRA.2014.6907443. URL http://dx.doi.org/10.1109/ICRA.2014.6907443.
3. Brand, M., Oliver, N., and Pentland, A. Coupled hidden markov models for complex action recognition. In CVPR, 1997.
4. Brubaker, Marcus A., Sigal, L., and Fleet, D.J. Estimating contact dynamics. In Computer Vision, 2009 IEEE 12th International Conference on, pp. 2389–2396, Sept 2009. doi: 10.1109/ICCV. 2009.5459407.
5. Ghahramani, Zoubin and Jordan, Michael I. Factorial hidden markov models. Mach. Learn., 29, 1997.
6. Hamrick, Jessica, Battaglia, Peter, and Tenenbaum, Joshua B. Internal physics models guide probabilistic judgments about object dynamics. In Proceedings of the 33rd annual conference of the cognitive science society, pp. 1545–1550. Cognitive Science Society Austin, TX, 2011.
7. Hansen, Nikolaus and Ostermeier, Andreas. Completely derandomized self-adaptation in evolution strategies. Evolutionary computation, 9(2):159–195, 2001.
8. Haruno, Masahiko, Wolpert, David H, and Kawato, Mitsuo. Mosaic model for sensorimotor learning and control. Neural computation, 13(10):2201–2220, 2001.
9. Hofsten, Claes Von and Rosander, Kerstin. Development of smooth pursuit tracking in young infants. Vision Research, 37(13):1799 – 1810, 1997. ISSN 0042-6989. doi: http://dx.doi.org/10.1016/S0042-6989(96)00332-X. URL http://www.sciencedirect.com/science/article/pii/S004269899600332X.
10. Jordan, Michael I and Rumelhart, David E. Forward models: Supervised learning with a distal teacher. Cognitive science, 16(3):307–354, 1992.
11. Kietzmann, Tim C. and Riedmiller, Martin A. The neuro slot car racer: Reinforcement learning in a real world setting. In International Conference on Machine Learning and Applications, ICMLA 2009, Miami Beach, Florida, USA, December 13-15, 2009, pp. 311–316, 2009. doi: 10.1109/ICMLA.2009.15. URL http://dx.doi.org/10.1109/ICMLA.2009.15.
12. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep con-volutional neural networks. In NIPS. 2012.
13. Kyriazis, Nikolaos, Oikonomidis, Iason, and Argyros, Antonis A. Binding computer vision to physics based simulation: The case study of a bouncing ball. In British Machine Vision Conference, BMVC 2011, Dundee, UK, August 29 - September 2, 2011. Proceedings, pp. 1–11, 2011. doi: 10.5244/C.25.43. URL http://dx.doi.org/10.5244/C.25.43.
14. Lange, Sascha, Riedmiller, Martin A., and Voigtländer, Arne. Autonomous reinforcement learning on raw visual input data in a real world application. In The 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, Australia, June 10-15, 2012, pp. 1–8, 2012. doi: 10.1109/IJCNN.2012.6252823. URL http://dx.doi.org/10.1109/IJCNN.2012.6252823.
15. Levine, Sergey, Finn, Chelsea, Darrell, Trevor, and Abbeel, Pieter. End-to-end training of deep visuomotor policies. CoRR, abs/1504.00702, 2015. URL http://arxiv.org/abs/1504.00702.
16. Lillicrap, Timothy P., Hunt, Jonathan J., Pritzel, Alexander, Heess, Nicolas, Erez, Tom, Tassa, Yuval, Silver, David, and Wierstra, Daan. Continuous control with deep reinforcement learning. CoRR, abs/1509.02971, 2015.
17. Mayne, David Q. Model predictive control: Recent developments and future promise. Automat-ica, 50(12):2967 – 2986, 2014. ISSN 0005-1098. doi: http://dx.doi.org/10.1016/j.automatica.2014.10.128. URL http://www.sciencedirect.com/science/article/pii/S0005109814005160.
18. Michalski, Vincent, Memisevic, Roland, and Konda, Kishore Reddy. Modeling deep temporal dependencies with recurrent grammar cells””. In Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada, pp. 1925–1933, 2014. URL http://papers.nips.cc/paper/5549-modeling-deep-temporal-dependencies-with-recurrent-grammar-cells.
19. Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Graves, Alex, Antonoglou, Ioannis, Wierstra, Daan, and Riedmiller, Martin A. Playing atari with deep reinforcement learning. CoRR, abs/1312.5602, 2013. URL http://arxiv.org/abs/1312.5602.
20. Mottaghi, Roozbeh, Bagherinezhad, Hessam, Rastegari, Mohammad, and Farhadi, Ali. Newtonian image understanding: Unfolding the dynamics of objects in static images. CoRR, abs/1511.04048, 2015. URL http://arxiv.org/abs/1511.04048.
21. Oh, Junhyuk, Guo, Xiaoxiao, Lee, Honglak, Lewis, Richard, and Singh, Satinder. Action-conditional video prediction using deep networks in atari games. arXiv preprint arXiv:1507.08750, 2015.
22. Salzmann, Mathieu and Urtasun, Raquel. Physically-based motion models for 3d tracking: A convex formulation. In Metaxas, Dimitris N., Quan, Long, Sanfeliu, Alberto, and Gool, Luc J. Van (eds.), ICCV, pp. 2064–2071. IEEE, 2011. ISBN 978-1-4577-1101-5. URL http://dblp.uni-trier.de/db/conf/iccv/iccv2011.html#SalzmannU11.
23. Sutskever, Ilya, Hinton, Geoffrey E., and Taylor, Graham W. The recurrent temporal restricted boltzmann machine. In NIPS, 2008.
24. Todorov, Emanuel and Ghahramani, Zoubin. Unsupervised learning of sensory-motor primitives. In Engineering in Medicine and Biology Society, 2003. Proceedings of the 25th Annual International Conference of the IEEE, volume 2, pp. 1750–1753. IEEE, 2003.
25. Urtasun, Raquel, Fleet, David J., and Fua, Pascal. 3d people tracking with gaussian process dynamical models. In CVPR, 2006.
26. Wahlström, Niklas, Schön, Thomas B., and Deisenroth, Marc Peter. From pixels to torques: Policy learning with deep dynamical models. CoRR, abs/1502.02251, 2015. URL http://arxiv.org/abs/1502.02251.
27. Watter, Manuel, Springenberg, Jost Tobias, Boedecker, Joschka, and Riedmiller, Martin A. Embed to control: A locally linear latent dynamics model for control from raw images. CoRR, abs/1506.07365, 2015. URL http://arxiv.org/abs/1506.07365.
28. Welch, Greg and Bishop, Gary. An introduction to the kalman filter. Technical report, Chapel Hill, NC, USA, 1995.
29. Weng, Shiuh-Ku, Kuo, Chung-Ming, and Tu, Shu-Kang. Video object tracking using adaptive kalman filter. J. Vis. Comun. Image Represent., 17(6):1190–1208, 2006. ISSN 1047-3203. doi: 10.1016/j.jvcir.2006.03.004. URL http://dx.doi.org/10.1016/j.jvcir.2006.03.004.
30. Wolpert, Daniel M, Ghahramani, Zoubin, and Jordan, Michael I. An internal model for sensorimotor integration. Science-AAAS-Weekly Paper Edition, 269(5232):1880–1882, 1995.
31. Wu, Jiajun, Yildirim, Ilker, Lim, Joseph J, Freeman, Bill, and Tenenbaum, Josh. Galileo: Perceiving physical object properties by integrating a physics engine with deep learning. In Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R., and Garnett, R. (eds.), Advances in Neural Information Processing Systems 28, pp. 127–135. Curran Associates, Inc., 2015. URL http://papers.nips.cc/paper/5780-galileo-perceiving-physical-object-properties-by-integrating-a-physics-engine pdf.