Learning physical intuition of block towers by example

33rd International Conference on Machine Learning, ICML 2016

Volumn 1, Issue , 2016, Pages 648-656

  Lerer, Adam ^a   Gross, Sam ^a   Fergus, Rob ^a  

^a FACEBOOK AI RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

3D GAME ENGINES; CONVOLUTIONAL NETWORKS; FEEDFORWARD MODEL; HUMAN SUBJECTS; MOTOR SKILLS; PHYSICAL BEHAVIORS; PHYSICAL SCENARIO; WOODEN BLOCKS;

LEARNING SYSTEMS;

EID: 84997703799     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Agrawal, Pulkit, Carreira, Joao, and Malik, Jitendra. Learning to see by moving. In The IEEE International Conference on Computer Vision (ICCV), June 2015.
2. Bates, C. J., Yildirim, I., Tenenbaum, J. B., and Battaglia, P. W. Humans predict liquid dynamics using probabilistic simulation. In In Proc. Conf. Cognitive Science Society, 2015.
3. Battaglia, Peter W., Hamrick, Jessica B., and Tenenbaum, Joshua B. Simulation as an engine of physical scene understanding. Proceedings of the National Academy of Sciences, 110(45):18327-18332, 2013.
4. Carey, Susan. The origin of concepts. Oxford University Press, 2009.
5. Collobert, Ronan, Kavukcuoglu, Koray, and Farabet, Clément. Torch7: A matlab-like environment for machine learning. In BigLearn, NIPS Workshop, number EPFL-CONF-192376, 2011.
6. Davis, Ernest and Marcus, Gary. The scope and limits of simulation in automated reasoning. Artificial Intelligence, 233:60-72, 2016.
7. Epic Games. Unreal engine 4. https://www.unrealengine.com, 2015.
8. Goodman, Noah D, Frank, Michael C, Griffiths, Thomas L, Tenenbaum, Joshua B, Battaglia, Peter W, and Hamrick, Jessica B. Relevant and robust a response to marcus and davis (2013). Psychological science, 26(4):539-541, 2015.
9. He, K., Zhang, X., Ren, S., and Sun, J. Deep Residual Learning for Image Recognition. ArXiv 1512.03385, December 2015.
10. Hegarty, Mary. Mechanical reasoning by mental simulation. Trends in cognitive sciences, 8(6):280-285, 2004.
11. Hinton, Geoffrey, Deng, Li, Yu, Dong, Dahl, George E, Mohamed, Abdel-rahman, Jaitly, Navdeep, Senior, Andrew, Vanhoucke, Vincent, Nguyen, Patrick, Sainath, Tara N, et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. Signal Processing Magazine, IEEE, 29(6):82-97, 2012.
12. Ioffe, Sergey and Szegedy, Christian. Batch normalization: Accelerating deep network training by reducing internal covariate shift. CoRR, abs/1502.03167, 2015.
13. Jia, Zhaoyin, Gallagher, A. C., Saxena, A., and Chen, Tsuhan. 3d reasoning from blocks to stability. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 37(5):905-918, 2015.
14. Koppula, Hema S and Saxena, Ashutosh. Anticipating human activities using object affordances for reactive robotic response. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 38(1):14-29, 2016.
15. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In Pereira, F., Burges, C. J. C., Bottou, L., and Weinberger, K. Q. (eds.), Advances in Neural Information Processing Systems 25, pp. 1097-1105. Curran Associates, Inc., 2012.
16. LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., and Jackel, L. D. Backpropagation applied to handwritten zip code recognition. Neural Computation, 1(4):541-551, Winter 1989.
17. Li, Wenbin, Azimi, Seyedmajid, Leonardis, Ales, and Fritz, Mario. To fall or not to fall: A visual approach to physical stability prediction. arXiv 1605.01138, 2016.
18. Lillicrap, Timothy P., Hunt, Jonathan J., Pritzel, Alexander, Heess, Nicolas, Erez, Tom, Tassa, Yuval, Silver, David, and Wierstra, Daan. Continuous control with deep reinforcement learning. CoRR, abs/1509.02971, 2015.
19. Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Rusu, Andrei A., Veness, Joel, Bellemare, Marc G., Graves, Alex, Riedmiller, Martin, Fidjeland, Andreas K., Ostrovski, Georg, Petersen, Stig, Beattie, Charles, Sadik, Amir, Antonoglou, Ioannis, King, Helen, Kumaran, Dharshan, Wierstra, Daan, Legg, Shane, and Hassabis, Demis. Human-level control through deep reinforcement learning. Nature, 518(7540):529-533, 02 2015.
20. Pinheiro, Pedro O, Collobert, Ronan, and Dollar, Piotr. Learning to segment object candidates. In Advances in Neural Information Processing Systems, pp. 1981-1989, 2015.
21. Russakovsky, Olga, Deng, Jia, Su, Hao, Krause, Jonathan, Satheesh, Sanjeev, Ma, Sean, Huang, Zhiheng, Karpathy, Andrej, Khosla, Aditya, Bernstein, Michael, Berg, Alexander C, and Fei-Fei, Li. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV), 115(3):211-252, 2015.
22. Shotton, Jamie, Shanp, Toby, Kipman, Alex, Fitzgibbon, Andrew, Finocchio, Mark, Blake, Andrew, Cook, Mat, and Moore, Richard. Real-time human pose recognition in parts from single depth images. Communications of the ACM, 56(1):116-124, 2013.
23. Smith, K. A., Battaglia, P. W., and Vul, E. Consistent physics underlying ballistic motion prediction. In Proc. 35th Ann. Conf. Cognitive Science Society, 2013.
24. Szegedy, Christian, Liu, Wei, Jia, Yangqing, Sermanet, Pierre, Reed, Scott, Anguelov, Dragomir, Erhan, Dumitru, Vanhoucke, Vincent, and Rabinovich, Andrew. Going deeper with convolutions. CoRR, abs/1409.4842, 2014.
25. Wu, Jiajun, Yildirim, Ilker, Lim, Joseph J, Freeman, Bill, and Tenenbaum, Josh. Galileo: Perceiving physical object properties by integrating a physics engine with deep learning. In Cortes, C, Lawrence, N. D., Lee, D. D., Sugiyama, M., and Garnett, R. (eds.), Advances in Neural Information Processing Systems 28, pp. 127-135. Curran Associates, Inc., 2015.
26. Zhang, Renqiao, Wu, Jiajun, Zhang, Chengkai, Freeman, William T., and Tenenbaum, Joshua T. A comparative evaluation of approximate probabilistic simulation and deep neural networks as accounts of human physical scene understanding. In CogSci, 2016.
27. Zheng, Bo, Zhao, Yibiao, Yu, Joey, Ikeuchi, Katsushi, and Zhu, Song-Chun. Scene understanding by reasoning stability and safety. International Journal of Computer Vision, 112(2):221-238, 2015.