Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 3521-3529

  Mottaghi, Roozbeh ^a   Bagherinezhad, Hessam ^b   Rastegari, Mohammad ^a   Farhadi, Ali ^a,b  

^a Allen Institute for Artificial Intelligence   (Austria)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; PATTERN RECOGNITION;

FORCE VECTORS; GAME ENGINE; GROUND TRUTH; NEWTONIAN DYNAMICS; QUERY OBJECT; SINGLE IMAGES; STATIC IMAGES; STILL IMAGES;

DYNAMICS;

EID: 84986275832     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.383     Document Type: Conference Paper

References (38)

1. Blender. http://www.blender.org/.
2. Torch7. http://torch.ch.
3. P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik. Contour detection and hierarchical image segmentation. PAMI, 2011.
4. M. Bar. The proactive brain: memory for predictions. Royal Society of London. Series B, Biological sciences, 2009.
5. P. Battaglia, J. Hamrick, and J. B. Tenenbaum. Simulation as an engine of physical scene understanding. PNAS, 2013.
6. M. A. Brubaker and D. J. Fleet. The kneed walker for human pose tracking. In CVPR, 2008.
7. M. A. Brubaker, D. J. Fleet, and A. Hertzmann. Physicsbased person tracking using simplified lower-body dynamics. In CVPR, 2007.
8. M. A. Brubaker, L. Sigal, and D. J. Fleet. Estimating contact dynamics. In ICCV, 2009.
9. O. Cheung and M. Bar. Visual prediction and perceptual expertise. Intl. J. of Psychophysiology, 2012.
10. R. Collins, Y. Liu, and M. Leordeanu. On-line selection of discriminative tracking features. PAMI, 2005.
11. D. Comaniciu, V. Ramesh, and P. Meer. Kernel-based object tracking. PAMI, 2003.
12. M. Everingham, L. Gool, C. K. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. IJCV, 2010.
13. D. F. Fouhey and C. Zitnick. Predicting object dynamics in scenes. In CVPR, 2014.
14. J. Hamrick, P. Battaglia, and J. B. Tenenbaum. Internal physics models guide probabilistic judgments about object dynamics. Annual Meeting of the Cognitive Science Societ, 2011.
15. J. Hawkins and S. Blakeslee. On Intelligence. Times Books, 2004.
16. M. Hoai and F. De la Torre. Max-margin early event detectors. In CVPR, 2012.
17. M. Isard and A. Blake. Condensation conditional density propagation for visual tracking. IJCV, 1998.
18. Z. Jia, A. Gallagher, A. Saxena, and T. Chen. 3d-based reasoning with blocks, support, and stability. In CVPR, 2013.
19. K. M. Kitani, B. D. Ziebart, J. A. D. Bagnell, and M. Hebert. Activity forecasting. In ECCV, 2012.
20. H. Koppula and A. Saxena. Anticipating human activities using object affordances for reactive robotic response. In RSS, 2013.
21. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
22. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre. Hmdb: a large video database for human motion recognition. In ICCV, 2011.
23. T. Lan, T. Chen, and S. Savarese. A hierarchical representation for future action prediction. In ECCV, 2014.
24. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollr, and C. L. Zitnick. Microsoft coco: Common objects in context. In ECCV, 2014.
25. C. Liu, J. Yuen, and A. Torralba. Sift flow: Dense correspondence across scenes and its applications. PAMI, 2011.
26. R. Mann, A. Jepson, and J. Siskind. The computational perception of scene dynamics. CVIU, 1997.
27. M. Pei, Y. Jia, and S.-C. Zhu. Parsing video events with goal inference and intent prediction. In ICCV, 2011.
28. S. L. Pintea, J. C. van Gemert, and A.W. M. Smeulders. Déjà vu:-motion prediction in static images. In ECCV, 2014.
29. M. S. Ryoo. Human activity prediction: Early recognition of ongoing activities from streaming videos. In ICCV, 2011.
30. K. Soomro, A. R. Zamir, and M. Shah. UCF101: A dataset of 101 human action classes from videos in the wild. Technical Report CRCV-TR-12-01, 2012.
31. D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri. Learning spatiotemporal features with 3d convolutional networks. In ICCV, 2015.
32. M. Vondrak, L. Sigal, and O. C. Jenkins. Physical simulation for probabilistic motion tracking. In CVPR, 2008.
33. J. Walker, A. Gupta, and M. Hebert. Patch to the future: Unsupervised visual prediction. In CVPR, 2014.
34. J. Walker, A. Gupta, and M. Hebert. Dense optical flow prediction from a static image. In ICCV, 2015.
35. J.Wu, I. Yildirim, J. J. Lim,W. T. Freeman, and J. B. Tenenbaum. Galileo: Perceiving physical object properties by integrating a physics engine with deep learning. In NIPS, 2015.
36. D. Xie, S. Todorovic, and S.-C. Zhu. Inferring dark matter and dark energy from videos. In ICCV, 2013.
37. J. Yuen and A. Torralba. A data-driven approach for event prediction. In ECCV, 2010.
38. B. Zheng, Y. Zhao, J. C. Yu, K. Ikeuchi, and S.-C. Zhu. Detecting potential falling objects by inferring human action and natural disturbance. In ICRA, 2014.