Marr revisited: 2D-3D alignment via surface normal prediction

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 5965-5974

  Bansal, Aayush ^a   Russell, Bryan ^b   Gupta, Abhinav ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; FORECASTING; NEURAL NETWORKS; PATTERN RECOGNITION;

CAD MODEL RETRIEVAL; CONVOLUTIONAL NEURAL NETWORK; INPUT IMAGE; NETWORK MODELING; POSE PREDICTIONS; STATE OF THE ART; STILL IMAGES; SURFACE NORMALS;

COMPUTER AIDED DESIGN;

EID: 84986247538     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.642     Document Type: Conference Paper

References (49)

1. M. Aubry, D. Maturana, A. A. Efros, B. C. Russell, and J. Sivic. Seeing 3D chairs: Exemplar part-based 2D-3D alignment using a large dataset of CAD models. In CVPR, 2014.
2. M. Aubry and B. C. Russell. Understanding deep features with computer-generated imagery. In ICCV, 2015.
3. S. Bell and K. Bala. Learning visual similarity for product design with convolutional neural networks. ACM Transactions on Graphics, 2015.
4. I. Biederman. Recognition by components: A theory of human image interpretation. Pyschological review, 94: 115-147, 1987.
5. T. O. Binford. Visual perception by computer. In IEEE conference on Systems and Control, 1971.
6. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman. Return of the devil in the details: Delving deep into convolutional nets. In BMVC, 2014.
7. C. B. Choy, M. Stark, S. Corbett-Davies, and S. Savarese. Object detection with 2D-3D registration and continuous viewpoint estimation. In CVPR, 2015.
8. J. Coughlan and A. Yuille. The Manhattan world assumption: Regularities in scene statistics which enable Bayesian inference. In NIPS, 2000.
9. D. Eigen and R. Fergus. Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In ICCV, 2015.
10. D. F. Fouhey, A. Gupta, and M. Hebert. Data-driven 3D primitives for single image understanding. In ICCV, 2013.
11. D. F. Fouhey, A. Gupta, and M. Hebert. Unfolding an indoor origami world. In ECCV, 2014.
12. D. F. Fouhey, W. Hussain, A. Gupta, and M. Hebert. Single image 3D without a single 3D image. In ICCV, 2015.
13. R. Guo and D. Hoiem. Support surface prediction in indoor scenes. In ICCV, 2013.
14. R. Guo, C. Zou, and D. Hoiem. Predicting complete 3d models of indoor scenes. CoRR, abs/1504. 02437, 2015.
15. S. Gupta, P. A. Arbeláez, R. B. Girshick, and J. Malik. Aligning 3D models to RGB-D images of cluttered scenes. In CVPR, 2015.
16. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik. Hypercolumns for object segmentation and fine-grained localization. In CVPR, 2015.
17. V. Hedau, D. Hoiem, and D. Forsyth. Recovering the spatial layout of cluttered rooms. In ICCV, 2009.
18. D. Hoiem, A. Efros, and M. Hebert. Automatic photo popup. In SIGGRAPH, 2005.
19. Q. Huang, H. Wang, and V. Koltun. Single-view reconstruction via joint analysis of image and shape collections. ACM Transactions on Graphics, 34 (4), 2015.
20. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. CoRR, abs/1408. 5093, 2014.
21. J. Kosecka and W. Zhang. Video compass. In ECCV, 2002.
22. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
23. L. Ladicky, B. Zeisl, and M. Pollefeys. Discriminatively trained dense surface normal estimation. In ECCV, 2014.
24. D. C. Lee, A. Gupta, M. Hebert, and T. Kanade. Estimating spatial layout of rooms using volumetric reasoning about objects and surfaces. In NIPS, 2010.
25. Y. Li, H. Su, C. R. Qi, N. Fish, D. Cohen-Or, and L. J. Guibas. Joint embeddings of shapes and images via CNN image purification. ACM Transactions on Graphics (Proceeding of SIGGRAPH Asia), 2015. 3
26. J. J. Lim, H. Pirsiavash, and A. Torralba. Parsing IKEA objects: Fine pose estimation. In ICCV, 2013.
27. F. Liu, C. Shen, and G. Lin. Deep convolutional neural fields for depth estimation from a single image. In CVPR, 2015.
28. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional models for semantic segmentation. In CVPR, 2015.
29. A. Mallya and S. Lazebnik. Learning informative edge maps for indoor scene layout prediction. In ICCV, 2015.
30. D. Marr. Vision. W. H. Freeman and Company, 1982.
31. M. Mostajabi, P. Yadollahpour, and G. Shakhnarovich. Feedforward semantic segmentation with zoom-out features. In CVPR, 2015.
32. J. L. Mundy. Object recognition in the geometric era: A retrospective. In Toward Category-Level Object Recognition, volume 4170 of Lecture Notes in Computer Science. Springer, 2006.
33. J. Papon and M. Schoeler. Semantic pose using deep networks trained on synthetic RGB-D. In ICCV, 2015.
34. X. Peng, K. Saenko, B. Sun, and K. Ali. Learning deep object detectors from 3D models. In ICCV, 2015.
35. B. Pepik, R. Benenson, T. Ritschel, and B. Schiele. What is holding back convnets for detection In GCPR, 2015.
36. L. Roberts. Machine perception of 3-D solids. In PhD. Thesis, 1965.
37. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet large scale visual recognition challenge. IJCV, 2015.
38. A. Schwing, S. Fidler, M. Pollefeys, and R. Urtasun. Box in the box: Joint 3D layout and object reasoning from single images. In ICCV, 2013.
39. A. Schwing and R. Urtasun. Efficient exact inference for 3D indoor scene understanding. In ECCV, 2012.
40. N. Silberman, D. Hoiem, P. Kohli, and R. Fergus. Indoor segmentation and support inference from rgbd images. In ECCV, 2012.
41. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409. 1556, 2014.
42. S. Song and J. Xiao. Sliding shapes for 3d object detection in depth images. In ECCV, 2014.
43. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. JMLR, 2014.
44. H. Su, Q. Huang, N. Mitra, Y. Li, and L. Guibas. Estimating image depth using shape collections. ACM Transactions on Graphics, 33 (4), 2014.
45. H. Su, C. Qi, Y. Li, and L. Guibas. Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views. In ICCV, 2015.
46. X. Wang, D. Fouhey, and A. Gupta. Designing deep networks for surface normal estimation. In CVPR, 2015.
47. Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, and J. Xiao. 3D ShapeNets: A deep representation for volumetric shape modeling. In CVPR, 2015.
48. J. Xiao, B. C. Russell, and A. Torralba. Localizing 3D cuboids in single-view images. In NIPS, 2012.
49. S. Xie and Z. Tu. Holistically-nested edge detection. In ICCV, 2015.