Structured prediction of unobserved voxels from a single depth image

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 5431-5440

  Firman, Michael ^a   Aodha, Oisin Mac ^a   Julier, Simon ^a   Brostow, Gabriel J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; SEMANTICS;

INDIVIDUAL OBJECTS; LOCAL OBSERVATIONS; MULTIPLE VIEWS; STRUCTURED PREDICTION; SURROUNDING NEIGHBORHOOD; UNDER-CONSTRAINED; VOLUMETRIC ELEMENT; VOLUMETRIC MODELING;

PATTERN RECOGNITION;

EID: 84986242782     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.586     Document Type: Conference Paper

References (62)

1. Binvox. www.cs. princeton.edu/?min/binvox, Accessed Nov 2015.
2. I. Biederman. Recognition-by-components: A theory of human image understanding. Psychological Review, 1987.
3. E. Brachmann, A. Krull, F. Michel, S. Gumhold, J. Shotton, and C. Rother. Learning 6D object pose estimation using 3D object coordinates. In ECCV, 2014.
4. T. T. Cocias, F. Moldoveanu, and S. M. Grigorescu. Generic fitted primitives (GFP): Towards full object volumetric reconstruction for service robotics. In Computer Graphics, Visualization and Computer Vision, 2013.
5. A. Criminisi, P. Perez, and K. Toyama. Object removal by exemplar-based inpainting. In CVPR, 2003.
6. A. Criminisi and J. Shotton. Decision forests for computer vision and medical image analysis. Springer Science, 2013.
7. A. Criminisi, J. Shotton, and S. Bucciarelli. Decision forests with long-range spatial context for organ localization in CT volumes. In MICCAI, 2009.
8. B. Curless and M. Levoy. A volumetric method for building complex models from range images. In Computer graphics and interactive techniques, 1996.
9. J. Davis, S. Marschner, M. Garr, and M. Levoy. Filling holes in complex surfaces using volumetric diffusion. In 3DPVT, 2002.
10. S. J. Dickinson, R. Bergevin, I. Biederman, J.-O. Eklundh, R. Munck-Fairwood, A. K. Jain, and A. Pentland. Panel report: The potential of geons for generic 3-D recognition. Image and Vision Computing, 1997.
11. P. Dollár and C. L. Zitnick. Fast edge detection using structured forests. PAMI, 2015.
12. B. Drost and S. Ilic. 3D object detection and localization using multimodal point pair features. In 3DIMPVT, 2012.
13. D. Eigen, C. Puhrsch, and R. Fergus. Depth map prediction from a single image using a multi-scale deep network. In NIPS, 2014.
14. M. Firman. RGBD datasets: Past, present and future. ArXiv: 1604. 00999, 2016.
15. D. F. Fouhey, A. Gupta, and M. Hebert. Data-driven 3D primitives for single image understanding. In ICCV, 2013.
16. Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski. Manhattan-world stereo. In CVPR, 2009.
17. A. Geiger and C. Wang. Joint 3D Object and Layout Inference from a single RGB-D Image. In German Conference on Pattern Recognition, 2015.
18. R. Girshick, J. Shotton, P. Kohli, A. Criminisi, and A. Fitzgibbon. Efficient regression of general-activity human poses from depth images. In ICCV, 2011.
19. R. Guo and D. Hoiem. Support surface prediction in indoor scenes. In ICCV, 2013.
20. A. Gupta, S. Satkin, A. A. Efros, and M. Hebert. From 3D scene geometry to human workspace. In CVPR, 2011.
21. S. Gupta, P. A. Arbeláez, R. B. Girshick, and J. Malik. Aligning 3D models to RGB-D images of cluttered scenes. In CVPR, 2015.
22. N. Halko, P.-G. Martinsson, and J. A. Tropp. Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. SIAM review, 2011.
23. G. Harary and A. Tal. Context-based coherent surface completion. ACM Transactions on Graphics, 2013.
24. J. Hays and A. A. Efros. Scene completion using millions of photographs. SIGGRAPH, 2007.
25. V. Hedau, D. Hoiem, and D. Forsyth. Recovering free space of indoor scenes from a single image. In CVPR, 2012.
26. A. Hermans, G. Floros, and B. Leibe. Dense 3D semantic mapping of indoor scenes from RGB-D images. In ICRA, 2014.
27. S. Hinterstoisser, V. Lepetit, S. Ilic, S. Holzer, G. Bradski, K. Konolige, and N. Navab. Model based training, detection and pose estimation of texture-less 3D objects in heavily cluttered scenes. In ACCV, 2012.
28. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, and A. Fitzgibbon. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In UIST, 2011.
29. Z. Jia, A. Gallagher, A. Saxena, and T. Chen. 3D reasoning from blocks to stability. PAMI, 2015.
30. H. Jiang and J. Xiao. A linear approach to matching cuboids in RGBD images. In CVPR, 2013.
31. E. Johns, S. Leutenegger, and A. J. Davison. Pairwise decomposition of image sequences for active multi-view recognition. In CVPR, 2016.
32. O. Kahler, V. A. Prisacariu, C. Y. Ren, X. Sun, P. H. S. Torr, and D. W. Murray. Very high frame rate volumetric integration of depth images on mobile devices. ISMAR, 2015.
33. B. Kim, P. Kohli, and S. Savarese. 3D scene understanding by voxel-CRF. In ICCV, 2013.
34. J. Kim and K. Grauman. Shape sharing for object segmentation. In ECCV, 2012.
35. O. Kroemer, H. B. Amor, M. Ewerton, and J. Peters. Point cloud completion using extrusions. In International Conference on Humanoid Robots, 2012.
36. K. Lai, L. Bo, and D. Fox. Unsupervised feature learning for 3D scene labeling. In ICRA, 2014.
37. K. Lai, L. Bo, X. Ren, and D. Fox. A large-scale hierarchical multi-view RGB-D object dataset. In ICRA, 2011.
38. A. J. Law and D. G. Aliaga. Single viewpoint model completion of symmetric objects for digital inspection. CVIU, 2010.
39. D. Lin, S. Fidler, and R. Urtasun. Holistic scene understanding for 3D object detection with RGBD cameras. In ICCV, 2013.
40. W. E. Lorensen and H. E. Cline. Marching cubes: A high resolution 3D surface construction algorithm. In SIGGRAPH, 1987.
41. M. R. Oswald, J. Stühmer, and D. Cremers. Generalized connectivity constraints for spatio-temporal 3D reconstruction. In ECCV, 2014.
42. C. Potthast and G. S. Sukhatme. A probabilistic framework for next best view estimation in a cluttered environment. Visual Communication and Image Representation, 2014.
43. V. A. Prisacariu and I. Reid. Shared shape spaces. In ICCV, 2011.
44. J. Rock, T. Gupta, J. Thorsen, J. Gwak, D. Shin, and D. Hoiem. Completing 3D object shape from one depth image. In CVPR, 2015.
45. S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR, 2006.
46. T. Shao, A. Monszpart, Y. Zheng, B. Koo, W. Xu, K. Zhou, and N. J. Mitra. Imagining the unseen: Stability-based cuboid arrangement for scene understanding. In SIGGRAPH Asia, 2014.
47. C.-H. Shen, H. Fu, K. Chen, and S.-M. Hu. Structure recovery by part assembly. In SIGGRAPH Asia, 2012.
48. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In CVPR, 2011.
49. J. Shotton, B. Glocker, C. Zach, S. Izadi, A. Criminisi, and A. Fitzgibbon. Scene coordinate regression forests for camera relocalization in RGB-D images. In CVPR, 2013.
50. N. Silberman, D. Hoiem, P. Kohli, and R. Fergus. Indoor segmentation and support inference from RGBD images. In ECCV, 2012.
51. N. Silberman, L. Shapira, R. Gal, and P. Kohli. A contour completion model for augmenting surface reconstructions. In ECCV, 2014.
52. A. Singh, J. Sha, K. Narayan, T. Achim, and P. Abbeel. Big-BIRD: A large-scale 3D database of object instances. In ICRA, 2014.
53. S. Song, S. Lichtenberg, and J. Xiao. SUN RGB-D: A RGBD scene understanding benchmark suite. In CVPR, 2015.
54. S. Song and J. Xiao. Sliding shapes for 3D object detection in depth images. In ECCV, 2014.
55. S. Song and J. Xiao. Deep sliding shapes for amodal 3D object detection in RGB-D images. In CVPR, 2016.
56. Z. Sui, O. C. Jenkins, and K. Desingh. Axiomatic particle filtering for goal-directed robotic manipulation. In IROS, 2015.
57. M. Sung, V. G. Kim, R. Angst, and L. Guibas. Data-driven structural priors for shape completion. In SIGGRAPH Asia, 2015.
58. S. Thrun and B. Wegbreit. Shape from symmetry. In ICCV, 2005.
59. A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and R. Raskar. Recovering three-dimensional shape around a corner using ultra-fast time-of-flight imaging. Nature Communications, 2012.
60. Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, and J. Xiao. 3D ShapeNets: A deep representation for volumetric shape modeling. In CVPR, 2015.
61. B. Zheng, Y. Zhao, J. C. Yu, K. Ikeuchi, and S.-C. Zhu. Beyond point clouds: Scene understanding by reasoning geometry and physics. In CVPR, 2013.
62. M. Zhu, K. G. Derpanis, Y. Yang, S. Brahmbhatt, M. Zhang, C. Phillips, M. Lecce, and K. Daniilidis. Single image 3D object detection and pose estimation for grasping. In ICRA, 2014.