3D semantic parsing of large-scale indoor spaces

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1534-1543

  Armeni, Iro ^a   Sener, Ozan ^a,b   Zamir, Amir R ^a   Jiang, Helen ^a   Brilakis, Ioannis ^c   Fischer, Martin ^a   Savarese, Silvio ^a  

^a STANFORD UNIVERSITY   (United States)

^b Cornell University ^*  (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; SEMANTICS;

BUILDING ELEMENT; CANONICAL COORDINATE SYSTEMS; DETECTION PROBLEMS; GEOMETRIC PATTERNS; HIERARCHICAL APPROACH; REFERENCE COORDINATE SYSTEM; SEMANTIC PARSING; STRUCTURAL ELEMENTS;

PATTERN RECOGNITION;

EID: 84986325920     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.170     Document Type: Conference Paper

References (41)

1. Matterport 3d models of interior spaces. http: //matterport. com/. Accessed: 2015-06-01.
2. Microsoft kinect. https: //www. microsoft. com/en-us/kinectforwindows/. Accessed: 2015-06-01.
3. Accurate Localization of 3D Objects from RGB-D Data using Segmentation Hypotheses, 2013.
4. M. Alzantot and M. Youssef. Crowdinside: Automatic construction of indoor floorplans. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems, pages 99-108. ACM, 2012.
5. I. Armeni, S. Ozan, Z. Amir, H. Jiang, I. Brilakis, M. Fischer, and S. Savarese. Supplementary material for: 3d semantic parsing for large-scale indoor spaces. http: //buildingparser. stanford. edu/images/supp-mat. pdf. Accessed: 2016-04-09.
6. J. Behley, V. Steinhage, and A. Cremers. Laser-based segment classification using a mixture of bag-of-words. In Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on, pages 4195-4200. IEEE, 2013.
7. L. Bo, K. Lai, X. Ren, and D. Fox. Object recognition with hierarchical kernel descriptors. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 1729-1736. IEEE, 2011.
8. M. Everingham, L. Van Gool, C. K. Williams, J. Winn, and A. Zisserman. The pascal visual object classes (voc) challenge. International journal of computer vision, 88 (2): 303-338, 2010.
9. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research, 9: 1871-1874, 2008.
10. B. J. Frey and D. Dueck. Clustering by passing messages between data points. Science, 315: 972-976, 2007.
11. A. Geiger, P. Lenz, C. Stiller, and R. Urtasun. Vision meets robotics: The kitti dataset. The International Journal of Robotics Research, page 0278364913491297, 2013.
12. B. Ghanem, A. Thabet, J. Carlos Niebles, and F. Caba Heilbron. Robust manhattan frame estimation from a single rgbd image. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
13. S. Gupta, R. Girshick, P. Arbeláez, and J. Malik. Learning rich features from rgb-d images for object detection and segmentation. In Computer Vision-ECCV 2014, pages 345-360. Springer, 2014.
14. A. Hermans, G. Floros, and B. Leibe. Dense 3d semantic mapping of indoor scenes from rgb-d images. In Robotics and Automation (ICRA), 2014 IEEE International Conference on, pages 2631-2638. IEEE, 2014.
15. D. Koller and N. Friedman. Probabilistic graphical models: principles and techniques. MIT press, 2009.
16. H. Koppula and A. Saxena. Anticipating human activities using object affordances for reactive robotic response. 2013.
17. H. S. Koppula, R. Gupta, and A. Saxena. Learning human activities and object affordances from rgb-d videos. The International Journal of Robotics Research, 32 (8): 951-970, 2013.
18. C. Liu, A. Schwing, K. Kundu, R. Urtasun, and S. Fidler. Rent3d: Floor-plan priors for monocular layout estimation. In CVPR, 2015.
19. T. Malisiewicz, A. Gupta, A. Efros, et al. Ensemble of exemplar-svms for object detection and beyond. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 89-96. IEEE, 2011.
20. C. Mura, O. Mattausch, A. J. Villanueva, E. Gobbetti, and R. Pajarola. Automatic room detection and reconstruction in cluttered indoor environments with complex room layouts. Computers & Graphics, 44: 20-32, 2014.
21. L. Nan, K. Xie, and A. Sharf. A search-classify approach for cluttered indoor scene understanding. ACM Transactions on Graphics (TOG), 31 (6): 137, 2012.
22. A. Nüchter and J. Hertzberg. Towards semantic maps for mobile robots. Robotics and Autonomous Systems, 56 (11): 915-926, 2008.
23. S. Ochmann, R. Vock, R. Wessel, M. Tamke, and R. Klein. Automatic generation of structural building descriptions from 3d point cloud scans. In GRAPP 2014-International Conference on Computer Graphics Theory and Applications. SCITEPRESS, Jan. 2014.
24. J. Papon, A. Abramov, M. Schoeler, and F. Worgotter. Voxel cloud connectivity segmentation-supervoxels for point clouds. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 2027-2034. IEEE, 2013.
25. W. M. Rand. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical association, 66 (336): 846-850, 1971.
26. X. Ren, L. Bo, and D. Fox. Rgb-(d) scene labeling: Features and algorithms. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2759-2766. IEEE, 2012.
27. R. Schnabel, R. Wahl, and R. Klein. Efficient ransac for point-cloud shape detection. In Computer graphics forum, volume 26, pages 214-226. Wiley Online Library, 2007.
28. O. Sener and A. Saxena. rcrf: Recursive belief estimation over crfs in rgb-d activity videos. In Proceedings of Robotics: Science and Systems, Rome, Italy, July 2015.
29. T. Shao, W. Xu, K. Zhou, J. Wang, D. Li, and B. Guo. An interactive approach to semantic modeling of indoor scenes with an rgbd camera. ACM Transactions on Graphics (TOG), 31 (6): 136, 2012.
30. N. Silberman and R. Fergus. Indoor scene segmentation using a structured light sensor. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pages 601-608. IEEE, 2011.
31. N. Silberman, D. Hoiem, P. Kohli, and R. Fergus. Indoor segmentation and support inference from rgbd images. In Computer Vision-ECCV 2012, pages 746-760. Springer, 2012.
32. S. Song and J. Xiao. Sliding shapes for 3d object detection in rgb-d images. In European Conference on Computer Vision, volume 2, page 6, 2014.
33. P. Steadman. Why are most buildings rectangular Architectural Research Quarterly, 10 (02): 119-130, 2006.
34. J. Straub, G. Rosman, O. Freifeld, J. J. Leonard, and J. W. Fisher. A mixture of manhattan frames: Beyond the manhattan world. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 3770-3777. IEEE, 2014.
35. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. In Proceedings of the twenty-first international conference on Machine learning, page 104. ACM, 2004.
36. E. Turner and A. Zakhor. Floor plan generation and room labeling of indoor environments from laser range data, 2014.
37. D. Z. Wang and I. Posner. Voting for voting in online point cloud object detection. In Proceedings of Robotics: Science and Systems, Rome, Italy, July 2015.
38. J. Xiao and Y. Furukawa. Reconstructing the worlds museums. In Computer Vision-ECCV 2012, pages 668-681. Springer, 2012.
39. J. Xiao, A. Owens, and A. Torralba. Sun3d: A database of big spaces reconstructed using sfm and object labels. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1625-1632. IEEE, 2013.
40. X. Xiong, A. Adan, B. Akinci, and D. Huber. Automatic creation of semantically rich 3d building models from laser scanner data. Automation in Construction, 31: 325-337, 2013.
41. Y. Zhang, S. Song, P. Tan, and J. Xiao. Panocontext: A whole-room 3d context model for panoramic scene understanding. In Computer Vision-ECCV 2014, pages 668-686. Springer, 2014.