An interactive approach to semantic modeling of indoor scenes with an RGBD Camera

ACM Transactions on Graphics

Volumn 31, Issue 6, 2012, Pages

  Shao, Tianjia ^a   Xu, Weiwei ^b,d   Zhou, Kun ^c   Wang, Jingdong ^d   Li, Dongping ^c   Guo, Baining ^d  

^a TSINGHUA UNIVERSITY   (China)

^b HANGZHOU NORMAL UNIVERSITY   (China)

^c ZHEJIANG UNIVERSITY   (China)

^d MICROSOFT RESEARCH ASIA   (China)

Author keywords

Depth images; Indoor scene; Labeling; Random Regress Forest; Segmentation

Indexed keywords

3D MODELS; DEPTH IMAGE; IMAGE DEPTH; INDOOR SCENE; INTERACTIVE APPROACH; MULTIPLE IMAGE; RANDOM REGRESS FOREST; SEMANTIC LABELS; SEMANTIC MODELING; SINGLE IMAGES;

CAMERAS; IMAGE MATCHING; LABELING; SEMANTICS;

IMAGE SEGMENTATION;

EID: 84870210140     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2366145.2366155     Document Type: Conference Paper

References (39)

1. ANAND, A., KOPPULA, H. S., JOACHIMS, T., AND SAXENA, A. 2011. Contextually guided semantic labeling and search for 3d point clouds. CoRR abs/1111.5358.
2. BLUM, M., SPRINGENBERG, J. T., WULFING, J., AND RIEDMILLER, M. 2011. On the applicability of unsupervised feature learning for object recognition in rgb-d data. In NIPS Workshop on Deep Learning and Unsupervised Feature Learning.
3. BO, L., REN, X., , AND FOX, D. 2011. Depth kernel descriptors for object recognition. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
4. BOYKOV, Y., VEKSLER, O., AND ZABIH, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 11 (Nov.), 1222-1239.
5. BREIMAN, L. 2001. Random forests. Mach. Learn. 45, 1 (Oct.), 5-32.
6. BRONSTEIN, A. M., BRONSTEIN, M. M., GUIBAS, L. J., AND OVSJANIKOV, M. 2011. Shape google: Geometric words and expressions for invariant shape retrieval. ACM Trans. Graph. 30, 1 (Feb.), 1:1-1:20.
7. CLARK, J. 2011. Object digitization for everyone. IEEE Computer 44, 10 (Oct.), 81-83.
8. DIETTERICH, T. G. 2000. An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Mach. Learn. 40, 2 (Aug.), 139-157.
9. DU, H., HENRY, P., REN, X., CHENG, M., GOLDMAN, D. B., SEITZ, S. M., AND FOX, D. 2011. Interactive 3d modeling of indoor environments with a consumer depth camera. In Proceedings of Ubicomp, 75-84.
10. FANELLI, G., WEISE, T., GALL, J., AND GOOL, L. V. 2011. Real time head pose estimation from consumer depth cameras. In Proceedings of the 33rd international conference on Pattern recognition, Springer-Verlag, Berlin, Heidelberg, DAGM'11, 101-110.
11. FOX, D., BURGARD, W., DELLAERT, F., AND THRUN, S. 1999. Monte carlo localization: efficient position estimation for mobile robots. In Proceedings of AAAI'99/IAAI'99, American Association for Artificial Intelligence, Menlo Park, CA, USA, AAAI '99/IAAI '99, 343-349.
12. FUNKHOUSER, T., MIN, P., KAZHDAN, M., CHEN, J., HALDERMAN, A., DOBKIN, D., AND JACOBS, D. 2003. A search engine for 3d models. ACM Trans. Graph. 22, 1 (Jan.), 83-105.
13. FURUKAWA, Y., AND PONCE, J. 2010. Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32, 8 (Aug.), 1362-1376.
14. FURUKAWA, Y., CURLESS, B., SEITZ, S. M., AND SZELISKI, R. 2009. Manhattan-world stereo. CVPR, 1422-1429.
15. FURUKAWA, Y., CURLESS, B., SEITZ, S. M., AND SZELISKI, R. 2009. Reconstructing Building Interiors from Images. In ICCV.
16. GOLOVINSKIY, A., KIM, V., AND FUNKHOUSER, T. 2009. Shape-based recognition of 3d point clouds in urban environments. In ICCV.
17. HARTLEY, R. I., AND ZISSERMAN, A. 2004. Multiple View Geometry in Computer Vision, second ed. Cambridge University Press.
18. HENRY, P., KRAININ, M., HERBST, E., REN, X., AND FOX, D. 2012. Rgbd mapping: Using depth cameras for dense 3d modeling of indoor environments. Internatioal Journal of Robotics Research 31, 5, 647-663.
19. IZADI, S., KIM, D., HILLIGES, O., MOLYNEAUX, D., NEWCOMBE, R., KOHLI, P., SHOTTON, J., HODGES, S., FREEMAN, D., DAVISON, A., AND FITZGIBBON, A. 2011. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM, New York, NY, USA, UIST '11, 559-568.
20. JANOCH, A., KARAYEV, S., JIA, Y., BARRON, J. T., FRITZ, M., SAENKO, K., AND DARRELL, T. 2011. A category-level 3-d object dataset: Putting the kinect to work. In ICCV Workshop on Consumer Depth Cameras for Computer Vision, 1168-1174.
21. JOHNSON, A. E., AND HEBERT, M. 1999. Using spin images for efficient object recognition in cluttered 3d scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21, 5 (May), 433-449.
22. KIM, Y. M., MITRA, N. J., YAN, D. M., AND GUIBAS, L. 2012. Acquiring 3d indoor environments with variability and repetition. To appear in SIGGRAPH Asia 2012.
23. KOPPULA, H., ANAND, A., JOACHIMS, T., AND SAXENA, A. 2011. Semantic labeling of 3d point clouds for indoor scenes. In NIPS.
24. LAI, K., AND FOX, D. 2010. Object recognition in 3d point clouds using web data and domain adaptation. International Journal of Robotics Research 29, 8 (July), 1019-1037.
25. LAI, K., BO, L., REN, X., AND FOX, D. 2011. A large-scale hierarchical multi-view rgb-d object dataset. In Proc. of IEEE International Conference on Robotics and Automation.
26. LI, Y., SUN, J., TANG, C.-K. AND SHUM, H.-Y. 2004. Lazy snapping. ACM Trans. Graph. 23, 3 (Aug.), 303-308.
27. LI, Y., WU, X., CHRYSATHOU, Y., SHARF, A., COHEN-OR, D. AND MITRA, N. J. 2011. Globfit: consistently fitting primitives by discovering global relations. ACM Trans. Graph. 30, 4 (Aug.), 52:1-52:12.
28. LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2 (Nov.), 91-110.
29. MERRELL, P., SCHKUFZA, E., LI, Z., AGRAWALA, M., AND KOLTUN, V. 2011. Interactive furniture layout using interior design guidelines. ACM Trans. Graph. 30 (July), 87:1-87:12.
30. NAN, L., XIE, K., AND SHARF, A. 2012. A search-classify approach for cluttered indoor scene understanding. To appear in SIGGRAPH Asia 2012.
31. SCHNABEL, R., WAHL, R., AND KLEIN, R. 2007. Efficient ransac for point-cloud shape detection. Computer Graphics Forum 26, 2 (June), 214-226.
32. SILBERMAN, N., AND FERGUS, R. 2011. Indoor scene segmentation using a structured light sensor. In Proceedings of the International Conference on Computer Vision-Workshop on 3D Representation and Recognition.
33. SILBERMAN, N., HOIEM, D., KOHLI, P., AND FERGUS, R. 2012. Indoor segmentation and support inference from rgbd images. In ECCV.
34. SNAVELY, N., SEITZ, S. M., AND SZELISKI, R. 2006. Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 25, 3 (July), 835-846.
35. TANGELDER, J. W., AND VELTKAMP, R. C. 2008. A survey of content based 3d shape retrieval methods. Multimedia Tools Appl. 39, 3 (Sept.), 441-471.
36. TRIGGS, B., MCLAUCHLAN, P., HARTLEY, R., AND FITZGIBBON, A. 2000. Bundle adjustment a modern synthesis. In Vision Algorithms: Theory and Practice, LNCS, Springer Verlag, 298-375.
37. WHITAKER, R. T., GREGOR, J., AND CHEN, P. F. 1999. Indoor scene reconstruction from sets of noisy range images. In Proceedings of the 2nd international conference on 3-D digital imaging and modeling, 3DIM'99, 348-357.
38. XIONG, X., AND HUBER, D. 2010. Using context to create semantic 3d models of indoor environments. In BMVC, 1-11.
39. YU, L.-F. YEUNG, S.-K., TANG, C.-K., TERZOPOULOS, D., CHAN, T. F., AND OSHER, S. J. 2011. Make it home: automatic optimization of furniture arrangement. ACM Trans. Graph. 30 (July), 86:1-86:12.