Autoscanning for coupled scene reconstruction and proactive object analysis

ACM Transactions on Graphics

Volumn 34, Issue 6, 2015, Pages

  Xu, Kai ^a,b   Huang, Hui ^a   Shi, Yifei ^b   Li, Hao ^c   Long, Pinxin ^a   Caichen, Jianong ^a,b   Sun, Wei ^a   Chen, Baoquan ^c  

^a SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^b NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^c SHANDONG UNIVERSITY   (China)

Author keywords

Autonomous scanning; Object aware reconstruction; Proactive analysis; Scene reconstruction

Indexed keywords

DIGITAL STORAGE; GRAPHIC METHODS; ITERATIVE METHODS; ROBOTS; SCANNING;

CURRENT ANALYSIS; INFORMATION GAIN; LEVEL OF DETAIL; OBJECT EXTRACTION; PROACTIVE ANALYSIS; RECONSTRUCTION QUALITY; SCENE ACQUISITION; SCENE RECONSTRUCTION;

UNCERTAINTY ANALYSIS;

EID: 84995916459     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2816795.2818075     Document Type: Conference Paper

References (46)

1. ALLEN, P. K. 1988. Integrating vision and touch for object recognition tasks. Int. J. Robotics Research 7, 6, 1533.
2. BACH, F., LANCKRIET, G., AND JORDAN, M. 2004. Multiple kernel learning, conic duality, and the smo algorithm. In Proc. ICML, 1-6.
3. BERGER, M., TAGLIASACCHI, A., SEVERSKY, L. M., ALLIEZ, P., LEVINE, J. A., SHARF, A., AND SILVA, C. 2014. State of the art in surface reconstruction from point clouds. Eurographics STAR, 165-185.
4. BERSCH, C., PANGERCIC, D., OSENTOSKI, S., HAUSMAN, K., MARTON, Z.-C., UEDA, R., OKADA, K., AND BEETZ, M. 2012. Segmentation of cluttered scenes through interactive perception. In RSS Workshop on Robots in Clutter: Manipulation, Perception and Navigation in Human Environments.
5. CALLIERI, M., FASANO, A., IMPOCO, G., CIGNONI, P., SCOPIGNO, R., PARRINI, G., AND BIAGINI, G. 2004. Roboscan: an automatic system for accurate and unattended 3D scanning. In Proc. of 3DPVT, 805-812.
6. CHEN, S., LI, Y., AND KWOK, N. M. 2011. Active vision in robotic systems: A survey of recent developments. Int. J. Robotics Research 30, 11, 1343-1377.
7. CHEN, J., BAUTEMBACH, D., AND IZADI, S. 2013. Scalable realtime volumetric surface reconstruction. ACM Trans. on Graph. (SIGGRAPH) 32, 4, 113:1-113:16.
8. CHEN, X., GOLOVINSKIY, A., AND FUNKHOUSER, T. 2013. A benchmark for 3D mesh segmentation. ACM Trans. on Graph. (SIGGRAPH) 28, 3, 73:1-73:12.
9. CHEN, K., LAI, Y.-K., WU, Y.-X., MARTIN, R., AND HU, S.-M. 2014. Automatic semantic modeling of indoor scenes from low-quality rgb-d data using contextual information. ACM Trans. on Graph. (SIGGRAPH Asia) 33, 6, 208:1-208:15.
10. COVER, T., AND THOMAS, J. 1991. Elements of Information Theory. Wiley.
11. CRAMMER, K., DEKEL, O., KESHET, J., SHALEV-SHWARTZ, S., AND SINGER, Y. 2006. Online passive-aggressive algorithms. J. Mach. Learn. Res. 7 (Dec.), 551-585.
12. CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In Proc. of SIGGRAPH, 303-312.
13. FISHER, M., SAVVA, M., AND HANRAHAN, P. 2011. Characterizing structural relationships in scenes using graph kernels. ACM Trans. on Graph. (SIGGRAPH) 30, 4, 34:1-34:11.
14. FISHER, M., RITCHIE, D., SAVVA, M., FUNKHOUSER, T., AND HANRAHAN, P. 2012. Example-based synthesis of 3D object arrangements. ACM Trans. on Graph. (SIGGRAPH Asia) 31, 6, 135:1-135:11.
15. FOSTER, R. B., WANG, R., AND GRUPEN, R. 2011. A mobile robot for autonomous scene capture and rendering. UMass Technical Report UM-CS-2011-019.
16. GOLOVINSKIY, A., KIM, V. G., AND FUNKHOUSER, T. A. 2009. Shape-based recognition of 3D point clouds in urban environments. In Proc. ICCV, 2154-2161.
17. GUPTA, S., ARBELAEZ, P., AND MALIK, J. 2013. Perceptual organization and recognition of indoor scenes from RGB-D images. In Proc. CVPR, 564-571.
18. HAUSMAN, K., BALINT-BENCZEDI, F., PANGERCIC, D., MARTON, Z.-C., UEDA, R., OKADA, K., AND BEETZ, M. 2013. Tracking-based interactive segmentation of textureless objects. In Proc. ICRA, 1122-1129.
19. HEDAU, V., HOIEM, D., AND FORSYTH, D. 2010. Thinking inside the box: Using appearance models and context based on room geometry. In Proc. ECCV. 224-237.
20. HERBST, E., HENRY, P., AND FOX, D. 2014. Toward online 3-D object segmentation and mapping. In Proc. ICRA, 3193-3200.
21. JIANG, Y., AND SAXENA, A. 2013. Hallucinating humans for learning robotic placement of objects. In Proc. Experimental Robotics, 921-937.
22. KATZ, S., AND TAL, A. 2003. Hierarchical mesh decomposition using fuzzy clustering and cuts. ACM Trans. on Graph. (SIGGRAPH) 22, 3, 954-961.
23. KHALFAOUI, S., SEULIN, R., FOUGEROLLE, Y., AND FOFI, D. 2013. An efficient method for fully automatic 3D digitization of unknown objects. Computers in Industry 64, 9, 1152-1160.
24. KIM, Y. M., MITRA, N. J., YAN, D.-M., AND GUIBAS, L. 2012. Acquiring 3D indoor environments with variability and repetition. ACM Trans. on Graph. (SIGGRAPH Asia) 31, 6, 138:1-138:11.
25. LEVANDOWSKY, M., AND WINTER, D. 1971. Distance between sets. Nature 234, 5, 34-35.
26. LI, Y., DAI, A., GUIBAS, L., AND NIESSNER, M. 2015. Database-assisted object retrieval for real-time 3D reconstruction. Computer Graphics Forum (Eurographics) 34, 2.
27. LIU, T., CHAUDHURI, S., KIM, V. G., HUANG, Q., MITRA, N. J., AND FUNKHOUSER, T. 2014. Creating consistent scene graphs using a probabilistic grammar. ACM Trans. on Graph. (SIGGRAPH Asia) 33, 6, 211:1-211:12.
28. MATTAUSCH, O., PANOZZO, D., MURA, C., SORKINE-HORNUNG, O., AND PAJAROLA, R. 2014. Object detection and classification from large-scale cluttered indoor scans. Computer Graphics Forum (Eurographics) 33, 2.
29. NAN, L., XIE, K., AND SHARF, A. 2012. A search-classify approach for cluttered indoor scene understanding. ACM Trans. on Graph. (SIGGRAPH Asia) 31, 6, 137:1-137:10.
30. NEWCOMBE, R. A., DAVISON, A. J., IZADI, S., KOHLI, P., HILLIGES, O., SHOTTON, J., MOLYNEAUX, D., HODGES, S., KIM, D., AND FITZGIBBON, A. 2011. KinectFusion: Real-time dense surface mapping and tracking. In Proc. IEEE Int. Symp. on Mixed and Augmented Reality, 127-136.
31. NIESSNER, M., ZOLLHÖFER, M., IZADI, S., AND STAMMINGER, M. 2013. Real-time 3D reconstruction at scale using voxel hashing. ACM Trans. on Graph. (SIGGRAPH Asia) 32, 6, 169:1-169:11.
32. PAPON, J., ABRAMOV, A., SCHOELER, M., AND WÖRGÖTTER, F. 2013. Voxel cloud connectivity segmentation - supervoxels for point clouds. In Proc. CVPR, 2027-2034.
33. PRISACARIU, V. A., KÄHLER, O., CHENG, M. M., VALENTIN, J., TORR, P. H. S., REID, I. D., AND MURRAY, D. W. 2014. A framework for the volumetric integration of depth images. ArXiv e-prints, 1410.0925.
34. ROS, 2014. ROS Wiki. http://wiki.ros.org/.
35. ROTH, H., AND VONA, M. 2012. Moving volume KinectFusion. In Proc. BMVC, 112:1-112:11.
36. SALAS-MORENO, R. F., NEWCOMBE, R. A., STRASDAT, H., KELLY, P. H. J., AND DAVISON, A. J. 2012. SLAM++: Simultaneous localisation and mapping at the level of objects. In CVPR, 1352-1359.
37. SAVVA, M., CHANG, A. X., HANRAHAN, P., FISHER, M., AND NIESSNER, M. 2014. Scenegrok: Inferring action maps in 3D environments. ACM Trans. on Graph. (SIGGRAPH Asia) 33, 6.
38. SCHNABEL, R., WAHL, R., AND KLEIN, R. 2007. Efficient RANSAC for point-cloud shape detection. Computer Graphics Forum 26, 2, 214-226.
39. SHAO, T., XU, W., ZHOU, K., WANG, J., LI, D., AND GUO, B. 2012. An interactive approach to semantic modeling of indoor scenes with an RGBD camera. ACM Trans. on Graph. (SIGGRAPH Asia) 31, 6, 136:1-136:11.
40. SILBERMAN, N., KOHLI, P., HOIEM, D., AND FERGUS, R. 2012. Indoor segmentation and support inference from RGBD images. In Proc. ECCV, 746-760.
41. VALENTIN, J., VINEET, V., CHENG, M.-M., KIM, D., SHOTTON, J., KOHLI, P., NIESSNER, M., CRIMINISI, A., IZADI, S., AND TORR, P. 2015. SemanticPaint: Interactive 3D labeling and learning at your finger tips. ACM Trans. on Graph., to appear.
42. WAGNER, R., FRESE, U., AND BUML, B. 2013. Real-time dense multi-scale workspace modeling on a humanoid robot. In Proc. IROS, 5164-5171.
43. WHELAN, T., KAESS, M., FALLON, M., JOHANNSSON, H., LEONARD, J., AND MCDONALD, J. 2012. Kintinuous: Spatially extended KinectFusion. In RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras.
44. WU, S., SUN, W., LONG, P., HUANG, H., COHEN-OR, D., GONG, M., DEUSSEN, O., AND CHEN, B. 2014. Quality-driven poisson-guided autoscanning. ACM Trans. on Graph. (SIGGRAPH Asia) 33, 6, 203:1-203:12.
45. ZHANG, Y., XU, W., TONG, Y., AND ZHOU, K. 2014. Online structure analysis for real-time indoor scene reconstruction. ACM Trans. on Graph..
46. ZHOU, Q.-Y., AND KOLTUN, V. 2013. Dense scene reconstruction with points of interest. ACM Trans. on Graph. (SIGGRAPH) 32, 4, 112:1-112:8.