Color map optimization for 3D reconstruction with consumer depth cameras

ACM Transactions on Graphics

Volumn 33, Issue 4, 2014, Pages

  Zhou, Qian Yi ^a   Koltun, Vladlen ^b  

^a STANFORD UNIVERSITY   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

3d reconstruction; Consumer depth cameras; Optimization; Range imaging; Texture mapping

Indexed keywords

ALGORITHMS; COLOR; COLOR IMAGE PROCESSING; GLOBAL OPTIMIZATION; INTERACTIVE COMPUTER GRAPHICS; MAPPING; OPTIMIZATION; CAMERAS; COMPUTER VISION; IMAGE RECONSTRUCTION;

3D RECONSTRUCTION; ALTERNATING OPTIMIZATIONS; CORRECTION FUNCTION; DEPTH CAMERA; OPTICAL DISTORTION; OPTIMIZATION APPROACH; RANGE IMAGING; TEXTURE MAPPING; COLORMAP; CONSUMER DEPTH CAMERA; GLOBAL OPTIMISATION; MAP OPTIMIZATIONS; OPTIMISATIONS;

CAMERAS; GLOBAL OPTIMIZATION;

EID: 84905718962     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/2601097.2601134     Document Type: Conference Paper

References (45)

1. AGANJ, E., MONASSE, P., AND KERIVEN, R. 2009. Multi-view texturing of imprecise mesh. In ACCV.
2. BAUMBERG, A. 2002. Blending images for texturing 3D models. In BMVC.
3. BERNARDINI, F., MARTIN, I. M., AND RUSHMEIER, H. E. 2001. High-quality texture reconstruction from multiple scans. IEEE Transactions on Visualization and Computer Graphics 7, 4.
4. BYLOW, E., STURM, J., KERL, C., KAHL, F., AND CREMERS, D. 2013. Real-time camera tracking and 3D reconstruction using signed distance functions. In RSS.
5. CALLIERI, M., CIGNONI, P., CORSINI, M., AND SCOPIGNO, R. 2008. Masked photo blending: Mapping dense photographic data set on high-resolution sampled 3D models. Computers & Graphics 32, 3.
6. CHEN, Q., AND KOLTUN, V. 2013. A simple model for intrinsic image decomposition with depth cues. In ICCV.
7. CHEN, J., BAUTEMBACH, D., AND IZADI, S. 2013. Scalable real-time volumetric surface reconstruction. ACM Transactions on Graphics 32, 4.
8. CHUANG, M., LUO, L., BROWN, B. J., RUSINKIEWICZ, S., AND KAZHDAN, M. M. 2009. Estimating the Laplace-Beltrami operator by restricting 3D functions. Computer Graphics Forum 28, 5.
9. CORSINI, M., DELLEPIANE, M., PONCHIO, F., AND SCOPIGNO, R. 2009. Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties. Computer Graphics Forum 28, 7.
10. CORSINI, M., DELLEPIANE, M., GANOVELLI, F., GHERARDI, R., FUSIELLO, A., AND SCOPIGNO, R. 2013. Fully automatic registration of image sets on approximate geometry. International Journal of Computer Vision 102, 1-3.
11. CRETE, F., DOLMIERE, T., LADRET, P., AND NICOLAS, M. 2007. The blur effect: perception and estimation with a new no-reference perceptual blur metric. In SPIE.
12. DELLEPIANE, M., MARROQUIM, R., CALLIERI, M., CIGNONI, P., AND SCOPIGNO, R. 2012. Flow-based local optimization for image-to-geometry projection. IEEE Transactions on Visualization and Computer Graphics 18, 3.
13. ENDRES, F., HESS, J., STURM, J., CREMERS, D., AND BURGARD, W. 2014. 3D mapping with an RGB-D camera. IEEE Transactions on Robotics 30, 1.
14. FRANKEN, T., DELLEPIANE, M., GANOVELLI, F., CIGNONI, P., MONTANI, C., AND SCOPIGNO, R. 2005. Minimizing user intervention in registering 2D images to 3D models. The Visual Computer 21, 8-10.
15. GAL, R., WEXLER, Y., OFEK, E., HOPPE, H., AND COHEN-OR, D. 2010. Seamless montage for texturing models. Computer Graphics Forum 29, 2.
16. IKEUCHI, K., OISHI, T., TAKAMATSU, J., SAGAWA, R., NAKAZAWA, A., KURAZUME, R., NISHINO, K., KAMAKURA, M., AND OKAMOTO, Y. 2007. The great Buddha project: Digitally archiving, restoring, and analyzing cultural heritage objects. International Journal of Computer Vision 75, 1.
17. IZADI, S., KIM, D., HILLIGES, O., MOLYNEAUX, D., NEW-COMBE, R. A., KOHLI, P., SHOTTON, J., HODGES, S., FREEMAN, D., DAVISON, A. J., AND FITZGIBBON, A. W. 2011. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In UIST.
18. JOHNSON, A. E., AND KANG, S. B. 1999. Registration and integration of textured 3D data. Image and Vision Computing 17, 2.
19. LAFFONT, P.-Y., BOUSSEAU, A., AND DRETTAKIS, G. 2013. Rich intrinsic image decomposition of outdoor scenes from multiple views. IEEE Transactions on Visualization and Computer Graphics 19, 2.
20. LEMPITSKY, V. S., AND IVANOV, D. V. 2007. Seamless mosaicing of image-based texture maps. In CVPR.
21. LENSCH, H. P. A., HEIDRICH, W., AND SEIDEL, H.-P. 2001. A silhouette-based algorithm for texture registration and stitching. Graphical Models 63, 4.
22. LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., SHADE, J., AND FULK, D. 2000. The digital Michelangelo project: 3D scanning of large statues. In SIGGRAPH.
23. LI, H., VOUGA, E., GUDYM, A., LUO, L., BARRON, J. T., AND GUSEV, G. 2013. 3D self-portraits. ACM Transactions on Graphics 32, 6.
24. LIU, L., AND STAMOS, I. 2012. A systematic approach for 2D-image to 3D-range registration in urban environments. Computer Vision and Image Understanding 116, 1.
25. NEUGEBAUER, P. J., AND KLEIN, K. 1999. Texturing 3D models of real world objects from multiple unregistered photographic views. Computer Graphics Forum 18, 3.
26. NEWCOMBE, R. A., IZADI, S., HILLIGES, O., MOLYNEAUX, D., KIM, D., DAVISON, A. J., KOHLI, P., SHOTTON, J., HODGES, S., AND FITZGIBBON, A. 2011. KinectFusion: Real-time dense surface mapping and tracking. In ISMAR.
27. NIESSNER, M., ZOLLHÖFER, M., IZADI, S., AND STAMMINGER, M. 2013. Real-time 3D reconstruction at scale using voxel hashing. ACM Transactions on Graphics 32, 6.
28. OFEK, E., SHILAT, E., RAPPOPORT, A., AND WERMAN, M. 1997. Multiresolution textures from image sequences. IEEE Computer Graphics and Applications 17, 2.
29. PETERS, J., AND REIF, U. 1997. The simplest subdivision scheme for smoothing polyhedra. ACM Transactions on Graphics 16, 4.
30. PIGHIN, F. H., HECKER, J., LISCHINSKI, D., SZELISKI, R., AND SALESIN, D. 1998. Synthesizing realistic facial expressions from photographs. In SIGGRAPH.
31. PULLI, K., AND SHAPIRO, L. G. 2000. Surface reconstruction and display from range and color data. Graphical Models 62, 3.
32. PULLI, K., PIIROINEN, S., DUCHAMP, T., AND STUETZLE, W. 2005. Projective surface matching of colored 3D scans. In 3DIM.
33. ROCCHINI, C., CIGNONI, P., MONTANI, C., AND SCOPIGNO, R. 1999. Multiple texture stitching and blending on 3D objects. In Rendering Techniques.
34. RUSU, R. B., AND COUSINS, S. 2011. 3D is here: Point Cloud Library (PCL). In ICRA.
35. SHAN, Q., ADAMS, R., CURLESS, B., FURUKAWA, Y., AND SEITZ, S. M. 2013. The visual Turing test for scene reconstruction. In 3DV.
36. SINHA, S. N., STEEDLY, D., SZELISKI, R., AGRAWALA, M., AND POLLEFEYS, M. 2008. Interactive 3D architectural modeling from unordered photo collections. ACM Transactions on Graphics 27, 5.
37. STAMOS, I., AND ALLEN, P. K. 2000. 3-D model construction using range and image data. In CVPR.
38. STAMOS, I., AND ALLEN, P. K. 2002. Geometry and texture recovery of scenes of large scale. Computer Vision and Image Understanding 88, 2.
39. STURM, J., BYLOW, E., KAHL, F., AND CREMERS, D. 2013. CopyMe3D: Scanning and printing persons in 3D. In GCPR.
40. TROCCOLI, A., AND ALLEN, P. K. 2008. Building illumination coherent 3D models of large-scale outdoor scenes. International Journal of Computer Vision 78, 2-3.
41. WEYRICH, T., LAWRENCE, J., LENSCH, H. P. A., RUSINKIEWICZ, S., AND ZICKLER, T. 2009. Principles of appearance acquisition and representation. Foundations and Trends in Computer Graphics and Vision 4, 2.
42. WHELAN, T., JOHANNSSON, H., KAESS, M., LEONARD, J., AND MCDONALD, J. 2013. Robust real-time visual odometry for dense RGB-D mapping. In ICRA.
43. YAMAUCHI, H., LENSCH, H. P. A., HABER, J., AND SEIDEL, H.-P. 2005. Textures revisited. The Visual Computer 21, 4.
44. ZHOU, Q.-Y., AND KOLTUN, V. 2013. Dense scene reconstruction with points of interest. ACM Transactions on Graphics 32, 4.
45. ZHOU, Q.-Y., MILLER, S., AND KOLTUN, V. 2013. Elastic fragments for dense scene reconstruction. In ICCV.