Online loop closure for real-time interactive 3D scanning

Computer Vision and Image Understanding

Volumn 115, Issue 5, 2011, Pages 635-648

  Weise, Thibaut ^a   Wismer, Thomas ^b   Leibe, Bastian ^c   Gool, Luc Van ^b,d  

^a EPFL   (Switzerland)

^b ETH ZURICH   (Switzerland)

^c RWTH AACHEN UNIVERSITY   (Germany)

^d UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

3D modeling; 3D scanning; Integration; Loop closure; Registration

Indexed keywords

3-D MODELING; 3D MODELS; 3D POINT CLOUD; 3D SCANNING; 3D SURFACE; LOOP CLOSURE; MODEL RECONSTRUCTION; MODELING APPROACH; OBJECT GEOMETRIES; OFF-LINE METHODS; PHOTOMETRIC PROPERTIES; POST PROCESSING; QUANTITATIVE RESULT; RANGE SCANNERS; REAL-WORLD OBJECTS; REGISTRATION; REGISTRATION ERROR; SCANNING ERROR; SCANNING SYSTEMS; SYNTHETIC AND REAL DATA; VISIBILITY CONSTRAINT;

GEOMETRY; IMAGING SYSTEMS; INTEGRATION; INVERSE KINEMATICS; ONLINE SYSTEMS; SCANNING;

THREE DIMENSIONAL;

EID: 79952281038     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.11.023     Document Type: Article

References (49)

1. B. Allen, B. Curless, and Z. Popović The space of human body shapes: reconstruction and parameterization from range scans ACM Transactions on Graphics 22 2003 587 594
2. A. Angeli, S. Doncieux, J.A. Meyer, D. Filliat, Real-time visual loop-closure detection, in: IEEE International Conference on Robotics and Automation (ICRA'08), 2008.
3. H. Bay, T. Tuytelaars, L. Van Gool, SURF: Speeded up robust features, in: Europeen Conference on Computer Vision (ECCV '06), 2006.
4. F. Bernardini, and H. Rushmeier The 3D model acquisition pipeline Computer Graphics Forum 21 2002 149 172 (Pubitemid 34750958)
5. P.J. Besl, and N.D. McKay A method for registration of 3-D shapes IEEE Transactions on Pattern Analysis and Machine Intelligence 14 1992 239 258
6. F. Blais, M. Picard, G. Godin, Accurate 3D acquisition of freely moving objects, in: 3D Data Processing, Visualization and Transmission (3DPVT '04), 2004.
7. M. Botsch, and O. Sorkine On linear variational surface deformation methods IEEE Transactions on Visualization and Computer Graphics 14 2008 213 230 (Pubitemid 350157892)
8. B. Büttgen, T. Oggier, M. Lehmann, Ccd/cmos lock-in pixel for range imaging: Challenges, limitations and state-of-the-art, in: 1st range imaging day, 2005.
9. R.J. Campbell, and P.J. Flynn A survey of free-form object representation and recognition techniques Computer Vision and Image Understanding 81 2001 166 210 (Pubitemid 32271703)
10. Y. Chen, and G. Medioni Object modelling by registration of multiple range images International Journal of Image and Vision Computing 10 1992 145 155
11. N. Cornelis, L. Van Gool, Real-time connectivity constrained depth map computation using programmable graphics hardware, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR '05), 2005.
12. B. Curless, M. Levoy, A volumetric method for building complex models from range images, in: SIGGRAPH '96: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, 1996.
13. J.D. Deschênes, P. Lambert, P. Hebert, Interactive modeling with automatic online compression, in: 3D Data Processing, Visualization, and Transmission (3DPVT'06), 2006.
14. N. Gelfand, S. Rusinkiewicz, L. Ikemoto, M. Levoy, Geometrically stable sampling for the ICP algorithm, in: 3-D Digital Imaging and Modeling (3DIM'03), 2003.
15. F.F. Gionis, R.B. Fisher, A. Fitzgibbon, A. Gionis, M. Wright, D. Eggert, A hand-held optical surface scanner for environmental modeling and virtual reality, in: Virtual Reality World, 1996.
16. G. Godin, M. Rioux, R. Baribeau, Three-dimensional registration using range and intensity information, in: Videometrics III, 1994.
17. G. Guennebaud, and M. Gross Algebraic point set surfaces ACM Transactions on Graphics 26 2007 23
18. M. Habbecke, L. Kobbelt, A surface-growing approach to multi-view stereo reconstruction, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07), 2007.
19. C. Harris, M. Stephens, A combined corner and edge detection, in: Proceedings of The Fourth Alvey Vision Conference, 1988.
20. A. Hilton, and J. Illingworth Geometric fusion for a hand-held 3d sensor Machine Vision Applications 12 2000 44 51
21. A. Hilton, A.J. Stoddart, J. Illingworth, and T. Windeatt Implicit surface-based geometric fusion Computer Vision and Image Understanding 69 1998 273 291 (Pubitemid 128423961)
22. B. Horn Closed-form solution of absolute orientation using unit quaternions Journal of the Optical Society of America 4 1987 629 642
23. D. Huber, and M. Hebert Fully automatic registration of multiple 3D data sets Image and Vision Computing 21 2003 637 650
24. G. Iddan, and G. Yahav 3d imaging in the studio (and elsewhere) SPIE Proceedings Series 4298 2000 48 55
25. T. Jaeggli, T. Koninckx, L. Van Gool, Online 3d acquisition and model integration, in: IEEE International Workshop on Projector-Camera Systems (ICCV '03), 2003.
26. S.B. Kang, A.E. Johnson, Registration and integration of textured 3-D data, in: 3-D Digital Imaging and Modeling (3DIM '97), 1997.
27. H. Kawasaki, R. Furukawa, R. Sagawa, Y. Yagi, Dynamic scene shape reconstruction using a single structured light pattern, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08), 2008.
28. M. Kazhdan, M. Bolitho, H. Hoppe, Poisson surface reconstruction, in: Symposium on Geometry Processing (SGP '06), 2006.
29. T. Koninckx, T. Jaeggli, L. Van Gool, Adaptive scanning for online 3D model acquisition, in: Workshop on Real-Time 3D Sensors and Their Use, 2004.
30. S. Krishnan, P.Y. Lee, J.B. Moore, S. Venkatasubramanian, Global registration of multiple 3D point sets via optimization-on-a-manifold, in: Symposium on Geometry Processing (SGP'05), 2005.
31. R. Lange, P. Seitz, A. Biber, R. Schwarte, Time-of-flight range imaging with a custom solid state image sensor, in: Laser Metrology and Inspection, 1999.
32. N. Max Weights for computing vertex normals from facet normals Journal of Graphics Tools 4 1999 1 6
33. Q. Pan, G. Reitmayr, T. Drummond, ProFORMA: Probabilistic Feature-based On-line Rapid Model Acquisition, in: British Machine Vision Conference (BMVC '09), 2009.
34. K. Pulli, Multiview registration for large data sets, in: 3-D Digital Imaging and Modeling (3DIM '99), 1999.
35. S. Rusinkiewicz, O. Hall-Holt, and M. Levoy Real-time 3d model acquisition ACM Transactions on Graphics 21 2002 438 446
36. S. Rusinkiewicz, M. Levoy, Efficient variants of the ICP algorithm, in: 3-D Digital Imaging and Modeling (3DIM'01), 2001.
37. C. Schütz, T. Jost, H. Hügli, Multi-feature matching algorithm for free-form 3d surface registration, in: International Conference on Pattern Recognition (ICPR'98), 1998.
38. J.K. Seo, G.C. Sharp, S.W. Lee, Range data registration using photometric features, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR'05), 2005.
39. O. Sorkine, M. Alexa, As-rigid-as-possible surface modeling, in: Symposium on Geometry Processing (SGP'07), 2007.
40. Stanford Scanning Repository, 2009. < http://graphics.stanford.edu/ data/3dscanrep/ >.
41. R.W. Sumner, J. Schmid, and M. Pauly Embedded deformation for shape manipulation ACM Transactions on Graphics 26 2007 80
42. D. Tubic, P. Hébert, J.D. Deschênes, D. Laurendeau, A unified representation for interactive 3D modeling, in: 3D Data Processing, Visualization and Transmission (3DPVT '04), 2004.
43. J. Weickert Anisotropic Diffusion in Image Processing 1998 Teubner
44. S. Weik, Registration of 3-d partial surface models using luminance and depth information, in: 3-D Digital Imaging and Modeling (3DIM '97), 1997.
45. T. Weise, B. Leibe, L. Van Gool, Fast 3d scanning with automatic motion compensation, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07), 2007.
46. T. Weise, B. Leibe, L. Van Gool, Accurate and robust registration for in-hand modeling, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08), 2008.
47. T. Weise, T. Wismer, B. Leibe, L. Van Gool, In-hand scanning with online loop closure, in: IEEE International Workshop on 3-D Digital Imaging and Modeling (3DIM '09), 2009.
48. Z Corporation, < http://www.zcorp.com >, 2010.
49. S. Zhang, P. Huang, High-resolution, real-time 3d shape acquisition, in: IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2004.