Automatic 3-D modeling of textured cultural heritage objects

IEEE Transactions on Image Processing

Volumn 13, Issue 3, 2004, Pages 354-369

  Andreetto, Marco ^a   Brusco, Nicola ^a   Cortelazzo, Guido Maria ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

Automatic modeling; Cultural heritage; Texture blending; Three dimensional (3 D) registration; Wide baseline matching

Indexed keywords

IMAGE ANALYSIS; OBJECT RECOGNITION; PATTERN MATCHING; THREE DIMENSIONAL COMPUTER GRAPHICS;

AUTOMATIC THREE DIMENSIONAL MODELLING; CULTURAL HERITAGE; TEXTURE BLENDING; WIDE BASELINE MATCHING;

IMAGE RETRIEVAL;

ALGORITHM; ARCHEOLOGY; ART; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; CULTURAL ANTHROPOLOGY; EVALUATION; IMAGE ENHANCEMENT; INFORMATION CENTER; INFORMATION PROCESSING; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING; VALIDATION STUDY;

ALGORITHMS; ANTHROPOLOGY, CULTURAL; ARCHAEOLOGY; ARCHIVES; ART; CULTURE; DATA COMPRESSION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 1942517854     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2003.821351     Document Type: Article

References (76)

1. Proc. IEEE CVPR Workshop on Application of Computer Vision in Archaeology, ACVA 2003, [Online] Available: http://www.lems.brown.edu/vision/conferences/ACVA03.
2. G. Godin, J. A. Beraldin, J. Taylor, L. Cournoyer, M. Rioux, S. El-Hackim, R. Baribeau, F. Blais, P. Boulanger, J. Domey, and M. Picard, "Active optical 3-D imaging for heritage applications," IEEE Comput. Graph. Applicat., pp. 24-36, Sept./Oct. 2002.
3. M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk, "The digital Michelangelo project: 3-D scanning of large statues," in Proc. SIGGRAPH Computer Graphics, Annu. Conf. Series, 2000, pp. 131-144.
4. R. Baribeau, M. Rioux, and G. Godin, "Color reflectance modeling using a polychromatic laser range sensor," IEEE Trans. Pattern Anal. Machine Intell., vol. 14, pp. 263-269, Feb. 1992.
5. F. Bernardini, I. Martin, and H. Rushmeier, "High-Quality Texture Synthesis From Multiple Scans," IBM Res., Tech. Rep. RC 21656(97598)1FEB2000, Feb. 2000.
6. H. Rushmeier and F. Bernardini, "The 3-D model acquisition pipeline," Computer Graphics Forum, vol. 21, no. 2, pp. 149-172, 2002.
7. F. Bernardini, I. Martin, J. Mittleman, H. Rushmeier, and G. Taubin, "Building a digital model of Michelangelo's Florentine Pietà," IEEE Comput. Graph. Applicat., vol. 22, no. 1, pp. 59-67, Jan./Feb. 2002.
8. J. Y. Zheng and L. Z. Zhong, "Virtual recovery of escavated relics," IEEE Comput. Graph. Applicat., vol. 19, pp. 6-11, May/June 1999.
9. D. Miyazaki, T. Ooishian, T. Nishikawa, R. Sagawa, K. Nishino, T. Tomomatsu, Y. Takase, and K. Ikeuchi, "The great buddha project: modeling cultural heritage through observation," in Proc. 6th Int. Conf. Virtual Systems and MultiMedia (VSMM 2000), Dec. 2000, pp. 138-145.
10. J.-A. Beraldin, F. Blais, L. Cournoyer, M. Rioux, F. Bernier, and N. Harrison, "Portable digital 3-D imaging system for remote sites," in Proc. Int. Symp. Circuits System, Monterey, CA, June 1998, pp. 412-418.
11. G. M. Cortelazzo and F. Marton, "3-D modeling for cultural heritage applications," in Proc. 2nd Int. Congr. Science and Technology for the Safeguard of Cultural Heritage in the Mediterranean Basin, Paris, France, July 1999, pp. 284-288.
12. L. Lucchese, G. Doretto, and G. M. Cortelazzo, "A frequency domain technique for 3-D view registration," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 1468-1484, Nov. 2002.
13. J. A. Beraldin, G. Guidi, S. Ciofi, and C. Atzeni, "Improvement of metric accuracy of digital 3-D models through digital photogrammetry. A case study: Donatello's Maddalena," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002), Padova, Italy, 2002, pp. 758-761.
14. J. A. Beraldin, M. Picard, S. F. El-Hakim, G. Godin, C. Latouche, V. Valzano, and A. Bandiera, "Exploring a byzantine crypt through a high-resolution texture mapped 3-D model: combining range data and photogrammetry," in Proc. Int. Workshop on Scanning for Cultural Heritage Recording, Corfu, Greece, Sept. 2002.
15. ____, "Virtualizing a byzantine crypt by combining high-resolution textures with laser scanner 3-D data," in Proc. VSMM 2002, Gyeongju, Korea, September 2002, pp. 3-14.
16. S. El-Hakim, J. A. Beraldin, and J. F. Lapointe, "Toward automatic modeling of monuments and towers," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002), Padova, Italy, 2002, pp. 526-531.
17. G. Guidi, G. Tucci, J. A. Beraldin, S. Ciofi, D. Ostuni, F. Costantini, and S. El-Hakim, "Multiscale archaeological survey based on the integration of 3-D scanning and photogrammetry," in Proc. Int. Workshop on Scanning for Cultural Heritage Recording, Corfu, Greece, Sept. 2002, pp. 58-64.
18. B. Zevi, Saper vedere l'architettura. Torino, Italy: Einaudi, 1964.
19. R. Scopigno, P. Pingia, C. Rocchini, P. Cignoni, and C. Montani, "3-D scanning and rendering cultural heritage artifacts on a low budget," in Proceedings European Workshop on High Performance Graphics Systems and Applications. Bologna, Italy: Cineca, October 2000, pp. 16-17.
20. J. Davis, S. R. Marschner, M. Garr, and M. Levoy, "Filling holes in complex surfaces using volumetric diffusion," in Proc. IEEE 1st Int. Symp. 3-D Data Processing Visualization and Transmission, June 2002, pp. 428-438.
21. P. J. Besl and N. D. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Machine Intell., vol. 14, pp. 239-259, Feb. 1992.
22. H. G. Mass, "Robust automatic surface reconstruction with structured light," in Proc. Int. Archives of Photogrammetry and Remote Sensing XXIX, 1992, pp. 709-713.
23. R. J. Valkenburg and A. M. McIvor, "Accurate 3-D measurement using a structured light system," Image Vis. Comput., vol. 16, pp. 99-110, 1998.
24. E. Horn and N. Kiryati, "Toward optimal structured light patterns," in Proc. Int. Conf. Recent Advances in 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, 1997, pp. 28-35.
25. M. Trobina, "Error Model of a Coded-Light Range Sensor," Res. Rep. ETH-Zentrum BIWI-TR-164, 1995.
26. A. Ashbrook, R. Fischer, C. Robertson, and N. Werghi, "Finding surface correspondence for object recognition and registration using pairwise geometric histograms," in Proc. Eur. Conf. Computer Vision, vol. 1407, 1998, pp. 674-786.
27. C. Dorai, G. Wang, A. Jain, and C. Mercer, "Registration and integration of multiple object views for 3-D model construction," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 83-89, Nov. 1998.
28. K. Higuchi, M. Hebert, and K. Ikeuchi, "Building 3-D models from unregistered range images," Graph. Mod. Imag. Process., vol. 57, no. 4, pp. 315-333, 1995.
29. D. Huber and M. Hebert, "Fully automatic registration of multiple 3-D data sets," in Proc. IEEE Workshop on Computer Vision Beyond the Visible Spectrum, Dec. 2001, pp. 433-449.
30. D. Zhang and M. Hebert, "Harmonic maps and their applications in surface matching," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 99), Nov. 1999, pp. 524-530.
31. A. E. Johnson, "Spin-Images: A Representation for 3-D Surface Matching," Ph.D. dissertation, Carnegie Mellon Univ., Pittsburgh, PA, Aug. 1997.
32. A. E. Johnson and M. Hebert, "Using spin-images for efficient multiple model recognition in cluttered 3-D scenes," IEEE Trans. Pattern Anal. Machine Intell., vol. 21, no. 5, pp. 433-449, 1999.
33. P. Krsek, T. Pajdla, V. Hlavac, and R. Martin, "Range image registration driven by hierarchy of surface differential features," in Proc. 22nd Workshop of the Austrian Association for Pattern Recognition, May 1998, pp. 175-183.
34. J. Vanden Wyngaerd and L. Van Gool, "Coarse registration of surface patches with local symmetries," in Proc. Eur. Conf. Computer Vision (ECCV'02), vol. 2351, May 2002, pp. 572-586.
35. J. Vanden Wyngaerd, L. Van Gool, R. Koch, and M. Proesmans, "Invariant-based registration of surface patches," in Proc. Int. Conf. Computer Vision (ICCV'99), 1999, pp. 301-306.
36. L. Van Gool, D. Vandermeulen, G. Kalberer, T. Tuytelaars, and A. Zalesny, "Modeling shapes and textures from images: new frontiers," in Proc. of 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002) Padova, Italy, June 2002, pp. 286-294.
37. G. Roth, "Registering two overlapping range images," in Proc. 2nd Int. Conf. on 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, October 1999, pp. 191-200.
38. B. K. P. Horn, Computer Vision. New York: McGraw-Hill, 1987.
39. Y. Chen and G. G. Medioni, "Object modeling by registration of multiple range images," Image Vis. Comput., vol. 10, no. 3, pp. 145-155, 1992.
40. Z. Zhang, "Iterative point matching for registration of free-form curves and surfaces," Int. J. Comput. Vis., vol. 13, no. 2, pp. 119-152, 1994.
41. T. Jost and H. Hügli, "A multi-resolution scheme ICP algorithm for fast shape registration," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002) Padova, Italy, 2002, pp. 540-543.
42. C. Kapoutsis, C. Vavoulidis, and I. Pitas, "Morphological iterative closest point algorithm," IEEE Trans. Image Processing, vol. 8, pp. 1644-1646, Nov. 99.
43. M. Greenspan and G. Godin, "A nearest neighbor method for efficient ICP," in Proc. 3rd Int. Conf. 3-D Digital Imaging and Modeling, Quebec City, QC, Canada, May 2001, pp. 161-168.
44. S. Rusinkiewicz and M. Levoy, "Efficient variants of the ICP algorithm," in Proc. 3rd Int. Conf. 3-D Digital Imaging and Modeling, Quebec City, QC, Canada, May 2001, pp. 145-152.
45. H. Hügli and C. Schültz, "Geometric Matching of 3-D objects: assessing the range of successful initial configuration," in Proc. Int. Conf. 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, 1997, pp. 101-106.
46. A. Johnson and S. Kang, "Registration and integration of textured 3-D data," in Proc. Int. Conf. Recent Advances in 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, May 1997, pp. 234-241.
47. R. Benjemaa and F. Schmitt, "Fast Global registration of 3-D sampled surfaces using a multi-z-buffer technique," in Proc. Int. Conf. Recent Advances in 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, May 1997, pp. 113-120.
48. D. W. Eggert, A. W. Fitzgibbon, and R. B. Fisher, "Simultaneous registration of multiple range views for use in reverse engineering of CAD models," Comput. Vis. Image Understand., vol. 69, no. 3, pp. 253-272, Nov. 1998.
49. K. Pulli, "Multiview registration for large data sets," in Proc. 2nd Int. Conf. on 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, October 1999, pp. 113-120.
50. R. Bergevin, M. Soucy, H. Gagnon, and D. Laurendeau, "Toward a general multiview registration technique," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 5, pp. 540-547, 1996.
51. K. Pulli, "Surface Reconstruction and Display from Range and Color Data," Ph.D. dissertation, Univ. Washington, Seattle, 1997.
52. R. Lenz, P. Meer, and M. Hauta-Kasari, "Spectral-based illumination estimation and color correction," Color Res. Applicat., vol. 24, no. 2, pp. 98-111, April 1999.
53. A. H. Munsell, Book of Color. Baltimore, MA: Matte Finish Collection, 1976.
54. G. M. Cortelazzo and L. Lucchese, "A new method of image mosaicking and its application to cultural heritage representation," in Comput. Graph. Forum, vol. 18, 1999, pp. 265-275.
55. P. J. Burt and E. H. Adelson, "A multiresolution spline with application to image mosaics," ACM Trans. Graph., vol. 2, no. 4, pp. 217-236, Oct. 1983.
56. C.-T. Hsu and J.-L. Wu, "Multiresolution Mosaic," in Proc. ICIP'96, vol. 3, Sept. 1996, pp. 743-746.
57. PolyWorks User's Guide Ver. 5.0, InnovMetric Software Inc., Sainte Foy, Canada, Jan. 2001.
58. R. Cipolla and P. Giblin, Visual Motion of Curves and Surfaces. Cambridge, U.K.: Cambridge Univ. Press, 2000.
59. J. Bouguet and P. Perona, "3D photography on your desk," in Proc. 6th Int. Conf. Computer Vision, Bombay, India, January 1998, pp. 43-50.
60. ____, "3d photography using shadows in dual-space geometry," International Journal of Computer Vision, vol. 35, no. 2, pp. 129-149, November-December 1999.
61. S. Savarese, H. Rushmeier, F. Bernardini, and P. Perona, "Implementation of a shadow carving system for shape capture," in Proc. of 1st International Symposium on 3-D Data Propcessing Visualization and Transmission (3-DPVT2002). Padova, Italy: IEEE Press, 2002, pp. 12-23.
62. C. H. Esteban and F. Schmitt, "Multi-stereo 3-D object reconstruction," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002), Padova, Italy, 2002, pp. 159-166.
63. F. Schmitt and Y. Yemez, "3-D color object reconstruction from 2-D image sequences," in IEEE Int. Conf. Image Processing, Kobe, Japan, 1999.
64. C. Colombo, A. Del Bimbo, and F. Pernici, "Uncalibrated 3-D metric reconstruction and flattened texture acquisition form a single view of a surface of revolution," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPT2002), Padova, Italy, June 2002, pp. 277-284.
65. S. Savarese, M. Chen, and P. Perona, "Second order local analysis for 3-D reconstruction of spectacular surfaces," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002), Padova, Italy, 2002, pp. 356-361.
66. V. Bajaj, V. Pascucci, and G. Zhuang, "Single resolution compression of arbitrary triangular meshes with properties," Comput. Geometry: Theory Applicat., vol. 14, pp. 167-186, 1999.
67. P. Cignoni, C. Montani, and R. Scopigno, "A comparison of mesh simplification algorithms," Comput. Graph., vol. 22, no. 1, pp. 37-54, 1998.
68. B. Kronrod and C. Gotsman, "Optimized compression of triangle mesh geometry using prediction trees," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002), Padova, Italy, 2002, pp. 602-608.
69. The Web3-D Consortium, [Online] Available: http://www.web3d.org/
70. G. Taubin, W. Horn, F. Lazarus, and J. Rossignac, "Geometry coding and VRML," Proc. IEEE, vol. 86, pp. 1228-1243, June 1998.
71. G. Taubin and J. Rossignac, "Geometric compression through topological surgery," ACM Trans. Graph., vol. 17, no. 2, pp. 84-115, 1998.
72. P. Cignoni, C. Montani, C. Rocchini, R. Scopigno, and M. Tarini, "Preserving attribute values on simplified meshes by re-sampling detail textures," Vis. Comput., vol. 15, no. 10, pp. 519-539, 1999.
73. M. Isenburg and J. Snoeyink, "Coding with ASCII: compact, yet text-based 3-D content," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002) Padova, Italy, 2002, pp. 609-616.
74. M. Levoy, "Polygon-assisted JPEG and MPEG compression of synthetic images," in Proc. SIGGRAPH Computer Graphics Proceedings Annu. Conf. Series, 1995, pp. 21-28.
75. K. Engel, O. Sommer, and T. Ertl, "A framework for interative hardware accelerated remote 3-D-visualization," in Proc. VisSym Joint Eurographics-IEEE TCVG Symp. Visualizaton, 2000, pp. 167-177.
76. R. Bernardini, G. M. Cortelazzo, and G. Tormen, "IBR-based compression for remote visualization," in Proc. 1st Int. Symp. 3-D Data Processing Visualization and Transmission (3-DPVT2002), Padova, Italy, June 2002, pp. 513-519.