Orientation and 3D modelling from markerless terrestrial images: Combining accuracy with automation

Photogrammetric Record

Volumn 25, Issue 132, 2010, Pages 356-381

  Barazzetti, Luigi ^a   Scaioni, Marco ^a   Remondino, Fabio ^b  

^a POLITECNICO DI MILANO   (Italy)

^b FONDAZIONE BRUNO KESSLER   (Italy)

Author keywords

3D modelling; Automation; Image matching; Image processing; Orientation; Surface reconstruction

Indexed keywords

3D MODELLING; 3D RECONSTRUCTION; BUNDLE ADJUSTMENTS; CALIBRATED CAMERAS; EXTERIOR ORIENTATION PARAMETERS; FEATURE-BASED; FREE-FORM OBJECT; IMAGE CORRESPONDENCE; MARKERLESS; MATCHING ALGORITHM; MULTI-IMAGE MATCHING; MULTIPLE IMAGE; ORIENTATION; ORIENTATION PARAMETER; POINT CLOUD; RANGE IMAGES; RANGE-BASED;

ALGORITHMS; AUTOMATION; IMAGE MATCHING; IMAGE PROCESSING; IMAGING SYSTEMS; PARAMETER ESTIMATION; SURFACE MEASUREMENT; SURFACE RECONSTRUCTION;

THREE DIMENSIONAL;

ALGORITHM; AUTOMATION; ESTIMATION METHOD; IMAGE PROCESSING; METHODOLOGY; MULTICRITERIA ANALYSIS; ORIENTATION; PHOTOGRAMMETRY; THREE-DIMENSIONAL MODELING;

EID: 78650350754     PISSN: 0031868X     EISSN: 14779730     Source Type: Journal    
DOI: 10.1111/j.1477-9730.2010.00599.x     Document Type: Article

References (82)

1. Agarwal, S., Snavely, N., Simon, I., Seitz, S. M. and Szeliski, R., 2009. Building Rome in a day. Proceedings of International Conference on Computer Vision, Kyoto, Japan. 8 pages.
2. Alba, M., Barazzetti, L., Giussani, A., Roncoroni, F. and Scaioni, M., 2009. Generazione di un DTM con l'integrazione di tecniche laser scanning e fotogrammetriche terrestri. Convegno Nazionale SIFET, Mantova, Italy. 7 pages (on CD-ROM).
3. Armangué, X. and Salvi, J., 2003. Overall view regarding fundamental matrix estimation. Image and Vision Computing, 21(2): 205-220.
4. Arya, S., Mount, D. M., Netenyahu, N. S., Silverman, R. and Wu, A. Y., 1998. An optimal algorithm for approximate nearest neighbor searching fixed dimensions. Journal of the ACM, 45(6): 891-923.
5. Baltsavias, E. P., 1991. Multiphoto geometrically constrained matching. Ph.D. thesis No. 9561, Mitteilungen Nr. 49, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland. 221 pages.
6. Bay, H., Ess, A., Tuytelaars, T. and Van Gool, L., 2008. Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3): 346-359.
7. Beardsley, P. A., Torr, P. H. S. and Zisserman, A., 1996. 3D model acquisition from extended image sequences. Proceedings of 4th European Conference on Computer Vision, Lecture Notes in Computer Science, 1065: 683-695.
8. Beis, J. S. and Lowe, D. G., 1997. Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. Proceedings of the Conference on Computer Vision and Pattern Recognition, 1000-1006.
9. Blais, F., 2004. Review of 20 years of range sensor development. Journal of Electronic Imaging, 13(1): 231-243.
10. Brown, M. and Lowe, D. G., 2003. Recognizing panoramas. International Conference on Computer Vision, 2: 1218-1225.
11. Brown, M. Z., Burschka, D. and Hager, G. D., 2003. Advances in computational stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(8): 993-1008.
12. Büyüksalih, G. and Li, Z., 2005. Practical experiences with automatic aerial triangulation using different software packages. Photogrammetric Record, 18(102): 131-155.
13. Canny, J. F., 1986. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6): 679-698.
14. Cignoni, P. and Scopigno, R., 2008. Sampled 3D models for CH applications: a viable and enabling new medium or just a technological exercise? ACM Journal on Computing and Cultural Heritage, 1(1): 23 pages.
15. Cronk, S., Fraser, C. and Hanley, H., 2006. Automated metric calibration of colour digital cameras. Photogrammetric Record, 21(116): 355-372.
16. D'Apuzzo, N., 2003. Surface measurement and tracking of human body parts from multi station video sequences. Ph.D. thesis No. 15271, Mitteilungen Nr. 81, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland. 147 pages.
17. De Luca, L., Veron, P. and Florenzano, M., 2006. Reverse engineering of architectural buildings based on a hybrid modeling approach. Computers & Graphics, 30(2): 160-176.
18. Dick, A. R., Torr, P. H. S. and Cipolla, R., 2004. Modelling and interpretation of architecture from several images. International Journal of Computer Vision, 60(2): 111-134.
19. Ebert, D. S., Musgrave, F. K., Peachey, D., Perlin, K. and Worley, S., 2003. Texturing & Modeling: A Procedural Approach. Third edition. The Morgan Kaufmann Series in Computer Graphics. Elsevier, San Francisco. 712 pages.
20. El-Hakim, S. F., 2002. Semi-automatic 3D reconstruction of occluded and unmarked surfaces from widely separated views. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 34(5): 143-148.
21. El-Hakim, S. F., Beraldin, J.-A., Picard, M. and Godin, G., 2004. Detailed 3D reconstruction of large-scale heritage sites with integrated techniques. IEEE Computer Graphics and Applications, 24(3): 21-29.
22. Fischler, M. A. and Bolles, R. C., 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6): 381-395.
23. Fraser, C. S., 1996. Network design. Close Range Photogrammetry and Machine Vision (Ed. K. B. Atkinson ). Whittles, Caithness, Scotland. 371 pages: 256-281.
24. Furukawa, Y. and Ponce, J., 2010. Accurate, dense, and robust multiview stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8): 1362-1376.
25. Ganci, G. and Handley, H. B., 1998. Automation in videogrammetry. International Archives of Photogrammetry and Remote Sensing, 32(5): 53-58.
26. Goesele, M., Curless, B. and Seitz, S. M., 2006. Multi-view stereo revisited. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2: 2402-2409.
27. Goesele, M., Snavely, N., Curless, B., Hoppe, H. and Seitz, S. M., 2007. Multi-view stereo for community photo collections. Proceedings of International Conference on Computer Vision. 8 pages.
28. Granshaw, S. I., 1980. Bundle adjustment methods in engineering photogrammetry. Photogrammetric Record, 10(56): 181-207.
29. Gruen, A., 1985. Adaptative least squares correlation: a powerful image matching technique. South African Journal of Photogrammetry, Remote Sensing and Cartography, 14(3): 175-187.
30. Gruen, A. and Baltsavias, E. P., 1988. Geometrically constrained multiphoto matching. Photogrammetric Engineering & Remote Sensing, 54(5): 633-641.
31. Guidi, G., Remondino, F., Russo, M., Menna, F., Rizzi, A. and Ercoli, S., 2009. A multi-resolution methodology for the 3D modeling of large and complex archeological areas. International Journal of Architectural Computing, 7(1): 39-55.
32. Hao, X. and Mayer, H., 2003. Orientation and auto-calibration of image triplets and sequences. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 34(3/W8): 73-78.
33. Hartley, R. I. and Zisserman, A., 2004. Multiple View Geometry in Computer Vision. Second edition. Cambridge University Press, Cambridge. 672 pages.
34. Huber, P. J., 1991. Between robustness and diagnostics. Directions in Robust Statistics and Diagnostics (Eds. W. Stahel & S. Weisberg ). Springer, New York. IMA Series 33: 121-130.
35. Jazayeri, I. and Fraser, C. S., 2010. Interest operators for feature-based matching in close range photogrammetry. Photogrammetric Record, 25(129): 24-41.
36. Ke, Y. and Sukthankar, R., 2004. PCA-SIFT: a more distinctive representation for local image descriptors. Proceedings IEEE Conference on Computer Vision and Pattern Recognition. 506-513.
37. Läbe, T. and Förstner, W., 2006. Automatic relative orientation of images. Proceedings of the 5th Turkish-German Joint Geodetic Days, Berlin. 6 pages.
38. Lemmens, M. J. P. M., 1988. A survey on stereo matching techniques. International Archives of Photogrammetry and Remote Sensing, 27(B8): 11-23.
39. Li, H., 1997. Semi-automatic road extraction from satellite and aerial images. Ph.D. thesis No. 12101, Mitteilungen Nr. 61, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland. 199 pages.
40. Li, Z. and Gruen, A., 2004. Automatic DSM generation from linear array imagery data. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 35(B3): 128-133.
41. Longuet-Higgins, H. C., 1984. The reconstruction of a scene from two projections. Configurations that defeat the 8-point algorithm. Proceedings of the 1st Conference on Artificial Intelligence Applications, Denver. 395-397.
42. Lowe, D. G., 1999. Object recognition from local scale-invariant features. Proceedings of International Conference on Computer Vision, Corfu, Greece. II: 1150-1157.
43. Lowe, D. G., 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2): 91-110.
44. Lue, Y., 1988. Interest operator and fast implementation. International Archives of Photogrammetry and Remote Sensing, 27(3): 491-500.
45. Mikolajczyk, K. and Schmid, C., 2005. A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10): 1615-1630.
46. Muja, M. and Lowe, D., 2009. Fast approximate nearest neighbours with automatic algorithm configuration. Proceedings of the International Conference on Computer Vision Theory and Applications. 10 pages.
47. Müller, P., Wonka, P., Haegler, S., Ulmer, A. and Van Gool, L., 2006. Procedural modeling of buildings. Proceedings of ACM SIGGRAPH 2006/ACM Transactions on Graphics, 25(3): 614-623.
48. Nister, D., 2004a. Automatic passive recovery of 3D from images and video. IEEE Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization, and Transmission. 438-445.
49. Nister, D., 2004b. An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(6): 756-770.
50. Ohdake, T. and Chikatsu, H., 2005. 3D modeling of high relief sculpture using image-based integrated measurement system. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(5/W17):6 pages (on CD-ROM).
51. Okutomi, M. and Kanade, T., 1993. A multiple-baseline stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(4): 353-363.
52. Pénard, L., Paparoditis, N. and Pierrot-Deseilligny, M., 2005. 3D building facade reconstruction under mesh form from multiple wide angle views. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(5/W17):7 pages (on CD-ROM).
53. Pollefeys, M., Koch, R. and Van Gool, L., 1999. Self-calibration and metric reconstruction in spite of varying and unknown intrinsic camera parameters. International Journal of Computer Vision, 32(1): 7-25.
54. Pollefeys, M., Van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J. and Kock, R., 2004. Visual modelling with a hand-held camera. International Journal of Computer Vision, 59(3): 207-232.
55. Remondino, F., 2006. Detectors and descriptors for photogrammetric applications. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(3): 49-54.
56. Remondino, F. and El-Hakim, S., 2006. Image-based 3D modelling: a review. Photogrammetric Record, 21(115): 269-291.
57. Remondino, F. and Fraser, C., 2006. Digital camera calibration methods: considerations and comparisons. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(5): 266-272.
58. Remondino, F. and Ressl, C., 2006. Overview and experiences in automated markerless image orientation. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(3): 248-254.
59. Remondino, F. and Zhang, L., 2006. Surface reconstruction algorithms for detailed close-range object modeling. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(3): 117-123.
60. Remondino, F., El-Hakim, S. F., Gruen, A. and Zhang, L., 2008. Turning images into 3-D models-development and performance analysis of image matching for detailed surface reconstruction of heritage objects. IEEE Signal Processing Magazine, 25(4): 55-65.
61. Remondino, F., El-Hakim, S. F., Girardi, S., Rizzi, A., Benedetti, S. and Gonzo, L., 2009. 3D virtual reconstruction and visualization of complex architectures-the "3D-ARCH" project. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 38(5/W1):9 pages (on CD-ROM).
62. Roncella, R., Forlani, G. and Remondino, F., 2005. Photogrammetry for geological applications: automatic retrieval of discontinuity in rock slopes. SPIE, 5665: 17-27.
63. Rönnholm, P., Honkavaara, E., Litkey, P., Hyyppä, H. and Hyyppä, J., 2007. Integration of laser scanning and photogrammetry. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(3/W52): 355-362.
64. Rosten, E. and Drummond, T., 2006. Machine learning for high-speed corner detection. Proceedings of the European Conference on Computer Vision, Graz, Austria. 430-443.
65. Rousseeuw, P. J. and Leroy, A. M., 1987. Robust Regression and Outlier Detection. John Wiley, New York. 329 pages.
66. Saint-Marc, P., Chen, J. S. and Medioni, G., 1991. Adaptative smoothing: a general tool for early vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(6): 514-529.
67. Scaioni, M., 2000. Robust estimation of relative orientation through the fundamental matrix. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 32(6W8/2): 253-259.
68. Scharstein, D. and Szeliski, R., 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision, 47(1-3): 7-42.
69. Seitz, S. M., Curless, B., Diebel, J., Scharstein, D. and Szeliski, R., 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 519-528.RT
70. Snavely, N., Seitz, S. M. and Szeliski, R., 2008. Modeling the world from internet photo collections. International Journal of Computer Vision, 80(2): 189-210.
71. Stamos, I., Liu, L., Chen, C., Wolberg, G., Yu, G. and Zokai, S., 2008. Integrating automated range registration with multiview geometry for photorealistic modeling of large-scale scenes. International Journal of Computer Vision, 78(2-3): 237-260.
72. Strecha, C., Tuytelaars, T. and Van Gool, L., 2003. Dense matching of multiple wide-baseline views. Proceedings of 9th IEEE International Conference on Computer Vision, Nice, France. 2, 1525 pages: 1194-1201.
73. Stumpfel, J., Tchou, C., Hawkins, T., Martinez, P., Emerson, B., Brownlow, M., Jones, A., Yun, N. and Debevec, P., 2003. Digital reunification of the Parthenon and its sculptures. Proceedings of 4th International Symposium on Virtual Reality, Archaeology and Intelligent Cultural Heritage. 41-50.
74. Thompson, E. H., 1959. A rational algebraic formulation of the problem of relative orientation. Photogrammetric Record, 3(14): 152-159.
75. Torr, P. H. S., 2002. Bayesian model estimation and selection for epipolar geometry and generic manifold fitting. International Journal of Computer Vision, 50(1): 35-61.
76. Torr, P. H. S. and Murray, D. W., 1993. Outlier detection and motion segmentation. SPIE 2059: 432-443.
77. Torr, P. H. S. and Zisserman, A., 1995. MLESAC: a new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding, 78(1): 138-156.
78. Torr, P. H. S. and Zisserman, A., 1998. Robust computation and parametrization of multiple view relations. Proceedings of the 6th International Conference on Computer Vision, Bombay. 727-732.
79. Valgren, C. and Lilienthal, A., 2007. SIFT, SURF and Seasons: long-term outdoor localization using local features. Proceedings of 3rd European Conference on Mobile Robots. 253-258.
80. Vogiatzis, G., Torr, P. H. S. and Cipolla, R., 2005. Multi-view stereo via volumetric graph-cuts. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2: 391-398.
81. Wallis, R., 1976. An approach to the space variant restoration and enhancement of images. Proceedings of Symposium on Current Mathematical Problems in Image Science. 329-340.
82. Zhang, L., 2005. Automatic digital surface model (DSM) generation from linear array images. Ph.D. thesis No. 16078, Mitteilungen Nr. 90, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland. 199 pages.