Development and Status of Image Matching in Photogrammetry

Photogrammetric Record

Volumn 27, Issue 137, 2012, Pages 36-57

  Gruen, Armin ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

DSM generation; Empirical tests; Image matching; Least squares; Multi image; Multiple image features

Indexed keywords

DSM GENERATION; EMPIRICAL TEST; LEAST SQUARE; MULTI-IMAGE; MULTIPLE IMAGE;

PHOTOGRAMMETRY; TEMPLATE MATCHING;

IMAGE MATCHING;

ACCURACY ASSESSMENT; ALGORITHM; DIGITAL PHOTOGRAMMETRY; EMPIRICAL ANALYSIS; IMAGE ANALYSIS; LEAST SQUARES METHOD; SPECTRUM;

EID: 84858305515     PISSN: 0031868X     EISSN: 14779730     Source Type: Journal    
DOI: 10.1111/j.1477-9730.2011.00671.x     Document Type: Article

References (116)

1. Ackermann, F., 1984. Digital image correlation: performance and potential application in photogrammetry. Photogrammetric Record, 11(64): 429-439.
2. Aggarwal, J. K., Duda, R. O. and Rosenfeld, A. (Eds.), 1977. Computer methods in image analysis. IEEE Press, New York. 466 pages.
3. Akca, D., 2007. Least squares 3D surface matching. Ph.D. thesis, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland, Mitteilungen 92. Dissertation No. 17136. 78 pages.
4. Alberich, L., 1985. Orthophotomapping with an automated system at 1:50000 map scale. Proceedings ASP-ACSM Convention, Washington, DC, 1: 222-228.
5. Albertz, J. and Koenig, G., 1984. A digital stereophotogrammetric system. International Archives of Photogrammetry and Remote Sensing, 25(A2): 1-7.
6. Almroth, U. and Hendriks, L., 1987. High accuracy digital matching of close-range objects on the analytical plotter Kern DSR-11. Proceedings of ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland. 437 pages: 193-203.
7. Andrews, H. C. (Ed.), 1978. Digital image processing. IEEE Press, New York. 737 pages.
8. Baker, H. H. and Binford, T. O., 1981. Depth from edge and intensity based stereo. Proceedings of the 7th International Joint Conferences on Artificial Intelligence 631-636.
9. Baltsavias, E., 1984. Digital image correlation in photogrammetry. M.Sc. technical report, Department of Geodetic Science and Surveying, Ohio State University, Columbus, Ohio.
10. Baltsavias, E., 1991. Multiphoto geometrically constrained matching. Ph.D. thesis, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland, Mitteilungen 49. 221 pages.
11. Baltsavias, E. P. and Stallmann, D., 1990. Trinocular vision for automatic and robust 3-D determination of the trajectories of moving objects. International Archives of Photogrammetry and Remote Sensing, 28(5/1): 620-629.
12. Baltsavias, E., Li, H., Gaschen, S. and Sinning, M., 1996. DTM generation with the Leica/Helava DPW 770 and VirtuoZo digital photogrammetric systems. Paper presented at GeoInformatics '96, Wuhan, China, 16th to 19th October. 10-17.
13. Baltsavias, E., Zhang, L. and Eisenbeiss, H., 2006. DSM generation and interior orientation determination of IKONOS images using a testfield in Switzerland. Photogrammetrie, Fernerkundung, Geoinformation, (1): 41-54.
14. Baltsavias, E., Gruen, A., Eisenbeiss, H., Zhang, L. and Waser, L. T., 2008. High quality image matching and automated generation of 3D tree models. International Journal of Remote Sensing, 29(5): 1243-1259.
15. Bernstein, R. (Ed.), 1978. Digital image processing for Remote Sensing. IEEE Press/Wiley, New York. 473 pages.
16. Bethel, J., 1986. The DSR11 image correlator. American Congress on Surveying and Mapping & American Society of Photogrammetry and Remote Sensing. Annual Convention, IV: 44-49.
17. Beyer, H. A., 1987. Some aspects of the geometric calibration of CCD-cameras. Proceedings of ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland. 437 pages: 68-81.
18. Beyer, H. A., 1992. Geometric and radiometric analysis of a CCD-camera based photogrammetric close-range system. Ph.D. thesis, Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland. Dissertation No. 9701. 186 pages.
19. Case, J. B., 1982. The digital stereo comparator/compiler (DSCC). International Archives of Photogrammetry, 24(2): 23-29.
20. Chellappa, R. and Sawchuk, A. A. (Ed.), 1985. Digital image processing and analysis, Volume 2. IEEE Computer Society Press, New York. 721 pages.
21. Cogan, L., Gugan, D., Hunter, D., Lutz, S. and Peny, C., 1988. Kern DSP1 digital stereo photogrammetric system. International Archives of Photogrammetry and Remote Sensing, 27(B2): 71-83.
22. Crespi, M., De Vendictis, L., Poli, D., Wolff, K., Colosimo, G., Gruen, A. and Volpe, F., 2008. Radiometric quality and DSM generation analysis of Cartosat-1 stereo imagery. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 37(B1-3): 1349-1355.
23. DeMeter, E. R., 1963. Latest advances in automated mapping. Photogrammetric Engineering, 29(6): 1027-1036.
24. Dowman, I., 1984. Instrumentation for topographic mapping from satellite data. International Archives of Photogrammetry, 25(2): 155-163.
25. Dowman, I. J. and Haggag, A. A. Y., 1977. Digital image correlation along epipolar lines. International Symposium on Image Processing, Interactions with Photogrammetry and Remote Sensing, Graz, Austria. 47-49.
26. Dowman, I. J., Gugan, D. J., Muller, J.-P., O'Neill, M. and Paramananda, V., 1987. Digital processing of SPOT data. Proceedings of ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland. 437 pages: 318-330.
27. Ebner, H. and Heipke, C., 1988. Integration of digital image matching and object surface reconstruction. International Archives of Photogrammetry and Remote Sensing, 27(B11): 534-545.
28. Eisenbeiss, H., Sauerbier, M., Zhang, L. and Grün, A., 2005. Mit dem Modellhelikopter über Pinchango Alto. Geomatik Schweiz, 2005(9): 510-515 (in German).
29. Ernst, I. and Hirschmüller, H., 2008. Mutual information based semi-global stereo matching on the GPU. Advances in Visual Computing. Proceedings 4th International Symposium on Visual Computing (ISVC08). Springer Lecture Notes in Computer Science, 5358: 228-239.
30. Förstner, W., 1982. On the geometric precision of digital correlation. International Archives of Photogrammetry, 24(3): 176-189.
31. Gong, J., Li, Z., Zhu, Q., Sui, H. and Zhou, Y., 2000. Effects of various factors on the accuracy of DEMs: an intensive experimental investigation. Photogrammetric Engineering & Remote Sensing, 66(9): 1113-1117.
32. Gruen, A., 1985a. Adaptive kleinste Quadrate Korrelation und geometrische Zusatzinformationen. Vermessung, Photogrammetrie, Kulturtechnik, 83(9): 309-312 (in German).
33. Gruen, A., 1985b. Adaptive least squares correlation: a powerful image matching technique. South African Journal of Photogrammetry, Remote Sensing and Cartography, 14(3): 175-187.
34. Gruen, A., 1988. Towards real-time photogrammetry. Photogrammetria, 42(5-6): 209-244.
35. Gruen, A. W., 1989. Digital photogrammetric processing systems: current status and prospects. Photogrammetric Engineering & Remote Sensing, 55(5): 581-586.
36. Gruen, A., 1996a. Digital photogrammetric stations revisited. International Archives of Photogrammetry and Remote Sensing, 31(B2): 127-134.
37. Gruen, A., 1996b. Least squares matching: a fundamental measurement algorithm. Chapter 8 in Close Range Photogrammetry and Machine Vision (Ed. K. B. Atkinson ). Whittles, Caithness, Scotland. 371 pages: 217-255.
38. Gruen, A., 1999. Digital photogrammetric stations. Promises, performance, perspectives. GeoInformatics, 2(3): 22-27.
39. Gruen, A., 2007. Laser scanning: blackbox or braintwister? GeoInformatics, 10(7): 49-51.
40. Gruen, A., 2009. Aerial photogrammetry-revival of a discipline. GIS Development, 13(1): 30-31.
41. Gruen, A. and Baltsavias, E. P., 1984. Adaptive least squares correlation. Project Report for Helava Assoc., Inc., USA.
42. Gruen, A. and Baltsavias, E. P., 1985. Adaptive least squares correlation with geometrical constraints. SPIE, 595: 72-82.
43. Gruen, A. and Baltsavias, E. P., 1986. High precision image matching for digital terrain model generation. International Archives of Photogrammetry and Remote Sensing, 26(3/1): 284-296.
44. Gruen, A. and Beyer, H. A., 1986. Real-time photogrammetry at the digital photogrammetric station (DIPS) of ETH Zurich. Canadian Surveyor, 41(2): 181-199.
45. Gruen, A. and Baltsavias, E. P., 1988a. Automatic 3-D measurement of human faces with CCD-cameras. SPIE, 1030: 106-115.
46. Gruen, A. and Baltsavias, E. P., 1988b. Geometrically constrained multiphoto matching. Photogrammetric Engineering & Remote Sensing, 54(5): 633-641.
47. Gruen, A. and Beyer, H. A., 1990. DIPS II-turning a standard computer workstation into a digital photogrammetric station. International Archives of Photogrammetry and Remote Sensing, 28(2): 247-255.
48. Gruen, A. and Stallmann, D., 1991. High accuracy edge matching with an extension of the MPGC-matching algorithm. SPIE, 1526: 42-55.
49. Gruen, A. and Agouris, P., 1994. Linear feature extraction by least squares template matching constrained by internal shape forces. International Archives of Photogrammetry and Remote Sensing, 30(3/1): 316-323.
50. Gruen, A. and Li, H., 1997. Semi-automatic linear feature extraction by dynamic programming and LSB-snakes. Photogrammetric Engineering & Remote Sensing, 63(8): 985-995.
51. Gruen, A., Bär, S. and Buehrer, Th., 2000. DTMs derived automatically from DIPS-where do we stand? GeoInformatics, 3(5): 36-39.
52. Gruen, A. and Zhang, L., 2002. Automatic DTM generation from three-line-scanner (TLS) images. International Archives of Photogrammetry and Remote Sensing, 34(2A): 131-137.
53. Gruen, A. and Akca, D., 2005. Least squares 3D surface and curve matching. ISPRS Journal of Photogrammetry and Remote Sensing, 59(3): 151-174.
54. Gruen, A., Zhang, L. and Eisenbeiss, H., 2005. 3D precision processing of high-resolution satellite imagery. Proceedings of the ASPRS 2005 Annual Conference, Baltimore, Maryland (on CD-ROM).
55. Gruen, A. and Wolff, K., 2007. DSM generation with ALOS/PRISM data using SAT-PP. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Barcelona, Spain. 4 pages (on CD-ROM).
56. Grün, A., 1984. Adaptive least squares correlation-concept and first results. Intermediate Research Project Report to Helava Assoc., Inc., Ohio State University, Columbus, Ohio. 13 pages.
57. Guelch, E., 1988. Results of test on image matching of ISPRS WGIII/4. International Archives of Photogrammetry and Remote Sensing, 27(B3): 254-271.
58. Haala, N., 2009. Comeback of digital image matching. In Photogrammetric Week 2009 (Ed. D. Fritsch ). Wichmann, Heidelberg, Germany. 289-301.
59. Haala, N. and Kada, M., 2010. An update on automatic 3D building reconstruction. ISPRS Journal of Photogrammetry and Remote Sensing, 65(6): 570-580.
60. Haggren, H., 1986. Real-time photogrammetry as used for machine vision applications. International Archives of Photogrammetry and Remote Sensing, 26(5): 374-382.
61. Hancock, E. R. and Kittler, J., 1990. Discrete relaxation. Pattern Recognition, 23: 711-733.
62. Helava, U. V., 1972. Digital processing and analysis of image data. International Archives of Photogrammetry, 20(1). 354 pages.
63. Helava, U. V., 1976. Digital correlation in photogrammetric instruments. International Archives of Photogrammetry, 21(2). 26 pages.
64. Helava, U. V., 1978. Digital correlation in photogrammetric instruments. Photogrammetria, 34(1): 19-34.
65. Helava, U. V., 1988a. Digital comparator correlator system. International Archives of Photogrammetry and Remote Sensing, 27(B2): 160-170.
66. Helava, U. V., 1988b. Object-space least squares correlation. Photogrammetric Engineering & Remote Sensing, 54(6): 711-714.
67. Hirschmueller, H., 2008. Stereo processing by semiglobal matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(2): 328-342.
68. Hobrough, G. L., 1959. Automatic stereo plotting. Photogrammetric Engineering, 25(5): 763-769.
69. Hobrough, G. L., 1965. Automation in photogrammetric instruments. Photogrammetric Engineering, 31(4): 595-603.
70. Hsia, J.-S. and Newton, I., 1999. A method for the automated production of digital terrain models using a combination of feature points, grid points, and filling back points. Photogrammetric Engineering & Remote Sensing, 65(6): 713-719.
71. Kelly, R. E., McConnell, P. R. H. and Mildenberger, S. J., 1977. The Gestalt photomapping system. Photogrammetric Engineering & Remote Sensing, 43(11): 1407-1417.
72. Kempa, M. and Schlueter, M., 1993. DEM evaluation by an operator and facets stereo vision: a comparison based on close range imagery. In Optical 3-D Measurement Techniques II (Eds. A. Gruen & H. Kahmen ). Wichmann, Karlsruhe, Germany. 624 pages: 502-509.
73. Konecny, G. and Pape, D., 1981. Correlation techniques and devices. Photogrammetric Engineering & Remote Sensing, 47(3): 323-333.
74. Krzystek, P., 1995. Generation of digital elevation models. Chapter 7 in Second Course in Digital Photogrammetry. Landesvermessungsamt Nordrhein-Westfalen and Institut für Photogrammetrie, Universität Bonn. Unpaginated.
75. Lambers, K., Eisenbeiss, H., Sauerbier, M., Kupferschmidt, D., Gaisecker, T., Sotoodeh, S. and Hanusch, T., 2007. Combining photogrammetry and laser scanning for the recording and modelling of the late intermediate period site of Pinchango Alto, Palpa, Peru. Journal of Archaeological Science, 34(10): 1702-1712.
76. Leberl, F., Irschara, A., Pock, T., Meixner, P., Gruber, M., Scholz, S. and Wiechert, A., 2010. Point clouds: lidar versus 3D vision. Photogrammetric Engineering & Remote Sensing, 76(10): 1123-1134.
77. Lemmens, J. P. M., 1988. A survey on stereo matching techniques. International Archives of Photogrammetry and Remote Sensing, 27(B8): 11-23.
78. Li, M. X., 1989. Hierarchical Multi-point Matching with simultaneous detection and location of breaklines. Ph.D. thesis, Department of Photogrammetry, Royal Institute of Technology, Stockholm, Sweden. 177 pages.
79. Lue, Y., Zhang, Z. and Zhang, J., 1987. Calibration of a drum scanner with least squares correlation. Proceedings of ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland. 437 pages: 109-119.
80. Maas, H.-G., 1996. Automatic DEM generation by multi-image feature based matching. International Archives of Photogrammetry and Remote Sensing, 31(3): 484-489.
81. Maas, H.-G., Stefanidis, A. and Gruen, A., 1994. From pixels to voxels: tracking volume elements in sequences of 3-D digital images. International Archives of Photogrammetry and Remote Sensing, 30(3/2): 539-546.
82. Makarovic, B., 1980. Image correlation algorithms. International Archives of Photogrammetry, 23(B2): 139-158.
83. Masry, S. E., 1974. Digital correlation principles. Photogrammetric Engineering, 40(3): 303-308.
84. Mikhail, E. M., Helava, U. A., Jancaitis, J. R., Doyle, F. J., Helmering, R. J., Ackerman, F. and Turner, A. K., 1978. Panel discussion: the future of DTM. Photogrammetric Engineering & Remote Sensing, 44(12): 1487-1497.
85. Miller, S. and De Venecia, K., 1992. Automatic elevation extraction and the digital photogrammetric workstation. ASPRS-ACSM Annual Convention, Albuquerque, New Mexico, 1: 572-580.
86. Otto, G. P. and Chau, T. K. W., 1988. A region-growing algorithm for matching of terrain images. Proceedings 4th Alvey Vision Conference, University of Manchester, UK. 123-128.
87. Panton, D. J., 1978. A flexible approach to digital stereo mapping. Photogrammetric Engineering & Remote Sensing, 44(12): 1499-1512.
88. PE&RS, 1983. Five short articles on automated correlation of stereo data. Photogrammetric Engineering & Remote Sensing, 49(4): 527-544.
89. Pertl, A., 1984. Digital image correlation with the analytical plotter Planicomp C100. International Archives of Photogrammetry, 25(3b): 874-882.
90. Poli, D., Zhang, L. and Gruen, A., 2004. SPOT-5/HRS stereo images orientation and automated DSM generation. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 35(B1): 421-432.
91. Poli, D., Wolff, K. and Gruen, A., 2009. Evaluation of Worldview-1 stereo scenes. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 38(1-4-7/W5). 6 pages (on CD-ROM).
92. Poon, J., Fraser, C. S., Zhang, C., Zhang, L. and Gruen, A., 2005. Quality assessment of digital surface models generated from IKONOS imagery. Photogrammetric Record, 20(110): 162-171.
93. Rauhala, U. H., 1986. Compiler positioning of array algebra technology. International Archives of Photogrammetry and Remote Sensing, 26(3/3): 173-198.
94. Remondino, F., El-Hakim, S. F., Gruen, A. and Zhang, L., 2008. Turning images into 3-D models. IEEE Signal Processing Magazine, 25(4): 55-65.
95. Remondino, F. and Menna, F., 2008. Image-based surface measurement for close-range heritage documentation. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 37(B5): 199-206.
96. Remondino, F., Gruen, A., Von Schwerin, J., Eisenbeiss, H., Rizzi, A., Girardi, S., Sauerbier, M. and Richards-Rissetto, H., 2009. Multi-sensor 3D documentation of the Maya site of Copan. Proceedings of the XXIIth CIPA International Symposium, Kyoto, Japan. 6 pages.
97. Rosenberg, P., 1955. Information theory and electronic photogrammetry. Photogrammetric Engineering, 21(4): 543-555.
98. Rosenfeld, A., 1984. Image analysis: problems, progress and prospects. Pattern Recognition, 17(1): 3-12.
99. Rosenholm, D., 1986. Accuracy improvement of digital matching for evaluation of digital terrain models. International Archives of Photogrammetry and Remote Sensing, 26(3/2): 573-587.
100. Scarano, F. A. and Brumm, G. A., 1976. A digital elevation data collection system. Photogrammetric Engineering & Remote Sensing, 42(4): 489-496.
101. Schewe, H. and Förstner, W., 1986. The program PALM for automatic line and surface measurement using image matching techniques. International Archives of Photogrammetry and Remote Sensing, 26(3/2): 608-622.
102. Smith, M. J. and Smith, D. G., 1996. Operational experiences of digital photogrammetric systems. International Archives of Photogrammetry and Remote Sensing, 31(B2): 357-362.
103. Snavely, N., Seitz, S. M. and Szeliski, R., 2006. Photo tourism: exploring photo collections in 3D. ACM Transactions on Graphics, 25(3): 835-846.
104. Trinder, J. C., 1986. Precision of stereoscopic height measurements. Photogrammetric Engineering & Remote Sensing, 52(1): 75-79.
105. Vu, H. H., Keriven, R., Labatut, P. and Pons, J.-P., 2009. Towards high-resolution large-scale multi-view stereo. Paper presented at CVPR09. [Accessed: 8th January 2011].
106. Williams, R. E., 1959. The automatic map compilation system. Photogrammetric Engineering, 25(1): 103-110.
107. Wolff, K., 2009. DGPF project: evaluation of digital photogrammetric aerial based imaging systems-generation of digital surface models. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 38(1-4-7/W5). 5 pages (on CD-ROM).
108. Wolff, K. and Gruen, A., 2008. Up-to-date DSM generation using high resolution satellite image data. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 37(B1-3): 1103-1108.
109. Wrobel, B., 1987. Facets stereo vision (FAST vision)-a new approach to computer stereo vision and to digital photogrammetry. Proceedings of ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland. 437 pages: 231-258.
110. Zhang, B. and Miller, S., 1997. Adaptive automatic terrain extraction. SPIE, 3072: 27-36.
111. Zhang, J., Zhang, Z., Shen, W. and Wang, Z., 1996. VirtuoZo digital photogrammetric system and its theoretical foundation and key algorithms. International Archives of Photogrammetry and Remote Sensing, 31(B2): 424-429.
112. Zhang, L., 2005. Automatic digital surface model (DSM) generation from linear array images. Institute of Geodesy and Photogrammetry, ETH Zurich, Switzerland, Mitteilungen 88. Dissertation No. 16078. 199 pages.
113. Zhang, L. and Gruen, A., 2004. Automatic DSM generation from linear array imagery data. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 35(B3): 128-133.
114. Zhang, L. and Gruen, A., 2006. Multi-image matching for DSM generation from IKONOS imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 60(3): 195-211.
115. Zhang, Z., Zhang, J., Wu, X. and Zhang, H., 1992. Global image matching with relaxation method. Proceedings of the International Colloquium on Photogrammetry, Remote Sensing and Geographic Information Systems, Wuhan, China, 11th to 14th May. 175-188.
116. Zheltov, S. Y. and Sibiryakov, A. V., 1997. Adaptive subpixel cross-correlation in a point correspondence. In Optical 3D Measurement Techniques (Eds. A. Gruen & O. Kühbler ). Wichmann, Zurich, Switzerland. 86-95.