Automatic registration of optical imagery with 3D LiDAR data using statistical similarity

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 88, Issue , 2014, Pages 28-40

  Parmehr, Ebadat G ^a,b   Fraser, Clive S ^a,b   Zhang, Chunsun ^a,c   Leach, Joseph ^b  

^a Andrew Haywood is with the Cooperative Research Centre for Spatial Information   (Australia)

^b UNIVERSITY OF MELBOURNE   (Australia)

^c RMIT UNIVERSITY   (Australia)

Author keywords

LiDAR; Mutual Information; Optical imagery; Point cloud; Registration

Indexed keywords

AERIAL PHOTOGRAPHY; IMAGE PROCESSING; REMOTE SENSING; THREE DIMENSIONAL;

AUTOMATED REGISTRATION; AUTOMATIC REGISTRATION; MULTI-RESOLUTION REMOTE SENSING; MUTUAL INFORMATIONS; OPTICAL IMAGERY; POINT CLOUD; REGISTRATION; STATISTICAL DEPENDENCIES;

OPTICAL RADAR;

ACCURACY ASSESSMENT; AUTOMATION; COMPUTER VISION; LAND COVER; LIDAR; OPTICAL METHOD; PHOTOGRAMMETRY; POINT SOURCE; REMOTE SENSING;

EID: 84890815583     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2013.11.015     Document Type: Article

References (57)

1. Abdel-Aziz, Y.I., Karara, H.M., 1971. Direct linear transformation from comparator coordinates into object space coordinates in close-range photogrammetry. In: Proc. ASP Symposium on Close Range Photogrammetry, American Society of Photogrammetry, Falls Church, VA.
2. Al-Manasir K., Fraser C.S. Automatic registration of terrestrial laser scanner data via imagery. Photogramm. Rec. 2006, 21(115):255-268.
3. Awrangjeb M., Zhang C., Fraser C.S. Building detection in complex scenes thorough effective separation of buildings from trees. Photogramm. Eng. Rem. Sens. 2012, 78(7):729-745.
4. Baltsavias E.P. A comparison between photogrammetry and laser scanning. ISPRS J. Photogramm. Rem. Sens. 1999, 54(2):83-94.
5. Baltsavias E.P. Airborne laser scanning: basic relations and formulas. ISPRS J. Photogramm. Rem. Sens. 1999, 54(2):199-214.
6. Besl P.J., McKay N.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14(2):239-255.
7. Bishop C.M. Neural Networks for Pattern Recognition 1995, Oxford University Press, Oxford.
8. Bodensteiner, C., Huebner, W., Juengling, K., Mueller, J., Arens, M., 2010. Local multi-modal image matching based on self-similarity. In: Proc. IEEE International Conference on Image Processing (ICIP), Hong Kong, pp. 937-940.
9. Bodensteiner, C., Hubner, W., Jungling, K., Solbrig, P., Arens, M., 2011. Monocular camera trajectory optimization using LiDAR data. In: Proc. IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barlcelona, Spain, pp. 2018-2025.
10. Cahill, N.D., 2010. Normalized measures of mutual information with general definitions of entropy for multimodal image registration. In: Biomedical Image Registration. Springer Berlin Heidelberg, pp. 258-268.
11. Choi K., Hong K., Lee I. Precise geometric registration of aerial imagery and LIDAR data. ETRI J. 2011, 33(4):506-516.
12. Chung, A.C.S., Gan, R., Wells, W.M., 2007. Robust Multi-modal Image Registration based on Prior Joint Intensity Distributions and Minimization of Kullback-Leibler Distance, HKUST CES Technical, Report, CS07-01.
13. Corsini M., Dellepiane M., Ponchio F., Scopigno R. Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties. Comput. Graph. Forum 2009, 28(7):1755-1764.
14. Cover, T.M., 1991. Elements of Information Theory. Wiley Series in Telecommunications, John Wiley & Sons Inc., New York.
15. Goshtasby A.A. 2-D and 3-D Image Registration: For Medical, Remote Sensing, and Industrial Applications 2005, John Wiley & Sons Inc., Hoboken, New Jersey.
16. Habib A., Schenk T. A new approach for matching surfaces from laser scanners and optical sensors. Int. Arch. Photogramm. Rem. Sens. Spatial Inform. Sci. 1999, 32(Part 3):55-61.
17. Habib, A., Lee Y., Morgan, M., 2001. LIDAR data for photogrammetric georeferencing. In: Proc. Joint Workshop of ISPRS WG I/2, I/5 and IV/7, High Resolution Mapping from Space 2001, University of Hanover, Hanover, Germany (on CD-ROM).
18. Habib A., Ghanma M., Morgan M., Al-Ruzouq R. Photogrammetric and LIDAR data registration using linear features. Photogramm. Eng. Rem. Sens. 2005, 71(6):699-707.
19. Hahn D., Daum V., Hornegger J. Automatic parameter selection for multimodal image registration. IEEE Trans. Med. Imaging 2010, 29(5):1140-1155.
20. Hajnal J.V., Hill D.L.G., Hawkes D.J. Medical Image Registration 2001, CRC Press, Baton Rouge, Florida.
21. Kadir, T., Brady, M., 2005. Estimating statistics in arbitrary regions of interest. In: Proc. 16th British Machine Vision Conference, Oxford, vol. 2, pp. 589-598.
22. Katkovnik V., Shmulevich I. Kernel density estimation with adaptive varying window size. Pattern Recogn. Lett. 2002, 23(14):1641-1648.
23. Kullback S. Information Theory and Statistics 1968, Dover Publications, New York.
24. Kwak T.S., Kim Y.I., Yu K.Y., Lee B.K. Registration of aerial imagery and aerial LiDAR data using centroids of plane roof surfaces as control information. KSCE J. Civ. Eng. 2006, 10(5):365-370.
25. Lee J.B., Yu K.Y. Co-registration of aerial photos, ALS data and digital maps using linear features. KOGSIS J. 2006, 14(4):37-44.
26. LeMoigne J., Netanyahu N.S., Eastman R.D. Image Registration for Remote Sensing 2011, Cambridge University Press, Cambridge.
27. Lowe D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 2004, 60(2):91-110.
28. Maes F., Collignon A., Vandermeulen D., Marchal G., Suetens P. Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 1997, 16(2):187-198.
29. Maes F., Vandermeulen D., Suetens P. Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information. Med. Image Anal. 1999, 3(4):373-386.
30. Mastin, A., Kepner, J., Fisher, J., 2009. Automatic registration of LIDAR and optical images of urban scenes. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL. pp. 2639-2646.
31. McGill W. Multivariate information transmission. IRE Profess. Group Inform. Theor. 1954, 4(4):93-111.
32. Palenichka R.M., Zaremba M.B. Automatic extraction of control points for the registration of optical satellite and LiDAR images. IEEE Trans. Geosci. Remote Sens. 2010, 48(7):2864-2879.
33. Parmehr, E.G., Zhang, C., Fraser, C.S., 2012. Automatic registration of multi-source data using mutual information. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. I-7. Melbourne, Australia, pp. 303-308.
34. Parmehr, E.G., Fraser, C.S., Zhang, C., Leach, J., 2013a. Automatic registration of optical imagery with 3D lidar data using local combined mutual information. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. II-5/W2. Antalya, Turkey, pp. 229-234.
35. Parmehr, E.G., Fraser, C.S., Zhang, C., Leach, J., 2013b. An effective histogram binning for mutual information based registration of optical imagery and 3D LiDAR data. In: Proc. IEEE International Conference on Image Processing (ICIP), Melbourne, Australia, pp. 1286-1290.
36. Pluim J.P.W., Maintz J.B.A., Viergever M.A. Mutual-information-based registration of medical images: a survey. IEEE Trans. Med. Imaging 2003, 22(8):986-1004.
37. Press W.H., Teukolsky S.A., Vetterling W.T., Flannery B.P. Numerical Recipes in C: The Art of Scientific Computing 1992, Cambridge University Press, New York.
38. Rajwade, A., Banerjee, A., Rangarajan, A., 2006. A new method of probability density estimation with application to mutual information based image registration. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New York, pp. 1769-1776.
39. Reza F.M. An Introduction to Information Theory 1961, McGraw-Hill, New York.
40. Rönnholm P. Registration quality - toward integration of laser scanning and photogrammetry. Eur. Spatial Data Res. 2011, (59). 298p.
41. Rönnholm, R., Haggrén, H., 2012. Registration of laser scanning point clouds and aerial images using either artificial or natural tie features. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. I-3, Melbourne, Australia, pp. 63-68.
42. Rottensteiner F., Briese C. Automatic generation of building models from LIDAR data and the integration of aerial images. Int. Arch. Photogramm. Rem. Sens. Spatial Inform. Sci. 2003, 34(Part 3):174-180.
43. Schenk T., Csathó B. Fusion of LIDAR data and aerial imagery for a more complete surface description. Int. Arch. Photogramm. Rem. Sens. Spatial Inform. Sci. 2002, 34(Part 3):310-317.
44. Shannon C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27:379.
45. Shorter, N., Kasparis, T., 2008. Autonomous registration of LiDAR data to single aerial image. In: Proc. IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Boston, MA, pp. 216-219.
46. Skaloud, J., 2006. Reliability in direct georeferencing: an overview of the current approaches and possibilities. In: Proc. International Calibration and Orientation Workshop, EuroCOW06, Castelldefels, Spain,14p.
47. Studeny M., Vejnarova J. The multiinformation function as a tool for measuring stochastic dependence. Learning in Graphical Models 1998, 261-298. Springer, Netherlands.
48. Studholme C., Hill D.L.G., Hawkes D.J. An overlap invariant entropy measure of 3D medical image alignment. Pattern Recogn. 1999, 32(1):71-86.
49. Suri S., Reinartz P. Mutual-information-based registration of TerraSAR-X and Ikonos imagery in urban areas. IEEE Trans. Geosci. Remote Sens. 2010, 48(2):939-949.
50. Toth, C., Ju, H., Grejner-Brzezinska, D., 2011. Matching between different image domains. In: Photogrammetric Image Analysis, Munich, Germany. pp. 37-47.
51. Viola P., Wells W.M. Alignment by maximization of mutual information. Int. J. Comput. Vision 1997, 24(2):137-154.
52. Wang, L., Neumann, U., 2009. A robust approach for automatic registration of aerial images with untextured aerial lidar data. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, pp. 2623-2630.
53. Watanabe S. Information theoretical analysis of multivariate correlation. IBM J. Res. Dev. 1960, 4(1):66-82.
54. Wong A., Orchard J. Efficient FFT-accelerated approach to invariant optical-LIDAR registration. IEEE Trans. Geosci. Remote Sens. 2008, 46(11):3917-3925.
55. Yan, W., Shaker, A., 2010. Radiometric calibration of airborne lidar intensity data for land cover classification. In: Canadian Geomatics Conference 2010 and ISPRS COM I Symposium, pp. 14-18.
56. Zhang, A., Hu, S., Jin, X., Sun, W., 2005. A method of merging aerial images and ground laser scans. In: Proc. IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Seoul, Korea, 4p (on CD-ROM).
57. Zöllei, L., Fisher, J., Wells, W., 2003. A unified statistical and information theoretic framework for multi-modal image registration. In: Proc. Information Processing in Medical Imaging, Ambleside, UK, pp. 366-377.