A fast and mobile system for registration of low-altitude visual and thermal aerial images using multiple small-scale UAVs

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 104, Issue , 2015, Pages 189-202

  Yahyanejad, Saeed ^a   Rinner, Bernhard ^a  

^a UNIVERSITY OF KLAGENFURT   (Austria)

Author keywords

3D registration; Depth map; Image registration; Real time UAV mapping; Visual and thermal images

Indexed keywords

AERIAL PHOTOGRAPHY; DISASTER PREVENTION; DISASTERS; IMAGE REGISTRATION; MAPPING;

3D REGISTRATION; DEPTH MAP; DISASTER MANAGEMENT; FEATURE BASED REGISTRATION; ILLUMINATION VARIATION; REAL TIME; REAL TIME MONITORING; THERMAL IMAGES;

STATISTICAL TESTS;

AERIAL PHOTOGRAPH; ALTITUDE; COST ANALYSIS; DISASTER MANAGEMENT; IMAGE PROCESSING; REAL TIME; SENSOR; THREE-DIMENSIONAL MODELING; UNMANNED VEHICLE; VISUAL ANALYSIS;

EID: 84937824972     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2014.07.015     Document Type: Article

References (50)

1. Banz, C., Hesselbarth, S., Flatt, H., Blume, H., Pirsch, P., 2010. Real-time stereo vision system using semi-global matching disparity estimation: architecture and FPGA-implementation. In: Proceedings of International Symposium on Systems, Architectures, Modeling, and Simulation (SAMOS). Samos, Greece, pp. 93-101.
2. Bay H., Ess A., Tuytelaars T., Gool L.V. SURF: speeded-up robust features. Comp. Vis. Image Understand. (CVIU) 2008, 110:346-359.
3. Canny J. A computational approach to edge detection. IEEE Trans. Patt. Anal. Mach. Intell. 1986, 8:679-698.
4. Coiras E., Santamaria J., Miravet C. Segment-based registration technique for visual-infrared images. Opt. Eng. 2000, 39:282-289.
5. Du Q., Raksuntorn N. Automatic registration and mosaicking for airborne multispectral image sequences. Photogram. Eng. Rem. Sens. 2008, 74:169-181.
6. Dufournaud, Y., Schmid, C., Horaud, R., 2000. Matching images with different resolutions. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR). Hilton Head, SC, USA, pp. 612-618.
7. Fischler M.A., Bolles R.C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 24:381-395.
8. Flöry S., Hofer M. Surface fitting and registration of point clouds using approximations of the unsigned distance function. Comp. Aided Geomet. Des. 2010, 27:60-77.
9. Fonseca, L.M.G., Costa, M.H.M., 1997. Automatic registration of satellite images. In: Proceedings of Brazilian symposium on computer graphics and image processing. Campos do Jordão, SP, Brazil, pp. 219-226.
10. Furukawa Y., Ponce J. Accurate, dense, and robust multiview stereopsis. IEEE Trans. Patt. Anal. Mach. Intell. 2010, 32:1362-1376.
11. Gonzalez R.C., Woods R.E. Digital Image Processing 1992, Addison-Wesley Publishing Company, Reading, Mass., Menlo Park, CA, New York.
12. Grompone von Gioi R., Jakubowicz J., Morel J.M., Randall G. LSD: a line segment detector. Image Process. On Line 2012, 2012:1-19.
13. Hansen B.B., Morse B.S. Multiscale image registration using scale trace correlation. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1999, 202-208. Ft. Collins, CO, USA.
14. Harris, C., Stephens, M., 1988. A combined corner and edge detector. In: Proceedings of Fourth Alvey Vision Conference. Manchester, UK, pp. 147-151.
15. Heinrichs M., Rodehorst V., Hellwich O. Efficient semi-global matching for trinocular stereo. Int. Arch. Photogram., Rem. Sens. Spatial Inform. Sci. 2007, 36(3/W49A):185-190.
16. Hirschmuller, H., 2005. Accurate and efficient stereo processing by semi-global matching and mutual information. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). San Diego, CA, USA, pp. 807-814.
17. Hong G., Zhang Y. The image registration technique for high resolution remote sensing image in hilly area. Int. Arch. Photogram., Rem. Sens. Spatial Inform. Sci. 2005, 36(8/W27). (on CDROM).
18. Irschara, A., Zach, C., Michael Frahm, J., Bischof, H., 2009. From structure-from-motion point clouds to fast location recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Miami, FL, USA, pp. 2599-2606.
19. Istenic, R., Heric, D., Ribaric, S., Zazula, D., 2007. Thermal and visual image registration in Hough parameter space. In: Proceedings of 14th International Workshop on Systems, Signals and Image Processing (IWSSIP). Maribor, Slovenia, pp. 106-109.
20. Joo, J., Choi, J., Cho, D., 2003. Robust registration in two heterogeneous sequence images on moving objects. In: Proceedings of Sixth International Conference of Information Fusion. Cairns, Queensland, Australia, pp. 277-282.
21. Kern J., Pattichis M. Robust multispectral image registration using mutual-information models. IEEE Trans. Geosci. Rem. Sens. 2007, 45:1494-1505.
22. Kim H., Kim M.G. Image registration using terrain relief correction based on the rigorous sensor models. Int. Arch. Photogram., Rem. Sens. Spatial Inform. Sci. 2012, 235-238.
23. Klein, A., Kroon, D.J., Hoogeveen, Y., Schultze Kool, L.J., Renema, W.K.J., Slump, C.H., 2011. Multimodal image registration by edge attraction and regularization using a b-spline grid. In: Proceedings of Society of Photo-Optical Instrumentation Engineers (SPIE). Orlando, FL, USA, pp. 7962:20-7962:28.
24. Kong S.G., Heo J., Boughorbel F., Zheng Y., Abidi B.R., Koschan A., Yi M., Abidi M.A. Multiscale fusion of visible and thermal IR images for illumination-invariant face recognition. Int. J. Comp. Vis. 2006, 71:215-233.
25. Lee S. A coarse-to-fine approach for remote-sensing image registration based on a local method. Int. J. Smart Sens. Intell. Syst. 2010, 3:690-702.
26. Lin, H., Du, P., Zhao, W., Zhang, L., Sun, H., 2010. Image registration based on corner detection and affine transformation. In: Proceedings of 3rd International Congress on Image and Signal Processing. Yantai, China, pp. 2184-2188.
27. Lowe D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comp. Vis. 2004, 60:91-110.
28. Mahdi H., Farag A. Image registration in multispectral data sets. Proceedings of International Conference on Image Processing (ICIP) 2002, 369-372. IEEE, Rochester, NY, USA.
29. McKinnon D., Smith R.N., Upcroft B. A semi-local method for iterative depth-map refinement. Proceedings of International Conference on Robotics and Automation (ICRA) 2012, 758-763. IEEE, St. Paul, MN, USA.
30. Meltzer, J., Soatto, S., 2008. Edge descriptors for robust wide-baseline correspondence. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Anchorage, AK, USA, pp. 1-8.
31. Mikolajczyk K., Schmid C. Scale & affine invariant interest point detectors. Int. J. Comp. Vis. 2004, 60:63-86.
32. Morel J.M., Yu G. Is SIFT scale invariant?. Inv. Prob. Imag. (IPI) 2011, 5:115-136.
33. Müller M., Heidelberger B., Teschner M., Gross M. Meshless deformations based on shape matching. ACM Trans. Graph. 2005, 24:471-478.
34. Quaritsch M., Stojanovski E., Bettstetter C., Friedrich G., Hellwagner H., Rinner B., Hofbauer M., Shah M. Collaborative microdrones: applications and research challenges. Proceedings of the Second International Conference on Autonomic Computing and Communication Systems 2008, 38:1-38:7. ACM Press, Turin, Italy.
35. Quaritsch M., Kruggl K., Wischounig-Strucl D., Bhattacharya S., Shah M., Rinner B. Networked UAVs as aerial sensor network for disaster management applications. Elektrotechnik und Informationstechnik (e&i) 2010, 127:56-63. Springer.
36. Quaritsch, M., Kuschnig, R., Hellwagner, H., Rinner, B., 2011. Fast aerial image acquisition and mosaicking for emergency response operations by collaborative UAVs. In: Proceedings of 8th International Conference on Information Systems for Crisis Response and Management (ISCRAM 2011). Lisbon, Portugal, pp. 1-5.
37. Schaefer G., Tait R., Howell K., Hopgood A., Woo P., Harper J. User Centered Design for Medical Visualization 2008, IGI Global, (Automated overlay of infrared and visual medical images, pp. 174-183).
38. Schilcher, U., Gyarmati, M., Bettstetter, C., Chung, Y.W., Kim, Y.H., 2008. Measuring inhomogeneity in spatial distributions. In: Proceedings of Vehicular Technology Conference (VTC Spring). Marina Bay, Singapore, pp. 2690-2694.
39. Šegvic, S., 2005. A multimodal image registration technique for structured polygonal scenes. In: Proceedings of Image and Signal Processing and Analysis (ISPA). Zagreb, Croatia, pp. 500- 505.
40. Sehgal A., Cernea D., Makaveeva M. Real-time scale invariant 3d range point cloud registration. Proceedings of International Conference on Image Analysis and Recognition (ICIAR) 2010, 220-229. Springer, Povoa de Varzim, Portugal.
41. Snavely N., Seitz S.M., Szeliski R. Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 2006, 25:835-846.
42. Song Z., Cheng X. A new search engine filtering scheme based on improved neural network and ontology. Proceedings of International Conference on Computational and Information Sciences 2010, 178-181. IEEE, Chengdu, Sichuan, China.
43. Szeliski R. Computer Vision: Algorithms and Applications. first ed. 2010, Springer-Verlag New York, Inc., New York, NY, USA.
44. Teke, M., Temizel, A., 2010. Multi-spectral satellite image registration using scale-restricted SURF. In: Proceedings of 20th International Conference on Pattern Recognition (ICPR). Istanbul, Turkey, pp. 2310-2313.
45. Tingdahl D., Van Gool L. A public system for image based 3d model generation. Proceedings of the 5th International Conference on Computer Vision/Computer Graphics Collaboration Techniques 2011, 262-273. Springer-Verlag, Rocquencourt, France.
46. Vaidehi, V., Ramya, R., Prasannadevi, M., Naresh Babu, N.T., Balamurali, P., Girish Chandra, M., 2011. Fusion of multi-scale visible and thermal images using EMD for improved face recognition. In: Proceedings of International MultiConference of Engineers and Computer Scientists. Hong Kong, pp. 543-548.
47. Wischounig-Strucl, D., Quartisch, M., Rinner, B., 2011. Prioritized data transmission in airborne camera networks for wide area surveillance and image mosaicking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Colorado Springs, CO, USA, pp. 17-24.
48. Yahyanejad S., Wischounig-Strucl D., Quaritsch M., Rinner B. Incremental mosaicking of images from autonomous, small-scale UAVs. Proceedings of the 7th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) 2010, 329-336. IEEE Computer Society, Boston, MA, USA.
49. Yahyanejad, S., Misiorny, J., Rinner, B., 2011a. Lens distortion correction for thermal cameras to improve aerial imaging with small-scale UAVs. In: Proceedings of IEEE International Symposium on Robotic and Sensors Environments (ROSE). Montreal, QC, Canada, pp. 231-236.
50. Yahyanejad, S., Quaritsch, M., Rinner, B., 2011b. Incremental, orthorectified and loop-independent mosaicking of aerial images taken by micro UAVs. In: Proceedings of IEEE International Symposium on Robotic and Sensors Environments (ROSE). Montreal, QC, Canada, pp. 137-142.