Band registration of tuneable frame format hyperspectral UAV imagers in complex scenes

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 134, Issue , 2017, Pages 96-109

  Honkavaara, Eija ^a   Rosnell, Tomi ^a   Oliveira, Raquel ^b   Tommaselli, Antonio ^b  

^a FINNISH GEOSPATIAL RESEARCH INSTITUTE   (Finland)

^b SÃO PAULO STATE UNIVERSITY UNESP   (Brazil)

Author keywords

Geometry; Hyperspectral imaging; Photogrammetry; Registration; UAV

Indexed keywords

ANTENNAS; CAMERAS; FABRY-PEROT INTERFEROMETERS; FORESTRY; IMAGE RECONSTRUCTION; PIXELS; REMOTE SENSING; SPECTROSCOPY; STEREO IMAGE PROCESSING; THREE DIMENSIONAL COMPUTER GRAPHICS; UNMANNED AERIAL VEHICLES (UAV);

3D SCENES; AERIAL VEHICLE; EMPIRICAL ASSESSMENT; FRAME FORMAT; HYPERSPECTRAL; PERFORMANCE; PIXEL SIZE; REGISTRATION; TUNEABLE FILTERS; UNMANNED AERIAL VEHICLE;

HYPERSPECTRAL IMAGING;

AERIAL SURVEY; GEOMETRY; INTERFEROMETER; MULTISPECTRAL IMAGE; PERFORMANCE ASSESSMENT; PHOTOGRAMMETRY; PIXEL; SPATIAL RESOLUTION; UNMANNED VEHICLE;

EID: 85032965543     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2017.10.014     Document Type: Article

References (61)

1. Aasen, H., Burkart, A., Bolten, A., Bareth, G., Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: from camera calibration to quality assurance. ISPRS J. Photogram. Rem. Sens. 108 (2015), 245–259, 10.1016/j.isprsjprs.2015.08.002.
2. Babey, S.K., Anger, C.D., 1989. A compact airborne spectrographic imager (CASI). In: Proc. IGARSS '89 and 12th Canadian Symposium on Remote Sensing, Vancouver, Canada, 10–14 July, 2, pp. 1028–1031. doi: 10.1109/IGARSS.1989.579067.
3. Berveglieri, A., Tommaselli, A.M.G., Imai, N.N., Ribeiro, E.A.W., Guimaraes, R.B., Honkavaara, E., Identification of successional stages and cover changes of tropical forest based on digital surface model analysis. IEEE J. Select. Top. Appl. Earth Observ. Rem. Sens. 9:12 (2016), 5385–5397 http//dx.doi.org/10.1109/JSTARS.2016.2606320.
4. Burkart, A., Aasen, H., Alonso, L., Menz, G., Bareth, G., Rascher, U., Angular dependency of hyperspectral measurements over wheat characterized by a novel UAV based goniometer. Remote Sens. 7 (2015), 725–746, 10.3390/rs70100725.
5. Büttner, A., Röser, H.-P., Hyperspectral remote sensing with the UAS ‘‘Stuttgarter Adler” – system setup, calibration and first results. Photogram. Fernerkundung Geoinform. 2014 (2014), 265–274, 10.1127/1432-8364/2014/0217.
6. Cocks, T., Jenssen, R., Stewart, A., Wilson, I., Shields, T., The HyMap airborne hyperspectral sensor: the system, calibration and performance. Proc. 1st EARSeL Workshop on Imaging Spectroscopy, Zurich, Paris, 1998, 37–43 (6–8 October).
7. Cramer, M., Stallmann, D., On the use of GPS/inertial exterior orientation parameters in airborne photogrammetry. Proc. ISPRS Workshop-High Resolution Mapping from Space, Hannover, Germany, 2001, 32–44 19–21 September.
8. Cramer, M., Experiences on operational gps/inertial system calibration in aiborne photogrammetry. J. GIS-Geoinformationssysteme 14:6 (2002), 37–42.
9. Cubert, Cubert GmbH. http://cubert-gmbh.de, 2017 (accessed 26 August, 2017).
10. Dawn, S., Saxena, V., Sharma, B., Remote sensing image registration techniques: a survey. Elmoataz, A., Lezoray, O., Nouboud, F., Mammass, D., Meunier, J., (eds.) Image and Signal Processing, 2010, Springer, Berlin, Heidelberg, 103–112.
11. Dall'Asta, E., Forlani, G., Roncella, R., Santise, M., Diotri, F., di Cella, U.M., Unmanned aerial systems and DSM matching for rock glacier monitoring. ISPRS J. Photogram. Rem. Sens. 127 (2017), 102–114, 10.1016/j.isprsjprs.2016.10.003.
12. Eltner, A., Schneider, D., Analysis of different methods for 3D reconstruction of natural surfaces from parallel-axes UAV images. Photogram. Rec. 30:151 (2015), 279–299, 10.1111/phor.12115.
13. Fraser, C.S., Digital camera self-calibration. ISPRS J. Photogram. Rem. Sens. 52:4 (1997), 149–159, 10.1016/S0924-2716(97)00005-1.
14. Gindraux, S., Boesch, R., Farinotti, D., Accuracy assessment of digital surface models from unmanned aerial vehicles’ imagery on glaciers. Remote Sens., 9(2), 2017, 186, 10.3390/rs9020186.
15. Goetz, A., Three decades of hyperspectral remote sensing of the Earth: a personal view. Remote Sens. Environ. 113 (2009), S5–S16, 10.1016/j.rse.2007.12.014.
16. Gruen, A., Development and status of image matching in photogrammetry. Photogram. Rec. 27:137 (2012), 36–57, 10.1111/j.1477-9730.2011.00671.x.
17. Haala, N., Cavegn, S., High density aerial image matching: state-of-the-art and future prospects. Int. Arch. Photogram. Rem. Sens. Spatial Inform. Sci. 41:B4 (2016), 625–630, 10.5194/isprs-archives-XLI-B4-625-2016.
18. Habib, A.F., Kim, E.M., Kim, C.J., New methodologies for true orthophoto generation. Photogram. Eng. Rem. Sens. 73:1 (2007), 25–36 https://dx.doi.org/10.14358/PERS.73.1.25.
19. Hirschmüller, H., 2005. Accurate and eficient stereo processing by semi-global matching and mutual information. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, San Diego, USA, 2, pp. 807-814. https://doi.org/10.1109/CVPR.2005.56.
20. Honkavara, E., Hakala, T., Saari, H., Markelin, L., Mäkynen, J., Rosnell, T., A process for radiometric correction of UAV image blocks. Photogram. Fernerkundung Geoinform. 2012:2 (2012), 115–127.
21. Honkavaara, E., Saari, H., Kaivosoja, J., Pölönen, I., Hakala, T., Litkey, P., Mäkynen, J., Pesonen, L., Processing and assessment of spectrometric, stereoscopic imagery collected using a lightweight UAV spectral camera for precision agriculture. Remote Sens. 5:10 (2013), 5006–5039, 10.3390/rs5105006.
22. Hosni, A., Bleyer, M., Gelautz, M., Secrets of adaptive support weight techniques for local stereo matching. Computer Vis. Image Underst. 117:6 (2013), 620–632, 10.1016/j.cviu.2013.01.007.
23. Hruska, R., Mitchell, J., Anderson, M., Glenn, N., Radiometric and geometric analysis of hyperspectral imagery acquired from an unmanned aerial vehicle. Remote Sens. 4:12 (2012), 2736–2752, 10.3390/rs4092736.
24. Imec, 2017. https://www.imec-int.com (accessed 26 August, 2017).
25. Jaud, M., Passot, S., Le Bivic, R., Delacourt, C., Grandjean, P., Le Dantec, N., Assessing the accuracy of high resolution digital surface models computed by PhotoScan® and MicMac® in sub-optimal survey conditions. Remote Sens., 8(6), 2016, 465, 10.3390/rs8060465.
26. Jhan, J.-P., Rau, J.-Y., Huang, C.-Y., Band-to-band registration and ortho-rectification of multilens/multispectral imagery: A case study of MiniMCA-12 acquired by a fixed-wing UAS. ISPRS J. Photogram. Remote Sens. 114 (2016), 66–77, 10.1016/j.isprsjprs.2016.01.008.
27. Kanade, T., Okutomi, M., A stereo matching algorithm with an adaptive window: Theory and experiment. IEEE Trans. Pattern Anal. Mach. Intell. 16:9 (1994), 920–932, 10.1109/34.310690.
28. Kraus, K., Photogrammetry, Geometry from Images and Laser Scans. second ed., 2007, Walter de Gruyter, Berlin, New York.
29. Laliberte, A.S., Goforth, M.A., Steele, C.M., Rango, A., Multispectral remote sensing from unmanned aircraft: image processing workflows and applications for rangeland environments. Remote Sens. 3:11 (2011), 2529–2551 https://dx.doi.org/doi:10.3390/rs3112529.
30. Leberl, F., Irschara, A., Pock, T., Meixner, P., Gruber, M., Scholz, S., Wiechert, A., Point clouds: Lidar versus 3D vision. Photogram. Eng. Rem. Sens. 76:10 (2010), 1123–1134 https://dx.doi.org/10.14358/PERS.76.10.1123.
31. Lisein, J., Pierrot-Deseilligny, M., Bonnet, S., Lejeune, P., A photogrammetric workflow for the creation of a forest canopy height model from small unmanned aerial system imagery. Forests 4:4 (2013), 922–944 https://doi.org/doi:10.3390/f4040922.
32. Lucieer, A., Malenovský, Z., Veness, T., Wallace, L., HyperUAS-imaging spectroscopy from a multirotor unmanned aircraft system. J. Field Robot. 31:4 (2014), 571–590 https://doi.org/doi:10.1002/rob.21508.
33. Luhmann, T., Robson, S., Kyle, S., Boehm, J., Close Range Photogrammetry and 3D Imaging. second ed., 2014, Walter de Gruyter GmbH & Co. KG, Göttningen, Germany.
34. Mannila, R., Holmlund, C., Ojanen, H., Näsilä, A., Saari, H., Short-wave infrared (SWIR) spectral imager based on Fabry-Perot interferometer for remote sensing. SPIE Proc. 9241, 92411M, 2014, 10.1117/12.2067206.
35. Mikhail, E.M., Observations and Least Squares. 1976, University Press of America Inc., New York.
36. Mikhail, E.M., Bethel, J.S., McGlone, J.C., Introduction to Modern Photogrammetry. first ed., 2001, John Wiley & Sons Inc., New York.
37. Mäkynen, J., Holmlund, C., Saari, H., Ojala, K., Antila, T., Unmanned aerial vehicle (UAV) operated megapixel spectral camera. SPIE Proc. 8186, 81860Y, 2011 10.1117/12.897712.
38. Nevalainen, O., Honkavaara, E., Tuominen, S., Viljanen, N., Hakala, T., Yu, X., Hyyppä, J., Saari, H., Pölönen, I., Imai, N.N., Tommaselli, A.M.G., Individual tree detection and classification with UAV-based photogrammetric point clouds and hyperspectral imaging. Remote Sens., 9(3), 2017, 185, 10.3390/rs9030185.
39. Nex, F., Remondino, F., UAV for 3D mapping applications: a review. Appl. Geomat. 6:1 (2014), 1–15.
40. Näsi, R., Honkavaara, E., Lyytikäinen-Saarenmaa, P., Blomqvist, M., Litkey, P., Hakala, T., Viljanen, N., Kantola, T., Tanhuanpää, T., Holopainen, M., Using UAV-based photogrammetry and hyperspectral imaging for mapping bark beetle damage at tree-level. Remote Sens. 7:11 (2015), 15467–15493, 10.3390/rs71115467.
41. NLS, 2016. National Land Survey of Finland, National Land Survey open data licence—version 1.0—1 May 2012, http://www.maanmittauslaitos.fi/en/NLS_open_data_licence_version1_20120501. (accessed 24 June, 2016).
42. Oliveira, R.A., Tommaselli, A.M., Honkavaara, E., Geometric calibration of a hyperspectral frame camera. Photogram. Rec. 31:155 (2016), 325–347, 10.1111/phor.12153.
43. Rosnell, T., Honkavaara, E., Point cloud generation from aerial image data acquired by a quadrocopter type micro unmanned aerial vehicle and a digital still camera. Sensors 12:12 (2012), 453–480, 10.3390/s120100453.
44. Saari, H., Pellikka, I., Pesonen, L., Tuominen, S., Heikkilä, J., Holmlund, C., Mäkynen, J., Ojala, K., Antila, T., 2011. Unmanned Aerial Vehicle (UAV) operated spectral camera system for forest and agriculture applications. In: SPIE Proc. 8174, 8174OH. doi: 10.1117/12.897585.
45. Saari, H., Pölönen, I., Salo, H., Honkavaara, E., Hakala, T., Holmlund, C., Mäkynen, J., Mannila, R., Antila, T., Akujärvi, A., 2013. Miniaturized hyperspectral imager calibration and UAV flight campaigns. In: SPIE Proc. 8889, 88891O. doi: 10.1117/12.2028972.
46. Schaepman, M., Imaging spectrometers. Warner, T.A., Nellis, M.D., Foody, G.M., (eds.) The SAGE Handbook of Remote Sensing, 2009, SAGE Publishers Ltd, 166–178, 10.4135/9780857021052.n12.
47. Senop, 2017. http://senop.fi/en/optronics-hyperspectral (accessed 26 August, 2017).
48. Specim, 2017. Specim, Spectral Imaging Ltd. http://www.specim.fi/hyperspectral-remote-sensing (accessed 26 August, 2017).
49. Suomalainen, J., Anders, N., Iqbal, S., Roerink, G., Franke, J., Wenting, P., Hünniger, D., Bartholomeus, H., Becker, R., Kooistra, L., A lightweight hyperspectral mapping system and photogrammetric processing chain for unmanned aerial vehicles. Remote Sens. 6 (2014), 11013–11030, 10.3390/rs61111013.
50. Tommaselli, A.M., Oliveira, R.A., Nagai, L.Y., Imai, N.N., Miyoshi, G.T., Honkavaara, E. and Hakala, T., 2015. Assessment of bands coregistration of a light-weight spectral frame camera for UAV. Proc. GeoUAV - ISPRS Geospatial Week, La Grande Motte, France, 192. https://geouav.teledetection.fr/papers/GEOSPATIAL_WEEK_2015_192.pdf.
51. Tommaselli, A.M.G., Berveglieri, A., Oliveira, R.A., Nagai, L.Y., Honkavaara, E., 2016. Orientation and calibration requirements for hyperspectral imaging using UAVs: a case study. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences 40 (3/W4), 109–115. doi: 10.5194/isprsarchives-XL-3-W4-109-2016.
52. Torres-Sanchez, J., Lopez-Granados, F., De Castro, A.I., Pena-Barragan, J.M., Configuration and specifications of an Unmanned Aerial Vehicle (UAV) for early site specific weed management. PLoS One, 8(3), 2013, e58210, 10.1371/journal.pone.0058210.
53. Turner, D., Lucieer, A., Malenovský, Z., King, D.H., Robinson, S.A., Spatial co-registration of ultra-high resolution visible, multispectral and thermal images acquired with a micro-UAV over Antarctic moss beds. Remote Sens. 6:5 (2014), 4003–4024, 10.3390/rs6054003.
54. Uto, K., Seki, H., Saito, G., Kosugi, Y., Characterization of rice paddies by a UAV-mounted miniature hyperspectral sensor system. IEEE J. Select. Top. Appl. Earth Observ. Remote Sens. 6:2 (2013), 851–860, 10.1109/JSTARS.2013.2250921.
55. Vakalopoulou, M., Karantzalos, K., Automatic descriptor-based co-registration of frame hyperspectral data. Remote Sens. 6:4 (2014), 3409–3426, 10.3390/rs6043409.
56. Vane, G., Green, R.O., Chrien, T.G., Enmark, H.T., Hansen, E.G., Porter, W.M., The airborne visible/infrared imaging Spectrometer (AVIRIS). Remote Sens. Environ. 44:2–3 (1993), 127–143, 10.1016/0034-4257(93)90012-M.
57. Wu, C., 2013. Towards linear-time incremental structure from motion. In: International Conference on 3D Vision 3DV 2013, Seattle, WA, pp. 127–134. doi: 10.1109/3DV.2013.25.
58. Wytham Woods, Wytham Woods the Natural Place for Science. http://www.wytham.ox.ac.uk/, 2017 (accessed 26 August, 2017).
59. Yang, Q., Ji, P., Li, D., Yao, S., Zhang, M., Fast stereo matching using adaptive guided filtering. Image Vis. Comput. 32:3 (2014), 202–211, 10.1016/j.imavis.2014.01.001.
60. Zarco-Tejada, P.J., Gonzalez-Dugo, V., Berni, J.A.J., Fluorescence, temperature and narrow-band indices acquired from a UAV platform for water stress detection using a micro-hyperspectral imager and a thermal camera. Remote Sens. Environ. 117 (2012), 322–337, 10.1016/j.rse.2011.10.007.
61. Zitová, B., Flusser, J., Image registration methods: a survey. Image Vis. Comput. 21:11 (2003), 977–1000, 10.1016/S0262-8856(03)00137-9.