Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 108, Issue , 2015, Pages 245-259

  Aasen, Helge ^a   Burkart, Andreas ^b   Bolten, Andreas ^a   Bareth, Georg ^a  

^a UNIVERSITY OF COLOGNE   (Germany)

^b FORSCHUNGSZENTRUM JÜLICH   (Germany)

Author keywords

Barley; Hyperspectral digital surface model; Image frame camera; Precision agriculture; Quality assurance; Radiometric calibration

Indexed keywords

AGRICULTURE; AMPHIBIOUS VEHICLES; CALIBRATION; GEOMETRY; QUALITY ASSURANCE; RADIOMETRY; UNMANNED AERIAL VEHICLES (UAV); VEGETATION;

BARLEY; DIGITAL SURFACE MODELS; IMAGE FRAMES; PRECISION AGRICULTURE; RADIOMETRIC CALIBRATIONS;

CAMERAS;

BARLEY; BIOMONITORING; CALIBRATION; DATA QUALITY; IMAGE ANALYSIS; LEAF AREA INDEX; PIXEL; PRECISION AGRICULTURE; RADIOMETRIC SURVEY; SPATIAL RESOLUTION; SPECTRAL ANALYSIS; THREE-DIMENSIONAL MODELING; UNMANNED VEHICLE; VEGETATION COVER; VIDEOGRAPHY;

HORDEUM;

EID: 84941263991     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2015.08.002     Document Type: Article

References (89)

1. Aasen, H., Bendig, J., Bolten, A., Bennertz, S., Willkomm, M., Bareth, G., 2014. Introduction and preliminary results of a calibration for full-frame hyperspectral cameras to monitor agricultural crops with UAVs. In: Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. XL-7, 2014 ISPRS Tech. Comm. VII Symp. XL, 8. doi: doi:10.5194/isprsarchives-XL-7-1-2014.
2. Aasen H., Gnyp M.L., Miao Y., Bareth G. Automated hyperspectral vegetation index retrieval from multiple correlation matrices with HyperCor. Photogramm. Eng. Remote Sens. 2014, 80:785-795. 10.14358/PERS.80.8.785.
3. Agisoft LLC, 2014. Agisoft PhotoScan User Manual: Professional Edition, version 1.0.
4. Agisoft LLC, 2015. Agisoft PhotoScan Change Log [WWW Document] (Accessed 06.10.15). http://www.agisoft.com/pdf/photoscan_changelog.pdf.
5. Alonzo M., Bookhagen B., Roberts D.a. Urban tree species mapping using hyperspectral and lidar data fusion. Remote Sens. Environ. 2014, 148:70-83. 10.1016/j.rse.2014.03.018.
6. Atzberger C. Advances in remote sensing of agriculture: context description, existing operational monitoring systems and major information needs. Remote Sens. 2013, 10.3390/rs5020949.
7. Atzberger C., Guérif M., Baret F., Werner W. Comparative analysis of three chemometric techniques for the spectroradiometric assessment of canopy chlorophyll content in winter wheat. Comput. Electron. Agric. 2010, 73:165-173. 10.1016/j.compag.2010.05.006.
8. Avbelj J., Iwaszczuk D., Müller R., Reinartz P., Stilla U. Coregistration refinement of hyperspectral images and DSM: an object-based approach using spectral information. ISPRS J. Photogramm. Remote Sens. 2014, 10.1016/j.isprsjprs.2014.05.010.
9. Bareth G., Aasen H., Bendig J., Gnyp M.L., Bolten A., Jung A., Michels R., Soukkamäki J. Low-weight and UAV-based hyperspectral full-frame cameras for monitoring crops: spectral comparison with portable spectroradiometer measurements. Photogramm. - Fernerkundung - Geoinf. 2015, 2015:69-79. 10.1127/pfg/2015/0256.
10. Bareth, G., Bolten, A., Hollberg, J., Aasen, H., Burkart, A., Schellberg, J., 2015. Feasibility study of using non-calibrated UAV-based RGB imagery for grassland monitoring : case study at the Rengen Long-term Grassland Experiment (RGE), Germany. In: DGPF Tagungsband 24/2015. Cologne, pp. 1-7.
11. Bendig J., Bolten A., Bareth G. UAV-based Imaging for multi-temporal, very high resolution crop surface models to monitor crop growth variability. Photogramm. - Fernerkundung - Geoinf. 2013, 2013:551-562. 10.1127/1432-8364/2013/0200.
12. Bendig J., Bolten A., Bennertz S., Broscheit J., Eichfuss S., Bareth G. Estimating biomass of barley using crop surface models (CSMs) derived from UAV-based RGB imaging. Remote Sens. 2014, 6:10395-10412. 10.3390/rs61110395.
13. Bendig J., Yu K., Aasen H., Bolten A., Bennertz S., Broscheit J., Gnyp M.L., Bareth G. Combining UAV-based plant height from crop surface models visible and near infrared vegetation indices for biomass monitoring in barley. Int. J. Appl. Earth Obs. Geoinf. 2015, 10.1016/j.jag.2015.02.012.
14. Berni J., Zarco-Tejada P.J., Suarez L., Fereres E. Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle. IEEE Trans. Geosci. Remote Sens. 2009, 47:722-738. 10.1109/TGRS.2008.2010457.
15. Blanke M. Determination of chlorophyll using DMSO. Wein-Wissenschaft 1992, 47:32-35.
16. Burkart A., Aasen H., Alonso L., Menz G., Bareth G., Rascher U. Angular dependency of hyperspectral measurements over wheat characterized by a novel UAV based goniometer. Remote Sens. 2015, 7:725-746. 10.3390/rs70100725.
17. Burkart A., Cogliati S., Schickling A., Rascher U. A novel UAV-based ultra-light weight spectrometer for field spectroscopy. IEEE Sens. J. 2014, 14:62-67. 10.1109/JSEN.2013.2279720.
18. Büttner A., Röser H.-P. Hyperspectral remote sensing with the UAS "Stuttgarter Adler" - system setup, calibration and first results. Photogramm. - Fernerkundung - Geoinf. 2014, 2014:265-274. 10.1127/1432-8364/2014/0217.
19. Clark M.L., Roberts D.A., Ewel J.J., Clark D.B. Estimation of tropical rain forest aboveground biomass with small-footprint lidar and hyperspectral sensors. Remote Sens. Environ. 2011, 115:2931-2942. 10.1016/j.rse.2010.08.029.
20. Colomina I., Molina P. Unmanned aerial systems for photogrammetry and remote sensing: a review. ISPRS J. Photogramm. Remote Sens. 2014, 10.1016/j.isprsjprs.2014.02.013.
21. Dandois J.P., Ellis E.C. Remote sensing of vegetation structure using computer vision. Remote Sens. 2010, 2:1157-1176. 10.3390/rs2041157.
22. Delalieux S., van Aardt J., Keulemans W., Schrevens E., Coppin P. Detection of biotic stress (Venturia inaequalis) in apple trees using hyperspectral data: Non-parametric statistical approaches and physiological implications. Eur. J. Agron. 2007, 27:130-143. 10.1016/j.eja.2007.02.005.
23. Diaz-Varela R.A., Zarco-Tejada P.J., Angileri V., Loudjani P. Automatic identification of agricultural terraces through object-oriented analysis of very high resolution DSMs and multispectral imagery obtained from an unmanned aerial vehicle. J. Environ. Manage. 2014, 134:117-126. 10.1016/j.jenvman.2014.01.006.
24. Erdle K., Mistele B., Schmidhalter U. Comparison of active and passive spectral sensors in discriminating biomass parameters and nitrogen status in wheat cultivars. F. Crop. Res. 2011, 124:74-84. 10.1016/j.fcr.2011.06.007.
25. Evans L.T. Crop Evolution, Adaptation and Yield 1993, Cambridge Univ. Press, Cambridge.
26. Foley J.A., Ramankutty N., Brauman K.A., Cassidy E.S., Gerber J.S., Johnston M., Mueller N.D., O'Connell C., Ray D.K., West P.C., Balzer C., Bennett E.M., Carpenter S.R., Hill J., Monfreda C., Polasky S., Rockström J., Sheehan J., Siebert S., Tilman D., Zaks D.P.M. Solutions for a cultivated planet. Nature 2011, 478:337-342. 10.1038/nature10452.
27. Gao B.C., Montes M.J., Davis C.O. Refinement of wavelength calibrations of hyperspectral imaging data using a spectrum-matching technique. Remote Sens. Environ. 2004, 90:424-433. 10.1016/j.rse.2003.09.002.
28. Geipel J., Link J., Claupein W. Combined spectral and spatial modeling of corn yield based on aerial images and crop surface models acquired with an unmanned aircraft system. Remote Sens. 2014, 6:10335-10355. 10.3390/rs61110335.
29. Gnyp M.L., Miao Y., Yuan F., Ustin S.L., Yu K., Yao Y., Huang S., Bareth G. Hyperspectral canopy sensing of paddy rice aboveground biomass at different growth stages. F. Crop. Res. 2014, 155:42-55. 10.1016/j.fcr.2013.09.023.
30. Gnyp M.L., Yu K., Aasen H., Yao Y., Huang S., Miao Y., Bareth C.G. Analysis of crop reflectance for estimating biomass in rice canopies at different phenological stages. Photogramm. - Fernerkundung - Geoinf. 2013, 2013:351-365. 10.1127/1432-8364/2013/0182.
31. Goetz A.F.H. Remote sensing of environment three decades of hyperspectral remote sensing of the earth: a personal view. Remote Sens. Environ. 2009, 113:5-16. 10.1016/j.rse.2007.12.014.
32. Goetz A.F.H., Vane G., Solomon J.E., Rock B.N. Imaging Spectrom. Earth Remote Sens. 1985, 228.
33. Goldman D.B. Vignette and exposure calibration and compensation. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32:2276-2288. 10.1109/TPAMI.2010.55.
34. Haboudane D., Miller J.R., Pattey E., Zarco-tejada P.J., Strachan I.B. Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: modeling and validation in the context of precision agriculture 2004, 90:337-352. 10.1016/j.rse.2003.12.013.
35. Haboudane D., Miller J.R., Tremblay N., Zarco-Tejada P.J., Dextraze L. Integrated narrow-band vegetation indices for prediction of crop chlorophyll content for application to precision agriculture. Remote Sens. Environ. 2002, 81:416-426. 10.1016/S0034-4257(02)00018-4.
36. Hagen N. Snapshot advantage: a review of the light collection improvement for parallel high-dimensional measurement systems. Opt. Eng. 2012, 10.1117/1.OE.51.11.111702).
37. Hakala T., Honkavaara E., Saari H., Mäkynen J., Kaivosoja J., Pesonen L., Pölönen I. Spectral imaging from UAVs under varying illumination conditions. ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. XL-1/W2 2013, 189-194. 10.5194/isprsarchives-XL-1-W2-189-2013.
38. Hansen P.M., Schjoerring J.K. Reflectance measurement of canopy biomass and nitrogen status in wheat crops using normalized difference vegetation indices and partial least squares regression. Remote Sens. Environ. 2003, 86:542-553. 10.1016/S0034-4257(03)00131-7.
39. Harwin S., Lucieer A. Assessing the accuracy of georeferenced point clouds produced via multi-view stereopsis from unmanned aerial vehicle (UAV) imagery. Remote Sens. 2012, 4:1573-1599. 10.3390/rs4061573.
40. Hernández-Clemente R., Navarro-Cerrillo R.M., Suárez L., Morales F., Zarco-Tejada P.J. Assessing structural effects on PRI for stress detection in conifer forests. Remote Sens. Environ. 2011, 115:2360-2375. 10.1016/j.rse.2011.04.036.
41. Hladik C., Schalles J., Alber M. Salt marsh elevation and habitat mapping using hyperspectral and LIDAR data. Remote Sens. Environ. 2013, 139:318-330. 10.1016/j.rse.2013.08.003.
42. Hoffmeister, D., Bolten, A., Curdt, C., Waldhoff, G., Bareth, G., 2010. High resolution crop surface models (CSM) and crop volume models (CVM) on field level by terrestrial laser scanning. In: SPIE Proc. 7840, 78400E-78400E-6. doi: doi:10.1117/12.872315.
43. Honkavaara E., Saari H., Kaivosoja J., Pölönen I., Hakala T., Litkey P., Mäkynen J., Pesonen L. Processing and assessment of spectrometric, stereoscopic imagery collected using a lightweight UAV spectral camera for precision agriculture. Remote Sens. 2013, 5:5006-5039. 10.3390/rs5105006.
44. Hruska R., Mitchell J., Anderson M., Glenn N.F. Radiometric and geometric analysis of hyperspectral imagery acquired from an unmanned aerial vehicle. Remote Sens. 2012, 4:2736-2752. 10.3390/rs4092736.
45. Hueni A., Nieke J., Schopfer J., Kneubühler M., Itten K.I. The spectral database SPECCHIO for improved long-term usability and data sharing. Comput. Geosci. 2009, 35:557-565. 10.1016/j.cageo.2008.03.015.
46. Hunt E.R., Dean Hively W., Fujikawa S.J., Linden D.S., Daughtry C.S.T., McCarty G.W. Acquisition of NIR-green-blue digital photographs from unmanned aircraft for crop monitoring. Remote Sens. 2010, 2:290-305. 10.3390/rs2010290.
47. Itten K.I., Dell'Endice F., Hueni A., Kneubühler M., Schläpfer D., Odermatt D., Seidel F., Huber S., Schopfer J., Kellenberger T., Bühler Y., D'Odorico P., Nieke J., Alberti E., Meuleman K. APEX - the hyperspectral ESA airborne prism experiment. Sensors 2008, 8:6235-6259. 10.3390/s8106235.
48. Jaakkola A., Hyyppä J., Kukko A., Yu X., Kaartinen H., Lehtomäki M., Lin Y. A low-cost multi-sensoral mobile mapping system and its feasibility for tree measurements. ISPRS J. Photogramm. Remote Sens. 2010, 65:514-522. 10.1016/j.isprsjprs.2010.08.002.
49. James Burger P.G. Hyperspectral NIR image regression part I: calibration and correction. J. Chemom. 2005, 19:355-363. 10.1002/cem.938.
50. Kelcey J., Lucieer A. Sensor correction of a 6-band multispectral imaging sensor for UAV remote sensing. Remote Sens. 2012, 4:1462-1493. 10.3390/rs4051462.
51. Kim S.J., Pollefeys M. Robust radiometric calibration and vignetting correction. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30:562-576. 10.1109/TPAMI.2007.70732.
52. Koch B. Status and future of laser scanning, synthetic aperture radar and hyperspectral remote sensing data for forest biomass assessment. ISPRS J. Photogramm. Remote Sens. 2010, 65:581-590. 10.1016/j.isprsjprs.2010.09.001.
53. Kuusk J. Dark signal temperature dependence correction method for miniature spectrometer modules. J. Sensors 2011, 2011:1-9. 10.1155/2011/608157.
54. Li F., Miao Y., Hennig S.D., Gnyp M.L., Chen X., Jia L., Bareth G. Evaluating hyperspectral vegetation indices for estimating nitrogen concentration of winter wheat at different growth stages. Precis. Agric. 2010, 11:335-357. 10.1007/s11119-010-9165-6.
55. Lucieer A., Malenovský Z., Veness T., Wallace L. HyperUAS-imaging spectroscopy from a multirotor unmanned aircraft system. J. F. Robot. 2014, 31:571-590. 10.1002/rob.21508.
56. Mahlein A., Rumpf T., Welke P., Dehne H., Plümer L., Steiner U., Oerke E. Remote sensing of environment development of spectral indices for detecting and identifying plant diseases. Remote Sens. Environ. 2013, 128:21-30. 10.1016/j.rse.2012.09.019.
57. Mansouri A., Marzani F.S., Gouton P. Development of a protocol for CCD calibration: application to a multispectral imaging system. Int. J. Robot. Autom. 2005, 10.2316/Journal.206.2005.2.206-2784.
58. Marshall M., Thenkabail P. Developing in situ non-destructive estimates of crop biomass to address issues of scale in remote sensing. Remote Sens. 2015, 808-835. 10.3390/rs70100808.
59. Milton E.J., Schaepman M.E., Anderson K., Fox N. Progress in field spectroscopy. Remote Sens. Environ. 2007, 113:92-109. 10.1016/j.rse.2007.08.001.
60. Mulla D.J. Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps. Biosyst. Eng. 2013, 114:358-371. 10.1016/j.biosystemseng.2012.08.009.
61. Müller-Linow M., Pinto-Espinosa F., Scharr H., Rascher U. The leaf angle distribution of natural plant populations: assessing the canopy with a novel software tool. Plant Methods 2015, 11:1-16. 10.1186/s13007-015-0052-z.
62. Pearlman J.S., Barry P.S., Segal C.C., Shepanski J., Beiso D., Carman S.L. Hyperion, a space-based imaging spectrometer. IEEE Trans. Geosci. Remote Sens. 2003, 41:1160-1173. 10.1109/TGRS.2003.815018.
63. Pronk A.A., Goudriaan J., Stilma E., Challa H. A simple method to estimate radiation interception by nursery stock conifers: a case study of eastern white cedar. NJAS - Wageningen J. Life Sci. 2003, 51:279-295. 10.1016/S1573-5214(03)80020-9.
64. Quemada M., Gabriel J., Zarco-Tejada P. Airborne hyperspectral images and ground-level optical sensors as assessment tools for maize nitrogen fertilization. Remote Sens. 2014, 6:2940-2962. 10.3390/rs6042940.
65. Remondino F., El-Hakim S. Image-based 3D modelling: a review. Photogramm. Rec. 2006, 21:269-291. 10.1111/j.1477-9730.2006.00383.x.
66. Rondeaux G., Steven M., Baret F. Optimization of soil-adjusted vegetation indices. Remote Sens. Environ. 1996, 55:95-107. 10.1016/0034-4257(95)00186-7.
67. Roujean J.-L., Breon F.-M. Estimating PAR absorbed by vegetation from bidirectional reflectance measurements. Remote Sens. Environ. 1995, 51:375-384. 10.1016/0034-4257(94)00114-3.
68. Rouse Jr., J.W., Haas, R.H., Schell, J.A., Deering, D.W., Rouse, W., Haas, H., Deering, W., 1974. Monitoring vegetation systems in the Great Plains with ERTS. In: NASA SP-351, 3rd ERTS-1 Symposium, Washington, DC, pp. 309-317.
69. Roy D.P., Borak J.S., Devadiga S., Wolfe R.E., Zheng M., Descloitres J. The MODIS land product quality assessment approach. Remote Sens. Environ. 2002, 83:62-76. 10.1016/S0034-4257(02)00087-1.
70. Schaepman-Strub G., Schaepman M.E., Painter T.H., Dangel S., Martonchik J.V. Reflectance quantities in optical remote sensing-definitions and case studies. Remote Sens. Environ. 2006, 103:27-42. 10.1016/j.rse.2006.03.002.
71. Smith G.M., Milton E.J. The use of the empirical line method to calibrate remotely sensed data to reflectance. Int. J. Remote Sens. 1999, 20:2653-2662. 10.1080/014311699211994.
72. Stagakis S., González-Dugo V., Cid P., Guillén-Climent M.L., Zarco-Tejada P.J. Monitoring water stress and fruit quality in an orange orchard under regulated deficit irrigation using narrow-band structural and physiological remote sensing indices. ISPRS J. Photogramm. Remote Sens. 2012, 71:47-61. 10.1016/j.isprsjprs.2012.05.003.
73. Sterling M., Baker C., Berry P., Wade A. An experimental investigation of the lodging of wheat. Agric. For. Meteorol. 2003, 119:149-165. 10.1016/S0168-1923(03)00140-0.
74. Suomalainen J., Anders N., Iqbal S., Roerink G., Franke J., Wenting P., Hünniger D., Bartholomeus H., Becker R., Kooistra L. A lightweight hyperspectral mapping system and photogrammetric processing chain for unmanned aerial vehicles. Remote Sens. 2014, 6:11013-11030. 10.3390/rs61111013.
75. Suomalainen J., Hakala T., Kaartinen H., Räikkönen E., Kaasalainen S. Demonstration of a virtual active hyperspectral lidar in automated point cloud classification. ISPRS J. Photogramm. Remote Sens. 2011, 66:637-641. 10.1016/j.isprsjprs.2011.04.002.
76. Swatantran A., Dubayah R., Roberts D., Hofton M., Blair J.B. Mapping biomass and stress in the Sierra Nevada using lidar and hyperspectral data fusion. Remote Sens. Environ. 2011, 115:2917-2930. 10.1016/j.rse.2010.08.027.
77. Szeliski R. Computer Vision, Texts in Computer Science 2011, Springer London, London. 10.1007/978-1-84882-935-0.
78. Thenkabail P.S., Lyon J.G., Huete A. Advances in hyperspectral remote sensing of vegetation and agricultural crops. Hyperspectral Remote Sensing of Vegetation 2011, 3-29. CRC Press- Taylor and Francis Group, Boca Raton, London, New York. P.S. Thenkabail, J.G. Lyon, A. Huete (Eds.).
79. Thenkabail P.S., Smith R.B., De Pauw E. Hyperspectral vegetation indices and their relationships with agricultural crop characteristics. Remote Sens. Environ. 2000, 71:158-182. 10.1016/S0034-4257(99)00067-X.
80. Tilly, N., Aasen, H., Bareth, G., n.d. Fusion of plant height and vegetation indices for estimating barley biomass. MDPI Remote Sens. J., (submitted for publication).
81. Tilly N., Hoffmeister D., Cao Q., Huang S., Lenz-Wiedemann V., Miao Y., Bareth G. Multitemporal crop surface models: accurate plant height measurement and biomass estimation with terrestrial laser scanning in paddy rice. J. Appl. Remote Sens. 2014, 8:083671. 10.1117/1.JRS.8.083671.
82. Turner D., Lucieer A., Wallace L. Direct georeferencing of ultrahigh-resolution UAV imagery. IEEE Trans. Geosci. Remote Sens. 2014, 52:2738-2745. 10.1109/TGRS.2013.2265295.
83. Von Bueren S., Burkart A., Hueni A., Rascher U., Tuohy M., Yule I. Deploying four optical UAV-based sensors over grassland: challenges and limitations. Biogeosciences 2015, 10.5194/bg-12-163-2015.
84. Yu K., Leufen G., Hunsche M., Noga G., Chen X., Bareth G. Investigation of leaf diseases and estimation of chlorophyll concentration in seven barley varieties using fluorescence and hyperspectral indices. Remote Sens. 2013, 6:64-86. 10.3390/rs6010064.
85. Yu K., Li F., Gnyp M.L., Miao Y., Bareth G., Chen X. Remotely detecting canopy nitrogen concentration and uptake of paddy rice in the Northeast China Plain. ISPRS J. Photogramm. Remote Sens. 2013, 78:102-115. 10.1016/j.isprsjprs.2013.01.008.
86. Yu W. Practical anti-vignetting methods for digital cameras. IEEE Trans. Consum. Electron. 2004, 50:975-983. 10.1109/TCE.2004.1362487.
87. Zarco-Tejada P.J., Berjon A., Lopezlozano R., Miller J., Martin P., Cachorro V., Gonzalez M., Defrutos A. Assessing vineyard condition with hyperspectral indices: leaf and canopy reflectance simulation in a row-structured discontinuous canopy. Remote Sens. Environ. 2005, 99:271-287. 10.1016/j.rse.2005.09.002.
88. Zarco-Tejada P.J., Diaz-Varela R., Angileri V., Loudjani P. Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods. Eur. J. Agron. 2014, 55:89-99. 10.1016/j.eja.2014.01.004.
89. Zarco-Tejada P.J., González-Dugo V., Berni J.A.J. Fluorescence, temperature and narrow-band indices acquired from a UAV platform for water stress detection using a micro-hyperspectral imager and a thermal camera. Remote Sens. Environ. 2012, 117:322-337. 10.1016/j.rse.2011.10.007.