A novel machine learning method for estimating biomass of grass swards using a photogrammetric canopy height model, images and vegetation indices captured by a drone

Agriculture (Switzerland)

Volumn 8, Issue 5, 2018, Pages

  Viljanen, Niko ^a   Honkavaara, Eija ^a   Näsi, Roope ^a   Hakala, Teemu ^a   Niemeläinen, Oiva ^b   Kaivosoja, Jere ^b  

^a FINNISH GEOSPATIAL RESEARCH INSTITUTE   (Finland)

^b FINNISH FOREST RESEARCH INSTITUTE   (Finland)

Author keywords

Biomass; Canopy height model; Digital surface model; Drone; Grass sward; Machine learning; Multiple linear regression; Photogrammetry; Random Forest; Unmanned aerial vehicle

Indexed keywords

EID: 85048261649     PISSN: None     EISSN: 20770472     Source Type: Journal    
DOI: 10.3390/agriculture8050070     Document Type: Article

References (75)

1. Virkajärvi, P. Comparison of Three Indirect Methods for Prediction of Herbage Mass on Timothy-Meadow Fescue Pastures. Acta Agric. Scand. Sect. B Soil Plant Sci. 1999, 49, 75–81. [CrossRef]
2. Pakarinen, K.; Hyrkäs, M.; Juutinen, E. Development and validation of practical methods for determination of dry matter yield in grass silage swards. In Proceedings of the 12th Congress of the European Society for Agronomy, Helsinki, Finland, 20–24 August 2012; Volume 14, pp. 542–543.
3. Cunliffe, A.M.; Brazier, R.E.; Anderson, K. Ultra-fine grain landscape-scale quantification of dryland vegetation structure with drone-acquired structure-from-motion photogrammetry. Remote Sens. Environ. 2016, 183, 129–143. [CrossRef]
4. Virkajarvi, P.; Jarvenranta, K. Leaf dynamics of timothy and meadow fescue under Nordic conditions. Grass Forage Sci. 2001, 56, 294–304. [CrossRef]
5. Tucker, C.J. A critical review of remote sensing and other methods for non-destructive estimation of standing crop biomass. Grass Forage Sci. 1980, 35, 177–182. [CrossRef]
6. Sanderson, M.A.; Rotz, C.A.; Fultz, S.W.; Rayburn, E.B. Estimating Forage Mass with a Commercial Capacitance Meter, Rising Plate Meter, and Pasture Ruler. Agron. J. 2001, 93, 1281–1286. [CrossRef]
7. Virkajärvi, P. Growth and Utilization of Timothy: Meadow Fescue Pastures; University of Helsinki: Helsinki, Finland, 2004.
8. Pittman, J.; Arnall, D.; Interrante, S.; Moffet, C.; Butler, T. Estimation of Biomass and Canopy Height in Bermudagrass, Alfalfa, and Wheat Using Ultrasonic, Laser, and Spectral Sensors. Sensors 2015, 15, 2920–2943. [CrossRef] [PubMed]
9. Hoffmeister, D.; Waldhoff, G.; Curdt, C.; Tilly, N.; Bendig, J.; Bareth, G. Spatial variability detection of crop height in a single field by terrestrial laser scanning. In Precision Agriculture ’13: Papers Presented at the 9th European Conference on Precision Agriculture; Stafford, J.V., Ed.; Wageningen Academic: Lleida, Spain, 2013; pp. 267–274.
10. Tilly, N.; Hoffmeister, D.; Cao, Q.; Huang, S.; Lenz-Wiedemann, V.; Miao, Y.; Bareth, G. Multitemporal crop surface models: Accurate plant height measurement and biomass estimation with terrestrial laser scanning in paddy rice. J. Appl. Remote Sens. 2014, 8, 083671. [CrossRef]
11. Zhang, C.; Kovacs, J.M. The application of small unmanned aerial systems for precision agriculture: A review. Precis. Agric. 2012, 13, 693–712. [CrossRef]
12. Bendig, J.; Bolten, A.; Bareth, G. UAV-based Imaging for Multi-Temporal, very high Resolution Crop Surface Models to monitor Crop Growth VariabilityMonitoring des Pflanzenwachstums mit Hilfe multitemporaler und hoch auflösender Oberflächenmodelle von Getreidebeständen auf Basis von Bildern aus UAV-Befliegungen. Photogramm. Fernerkund. Geoinf. 2013, 551–562. [CrossRef]
13. Bendig, J.; Bolten, A.; Bennertz, S.; Broscheit, J.; Eichfuss, S.; Bareth, G. Estimating Biomass of Barley Using Crop Surface Models (CSMs) Derived from UAV-Based RGB Imaging. Remote Sens. 2014, 6, 10395–10412. [CrossRef]
14. Li, W.; Niu, Z.; Chen, H.; Li, D.; Wu, M.; Zhao, W. Remote estimation of canopy height and aboveground biomass of maize using high-resolution stereo images from a low-cost unmanned aerial vehicle system. Ecol. Indic. 2016, 67, 637–648. [CrossRef]
15. Lucieer, A.; Turner, D.; King, D.H.; Robinson, S.A. Using an Unmanned Aerial Vehicle (UAV) to capture micro-topography of Antarctic moss beds. Int. J. Appl. Earth Obs. Geoinf. 2014, 27, 53–62. [CrossRef]
16. Turner, D.; Lucieer, A.; Malenovský, Z.; King, D.; Robinson, S.A. Assessment of Antarctic moss health from multi-sensor UAS imagery with Random Forest Modelling. Int. J. Appl. Earth Obs. Geoinf. 2018, 68, 168–179. [CrossRef]
17. Berni, J.; Zarco-Tejada, P.J.; Suarez, L.; Fereres, E. Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle. IEEE Trans. Geosci. Remote Sens. 2009, 47, 722–738. [CrossRef]
18. Hunt, E.R.; Hively, W.D.; Fujikawa, S.; Linden, D.; Daughtry, C.S.; McCarty, G. Acquisition of NIR-Green-Blue Digital Photographs from Unmanned Aircraft for Crop Monitoring. Remote Sens. 2010, 2, 290–305. [CrossRef]
19. Candiago, S.; Remondino, F.; De Giglio, M.; Dubbini, M.; Gattelli, M. Evaluating Multispectral Images and Vegetation Indices for Precision Farming Applications from UAV Images. Remote Sens. 2015, 7, 4026–4047. [CrossRef]
20. Geipel, J.; Link, J.; Wirwahn, J.; Claupein, W. A Programmable Aerial Multispectral Camera System for In-Season Crop Biomass and Nitrogen Content Estimation. Agriculture 2016, 6, 4. [CrossRef]
21. Zarco-Tejada, P.J.; González-Dugo, V.; Berni, J.A.J. Fluorescence, temperature and narrow-band indices acquired from a UAV platform for water stress detection using a micro-hyperspectral imager and a thermal camera. Remote Sens. Environ. 2012, 117, 322–337. [CrossRef]
22. Honkavaara, E.; Saari, H.; Kaivosoja, J.; Pölönen, I.; Hakala, T.; Litkey, P.; Mäkynen, J.; Pesonen, L. Processing and Assessment of Spectrometric, Stereoscopic Imagery Collected Using a Lightweight UAV Spectral Camera for Precision Agriculture. Remote Sens. 2013, 5, 5006–5039. [CrossRef]
23. Aasen, H.; Burkart, A.; Bolten, A.; Bareth, G. Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: From camera calibration to quality assurance. ISPRS J. Photogramm. Remote Sens. 2015, 108, 245–259. [CrossRef]
24. Yue, J.; Yang, G.; Li, C.; Li, Z.; Wang, Y.; Feng, H.; Xu, B. Estimation of Winter Wheat Above-Ground Biomass Using Unmanned Aerial Vehicle-Based Snapshot Hyperspectral Sensor and Crop Height Improved Models. Remote Sens. 2017, 9, 708. [CrossRef]
25. Bendig, J.; Yu, K.; Aasen, H.; Bolten, A.; Bennertz, S.; Broscheit, J.; Gnyp, M.L.; Bareth, G. Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley. Int. J. Appl. Earth Obs. Geoinf. 2015, 39, 79–87. [CrossRef]
26. Reddersen, B.; Fricke, T.; Wachendorf, M. A multi-sensor approach for predicting biomass of extensively managed grassland. Comput. Electron. Agric. 2014, 109, 247–260. [CrossRef]
27. Fricke, T.; Wachendorf, M. Combining ultrasonic sward height and spectral signatures to assess the biomass of legume–grass swards. Comput. Electron. Agric. 2013, 99, 236–247. [CrossRef]
28. Tilly, N.; Aasen, H.; Bareth, G. Fusion of Plant Height and Vegetation Indices for the Estimation of Barley Biomass. Remote Sens. 2015, 7, 11449–11480. [CrossRef]
29. Bareth, G.; Bolten, A.; Hollberg, J.; Aasen, H.; Burkart, A.; Schellberg, J. Feasibility study of using non-calibrated UAV-based RGB imagery for grassland monitoring: Case study at the Rengen Long-term Grassland Experiment (RGE), Germany. DGPF Tag. 2015, 24, 1–7.
30. Hunt, E.R.; Doraiswamy, P.C.; McMurtrey, J.E.; Daughtry, C.S.T.; Perry, E.M.; Akhmedov, B. A visible band index for remote sensing leaf chlorophyll content at the canopy scale. Int. J. Appl. Earth Obs. Geoinf. 2013, 21, 103–112. [CrossRef]
31. Li, F.; Miao, Y.; Hennig, S.D.; Gnyp, M.L.; Chen, X.; Jia, L.; Bareth, G. Evaluating hyperspectral vegetation indices for estimating nitrogen concentration of winter wheat at different growth stages. Precis. Agric. 2010, 11, 335–357. [CrossRef]
32. Possoch, M.; Bieker, S.; Hoffmeister, D.; Bolten, A.; Schellberg, J.; Bareth, G. Multi-temporal crop surface models combined with the rgb vegetation index from uav-based images for forage monitoring in grassland. ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2016, XLI-B1, 991–998. [CrossRef]
33. Marabel, M.; Alvarez-Taboada, F. Spectroscopic Determination of Aboveground Biomass in Grasslands Using Spectral Transformations, Support Vector Machine and Partial Least Squares Regression. Sensors 2013, 13, 10027–10051. [CrossRef] [PubMed]
34. Yue, J.; Feng, H.; Yang, G.; Li, Z. A Comparison of Regression Techniques for Estimation of Above-Ground Winter Wheat Biomass Using Near-Surface Spectroscopy. Remote Sens. 2018, 10, 66. [CrossRef]
35. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [CrossRef]
36. Gislason, P.O.; Benediktsson, J.A.; Sveinsson, J.R. Random Forests for land cover classification. Pattern Recognit. Lett. 2006, 27, 294–300. [CrossRef]
37. Belgiu, M.; Drăguţ, L. Random forest in remote sensing: A review of applications and future directions. ISPRS J. Photogramm. Remote Sens. 2016, 114, 24–31. [CrossRef]
38. Pelletier, C.; Valero, S.; Inglada, J.; Dedieu, G.; Champion, N. An assessment of image features and random forest for land cover mapping over large areas using high resolution Satellite Image Time Series. In Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China, 10–15 July 2016; pp. 3338–3341.
39. Baccini, A.; Friedl, M.A.; Woodcock, C.E.; Warbington, R. Forest biomass estimation over regional scales using multisource data: MAPPING FOREST BIOMASS. Geophys. Res. Lett. 2004, 31. [CrossRef]
40. Koch, B. Status and future of laser scanning, synthetic aperture radar and hyperspectral remote sensing data for forest biomass assessment. ISPRS J. Photogramm. Remote Sens. 2010, 65, 581–590. [CrossRef]
41. Fassnacht, F.E.; Hartig, F.; Latifi, H.; Berger, C.; Hernández, J.; Corvalán, P.; Koch, B. Importance of sample size, data type and prediction method for remote sensing-based estimations of aboveground forest biomass. Remote Sens. Environ. 2014, 154, 102–114. [CrossRef]
42. Wang, C.; Nie, S.; Xi, X.; Luo, S.; Sun, X. Estimating the Biomass of Maize with Hyperspectral and LiDAR Data. Remote Sens. 2016, 9, 11. [CrossRef]
43. Liu, W.; Liu, C.; Hu, X.; Yang, J.; Zheng, L. Application of terahertz spectroscopy imaging for discrimination of transgenic rice seeds with chemometrics. Food Chem. 2016, 210, 415–421. [CrossRef] [PubMed]
44. Karjatilan Kannattava Peltovilejly—Hanke (KARPE). Finnish Guidelines for Producing an Estimate of Biomass for a Grass Sward Parcel. 2012. Available online: https://www.karpe.fi/materiaalit/karpekirjasto/lohkokohtaisen_satotason_arviointi_ohje.pdf (accessed on 15 May 2018).
45. Ardupilot. Ardupilot Open-source Autopilot. 2018. Available online: http://ardupilot.org (accessed on 4 May 2018).
46. National Land Survey of Finland. Finnref GNSS RINEX Service. 2018. Available online: https://www.maanmittauslaitos.fi/en/maps-and-spatial-data/positioning-services/rinex-palvelu (accessed on 4 May 2018).
47. RTKlib. RTKlib, An Open-source Program Package for GNSS Positioning, Version 2.4.2. 2018. Available online: www.rtklib.com (accessed on 4 May 2018).
48. Häkli, P. Practical test on accuracy and usability of virtual reference station method in Finland. In FIG Working Week; The Olympic Spirit in Surveying: Athens, Greece, 2004.
49. Harwin, S.; Lucieer, A. Assessing the Accuracy of Georeferenced Point Clouds Produced via Multi-View Stereopsis from Unmanned Aerial Vehicle (UAV) Imagery. Remote Sens. 2012, 4, 1573–1599. [CrossRef]
50. AgiSoft. AgiSoft Photoscan Professional (Versio 1.3.4) (Software). 2017. Available online: http://www. agisoft.com/downloads/installer/(accessed on 24 March 2018).
51. Honkavaara, E.; Eskelinen, M.A.; Polonen, I.; Saari, H.; Ojanen, H.; Mannila, R.; Holmlund, C.; Hakala, T.; Litkey, P.; Rosnell, T.; et al. Remote Sensing of 3-D Geometry and Surface Moisture of a Peat Production Area Using Hyperspectral Frame Cameras in Visible to Short-Wave Infrared Spectral Ranges Onboard a Small Unmanned Airborne Vehicle (UAV). IEEE Trans. Geosci. Remote Sens. 2016, 54, 5440–5454. [CrossRef]
52. Dandois, J.P.; Ellis, E.C. High spatial resolution three-dimensional mapping of vegetation spectral dynamics using computer vision. Remote Sens. Environ. 2013, 136, 259–276. [CrossRef]
53. James, M.R.; Robson, S.; Smith, M.W. 3-D uncertainty-based topographic change detection with structure-from-motion photogrammetry: Precision maps for ground control and directly georeferenced surveys: 3-D uncertainty-based change detection for SfM surveys. Earth Surf. Process. Landf. 2017, 42, 1769–1788. [CrossRef]
54. Agisoft. Agisoft Photoscan User Manual Professional Edition, Version 1.3. 2017. Available online: http://www.agisoft.com/pdf/photoscan-pro_1_3_en.pdf/(accessed on 26 April 2018).
55. Brovelli, M.A.; Mattia, C.; Fratarcangeli, F.; Giannone, F.; Realini, E. Accuracy assessment of High Resolution Satellite Imagery by Leave-one-out method. In Proceedings of the 7th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Lisbon, Portugal, 5–7 July 2006; Available online: http://www.spatial-accuracy.org/system/files/Brovelli2006accuracy.pdf (accessed on 27 April 2018).
56. Smith, G.M.; Milton, E.J. The use of the empirical line method to calibrate remotely sensed data to reflectance. Int. J. Remote Sens. 1999, 20, 2653–2662. [CrossRef]
57. Méndez-Barroso, L.A.; Zárate-Valdez, J.L.; Robles-Morúa, A. Estimation of hydromorphological attributes of a small forested catchment by applying the Structure from Motion (SfM) approach. Int. J. Appl. Earth Obs. Geoinf. 2018, 69, 186–197. [CrossRef]
58. Woebbecke, D.M.; Meyer, G.E.; Von Bargen, K.; Mortensen, D.A. Color Indices for Weed Identification Under Various Soil, Residue, and Lighting Conditions. Trans. ASAE 1995, 38, 259–269. [CrossRef]
59. Torres-Sánchez, J.; Peña, J.M.; de Castro, A.I.; López-Granados, F. Multi-temporal mapping of the vegetation fraction in early-season wheat fields using images from UAV. Comput. Electron. Agric. 2014, 103, 104–113. [CrossRef]
60. Tucker, C.J. Red and photographic infrared linear combinations for monitoring vegetation. Remote Sens. Environ. 1979, 8, 127–150. [CrossRef]
61. Meyer, G.E.; Hindman, T.W.; Laksmi, K. Machine Vision Detection Parameters for Plant Species Identification; Meyer, G.E., DeShazer, J.A., Eds.; University of Nebraska: Lincoln, NE, USA, 1999; pp. 327–335.
62. Neto, J. A Combined Statistical-Soft Computing Approach for Classification and Mapping Weed Species in Minimum Tillage Systems; University of Nebraska: Lincoln, NE, USA, 2004; p. 170.
63. Rouse, J.W.; Haas, R.H.; Schell, J.A.; Deering, D.W. Monitoring Vegetation Systems in the Great Plains with ERTS; Third Earth Resources Technology Satellite, Symposium 1; NASA: Washington, DC, USA, 1974; p. 309.
64. Pearson, R.L.; Miller, L.D. Remote mapping of standing crop biomass for estimation of the productivity of the short-grass Prairie, Pawnee National Grasslands, Colorado. In Proceedings of the 8th International Symposium on Remote Sensing of Environment, Ann Arbor, MI, USA, 2–6 October 1972; pp. 1357–1381.
65. Qi, J.; Chehbouni, A.; Huete, A.R.; Kerr, Y.H.; Sorooshian, S. A modified soil adjusted vegetation index. Remote Sens. Environ. 1994, 48, 119–126. [CrossRef]
66. Rondeaux, G.; Steven, M.; Baret, F. Optimization of soil-adjusted vegetation indices. Remote Sens. Environ. 1996, 55, 95–107. [CrossRef]
67. Akaike, H. A new look at the statistical model identification. IEEE Trans. Autom. Control 1974, 19, 716–723. [CrossRef]
68. Dandois, J.; Olano, M.; Ellis, E. Optimal Altitude, Overlap, and Weather Conditions for Computer Vision UAV Estimates of Forest Structure. Remote Sens. 2015, 7, 13895–13920. [CrossRef]
69. Turner, D.; Lucieer, A.; Wallace, L. Direct Georeferencing of Ultrahigh-Resolution UAV Imagery. IEEE Trans. Geosci. Remote Sens. 2014, 52, 2738–2745. [CrossRef]
70. Motohka, T.; Nasahara, K.N.; Oguma, H.; Tsuchida, S. Applicability of Green-Red Vegetation Index for Remote Sensing of Vegetation Phenology. Remote Sens. 2010, 2, 2369–2387. [CrossRef]
71. Hunt, E.R.; Cavigelli, M.; Daughtry, C.S.T.; Mcmurtrey, J.E.; Walthall, C.L. Evaluation of Digital Photography from Model Aircraft for Remote Sensing of Crop Biomass and Nitrogen Status. Precis. Agric. 2005, 6, 359–378. [CrossRef]
72. Chang, K.-W.; Shen, Y.; Lo, J.-C. Predicting Rice Yield Using Canopy Reflectance Measured at Booting Stage. Agron. J. 2005, 97, 872. [CrossRef]
73. Moeckel, T.; Safari, H.; Reddersen, B.; Fricke, T.; Wachendorf, M. Fusion of Ultrasonic and Spectral Sensor Data for Improving the Estimation of Biomass in Grasslands with Heterogeneous Sward Structure. Remote Sens. 2017, 9, 98. [CrossRef]
74. Wachendorf, M.; Fricke, T.; Möckel, T. Remote sensing as a tool to assess botanical composition, structure, quantity and quality of temperate grasslands. Grass Forage Sci. 2018, 73, 1–14. [CrossRef]
75. MicaSense Parrot Sequoia Multispectral Sensor. Available online: https://www.micasense.com/parrotsequoia (accessed on 24 March 2018).