Toward an automated low-cost three-dimensional crop surface monitoring system using oblique stereo imagery from consumer-grade smart cameras

Journal of Applied Remote Sensing

Volumn 10, Issue 4, 2016, Pages

  Brocks, Sebastian ^a   Bendig, Juliane ^a   Bareth, Georg ^a,b  

^a UNIVERSITY OF COLOGNE   (Germany)

^b UNIVERSITY OF BONN   (Germany)

Author keywords

barley; crop surface model; monitoring; oblique; plant height; structure from motion

Indexed keywords

APPLICATION PROGRAMS; CAMERAS; COSTS; CROPS; CULTIVATION; IMAGE ACQUISITION; MEAN SQUARE ERROR; PLANTS (BOTANY); ROCK MECHANICS; STEREO IMAGE PROCESSING;

BARLEY; OBLIQUE; PLANT HEIGHT; STRUCTURE FROM MOTION; SURFACE MODELING;

MONITORING;

EID: 85002157943     PISSN: None     EISSN: 19313195     Source Type: Journal    
DOI: 10.1117/1.JRS.10.046021     Document Type: Article

References (75)

1. D. J. Mulla, "Twenty five years of remote sensing in precision agriculture: key advances and remaining knowledge gaps," Biosyst. Eng. 114, 358-371 (2013).
2. J. Bendig, A. Bolten, and G. Bareth, "UAV-based imaging for multi-temporal, very high resolution crop surface models to monitor crop growth variability," Photogramm. Fernerkundung Geoinf. 2013, 551-562 (2013).
3. J. Geipel, J. Link, and W. Claupein, "Combined spectral and spatial modeling of corn yield based on aerial images and crop surface models acquired with an unmanned aircraft system," Remote Sens. 11, 10335-10355 (2014).
4. N. Tilly et al., "Multitemporal crop surface models: accurate plant height measurement and biomass estimation with terrestrial laser scanning in paddy rice," J. Appl. Remote Sens. 8, 083671 (2014).
5. J. Bendig et al., "Estimating biomass of barley using crop surface models (CSMs) derived from UAV-based RGB imaging," Remote Sens. 6, 10395-10412 (2014).
6. N. Tilly, H. Aasen, and G. Bareth, "Fusion of plant height and vegetation indices for the estimation of Barley biomass," Remote Sens. 7, 11449-11480 (2015).
7. J. Clevers and A. Gitelson, "Remote estimation of crop and grass chlorophyll and nitrogen content using red-edge bands on Sentinel-2 and-3," Int. J. Appl. Earth Obs. Geoinf. 23(2013), 344-351 (2013).
8. K. Yu et al., "Estimate leaf chlorophyll of rice using reflectance indices and partial least squares," Photogramm. Fernerkundung Geoinf. 2015, 45-54 (2015).
9. O. Nevalainen et al., "Fast and nondestructive method for leaf level chlorophyll estimation using hyperspectral LiDAR," Agric. For. Meteorol. 198-199, 250-258 (2014).
10. S. Dadshani et al., "Non-invasive assessment of leaf water status using a dual-mode microwave resonator," Plant Methods 11(1), 8 (2015).
11. R. Gente, A. Rehn, and M. Koch, "Contactless water status measurements on plants at 35 GHz," J. Infrared Millimeter and Terahertz Waves 36(3), 312-317 (2015).
12. M. Marshall and P. Thenkabail, "Advantage of hyperspectral EO-1 hyperion over multispectral IKONOS, Geoeye-1, Worldview-2, Landsat ETM+, and MODIS vegetation indices in crop biomass estimation," ISPRS J. Photogramm. Remote Sens. 108, 205-218 (2015).
13. J. Bendig et al., "Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley," Int. J. Appl. Earth Obs. Geoinf. 39, 79-87 (2015).
14. H. Aasen et al., "Generating 3D hyperspectral information with lightweight UAV snapshot cameras for vegetation monitoring: from camera calibration to quality assurance," ISPRS J. Photogramm. Remote Sens. 108, 245-259 (2015).
15. D. Hoffmeister et al., "High resolution crop surface models (CSM) and crop volume models (CVM) on field level by terrestrial laser scanning," Proc. SPIE 7840, 78400E (2010).
16. N. Tilly et al., "Transferability of models for estimating paddy rice biomass from spatial plant height data," Agriculture 5, 538-560 (2015).
17. N. Tilly et al., "Precise plant height monitoring and biomass estimation with terrestrial laser scanning in paddy rice," ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. II-5/W2, 295-300 (2013).
18. H. Aasen et al., "Automated hyperspectral vegetation index retrieval from multiple correlation matrices with hypercor," Photogramm. Eng. Remote Sens. 80, 785-795 (2014).
19. J. Hyyppä et al., "Review of methods of small-footprint airborne laser scanning for extracting forest inventory data in boreal forests," Int. J. Remote Sens. 29, 1339-1366 (2008).
20. I. Moorthy et al., "Field characterization of olive (Olea europaea L.) tree crown architecture using terrestrial laser scanning data," Agric. For. Meteorol. 151, 204-214 (2011).
21. F. Hosoi and K. Omasa, "Voxel-Based 3-D modeling of individual trees for estimating leaf area density using high-resolution portable scanning lidar," IEEE Trans. Geosci. Remote Sens. 44, 3610-3618 (2006).
22. A. Escolà et al., "A mobile terrestrial laser scanner for tree crops: point cloud generation, information extraction and validation in an intensive olive orchard," in Precision Agriculture '15, J. V. Stafford, Ed., pp. 337-344, Wageningen Academic Publishers, The Netherlands (2015).
23. W. Li et al., "Estimation of leaf biochemical content using a novel hyperspectral full-waveform LiDAR system," Remote Sens. Lett. 5, 693-702 (2014).
24. S. Jay et al., "In-field crop row phenotyping from 3D modeling performed using structure from motion," Comput. Electron. Agric. 110, 70-77 (2015).
25. T. Motohka et al., "Applicability of green-red vegetation index for remote sensing of vegetation phenology," Remote Sens. 2(10), 2369-2387 (2010).
26. T. Sritarapipat, P. Rakwatin, and T. Kasetkasem, "Automatic rice crop height measurement using a field server and digital image processing.," Sensors 14, 9-26 (2014).
27. T. Hague, N. D. Tillett, and H. Wheeler, "Automated crop and weed monitoring in widely spaced cereals," Precision Agric. 7, 21-32 (2006).
28. T. Inoue et al., "Utilization of ground-based digital photography for the evaluation of seasonal changes in the aboveground green biomass and foliage phenology in a grassland ecosystem," Ecol. Inf. 25, 1-9 (2015).
29. M. L. Gnyp et al., "Hyperspectral canopy sensing of paddy rice aboveground biomass at different growth stages," Field Crops Res. 155, 42-55 (2014).
30. M. L. Gnyp et al., "Development and implementation of a multiscale biomass model using hyperspectral vegetation indices for winter wheat in the North China plain," Int. J. Appl. Earth Obs. Geoinf. 33(1), 232-242 (2014).
31. P. S. Thenkabail et al., "Selection of hyperspectral narrowbands (HNBs) and composition of hyperspectral twoband vegetation indices (HVIs) for biophysical characterization and discrimination of crop types using field reflectance and hyperion/EO-1 data," IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 6, 427-439 (2013).
32. Q. Cao et al., "Non-destructive estimation of rice plant nitrogen status with crop circle multispectral active canopy sensor," Field Crops Res. 154, 133-144 (2013).
33. K. Yu et al., "Remotely detecting canopy nitrogen concentration and uptake of paddy rice in the Northeast China plain," ISPRS J. Photogramm. Remote Sens. 78, 102-115 (2013).
34. F. Li et al., "Evaluating hyperspectral vegetation indices for estimating nitrogen concentration of winter wheat at different growth stages," Precision Agric. 11, 335-357 (2010).
35. F. Li et al., "Estimating N status of winter wheat using a handheld spectrometer in the North China plain," Field Crops Res. 106, 77-85 (2008).
36. A. K. Tilling et al., "Remote sensing of nitrogen and water stress in wheat," Field Crops Res. 104, 77-85 (2007).
37. M. Rossini et al., "Red and far red Sun-induced chlorophyll fluorescence as a measure of plant photosynthesis," Geophys. Res. Lett. 42, 1632-1639 (2015).
38. G. Bareth et al., "Low-weight and UAV-based hyperspectral full-frame cameras for monitoring crops: spectral comparison with portable spectroradiometer measurements," Photogramm. Fernerkundung Geoinf. 2015, 69-79 (2015).
39. J. Suomalainen et al., "A lightweight hyperspectral mapping system and photogrammetric processing chain for unmanned aerial vehicles," Remote Sens. 6(11), 11013-11030 (2014).
40. J. Bellvert et al., "Mapping crop water stress index in a 'Pinot-noir' vineyard: comparing ground measurements with thermal remote sensing imagery from an unmanned aerial vehicle," Precision Agric. 15, 361-376 (2013).
41. J. W. White et al., "Field-based phenomics for plant genetics research," Field Crops Res. 133, 101-112 (2012).
42. J. L. Araus and J. E. Cairns, "Field high-throughput phenotyping: the new crop breeding frontier," Trends Plant Sci. 19, 52-61 (2014).
43. D. Deery et al., "Proximal remote sensing buggies and potential applications for field-based phenotyping," Agronomy 4, 349-379 (2014).
44. P. Andrade-Sanchez et al., "Development and evaluation of a field-based high-throughput phenotyping platform," Funct. Plant Biol. 41(2007), 68-79 (2014).
45. ETH Zürich, "ETH Zürich field phenotyping platform (FIP)," http://www.kp.ethz.ch/infrastructure/FIP (25 November 2015).
46. S. Brocks and G. Bareth, "Evaluating the potential of consumer-grade smart cameras for low-cost stereo-photogrammetric crop-surface monitoring," ISPRS Int. Archives Photogramm. Remote Sens. Spat. Inf. Sci. XL-7, 43-49 (2014).
47. H. Lilienthal, Entwicklung eines bodengestützten Fernerkundungssystems für die Landwirtschaft (Landbauforschung Völkenrode: Sonderheft 254), Technische Universität Braunschweig, Braunschweig (2003).
48. S. Ullman, "The interpretation of structure from motion," Proc. R. Soc. London, Ser. B. 203(1153), 405-426 (1979).
49. S. Seitz et al., "A comparison and evaluation of multi-view stereo reconstruction algorithms," in 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'06), Vol. 1, pp. 519-528, IEEE (2006).
50. M. Westoby et al., "'Structure-from-motion' photogrammetry: a low-cost, effective tool for geoscience applications," Geomorphology 179, 300-314 (2012).
51. M. James and S. Robson, "Sequential digital elevation models of active lava flows from ground-based stereo time-lapse imagery," ISPRS J. Photogramm. Remote Sens. 97, 160-170 (2014).
52. M. R. James and N. Varley, "Identification of structural controls in an active lava dome with high resolution DEMs: Volcán de Colima, Mexico," Geophys. Res. Lett. 39 (2012).
53. L. Javernick, J. Brasington, and B. Caruso, "Modeling the topography of shallow braided rivers using structure-from-motion photogrammetry," Geomorphology 213, 166-182 (2014).
54. G. Verhoeven, "Taking computer vision aloft-archaeological three-dimensional reconstructions from aerial photographs with photoscan," Archaeological Prospection 73, 67-73 (2011).
55. D. Semyonov, "Algorithms used in photoscan," 2011, http://www.agisoft.com/forum/index. php?topic=89.msg323#msg323 (9 January 2015).
56. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comp. Vision 60, 91-110 (2004).
57. B. Triggs et al., "Bundle adjustment - a modern synthesis," Lect. Notes Comput. Sci. 1883, 298-372 (2000).
58. M. Herker, "Crop.SENSe.net," 2009, https://www.cropsense.uni-bonn.de/(22July2015).
59. Samsung, "Specs - Point-and-Shoot EK-GC100," http://www.samsung.com/us/photography/digital-cameras/EK-GC100ZWAATT-specs (1 January 2015).
60. J. Chandler, J. Fryer, and A. Jack, "Metric capabilities of low-cost digital cameras for close range surface measurement," Photogramm. Record 20, 12-26 (2005).
61. Topcon Positioning Systems, "HiPer pro operator's manual," http://www.top-survey.com/top-survey/downloads/HiPerPro-om.pdf (22 January 2015).
62. T. Luhmann et al., Close-Range Photogrammetry and 3D Imaging, 2nd ed., Walter de Gruyther, Berlin (2014).
63. GeoGebra Institute, "Geogebra," http://www.geogebra.org/(22 January 2015).
64. Trimble, "Datasheet - Trimble M3," http://trl.trimble.com/dscgi/ds.py/Get/File-262358/022543-155J-TrimbleM3-DS-0414-LR.pdf (28 July 2015).
65. Inkspace Project, "About Inkscape," http://inkscape.org/en/about (22 July 2015).
66. "About Python," https://www.python.org/about/(1 February 2015).
67. Agisoft, "PhotoScan python reference," http://www.agisoft.com/pdf/photoscan-python- api-1-1-0.pdf (December 2014).
68. C. E. Shannon, "A mathematical theory of communication," Bell Sys. Tech. J. 27, 379-423 (1948).
69. F. Lundh and A. Clark, "About Pillow," https://pillow.readthedocs.io/ern/3.3.x/about.html (25 July 2016).
70. P. A. Zandbergen, Python Scripting for ArcGIS, Esri Press, Redlands (2013).
71. C. J. Willmott, S. M. Robeson, and K. Matsuura, "A refined index of model performance," Int. J. Climatol. 32(13), 2088-2094 (2012).
72. M. Hämmerle and B. Höfle, "Effects of reduced terrestrial LiDAR point density on highresolution grain crop surface models in precision agriculture," Sensors 14(12), 24212-24230 (2014).
73. S. Luo et al., "Effects of LiDAR point density, sampling size and height threshold on estimation accuracy of crop biophysical parameters," Opt. Express 24(11), 11578 (2016).
74. G. Bareth et al., "A comparison of UAV-and TLS-derived plant height for crop monitoring: using polygon grids for the analysis of crop surface models (CSMs)," Photogramm. Fernerkundung Geoinf. 2016(2), 85-94 (2016).
75. D. Ehlert and M. Heisig, "Sources of angle-dependent errors in terrestrial laser scannerbased crop stand measurement," Comput. Electron. Agric. 93, 10-16 (2013).