Automatic coregistration algorithm to remove canopy shaded pixels in UAV-borne thermal images to improve the estimation of crop water stress index of a drip-irrigated cabernet sauvignon vineyard

Sensors (Switzerland)

Volumn 18, Issue 2, 2018, Pages

  Poblete, Tomas ^a   Ortega Farías, Samuel ^a   Ryu, Dongryeol ^b  

^a UNIVERSIDAD DE TALCA   (Chile)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Crop water stress index (CWSI); Midday stem water potential; Multispectral and thermal automatic coregistration; Shadow removal; UAV

Indexed keywords

CROPS; FORESTRY; MEAN SQUARE ERROR; PIXELS; PLANTS (BOTANY); UNMANNED AERIAL VEHICLES (UAV); WINE;

COEFFICIENT OF DETERMINATION; COMPUTER VISION ALGORITHMS; COREGISTRATION; COREGISTRATION ALGORITHM; CROP WATER STRESS INDICES; SCALE INVARIANT FEATURE TRANSFORMATIONS; SHADOW REMOVAL; STEM WATER POTENTIALS;

IMAGE ENHANCEMENT;

ARTICLE; CANOPY; COMPUTER VISION; CONTROLLED STUDY; INFRARED RADIATION; SCALE INVARIANT FEATURE TRANSFORM; STEM WATER POTENTIAL; VINEYARD; WATER AVAILABILITY; WATER STRESS;

EID: 85041375463     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s18020397     Document Type: Article

References (83)

1. Bates, B.; Kundzewicz, Z.W.; Wu, S.; Palutikof, J. Climate Change and Water: Technical Paper Vi; Intergovernmental Panel on Climate Change (IPCC): Geneva, Switzerland, 2008.
2. Chaves, M.M.; Santos, T.P.; Souza, C.R.D.; Ortuño, M.; Rodrigues, M.; Lopes, C.; Maroco, J.; Pereira, J.S. Deficit irrigation in grapevine improves water-use efficiency while controlling vigour and production quality. Ann. Appl. Biol. 2007, 150, 237–252. [CrossRef]
3. Chapman, D.M.; Roby, G.; Ebeler, S.E.; Guinard, J.X.; Matthews, M.A. Sensory attributes of cabernet sauvignon wines made from vines with different water status. Aust. J. Grape Wine Res. 2005, 11, 339–347. [CrossRef]
4. Berger, T.; Birner, R.; Mccarthy, N.; DíAz, J.; Wittmer, H. Capturing the complexity of water uses and water users within a multi-agent framework. Water Resour. Manag. 2007, 21, 129–148. [CrossRef]
5. Granier, C.; Aguirrezabal, L.; Chenu, K.; Cookson, S.J.; Dauzat, M.; Hamard, P.; Thioux, J.J.; Rolland, G.; Bouchier-Combaud, S.; Lebaudy, A. Phenopsis, an automated platform for reproducible phenotyping of plant responses to soil water deficit in arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. New Phytol. 2006, 169, 623–635. [CrossRef] [PubMed]
6. Choné, X.; Van Leeuwen, C.; Dubourdieu, D.; Gaudillère, J.P. Stem water potential is a sensitive indicator of grapevine water status. Ann. Bot. 2001, 87, 477–483. [CrossRef]
7. Romero, P.; García, J.G.; Fernández-Fernández, J.I.; Muñoz, R.G.; del Amor Saavedra, F.; Martínez-Cutillas, A. Improving berry and wine quality attributes and vineyard economic efficiency by long-term deficit irrigation practices under semiarid conditions. Sci. Hortic. 2016, 203, 69–85. [CrossRef]
8. Balint, G.; Reynolds, A.G. Irrigation level and time of imposition impact vine physiology, yield components, fruit composition and wine quality of ontario chardonnay. Sci. Hortic. 2017, 214, 252–272. [CrossRef]
9. Nortes, P.; Pérez-Pastor, A.; Egea, G.; Conejero, W.; Domingo, R. Comparison of changes in stem diameter and water potential values for detecting water stress in young almond trees. Agric. Water Manag. 2005, 77, 296–307. [CrossRef]
10. Espadafor, M.; Orgaz, F.; Testi, L.; Lorite, I.J.; González-Dugo, V.; Fereres, E. Responses of transpiration and transpiration efficiency of almond trees to moderate water deficits. Sci. Hortic. 2017, 225, 6–14. [CrossRef]
11. Moriana, A.; Pérez-López, D.; Prieto, M.; Ramírez-Santa-Pau, M.; Pérez-Rodriguez, J. Midday stem water potential as a useful tool for estimating irrigation requirements in olive trees. Agric. Water Manag. 2012, 112, 43–54. [CrossRef]
12. Ahumada-Orellana, L.E.; Ortega-Farías, S.; Searles, P.S.; Retamales, J.B. Yield and water productivity responses to irrigation cut-off strategies after fruit set using stem water potential thresholds in a super-high density olive orchard. Front. Plant Sci. 2017, 8, 1280. [CrossRef] [PubMed]
13. Acevedo-Opazo, C.; Tisseyre, B.; Guillaume, S.; Ojeda, H. The potential of high spatial resolution information to define within-vineyard zones related to vine water status. Precis. Agric. 2008, 9, 285–302. [CrossRef]
14. Baluja, J.; Diago, M.P.; Balda, P.; Zorer, R.; Meggio, F.; Morales, F.; Tardaguila, J. Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (uav). Irrig. Sci. 2012, 30, 511–522. [CrossRef]
15. Vadivambal, R.; Jayas, D.S. Applications of thermal imaging in agriculture and food industry—A review. Food Bioprocess Technol. 2011, 4, 186–199. [CrossRef]
16. Rapaport, T.; Hochberg, U.; Shoshany, M.; Karnieli, A.; Rachmilevitch, S. Combining leaf physiology, hyperspectral imaging and partial least squares-regression (pls-r) for grapevine water status assessment. ISPRS J. Photogramm. Remote Sens. 2015, 109, 88–97. [CrossRef]
17. Rallo, G.; Minacapilli, M.; Ciraolo, G.; Provenzano, G. Detecting crop water status in mature olive groves using vegetation spectral measurements. Biosyst. Eng. 2014, 128, 52–68. [CrossRef]
18. Pôças, I.; Rodrigues, A.; Gonçalves, S.; Costa, P.M.; Gonçalves, I.; Pereira, L.S.; Cunha, M. Predicting grapevine water status based on hyperspectral reflectance vegetation indices. Remote Sens. 2015, 7, 16460–16479. [CrossRef]
19. Pôças, I.; Gonçalves, J.; Costa, P.M.; Gonçalves, I.; Pereira, L.S.; Cunha, M. Hyperspectral-based predictive modelling of grapevine water status in the portuguese douro wine region. Int. J. Appl. Earth Observ. Geoinf. 2017, 58, 177–190. [CrossRef]
20. Poblete, T.; Ortega-Farías, S.; Moreno, M.A.; Bardeen, M. Artificial neural network to predict vine water status spatial variability using multispectral information obtained from an unmanned aerial vehicle (uav). Sensors 2017, 17, 2488. [CrossRef] [PubMed]
21. King, B.; Shellie, K. Evaluation of neural network modeling to predict non-water-stressed leaf temperature in wine grape for calculation of crop water stress index. Agric. Water Manag. 2016, 167, 38–52. [CrossRef]
22. Gade, R.; Moeslund, T.B. Thermal cameras and applications: A survey. Mach. Vis. Appl. 2014, 25, 245–262. [CrossRef]
23. Möller, M.; Alchanatis, V.; Cohen, Y.; Meron, M.; Tsipris, J.; Naor, A.; Ostrovsky, V.; Sprintsin, M.; Cohen, S. Use of thermal and visible imagery for estimating crop water status of irrigated grapevine. J. Exp. Bot. 2006, 58, 827–838. [CrossRef] [PubMed]
24. DeJonge, K.C.; Taghvaeian, S.; Trout, T.J.; Comas, L.H. Comparison of canopy temperature-based water stress indices for maize. Agric. Water Manag. 2015, 156, 51–62. [CrossRef]
25. Sepúlveda-Reyes, D.; Ingram, B.; Bardeen, M.; Zúñiga, M.; Ortega-Farías, S.; Poblete-Echeverría, C. Selecting canopy zones and thresholding approaches to assess grapevine water status by using aerial and ground-based thermal imaging. Remote Sens. 2016, 8, 822. [CrossRef]
26. Zhang, C.; Kovacs, J.M. The application of small unmanned aerial systems for precision agriculture: A review. Precis. Agric. 2012, 13, 693–712. [CrossRef]
27. Ortega-Farías, S.; Ortega-Salazar, S.; Poblete, T.; Kilic, A.; Allen, R.; Poblete-Echeverría, C.; Ahumada-Orellana, L.; Zuñiga, M.; Sepúlveda, D. Estimation of energy balance components over a drip-irrigated olive orchard using thermal and multispectral cameras placed on a helicopter-based unmanned aerial vehicle (uav). Remote Sens. 2016, 8, 638. [CrossRef]
28. López-Granados, F.; Torres-Sánchez, J.; Serrano-Pérez, A.; de Castro, A.I.; Mesas-Carrascosa, F.-J.; Peña, J.-M. Early season weed mapping in sunflower using uav technology: Variability of herbicide treatment maps against weed thresholds. Precis. Agric. 2016, 17, 183–199. [CrossRef]
29. Colomina, I.; Molina, P. Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS J. Photogramm. Remote Sens. 2014, 92, 79–97. [CrossRef]
30. Park, S.; Ryu, D.; Fuentes, S.; Chung, H.; Hernández-Montes, E.; O’Connell, M. Adaptive estimation of crop water stress in nectarine and peach orchards using high-resolution imagery from an unmanned aerial vehicle (uav). Remote Sens. 2017, 9, 828. [CrossRef]
31. Santesteban, L.; Di Gennaro, S.; Herrero-Langreo, A.; Miranda, C.; Royo, J.; Matese, A. High-resolution uav-based thermal imaging to estimate the instantaneous and seasonal variability of plant water status within a vineyard. Agric. Water Manag. 2017, 183, 49–59. [CrossRef]
32. Bellvert, J.; Zarco-Tejada, P.J.; Girona, J.; Fereres, E. Mapping crop water stress index in a ‘pinot-noir’vineyard: Comparing ground measurements with thermal remote sensing imagery from an unmanned aerial vehicle. Precis. Agric. 2014, 15, 361–376. [CrossRef]
33. Bellvert, J.; Marsal, J.; Girona, J.; Zarco-Tejada, P.J. Seasonal evolution of crop water stress index in grapevine varieties determined with high-resolution remote sensing thermal imagery. Irrig. Sci. 2015, 33, 81–93. [CrossRef]
34. Shahtahmassebi, A.; Yang, N.; Wang, K.; Moore, N.; Shen, Z. Review of shadow detection and de-shadowing methods in remote sensing. Chin. Geogr. Sci. 2013, 23, 403–420. [CrossRef]
35. Liu, W.; Yamazaki, F. Object-based shadow extraction and correction of high-resolution optical satellite images. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2012, 5, 1296–1302. [CrossRef]
36. Miura, H.; Midorikawa, S.; Fujimoto, K. Automated building detection from high-resolution satellite image for updating gis building inventory data. In Proceedings of the 13th World Conference on Earthquake Engineering, Vancouver, BC, Canada, 1–6 August 2004.
37. Song, M.; Civco, D.L. A Knowledge-Based Approach for Reducing Cloud and Shadow. In Proceedings of the 2002 ASPRS-ACSM Annual Conference and FIG XXII Congress, Washington, DC, USA, 19–26 April 2002; pp. 22–26.
38. Heiskanen, J.; Kajuutti, K.; Jackson, M.; Elvehøy, H.; Pellikka, P. Assessment of glaciological parameters using landsat sat-ellite data in svartisen, northern norway. In Proceedings of the EARSeL-LISSIG-Workshop Observing Our Cryosphere from Space, Bern, Switzerland, 11–13 March 2002.
39. Hendriks, J.; Pellikka, P. Estimation of reflectance from a glacier surface by comparing spectrometer measurements with satellite-derived reflectances. J. Glaciol. 2004, 38, 139–154.
40. Cai, D.; Li, M.; Bao, Z.; Chen, Z.; Wei, W.; Zhang, H. In Study on shadow detection method on high resolution remote sensing image based on his space transformation and ndvi index. In Proceedings of the 18th International Conference on Geoinformatics, Beijing, China, 18–20 June 2010; pp. 1–4.
41. Sotomayor, A.I.T. A Spatial Analysis of Different Forest Cover Types Using Gis and Remote Sensing Techniques; Innovation and Technology Commission (ITC): Geneva, Switzerland, 2002.
42. Leinonen, I.; Jones, H.G. Combining thermal and visible imagery for estimating canopy temperature and identifying plant stress. J. Exp. Bot. 2004, 55, 1423–1431. [CrossRef] [PubMed]
43. Zarco-Tejada, P.J.; González-Dugo, V.; Berni, J.A. Fluorescence, temperature and narrow-band indices acquired from a uav platform for water stress detection using a micro-hyperspectral imager and a thermal camera. Remote Sens. Environ. 2012, 117, 322–337. [CrossRef]
44. Suárez, L.; Zarco-Tejada, P.J.; González-Dugo, V.; Berni, J.; Sagardoy, R.; Morales, F.; Fereres, E. Detecting water stress effects on fruit quality in orchards with time-series pri airborne imagery. Remote Sens. Environ. 2010, 114, 286–298. [CrossRef]
45. Zarco-Tejada, P.J.; González-Dugo, V.; Williams, L.; Suárez, L.; Berni, J.A.; Goldhamer, D.; Fereres, E. A pri-based water stress index combining structural and chlorophyll effects: Assessment using diurnal narrow-band airborne imagery and the cwsi thermal index. Remote Sens. Environ. 2013, 138, 38–50. [CrossRef]
46. Gonzalez-Dugo, V.; Zarco-Tejada, P.; Nicolás, E.; Nortes, P.; Alarcón, J.; Intrigliolo, D.; Fereres, E. Using high resolution uav thermal imagery to assess the variability in the water status of five fruit tree species within a commercial orchard. Precis. Agric. 2013, 14, 660–678. [CrossRef]
47. Otsu, N. A threshold selection method from gray-level histograms. Automatica 1975, 11, 23–27. [CrossRef]
48. Fraser, R.H.; Olthof, I.; Lantz, T.C.; Schmitt, C. Uav photogrammetry for mapping vegetation in the low-arctic. Arct. Sci. 2016, 2, 79–102. [CrossRef]
49. Van Zyl, J. Diurnal variation in grapevine water stress as a function of changing soil water status and meteorological conditions. S. Afr. J. Enol. Vitic. 2017, 8, 45–52. [CrossRef]
50. Pou, A.; Diago, M.P.; Medrano, H.; Baluja, J.; Tardaguila, J. Validation of thermal indices for water status identification in grapevine. Agric. Water Manag. 2014, 134, 60–72. [CrossRef]
51. Grant, O.M.; Chaves, M.M.; Jones, H.G. Optimizing thermal imaging as a technique for detecting stomatal closure induced by drought stress under greenhouse conditions. Physiol. Plant. 2006, 127, 507–518. [CrossRef]
52. Smith, H.K.; Clarkson, G.J.; Taylor, G.; Thompson, A.J.; Clarkson, J.; Rajpoot, N.M. Automatic detection of regions in spinach canopies responding to soil moisture deficit using combined visible and thermal imagery. PLoS ONE 2014, 9, e97612.
53. Bulanon, D.; Burks, T.; Alchanatis, V. Image fusion of visible and thermal images for fruit detection. Biosyst. Eng. 2009, 103, 12–22. [CrossRef]
54. Li, S.; Kang, X.; Fang, L.; Hu, J.; Yin, H. Pixel-level image fusion: A survey of the state of the art. Infor. Fusion 2017, 33, 100–112. [CrossRef]
55. Morsdorf, F.; Kötz, B.; Meier, E.; Itten, K.; Allgöwer, B. Estimation of lai and fractional cover from small footprint airborne laser scanning data based on gap fraction. Remote Sens. Environ. 2006, 104, 50–61. [CrossRef]
56. Moriana, A.; Fereres, E. Plant indicators for scheduling irrigation of young olive trees. Irrig. Sci. 2002, 21, 83–90.
57. Ribeiro-Gomes, K.; Hernández-López, D.; Ortega, J.F.; Ballesteros, R.; Poblete, T.; Moreno, M.A. Uncooled thermal camera calibration and optimization of the photogrammetry process for uav applications in agriculture. Sensors 2017, 17, 2173. [CrossRef] [PubMed]
58. Laliberte, A.S.; Rango, A. Texture and scale in object-based analysis of subdecimeter resolution unmanned aerial vehicle (uav) imagery. IEEE Trans. Geosci. Remote Sens. 2009, 47, 761–770. [CrossRef]
59. Ghosh, D.; Kaabouch, N. A survey on image mosaicing techniques. J. Vis. Commun. Image Represent. 2016, 341–11. [CrossRef]
60. Jones, H.G. Plants and Microclimate: A Quantitative Approach to Environmental Plant Physiology; Cambridge University Press: Cambridge, UK, 2013.
61. Lowe, D.G. Object recognition from local scale-invariant features. In Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece, 20–27 September 1999; pp. 1150–1157.
62. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 24, 381–395. [CrossRef]
63. Raguram, R.; Frahm, J.-M.; Pollefeys, M. A comparative analysis of ransac techniques leading to adaptive real-time random sample consensus. In Computer Vision–ECCV 2008; Springer: Berlin/Heidelberg, Germany 2008; pp. 500–513.
64. Derpanis, K.G. Overview of the ransac algorithm. Image Rochester N. Y. 2010, 4, 2–3.
65. Vourvoulakis, J.; Kalomiros, J.; Lygouras, J. Fpga-based architecture of a real-time sift matcher and ransac algorithm for robotic vision applications. Multimed. Tools Appl. 2017, 1–23. [CrossRef]
66. Michaelsen, E.; von Hansen, W.; Kirchhof, M.; Meidow, J.; Stilla, U. Estimating the essential matrix: Goodsac versus ransac. In Proceedings of the ISPRS Symposium on Photogrammetric Computer Vision, BonnGermany, 20–22 September 2006.
67. Meler, A.; Decrouez, M.; Crowley, J.L. Betasac: A new conditional sampling for ransac. In Proceedings of the British Machine Vision Conference, Aberystwyth, UK, 31 August–3 September 2010.
68. Bush, F.N.; Esposito, J.M. Vision-based lane detection for an autonomous ground vehicle: A comparative field test. In Proceedings of the 2010 42nd Southeastern Symposium on System Theory (SSST), Tyler, TXUSA, 7–9 March 2010; pp. 35–39.
69. Bazin, J.-C.; Seo, Y.; Pollefeys, M. Globally optimal consensus set maximization through rotation searchIn Asian Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2012; pp. 539–551.
70. Ramos, F.; Kadous, M.W.; Fox, D. In Learning to associate image features with crf-matching. In Experimental Robotics; Springer: Berlin/Heidelberg, Germany, 2009; pp. 505–514.
71. Kong, S.G.; Heo, J.; Boughorbel, F.; Zheng, Y.; Abidi, B.R.; Koschan, A.; Yi, M.; Abidi, M.A. Multiscale fusion of visible and thermal ir images for illumination-invariant face recognition. Int. J. Comput. Vis. 2007, 71215–233. [CrossRef]
72. Turner, D.; Lucieer, A.; Malenovský, Z.; King, D.H.; Robinson, S.A. Spatial co-registration of ultra-high resolution visible, multispectral and thermal images acquired with a micro-uav over antarctic moss bedsRemote Sens. 2014, 6, 4003–4024. [CrossRef]
73. Vedaldi, A.; Fulkerson, B. Vlfeat: An open and portable library of computer vision algorithms. In Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy, 25–29 October 2010; ACM: New York, NY, USA, 2010; pp. 1469–1472.
74. Arthur, D.; Vassilvitskii, S. K-means++: The advantages of careful seeding. In Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, New Orleans, LA, USA, 7–9 January 2007; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2007; pp. 1027–1035.
75. Byrt, T.; Bishop, J.; Carlin, J.B. Bias, prevalence and kappa. J. Clin. Epidemiol. 1993, 46, 423–429. [CrossRef]
76. Ünsalan, C.; Boyer, K.L. A system to detect houses and residential street networks in multispectral satellite images. Comput. Vis. Image Underst. 2005, 98, 423–461. [CrossRef]
77. Sirmacek, B.; Unsalan, C. Building detection from aerial images using invariant color features and shadow information. In Proceedings of the 23rd International Symposium on Computer and Information SciencesIstanbul, Turkey, 27–29 October 2008; pp. 1–5.
78. Teke, M.; Başeski, E.; Ok, A.; Yüksel, B.; Şenaras, Ç. Multi-spectral false color shadow detectionIn Photogrammetric Image Analysis, Proceedings of the ISPRS Conference, PIA 2011 Munich, Germany5–7 October 2011; Springer: Berlin/Heidelberg, Germany, 2011; pp. 109–119.
79. Zhu, Z.; Woodcock, C.E. Object-based cloud and cloud shadow detection in landsat imagery. Remote Sens. Environ. 2012, 118, 83–94. [CrossRef]
80. Luo, Y.; Trishchenko, A.P.; Khlopenkov, K.V. Developing clear-sky, cloud and cloud shadow mask for producing clear-sky composites at 250-meter spatial resolution for the seven modis land bands over canada and north america. Remote Sens. Environ. 2008, 112, 4167–4185. [CrossRef]
81. Acevedo-Opazo, C.; Tisseyre, B.; Ojeda, H.; Ortega-Farias, S.; Guillaume, S. Is it possible to assess the spatial variability of vine water status? OENO ONE 2008, 42, 203–219. [CrossRef]
82. Jones, H.G.; Stoll, M.; Santos, T.; Sousa, C.d.; Chaves, M.M.; Grant, O.M. Use of infrared thermography for monitoring stomatal closure in the field: Application to grapevine. J. Exp. Bot. 2002, 53, 2249–2260. [CrossRef] [PubMed]
83. Idso, S.B. Non-water-stressed baselines: A key to measuring and interpreting plant water stress. Agric. Meteorol. 1982, 27, 59–70. [CrossRef]