LiDAR and thermal images fusion for ground-based 3D characterisation of fruit trees

Biosystems Engineering

Volumn 151, Issue , 2016, Pages 479-494

  Yandún Narváez, Francisco J ^a   Salvo del Pedregal, Jaime ^b   Prieto, Pablo A ^a   Torres Torriti, Miguel ^c   Auat Cheein, Fernando A ^a  

^a DEPARTAMENTO DE FÍSICA   (Chile)

^b INSTITUTO DE INVESTIGACIONES AGROPECUARIAS   (Chile)

^c PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

Author keywords

3D reconstruction; Ground based remote sensing; LiDAR readings; Thermal images

Indexed keywords

FARMS; FORESTRY; FRUITS; IMAGE MATCHING; IMAGE PROCESSING; IMAGE RECONSTRUCTION; ITERATIVE METHODS; OPTICAL RADAR; ORCHARDS; REMOTE SENSING; SATELLITE IMAGERY;

3D RECONSTRUCTION; GLOBAL NAVIGATION SATELLITE SYSTEMS; GROUND-BASED REMOTE SENSING; GROUND-BASED SYSTEMS; ITERATIVE CLOSEST POINT ALGORITHM; SUPERVISED CLASSIFIERS; THERMAL IMAGES; THERMAL RECONSTRUCTION;

GLOBAL POSITIONING SYSTEM;

EID: 84994659931     PISSN: 15375110     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.biosystemseng.2016.10.012     Document Type: Article

References (51)

1. Acampora, L., De Filippis, F., Martucci, A., Sorgi, L., 3D Reconstruction of thermal images. 26th Aerospace Testing Seminar 2011, (January), 2011, 263–276.
2. Alenyá, G., Dellen, B., Torras, C., 3D modelling of leaves from color and ToF data for robotized plant measuring. Proceedings – IEEE International Conference on Robotics and Automation, 2011, 3408–3414.
3. Andújar, D., Escolà, A., Rosell-Polo, J.R., Fernández-Quintanilla, C., Dorado, J., Potential of a terrestrial LiDAR-based system to characterise weed vegetation in maize crops. Computers and Electronics in Agriculture 92 (2013), 11–15.
4. Andújar, D., Ribeiro, A., Fernández-Quintanilla, C., Dorado, J., Using depth cameras to extract structural parameters to assess the growth state and yield of cauliflower crops. Computers and Electronics in Agriculture 122 (2016), 67–73.
5. Auat Cheein, F.A., Guivant, J., SLAM-based incremental convex hull processing approach for treetop volume estimation. Computers and Electronics in Agriculture 102 (2014), 19–30.
6. Auat Cheein, F.A., Guivant, J., Sanz, R., Escolà, A., Yandún, F., et al. Real-time approaches for characterization of fully and partially scanned canopies in groves. Computers and Electronics in Agriculture 118 (2015), 361–371.
7. Baluja, J., Diago, M.P., Balda, P., Zorer, R., Meggio, F., Morales, F., et al. Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (UAV). Irrigation Science 30:6 (2012), 511–522.
8. Barbagallo, S., Consoli, S., Russo, A., A one-layer satellite surface energy balance for estimating evapotranspiration rates and crop water stress indexes. Sensors 9:1 (2009), 1–21.
9. Bulanon, D.M., Burks, T.F., Alchanatis, V., Study on temporal variation in citrus canopy using thermal imaging for citrus fruit detection. Biosystems Engineering 101:2 (2008), 161–171.
10. Bulanon, D.M., Burks, T.F., Alchanatis, V., Image fusion of visible and thermal images for fruit detection. Biosystems Engineering 103:1 (2009), 12–22.
11. Camejo, D., Rodríguez, P., Angeles Morales, M., Miguel Dell'Amico, J., Torrecillas, A., Alarcón, J.J., High temperature effects on photosynthetic activity of two tomato cultivars with different heat susceptibility. Journal of Plant Physiology 162:3 (2005), 281–289.
12. Chan, T.F., Vese, L.A., Active contours without edges. IEEE Transactions on Image Processing 10:2 (2001), 266–277.
13. Chen, C.-Y., Yeh, C.-H., Chang, B.R., Pan, J.-M., 3D reconstruction from IR thermal images and reprojective evaluations. Mathematical Problems in Engineering, 2015, 2015.
14. Chetverikov, D., Stepanov, D., Krsek, P., Robust Euclidean alignment of 3D point sets: The trimmed iterative closest point algorithm. Image and Vision Computing 23:3 (2005), 299–309.
15. Choi, W.S., Kim, Y.S., Oh, S.Y., Lee, J., Fast iterative closest point framework for 3D LIDAR data in intelligent vehicle. IEEE Intelligent Vehicles Symposium, Proceedings, 2012, 1029–1034.
16. Chéné, Y., Rousseau, D., Lucidarme, P., Bertheloot, J., Caffier, V., Morel, P., et al. On the use of depth camera for 3D phenotyping of entire plants. Computers and Electronics in Agriculture 82 (2012), 122–127.
17. Cohen, Y., Alchanatis, V., Meron, M., Saranga, Y., Tsipris, J., Estimation of leaf water potential by thermal imagery and spatial analysis. Journal of Experimental Botany 56:417 (2005), 1843–1852.
18. DaMatta, F.M., Cochicho Ramalho, J.D., Impacts of drought and temperature stress on coffee physiology and production: A review. Brazilian Journal of Plant Physiology 18:1 (2006), 55–81.
19. Day, M.E., Influence of temperature and leaf-to-air vapor pressure deficit on net photosynthesis and stomatal conductance in red spruce (Picea rubens). Tree Physiology 20 (2000), 57–63.
20. Elseberg, J., Magnenat, S., Siegwart, R., Andreas, N., Comparison of nearest-neighbor-search strategies and implementations for efficient shape registration. Journal of Software Engineering for Robotics (JOSER) 3:1 (2012), 2–12.
21. Fraser, A., Hengartner, N., Vixie, K., Wohlberg, B., Incorporating invariants in mahalanobis distance based classifiers: Application to face recognition. Proceedings of the International Joint Conference on neural networks, 2003, Vol. 4, 2003, 3118–3123.
22. Gago, J., Douthe, C., Coopman, R.E., Gallego, P.P., Ribas-Carbo, M., Flexas, J., et al. UAVs challenge to assess water stress for sustainable agriculture. Agricultural Water Management 153 (2015), 9–19.
23. Gongal, A., Amatya, S., Karkee, M., Zhang, Q., Lewis, K., Sensors and systems for fruit detection and localization: A review. Computers and Electronics in Agriculture 116 (2015), 8–19.
24. Gómez-Bellot, M.J., Nortes, P.A., Sánchez-Blanco, M.J., Ortuño, M.F., Sensitivity of thermal imaging and infrared thermometry to detect water status changes in Euonymus japonica plants irrigated with saline reclaimed water. Biosystems Engineering 133 (2015), 21–32.
25. Houborg, R., Boegh, E., Mapping leaf chlorophyll and leaf area index using inverse and forward canopy reflectance modeling and SPOT reflectance data. Remote Sensing of Environment 112:1 (2008), 186–202.
26. Jones, H.G., Use of infrared thermometry for estimation of stomatal conductance as a possible aid to irrigation scheduling. Agricultural and Forest Meteorology 95:3 (1999), 139–149.
27. Keightley, K., Bawden, G., 3D volumetric modeling of grapevine biomass using Tripod LiDAR. Computers and Electronics in Agriculture 74:2 (2010), 305–312.
28. Koenig, K., Höfle, B., Hümmerle, M., Jarmer, T., Siegmann, B., Lilienthal, H., Comparative classification analysis of post-harvest growth detection from terrestrial LiDAR point clouds in precision agriculture. ISPRS Journal of Photogrammetry and Remote Sensing 104 (2015), 112–125.
29. Kross, A., Lapen, D.R., McNairn, H., Sunohara, M., Champagne, C., Wilkes, G., Satellite and in situ derived corn and soybean biomass and leaf area index: Response to controlled tile drainage under varying weather conditions. Agricultural Water Management 160 (2015), 118–131.
30. Leinonen, I., Grant, O.M., Tagliavia, C.P.P., Chaves, M.M., Jones, H.G., Estimating stomatal conductance with thermal imagery. Plant, Cell and Environment 29:8 (2006), 1508–1518.
31. Leinonen, I., Jones, H.G., Combining thermal and visible imagery for estimating canopy temperature and identifying plant stress. Journal of Experimental Botany 55:401 (2004), 1423–1431.
32. LICOR Inc, Using the LI-6400 portable photosynthesis system. 2002.
33. Lin, Y., LiDAR: An important tool for next-generation phenotyping technology of high potential for plant phenomics?. 2015.
34. Nguyen, T.T., Vandevoorde, K., Wouters, N., Kayacan, E., De Baerdemaeker, J.G., Saeys, W., Detection of red and bicoloured apples on tree with an RGB-D camera. Biosystems Engineering, 2016, 1–12.
35. Olsoy, P.J., Glenn, N.F., Clark, P.E., Estimating sagebrush biomass using terrestrial laser scanning. Rangeland Ecology & Management 67:2 (2014), 224–228.
36. O'Carrigan, A., Babla, M., Wang, F., Liu, X., Mak, M., Thomas, R., et al. Analysis of gas exchange, stomatal behaviour and micronutrients uncovers dynamic response and adaptation of tomato plants to monochromatic light treatments. Plant Physiology and Biochemistry 82 (2014), 105–115.
37. Pforte, F., Selbeck, J., Hensel, O., Comparison of two different measurement techniques for automated determination of plum tree canopy cover. Biosystems Engineering 113:4 (2012), 325–333.
38. Rangel, J., Soldan, S., Kroll, A., 3D thermal imaging: Fusion of thermography and depth cameras. Conference on Quantitative InfraRed Thermography, 2014.
39. Rosell-Polo, J.R., Llorens, J., Sanz, R., Arnó, J., Ribes-Dasi, M., Masip, J., et al. Obtaining the three-dimensional structure of tree orchards from remote 2D terrestrial LIDAR scanning. Agricultural and Forest Meteorology 149:9 (2009), 1505–1515.
40. Rusinkiewicz, S., Levoy, M., Efficient variants of the ICP algorithm. Proceedings of International Conference on 3-D digital imaging and modeling, 3DIM, 2001, 145–152.
41. Rzeszotarski, D., Wi, B., Calibration for 3D reconstruction of thermal images. 9th International Conference on Quantitative InfraRed Thermography, 2008, 0–3.
42. Salvi, J., Matabosch, C., Fofi, D., Forest, J., A review of recent range image registration methods with accuracy evaluation. Image and Vision Computing 25:5 (2007), 578–596.
43. Sanz, R., Rosell, J.R., Llorens, J., Gil, E., Planas, S., Relationship between tree row LIDAR-volume and leaf area density for fruit orchards and vineyards obtained with a LIDAR 3D Dynamic Measurement System. Agricultural and Forest Meteorology 171–172 (2013), 153–162.
44. Seguin, B., Lagouarde, J.-P., Savane, M., The assessment of regional crop water conditions from meteorological satellite thermal infrared data. Remote Sensing of Environment 35 (1991), 141–148.
45. Sepulcre-Cantó, G., Zarco-Tejada, P.J., Jiménez-Mun˜oz, J.C., Sobrino, J.A., Miguel, E.D., Villalobos, F.J., Detection of water stress in an olive orchard with thermal remote sensing imagery. Agricultural and Forest Meteorology 136:1–2 (2006), 31–44.
46. Song, Y., Glasbey, C.A., Van Der Heijden, G., Polder, G., Dieleman, J.A., Combining stereo and time-of-flight images with application to automatic plant phenotyping. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6688 LNCS, 2011, 467–478.
47. Wang, W., Vinocur, B., Altman, A., Plant responses to drought, salinity and extreme temperatures: Towards genetic engineering for stress tolerance. Planta 218:1 (2003), 1–14.
48. Weerakkody, W.A.P., Suriyagoda, L.D.B., Scientia Horticulturae Estimation of leaf and canopy photosynthesis of pot chrysanthemum and its implication on intensive canopy management. Scientia Horticulturae 192 (2015), 237–243.
49. Weiss, U., Biber, P., Plant detection and mapping for agricultural robots using a 3D LIDAR sensor. Robotics and Autonomous Systems 59:5 (2011), 265–273.
50. Wong, C.K., Lim, P.P.K., Processing of point cloud data from ToF camera for the localisation of ground-based crop. 19th International Conference on Mechatronics and Machine Vision in Practice, 2012, 28–30.
51. Wu, C., Wang, L., Niu, Z., Gao, S., Wu, M., Nondestructive estimation of canopy chlorophyll content using Hyperion and Landsat/TM images. International Journal of Remote Sensing 31:8 (2010), 2159–2167.