Spatio-temporal analysis for obstacle detection in agricultural videos

Applied Soft Computing Journal

Volumn 45, Issue , 2016, Pages 86-97

  Campos, Yerania ^a   Sossa, Humberto ^b   Pajares, Gonzalo ^a  

^a UNIVERSIDAD COMPLUTENSE DE MADRID   (Spain)

^b INSTITUTO POLITÉCNICO NACIONAL   (Mexico)

Author keywords

Autonomous vehicles; Natural images; Obstacle detection; Precision agriculture; Spatiotemporal analysis

Indexed keywords

AGRICULTURAL MACHINERY; AGRICULTURE; COMPUTER VISION; IMAGE ANALYSIS; IMAGE SEGMENTATION; MOTION PLANNING; NAVIGATION SYSTEMS; OBJECT DETECTION; OBSTACLE DETECTORS; ROBOT PROGRAMMING; ROBOTS; VEHICLES;

AUTONOMOUS VEHICLES; NATURAL IMAGES; OBSTACLE DETECTION; PRECISION AGRICULTURE; SPATIOTEMPORAL ANALYSIS;

SPATIAL VARIABLES MEASUREMENT;

EID: 84968845907     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2016.03.016     Document Type: Article

References (52)

1. RHEA Robot Fleets for Highly Effective Agriculture and Forestry Management 2015 http://www.rhea-project.eu/
2. J. Romeo, J.M. Guerrero, M. Montalvo, L. Emmi, M. Guijarro, P. Gonzalez-de Santos, and G. Pajares Camera sensor arrangement for crop/weed detection accuracy in agronomic images Sensors 13 4 2013 4348 10.3390/s130404348 http://www.mdpi.com/1424-8220/13/4/4348
3. J.A. Gzquez, N.N. Castellano, and F. Manzano-Agugliaro Intelligent low cost telecontrol system for agricultural vehicles in harmful environments J. Clean. Prod. 113 2016 204 215 10.1016/j.jclepro.2015.11.015 http://www.sciencedirect.com/science/article/pii/S0959652615016443
4. G. Pajares A Hopfield neural network for image change detection IEEE Trans. Neural Netw. 17 5 2006 1250 1264 10.1109/TNN.2006.875978
5. T. Parekh, and Jaliya A survey on object detection and tracking methods Int. J. Innov. Res. Comput. Commun. Eng. 2 2 2014 2970 2978
6. J. Oroko, and G. Nyakoe Obstacle avoidance and path planning schemes for autonomous navigation of a mobile robot: a review Proceedings of Sustainable Research and Innovation Conference 2014 314 318
7. D. Fortun, P. Bouthemy, and C. Kervrann Optical flow modeling and computation: a survey Comput. Vis. Image Underst. 134 2015 1 21
8. H. Chao, Y. Gu, and M. Napolitano A survey of optical flow techniques for UAV navigation applications 2013 International Conference on Unmanned Aircraft Systems (ICUAS) 2013 710 716 10.1109/ICUAS.2013.6564752
9. C. Chen, J. Liang, H. Zhao, H. Hu, and J. Tian Frame difference energy image for gait recognition with incomplete silhouettes Pattern Recognit. Lett. 30 11 2009 977 984 10.1016/j.patrec.2009.04.012 http://www.sciencedirect.com/science/article/pii/S0167865509000920
10. C. Stauffer, and W.E.L. Grimson Adaptive background mixture models for real-time tracking IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, vol. 2 1999 252 10.1109/CVPR.1999.784637
11. A. Mittal, A. Bensrhair, and E.R. Hancock Obstacle detection by means of stereo feature matching 2014 IEEE International Conference on Image Processing (ICIP) 2014 1618 1622 10.1109/ICIP.2014.7025324
12. P. Panchal, G. Prajapati, S. Patel, H. Shah, and J. Nasriwala A review on object detection and tracking methods Int. J. Res. Emerg. Sci. Technol. 2 2015 7 12
13. A. Mazinan A powerful approach to real-time mobile objects tracking in crowded environments utilizing 3D video analysis of fixed camera, particle filter and neural network Optik 125 21 2014 6357 6365 10.1016/j.ijleo.2014.06.133 http://www.sciencedirect.com/science/article/pii/S003040261400895X
14. B. Leibe, K. Schindler, N. Cornelis, and L.V. Gool Coupled object detection and tracking from static cameras and moving vehicles IEEE Trans. Pattern Anal. Mach. Intell. 30 10 2008 1683 1698 10.1109/TPAMI.2008.170
15. K.B. Panchsheria, and M.C. Parikh A comprehensive survey on moving object segmentation methods Int. J. Technol. Res. Eng. 2 2015 2347 4718
16. 1st ed. Feature Extraction for the Identification of Weed Species in Digital Images for the Purpose of Site-specific Weed Control vol. 7 2007 J.V. Stafford/Wageningen Academic Publishers Wageningen, The Netherlands
17. D.C. Youchun Ding, and S. Wang The mature wheat cut and uncut edge detection method based on wavelet image rotation and projection Afr. J. Agric. Res. 11 2011 2609 2616
18. N.K.A. Al-Sahib, and S.R. Majeed Environmental mobile robot based on artificial intelligence and visual perception for weed elimination INCAS Bull. 4 2012 11 25
19. J. Guerrero, M. Guijarro, M. Montalvo, J. Romeo, L. Emmi, A. Ribeiro, and G. Pajares Automatic expert system based on images for accuracy crop row detection in maize fields Expert Syst. Appl. 40 2 2013 656 664 10.1016/j.eswa.2012.07.073 http://www.sciencedirect.com/science/article/pii/S0957417412009293
20. G. Bhadane, S. Sharma, and V.B. Nerkar Early pest identification in agricultural crops using image processing techniques Int. J. Electr. Electron. Comput. Eng. 2 2 2013 77 82
21. V. Tewari, A.K. Arudra, S.P. Kumar, V. Pandey, and N.S. Chandel Estimation of plant nitrogen content using digital image processing Agric. Eng. Int.: CIGR J. 15 2 2013 78 86
22. M. Li, K. Imou, K. Wakabayashi, and S. Yokoyama Review of research on agricultural vehicle autonomous guidance Int. J. Agric. Biol. Eng. 2 3 2009 1 16
23. S. Yaghoubi, N.A. Akbarzadeh, S.S. Bazargani, S.S. Bazargani, M. Bamizan, and M.I. Asl Autonomous Robots for Agricultural Tasks and Farm Assignment and Future Trends in Agro Robots 2013
24. F. Rovira-Más, I. Chatterjee, and V. Sáiz-Rubio The Role of GNSS in the navigation strategies of cost-effective agricultural robots Comput. Electron. Agric. 112 C 2015 172 183 10.1016/j.compag.2014.12.017
25. A. ur Rehman, A.Z. Abbasi, N. Islam, and Z.A. Shaikh A review of wireless sensors and networks' applications in agriculture Comput. Stand. Interfaces 36 2 2014 263 270 10.1016/j.csi.2011.03.004 http://www.sciencedirect.com/science/article/pii/S0920548911000353
26. N. Shalal, T. Low, C. McCarthy, and N. Hancock A review of autonomous navigation systems in agricultural environments SEAg 2013: Innovative Agricultural Technologies for a Sustainable Future 2013
27. H. Mousazadeh A technical review on navigation systems of agricultural autonomous off-road vehicles J. Terramech. 50 3 2013 211 232 10.1016/j.jterra.2013.03.004 http://www.sciencedirect.com/science/article/pii/S0022489813000220
28. D.D. Bochtis, C.G. Srensen, and P. Busato Advances in agricultural machinery management: a review Biosyst. Eng. 126 2014 69 81 10.1016/j.biosystemseng.2014.07.012 http://www.sciencedirect.com/science/article/pii/S1537511014001287
29. G. Reina, and A. Milella Towards autonomous agriculture: automatic ground detection using trinocular stereovision Sensors 12 9 2012 12405 10.3390/s120912405 http://www.mdpi.com/1424-8220/12/9/12405
30. P. Biber, U. Weiss, M. Dorna, and A. Albert Navigation system of the autonomous agricultural robot BoniRob Workshop on Agricultural Robotics: Enabling Safe, Efficient, and Affordable Robots for Food Production (Collocated with IROS 2012) 2012
31. M. Garrido, M. Perez-Ruiz, C. Valero, C.J. Gliever, B.D. Hanson, and D.C. Slaughter Active optical sensors for tree stem detection and classification in nurseries Sensors 14 6 2014 10783 10803
32. G. Monteiro, C. Premebida, P. Peixoto, and U. Nunes Tracking and classification of dynamic obstacles using laser range finder and vision Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2006 1 7
33. B. Douillard, D. Fox, and F. Ramos A spatio-temporal probabilistic model for multi-sensor object recognition IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007. IROS 2007 2007 2402 2408 10.1109/IROS.2007.4399537
34. C. Premebida, O. Ludwig, and U. Nunes LIDAR and vision-based pedestrian detection system J. Field Robot. 26 9 2009 696 711
35. P. Ross, A. English, D. Ball, B. Upcroft, G. Wyeth, and P. Corke Novelty-based visual obstacle detection in agriculture 2014 IEEE International Conference on Robotics and Automation (ICRA) 2014 1699 1705 10.1109/ICRA.2014.6907080
36. S. Nissimov, J. Goldberger, and V. Alchanatis Obstacle detection in a greenhouse environment using the kinect sensor Comput. Electron. Agric. 113 2015 104 115 10.1016/j.compag.2015.02.001 http://www.sciencedirect.com/science/article/pii/S0168169915000435
37. T. Ojala, M. Pietikinen, and D. Harwood A comparative study of texture measures with classification based on featured distributions Pattern Recognit. 29 1 1996 51 59 10.1016/0031-3203(95)00067-4 http://www.sciencedirect.com/science/article/pii/0031320395000674
38. A. Talukder, R. Manduchi, A. Rankin, and L. Matthies Fast and reliable obstacle detection and segmentation for cross-country navigation Intelligent Vehicle Symposium, 2002. IEEE, vol. 2 2002 610 618 10.1109/IVS.2002.1188019
39. C.C.T. Mendes, F.S. Osrio, and D.F. Wolf An efficient obstacle detection approach for organized point clouds Intelligent Vehicles Symposium (IV), 2013 IEEE 2013 1203 1208 10.1109/IVS.2013.6629630
40. F. Rovira-Mas, J. Reid, S. Han, and et al. Obstacle detection using stereo vision to enhance safety of autonomous machines Trans. ASAE 48 6 2005 2389 2397
41. P. Fleischmann, and K. Berns A stereo vision based obstacle detection system for agricultural applications Field and Service Robotics: Results of the 10th International Conference 2016 Springer International Publishing Cham 217 231 10.1007/978-3-319-27702-8-15
42. F.A. Cheein, G. Steiner, G.P. Paina, and R. Carelli Optimized EIF-SLAM algorithm for precision agriculture mapping based on stems detection Comput. Electron. Agric. 78 2 2011 195 207 10.1016/j.compag.2011.07.007 http://www.sciencedirect.com/science/article/pii/S0168169911001542
43. G. Bayar, M. Bergerman, E.I. Konukseven, and A.B. Koku Improving the trajectory tracking performance of autonomous orchard vehicles using wheel slip compensation Biosyst. Eng. 2016 10.1016/j.biosystemseng.2015.12.019 http://www.sciencedirect.com/science/article/pii/S1537511015001981
44. K.A. Steen, P. Christiansen, H. Karstoft, and R.N. Jrgensen Using deep learning to challenge safety standard for highly autonomous machines in agriculture J. Imaging 2 1 2016 6 10.3390/jimaging2010006 http://www.mdpi.com/2313-433X/2/1/6
45. A. Koschan, and M. Abidi Digital Color Image Processing 2008 John Wiley & Sons
46. V.T.S. Larsson Partial Differential Equations with Numerical Methods 2013 Springer Berlin Heidelberg
47. E.R. Dougherty, and R.A. Lotufo Hands-on Morphological Image Processing (SPIE Tutorial Texts in Optical Engineering Vol. TT59) 2003 SPIE Publications
48. N. Otsu A threshold selection method from gray-level histograms Automatica 11 285-296 1975 23 27
49. Y. Yang, and S. Huang Image segmentation by fuzzy c-means clustering algorithm with a novel penalty term Comput. Inform. 26 1 2012 17 31
50. J.L. Barron, D.J. Fleet, and S.S. Beauchemin Performance of optical flow techniques Int. J. Comput. Vis. 12 1 1994 43 77 10.1007/BF01420984
51. A. Ruckelshausen, University of Applied Sciences Osnabrck Germany, https://www.youtube.com/watch?v=x8Aq6qVQOkw, 2013.
52. J.M. Bengochea-Guevara, J. Conesa-Muoz, D. Andjar, and A. Ribeiro Merge fuzzy visual servoing and GPS-based planning to obtain a proper navigation behavior for a small crop-inspection robot Sensors 16 3 2016 276 10.3390/s16030276 http://www.mdpi.com/1424-8220/16/3/276