Vision-based extraction of spatial information in grape clusters for harvesting robots

Biosystems Engineering

Volumn 151, Issue , 2016, Pages 90-104

  Luo, Lufeng ^a,b   Tang, Yunchao ^c   Zou, Xiangjun ^a   Ye, Min ^a   Feng, Wenxian ^c   Li, Guoqing ^b  

^a SOUTH CHINA AGRICULTURAL UNIVERSITY   (China)

^b TIANJIN UNIVERSITY OF TECHNOLOGY AND EDUCATION   (China)

^c GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Binocular stereo vision; Bounding volume; Cutting point; Grape cluster; Harvesting robots

Indexed keywords

BINS; END EFFECTORS; HARVESTING; MANIPULATORS; ROBOT PROGRAMMING; ROBOTS; STEREO IMAGE PROCESSING;

BINOCULAR STEREO VISION; BOUNDING VOLUME; CUTTING POINT; GRAPE CLUSTER; HARVESTING ROBOT;

STEREO VISION;

EID: 84987862317     PISSN: 15375110     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.biosystemseng.2016.08.026     Document Type: Article

References (38)

1. Bac, C.W., Hemming, J., van Henten, E.J., Stem localization of sweet-pepper plants using the support wire as a visual cue. Computers and Electronics in Agriculture 105 (2014), 111–120.
2. Berenstein, R., Ben Shahar, O., Shapiro, A., Edan, Y., Grape clusters and foliage detection algorithms for autonomous selective vineyard sprayer. Intelligent Service Robotics 3 (2010), 233–243.
3. Brown, M.Z., Burschka, D., Hager, G.D., Advances in computational stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 (2003), 993–1008.
4. Cai, J., Zhou, X., Wang, F., Lǜ, Q., Obstacle identification of citrus harvesting robot. Transactions of the Chinese Society of Agricultural Engineering 40:11 (2009), 171–175 (in Chinese with English abstract).
5. Canny, J., A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8:6 (1986), 679–698.
6. Cubero, S., Diago, M.P., Blasco, J., Tardáguila, J., Millán, B., Aleixos, N., A new method for pedicel/peduncle detection and size assessment of grapevine berries and other fruits by image analysis. Biosystems Engineering 117 (2014), 62–72.
7. Font, D., Pallejà, T., Tresanchez, M., Teixidó, M., Martinez, D., Counting red grapes in vineyards by detecting specular spherical reflection peaks in RGB images obtained at night with artificial illumination. Computers and Electronics in Agriculture 108 (2014), 105–111.
8. Galambos, C., Kittler, J., Matas, J., Gradient-based progressive probabilistic hough transform. IEEE Vision Image and Signal Processing 148:3 (2002), 158–165.
9. Gonzalez, R.C., Woods, R.E., Digital image processing. 3rd ed., 2012, Publish House of Ecectronics Industry, China (Chapter 3).
10. Hayashi, S., Ganno, K., Kurosaki, H., Arima, S., Monta, M., Robotic harvesting system for eggplants trained in V-shape (part 2). Journal of Society of High Technology in Agriculture 15:4 (2003), 211–216.
11. Hayashi, S., Shigematsu, K., Yamamoto, S., Kobayashi, K., Kohno, Y., Kamata, J., et al. Evaluation of a strawberry-harvesting robot in a field test. Biosystems Engineering 105 (2010), 160–171.
12. Herrero-Huerta, M., González-Aguilera, D., Rodriguez-Gonzalvez, P., Hernández-López, D., Vineyard yield estimation by automatic 3D bunch modelling in field conditions. Computers and Electronics in Agriculture 110 (2015), 17–26.
13. Hu, X., Mordohai, P., A quantitative evaluation of confidence measures forstereo vision. IEEE Transactions on Pattern Analysis and Machine Intelligence 34 (2012), 2121–2133.
14. Jimenez, A.R., Ceres, R., Pons, J.L., A vision system based on a laser range-finder applied to robotic fruit harvesting. Machine Vision and Applications 11 (2000), 321–329.
15. Kai, Z., Lining, Z., Zhe, S., Design and experiment of intelligent grape bagging robot. Applied Mechanics and Materials 389 (2013), 706–711.
16. Kicherer, A., Roscher, R., Herzog, K., Förstner, W., Töpfer, R., Image based evaluation for the detection of cluster parameters in grapevine. Acta Hortic 1082 (2015), 335–340, 10.17660/ActaHortic.2015.1082.46.
17. Kondo, N., Monta, M., Hisaeda, K., Harvesting robot for strawberry grown on annual hill top (part 2). Journal of Societyof High Technology in Agriculture 13:4 (2001), 231–236.
18. Kondo, N., Shibano, Y., Mohri, K., Basic studies on robot to work in vineyard (part 2). Journal of the Japanese Society of Agricultural Machinery 56:1 (1994), 45–53.
19. Liu, S., Whitty, M., Cossell, S., A lightweight method for grape berry counting based on automated 3D bunch reconstruction from a single image. Workshop on Robotics in Agriculture, Seattle, USA, 2015.
20. Matas, C.G., Kittler, J., Robust detection of lines using the progressive probabilistic hough transform. Computer Vision Image Understanding 78 (2000), 119–137.
21. Mehta, S.S., Burks, T.F., Vision-based control of robotic manipulator for citrus harvesting. Computers and Electronics in Agriculture 102 (2014), 146–158.
22. Monta, M., Kondo, N., Ting, K.C., Giacomelli, G.A., Mears, D.R., Kim, Y., et al. Harvesting end-effector for inverted single truss tomato production systems. Journal of the Japanese Society of Agricultural Machinery 60:6 (1998), 97–104.
23. Otsu, N., A threshold selection method from gray-level histograms. IEEE Transactions on Systems Man and Cybernetics 9:1 (1979), 62–66.
24. Reis, M.J.C.S., Morais, R., Peres, E., Automatic detection of bunches of grapes in natural environment from colour images. Journal of Applied Logic 10 (2012), 285–290.
25. Rodriguez, J.J., Aggarwal, J.K., Stochastic analysis of stereo quantization error. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (1990), 467–470.
26. Sezgin, M., Sankur, B., Survey over image thresholding techniques and quantitative performance evaluation. Journal of Electronic Imaging 13:1 (2004), 146–165.
27. Si, Y., Liu, G., Feng, J., Location of apples in trees using stereoscopic vision. Computers and Electronics in Agriculture 112 (2015), 68–74.
28. Steger, C., Ulrich, M., Wiedemann, C., Machine vision algorithms, machine vision algorithms and applications. 2007, Wiley-VCH, Weinheim, Germany (Chapter 3).
29. Tomasi, C., Manduchi, R., Bilateral filtering for gray and colour images. Proceedings of the IEEE International Conference on Computer Vision, Bombay, India, 1998, 839–846.
30. Van Henten, E.J., Hemming, J., Van Tuijl, B.A.J., Kornet, J.G., Meuleman, J., Bontsema, J., et al. An autonomous robot for harvesting cucumbers in greenhouses. Autonomous Robots 13 (2002), 241–258.
31. Van Henten, E.J., Van Tuijl, B.A.J., Hemming, J., Kornet, J.G., Bontsema, J., Van Os, E.A., Field test of an autonomous cucumber picking robot. Biosystems Engineering 86:3 (2003), 305–313.
32. Van Henten, E.J., Van Tuijl, B.A.J., Hoogakker, G.J., Van Der Weerd, M.J., Hemming, J., Kornet, J.G., et al. An autonomous robot for de-leafing cucumber plants grown in a high-wire cultivation system. Biosystems Engineering 94:3 (2006), 317–323.
33. Wang, C., Zou, X., Tang, Y., Luo, L., Feng, W., Localisation of litchi in an unstructured environment using binocular stereo vision. Biosystems Engineering 145 (2016), 39–51.
34. Xiang, R., Jiang, H., Ying, Y., Recognition of clustered tomatoes based on binocular stereo vision. Computers and Electronics in Agriculture 106 (2014), 75–90.
35. Yang, Q., Liu, C., Xun, Y., Bao, G., Wang, Z., Huang, P., Target recognition for grape bagging robot. Transactions of the Chinese Society for Agricultural Machinery 44:8 (2013), 234–239 (in Chinese with English abstract).
36. Zhao, D., Lv, J., Ji, W., Zhang, Y., Chen, Y., Design and control of an apple harvesting robot. Biosystems Engineering 110 (2011), 112–122.
37. Zou, X., Ye, M., Luo, C., Xiong, T., Luo, L., Chen, Y., et al. Fault-tolerant design of a limited universal fruit-picking end-effector based on vision positioning error. Applied Engineering in Agriculture 32:1 (2016), 5–18.
38. Zou, X., Zou, H., Lu, J., Virtual manipulator-based binocular stereo vision positioning system and errors modeling. Machine Vision and Applications 23:1 (2012), 43–63.