Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit picking

Computers and Electronics in Agriculture

Volumn 142, Issue , 2017, Pages 388-396

  Tao, Yongting ^a   Zhou, Jun ^a  

^a NANJING AGRICULTURAL UNIVERSITY   (China)

Author keywords

Agricultural robot; Apple detection; Machine learning; Point cloud data

Indexed keywords

AGRICULTURAL MACHINERY; COLOR; GENETIC ALGORITHMS; LEARNING SYSTEMS; ROBOTICS; THREE DIMENSIONAL COMPUTER GRAPHICS;

AGRICULTURAL ROBOT; AUTOMATIC RECOGNITION METHOD; COLOR FEATURES; PERCEPTION CAPABILITY; POINT CLOUD DATA; ROBOT RECOGNITION; ROBOTIC FRUIT PICKINGS; THREE-DIMENSIONAL (3D) SPACE;

FRUITS;

CELLULAR AUTOMATON; COLOR; COMPARATIVE STUDY; DATA ASSIMILATION; DETECTION METHOD; FRUIT; GEOMETRY; MACHINE LEARNING; NUMERICAL METHOD; OPERATIONS TECHNOLOGY; OPTIMIZATION; ROBOTICS;

MALUS X DOMESTICA;

EID: 85029796233     PISSN: 01681699     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compag.2017.09.019     Document Type: Article

References (25)

1. Edan, Y., Han, S., Kondo, N., Automation in agriculture, Springer handbook of automation. 2009, Springer, 1095–1128.
2. Goncalves, P., Torres, P., 2010. Learning approaches to visual control of robotic manipulators. In: The Second International Conference on Advanced Cognitive Technologies and Applications. Citeseer, pp. 103–108.
3. Grift, T., Zhang, Q., Kondo, N., Ting, K., A review of automation and robotics for the bioindustry. J. Biomech. Eng. 1 (2008), 37–54.
4. Ji, W., Zhao, D., Cheng, F., Xu, B., Zhang, Y., Wang, J., Automatic recognition vision system guided for apple harvesting robot. Comput. Electr. Eng. 38 (2012), 1186–1195.
5. Jia, W., Zhao, D., Liu, X., Tang, S., Ruan, C., Ji, W., Apple recognition based on K-means and GA-RBF-LMS neural network applicated in harvesting robot. Trans. Chinese Soc. Agric. Eng. 31 (2015), 175–183.
6. Jiang, L., Koch, A., Zell, A., 2016. Object recognition and tracking for indoor robots using an rgb-d sensor, Intelligent Autonomous Systems 13. Springer, pp. 859–871.
7. Lessmann, S., Stahlbock, R., Crone, S.F., 2006. Genetic algorithms for support vector machine model selection. In: Neural Networks, 2006. IJCNN’06. International Joint Conference on. IEEE, pp. 3063–3069.
8. Li, J.-F., Wang, K.-Q., Zhang, D., 2002. A new equation of saturation in RGB-to-HSI conversion for more rapidity of computing. In: Machine Learning and Cybernetics, 2002. Proceedings. 2002 International Conference on. IEEE, pp. 1493–1497.
9. Li, X., Kong, J., Application of GA-SVM method with parameter optimization for landslide development prediction. Nat. Hazards Earth Syst. Sci., 14, 2014, 525.
10. Ma, X., Liu, G., Zhou, W., Feng, J., Apple recognition based fuzzy neural network and quantum genetic algorithm. Trans. Chin. Soc. Agric. Mach. 44 (2013), 227–251.
11. Mai, C., Zheng, L., Sun, H., Yang, W., Research on 3D reconstruction of fruit tree and fruit recognition and location method based on RGB-D Camera. Trans. Chinese Soc. Agric. Mach., 46, 2015, 6.
12. Marton, Z.-C., Pangercic, D., Rusu, R.B., Holzbach, A., Beetz, M., 2010. Hierarchical object geometric categorization and appearance classification for mobile manipulation. In: Humanoid Robots (Humanoids), 2010 10th IEEE-RAS International Conference on. IEEE, pp. 365–370.
13. Nguyen, T.T., Vandevoorde, K., Kayacan, E., De Baerdemaeker, J., Saeys, W., 2014. Apple detection algorithm for robotic harvesting using a rgb-d camera. In: International Conference of Agricultural Engineering, Zurich, Switzerland.
14. Rusu, R.B., Blodow, N., Beetz, M., 2009. Fast point feature histograms (FPFH) for 3D registration. In: Robotics and Automation, 2009. ICRA’09. IEEE International Conference on. IEEE, pp. 3212–3217.
15. Rusu, R.B., Bradski, G., Thibaux, R., Hsu, J., 2010. Fast 3d recognition and pose using the viewpoint feature histogram. In: Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on. IEEE, pp. 2155–2162.
16. Rusu, R.B., Cousins, S., 2011. 3d is here: Point cloud library (pcl). In: Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, pp. 1–4.
17. Rusu, R.B., Marton, Z.C., Blodow, N., Beetz, M., 2008. Persistent point feature histograms for 3D point clouds. In: Proc 10th Int Conf Intel Autonomous Syst (IAS-10), Baden-Baden, Germany, pp. 119–128.
18. Sa, I., Lehnert, C., English, A., McCool, C., Dayoub, F., Upcroft, B., Perez, T., Peduncle detection of sweet pepper for autonomous crop harvesting—combined color and 3-D information. IEEE Robot. Automat. Lett. 2 (2017), 765–772.
19. Tombari, F., Salti, S., Di Stefano, L., 2010. Unique signatures of histograms for local surface description. In: European Conference on Computer Vision. Springer, pp. 356–369.
20. Wachs, J.P., Stern, H., Burks, T., Alchanatis, V., Low and high-level visual feature-based apple detection from multi-modal images. Precision Agric. 11 (2010), 717–735.
21. Wahabzada, M., Paulus, S., Kersting, K., Mahlein, A.-K., Automated interpretation of 3D laserscanned point clouds for plant organ segmentation. BMC Bioinformatics, 16, 2015, 248.
22. Weeks, A.R., Hague, G.E., 1997. Color segmentation in the HSI color space using the K-means algorithm, Electronic Imaging’97. International Society for Optics and Photonics, pp. 143–154.
23. Wohlkinger, W., Vincze, M., 2011. Ensemble of shape functions for 3d object classification. In: Robotics and Biomimetics (ROBIO), 2011 IEEE International Conference on. IEEE, pp. 2987–2992.
24. Yang, L., Zhang, L., Dong, H., Alelaiwi, A., El Saddik, A., Evaluating and improving the depth accuracy of Kinect for Windows v2. IEEE Sens. J. 15 (2015), 4275–4285.
25. Zhao, Y., Gong, L., Huang, Y., Liu, C., A review of key techniques of vision-based control for harvesting robot. Comput. Electron. Agric. 127 (2016), 311–323.