Research on 3D reconstruction of fruit tree and fruit recognition and location method based on RGB-D camera

Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery

Volumn 46, Issue , 2015, Pages 35-40

  Mai, Chunyan ^a   Zheng, Lihua ^a   Sun, Hong ^a   Yang, Wei ^a  

^a CHINA AGRICULTURAL UNIVERSITY   (China)

Author keywords

3D reconstruction; Apple harvesting robot; Location; Recognition; RGB D camera; Segmentation of point cloud

Indexed keywords

CAMERAS; COLOR; FORESTRY; FRUITS; IMAGE PROCESSING; IMAGE RECONSTRUCTION; ITERATIVE METHODS; LOCATION; ORCHARDS;

3D RECONSTRUCTION; HARVESTING ROBOT; POINT CLOUD; RECOGNITION; RGB-D CAMERAS;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84954350477     PISSN: 10001298     EISSN: None     Source Type: Journal    
DOI: 10.6041/j.issn.1000-1298.2015.S0.006     Document Type: Article

References (31)

1. Khoshroo A, Arefi A, Khodaei J. Detection of red tomato on plants using image processing techniques[J]. Agricultural Communications, 2014, 2(4): 9-15.
2. Sharma D J, Kaur J. Robotic apple harvesting using computer vision based on shape & colour analysis and object positioning[J]. Digital Signal Processing, 2014, 6(7): 226-233.
3. Moltó E, Pla F, Juste F. Vision systems for the location of citrus fruit in a tree canopy[J]. Journal of Agricultural Engineering Research, 1992, 52: 101-110.
4. Palaniappan Annamalai, Won Suk Lee, Burks T F. Color vision system for estimating citrus yield in real-time[C]// 2004 ASAE Annual International Meeting, ASAE Paper 043054, 2004.
5. Lü Qiang, Cai Jianrong, Zhao Jiewen, et al. Real-time recognition of citrus on trees in natural scene[J]. Transactions of the Chinese Society for Agricultural Machinery, 2010, 41(2): 185-188. (in Chinese).
6. Wijethunga P, Samarasinghe S, Kulasiri D, et al. Digital image analysis based automated kiwifruit counting technique[C]// Image and Vision Computing New Zealand 23rd International Conference, Paper 4762149, 2008.
7. Cui Yongjie, Su Shuai, Wang Xiaxia, et al. Recognition and feature extraction of kiwi-fruit in natural environment based on machine vision[J]. Transactions of the Chinese Society for Agricultural Machinery, 2013, 44(5): 247-252. (in Chinese).
8. Payne A B, Walsh K B, Subedi P P, et al. Estimation of mango crop yield using image analysis segmentation method[J]. Computers and Electronics in Agriculture, 2013, 91: 57-64.
9. Bulanon D M, Kataoka T. Fruit detection system and an end effector for robotic harvesting of Fuji apples[J]. Agricultural Engineering International CIGR Journal, 2010, 12(1): 203-210.
10. Lak M B. Apple fruits recognition under natural luminance using machine vision[J]. Advance Journal of Food Science & Technology, 2010, 2(6): 325-327.
11. Ji W, Zhao D, Cheng F, et al. Automatic recognition vision system guided for apple harvesting robot[J]. Computers & Electrical Engineering, 2012, 38(5): 1186-1195.
12. Si Yongsheng, Qiao Jun, Liu Gang. Recognition and shape features extraction of apples based on machine vision[J]. Transactions of the Chinese Society for Agricultural Machinery, 2010, 41(9): 148-153. (in Chinese).
13. Nielsen M, Slaughter D C, Gliever C. Vision-based 3D peach tree reconstruction for automated blossom thinning[J]. IEEE Transactions on Industrial Informatics, 2012, 8(1): 188-196.
14. Adhikari B, Karkee M. 3D reconstruction of apple trees for mechanical pruning[C]// ASAE Annual Meeting, Paper 1111613, 2011.
15. Cai Jianrong, Sun Haibo, Li Yongping, et al. Fruit trees 3-D information perception and reconstruction based on binocular stereo vision[J]. Transactions of the Chinese Society for Agricultural Machinery, 2012, 43(3): 152-156. (in Chinese).
16. Lin Y, Hyyppä J. Multiecho-recording mobile laser scanning for enhancing individual tree crown reconstruction[J]. IEEE Transactions on Geoscience and Remote Sensing, 2012, 50(11): 4323-4332.
17. Gao Ziqiang, Wang Zhongren. A study of extraction and modeling of three-dimensional laser scanning of tree trunk[J]. Geomatics & Spatial Information Technology, 2012, 35(7): 67-73. (in Chinese).
18. Wang Fei, Zhang Sheqi, Li Bingzhi, et al. Three-dimensional reconstruction of trees trained to tall spindle shape and assessment of light characteristics[J]. Northern Horticulture, 2012(6): 10-13. (in Chinese).
19. Ma Xiaodan, Meng Qingkuan, Zhang Lijiao, et al. Image mosaics reconstruction of canopy organ morphology of apple trees[J]. Transactions of the CSAE, 2014, 30(12): 154-162. (in Chinese).
20. Nguyen T T, Vandevoorde K, Kayacan E, et al. Apple detection algorithm for robotic harvesting using an RGB-D camera[C]// International Conference of Agricultural Engineering, Paper C02290001, 2014.
21. Feng Juan, Liu Gang, Si Yongsheng, et al. Apple fruit recognition algorithm based on laser scanning 3-D image[J]. Transactions of the Chinese Society for Agricultural Machinery, 2013, 44(4): 217-222. (in Chinese).
22. Catuhe D. Programming with the kinect for windows software development kit[M]// Redmond: Microsoft Press, 2012: 55-59.
23. Shum H P H, Ho E S L, Jiang Y, et al. Real-time posture reconstruction for microsoft kinect[J]. IEEE Transactions on Cybernetics, 2013, 43(5): 1357-1369.
24. Lim Y W, Lee H Z, Yang N E, et al. 3-D Reconstruction using the Kinect sensor and its applicationto a visualization system[C]// IEEE International Conference on Systems, Man, and Cybernetics, Paper 6378311, 2012.
25. Gai J, Tang L, Steward B L. Plant recognition through the fusion of 2D and 3D images for robotic weeding[C]// ASABE Annual International Meeting, ASABE Paper 152181371, 2015.
26. Geng Yinyin, Cai Anni. Anautomatic thresholding algorithm for image segmentation[J]. Computer Engineering and Applications, 2002, 38(17): 119-122. (in Chinese).
27. Rusu R B, Marton Z C, Blodow N, et al. Towards 3D point cloud based object maps for household environments[J]. Robotics and Autonomous Systems, 2008, 56(11): 927-941.
28. Fischler M A, Bolles R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6): 381-395.
29. Li Na, Ma Yiwei, Yang Yang, et al. Segmentation of building facade point clouds using RANSAC[J]. Science of Surveying and Mapping, 2011, 36(5): 144-145. (in Chinese).
30. Luchowski L, Kowalski P. Using RANSAC for 3D point cloud segmentation[J]. Theoretical and Applied Informatics, 2013, 25(2): 105-117.
31. Schnabel R, Wahl R, Klein R. Efficient RANSAC for point-cloud shape detection[J]. Computer Graphics Forum, 2007, 26(2): 214-226.