Robust visual servo control in the presence of fruit motion for robotic citrus harvesting

Computers and Electronics in Agriculture

Volumn 123, Issue , 2016, Pages 362-375

  Mehta, S S ^a   MacKunis, W ^b   Burks, T F ^a  

^a University of Florida   (United States)

^b EMBRY RIDDLE AERONAUTICAL UNIVERSITY   (United States)

Author keywords

Agricultural robotics; Fruit motion; Robotic harvesting; Vision based control

Indexed keywords

COMPUTER VISION; CONTROLLERS; DEGREES OF FREEDOM (MECHANICS); END EFFECTORS; FRUITS; HARVESTING; MANIPULATORS; NONLINEAR FEEDBACK; ROBOT APPLICATIONS; ROBOTICS; UNLOADING;

AGRICULTURAL ROBOTICS; EXOGENOUS DISTURBANCES; FINITE-TIME CONVERGENCE; IMAGE-BASED VISUAL SERVO; KINEMATICALLY REDUNDANT MANIPULATORS; LYAPUNOV-BASED STABILITY ANALYSIS; UNIFORMLY ULTIMATELY BOUNDED; VISION BASED CONTROL;

CITRUS FRUITS;

AGRICULTURAL TECHNOLOGY; CONTROL SYSTEM; ENVIRONMENTAL DISTURBANCE; FRUIT; HARVESTING; MOVEMENT; NUMERICAL MODEL; ROBOTICS; SHRUB;

CITRUS;

EID: 84962520729     PISSN: 01681699     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compag.2016.03.007     Document Type: Article

References (42)

1. Allen P.K., Timcenko A., Yoshimi B., Michelman P. Automated tracking and grasping of a moving object with a robotic hand-eye system. IEEE Trans. Robot. Automat. 1993, 9:152-165.
2. Bac C.W., Henten E.J., Hemming J., Edan Y. Harvesting robots for high-value crops: state-of-the-art review and challenges ahead. J. Field Robot. 2014, 31:888-911.
3. Baeten J., Donné K., Boedrij S., Beckers W., Claesen E. Autonomous fruit picking machine: a robotic apple harvester. Field and Service Robotics 2008, 531-539. Springer.
4. Buemi F., Massa M., Sandini G., Costi G. The agrobot project. Adv. Space Res. 1996, 18:185-189.
5. Ceres R., Pons F.L., Jimenez A.R., Martin F.M., Calderon L. Design and implementation of an aided fruit-harvesting robot (Agribot). Ind. Robot 1998, 25:337-346.
6. De-An Z., Jidong L., Wei J., Ying Z., Yu C. Design and control of an apple harvesting robot. Biosyst. Eng. 2011, 110:112-122.
7. d'Esnon A.G. Robotic harvesting of apples. Agri-Mation 1 1985, 210-214. ASAE, Chicago, IL.
8. Edan Y., Flash T., Peiper U., Shmulevich I., Sarig Y. Near-minimum-time task planning for fruit-picking robots. IEEE Trans. Robot. Automat. 1991, 7:48-56.
9. Fagerer C., Dickmanns D., Dickmanns E.D. Visual grasping with long delay time of a free floating object in orbit. Auton. Robots 1994, 1:53-68.
10. Fortuna L., Muscato G., Nunnari G., Pandolfo A., Plebe A. Application of neural control in agriculture: an orange picking robot. Acta Hortic. 1996, 441-450.
11. Hannan, M.W., Burks, T.F., 2004. Current developments in automated citrus harvesting, in: ASABE Annual International Meeting, p. ASAE Paper. No. 043087.
12. Hannan M.W., Burks T.F., Bulanon D.M. A machine vision algorithm combining adaptive segmentation and shape analysis for orange fruit detection. Agric. Eng. Int.: CIGR EJ. 2009, XI:1-17.
13. Harrell R.C., Adsit P.D., Munilla R.D., Slaughter D.C. Robotic picking of citrus. Robotica 1990, 8:269-278.
14. Harrell R.C., Adsit P.D., Pool T.A., Hoffman R., et al. The Florida robotic grove-lab. Trans. ASAE 1990, 33:391-399.
15. Harrell R.C., Slaughter D.C., Adsit P.D. A fruit-tracking system for robotic harvesting. Mach. Vis. Appl. 1989, 2:69-80.
16. Hayashi S., Ganno K., Ishii Y., Tanaka I. Robotic harvesting system for eggplants. Jpn. Agric. Res. Quart. 2002, 36:163-168.
17. Herisse B., Hamel T., Mahony R., Russotto F.X. The landing problem of a vtol unmanned aerial vehicle on a moving platform using optical flow. 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2010, 1600-1605. IEEE.
18. Horaud R., Dornaika F., Espiau B. Visually guided object grasping. IEEE Trans. Robot. Automat. 1998, 14:525-532.
19. Janabi-Sharifi F., Wilson W.J. Automatic grasp planning for visual-servo controlled robotic manipulators. IEEE Trans. Syst. Man Cybernet. Part B: Cybernet. 1998, 28:693-711.
20. Jimenez A., Ceres R., Pons J., et al. A survey of computer vision methods for locating fruit on trees. Trans. ASAE - Am. Soc. Agric. Eng. 2000, 43:1911-1920.
21. Juste, F., Sevila, F., 1991. Citrus: an European project to study the robotic harvesting of oranges, in: 2nd Workshop on Robotics in Agriculture and Food in Industry, pp. 187-196.
22. Kondo N., Nishitsuji Y., Ling P., Ting K. Visual feedback guided robotic cherry tomato harvesting. Trans. ASAE 1996, 39:2331-2338.
23. Kragić D., Miller A.T., Allen P.K. Real-time tracking meets online grasp planning. IEEE International Conference on Robotics and Automation, 2001, Proceedings 2001 ICRA 2001, 2460-2465. IEEE.
24. Levi P., Falla A., Pappalardo R. Image controlled robotics applied to citrus fruit harvesting. 7th International Conference on Robot Vision and Sensory Controls 1988, IFS Publications, Zurich, Switzerland.
25. Li P., Lee S., Hsu H. Review on fruit harvesting method for potential use of automatic fruit harvesting systems. Proc. Eng. 2011, 23:351-366.
26. Malis E., Chaumette F. Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods. IEEE Trans. Robot. Automat. 2002, 18:176-186.
27. Mehta S., Ton C., Kan Z., Curtis J. Vision-based navigation and guidance of a sensorless missile. J. Franklin Inst. 2015, 352:5569-5598.
28. Mehta, S.S., Burks, T.F., 2014a. Path planning and robust control for robotic citrus harvesting, in: Proc. of the Robotics and associated High-technologies and Equipment for Agriculture and forestry (RHEA), Madrid, Spain, pp. 467-476.
29. Mehta S.S., Burks T.F. Vision-based control of robotic manipulator for citrus harvesting. Comput. Electron. Agric. 2014, 102:146-158.
30. Mehta, S.S., MacKunis, W., Burks, T.F., 2014. Nonlinear robust visual servo control for robotic citrus harvesting, in: IFAC World Congress, pp. 8110-8115.
31. Mehta, S.S., MacKunis, W., Curtis, J.W., 2011. Adaptive vision-based missile guidance in the presence of evasive target maneuvers, in: 18th IFAC World Congress, pp. 5471-5476.
32. Muscato G., Prestifilippo M., Abbate N., Rizzuto I. A prototype of an orange picking robot: past history, the new robot and experimental results. Ind. Robot: Int. J. 2005, 32:128-138.
33. Nomura H., Naito T. Integrated visual servoing system to grasp industrial parts moving on conveyer by controlling 6DOF arm. 2000 IEEE International Conference on Systems, Man, and Cybernetics 2000, 1768-1775. IEEE.
34. Plebe A., Grasso G. Localization of spherical fruits for robotic harvesting. Mach. Vis. Appl. 2001, 13:70-79.
35. Rabatel, G., Bourely, A., Sevila, F., Juste, F., 1995. Robotic harvesting of citrus: state-of-art and development of the French Spanish EUREKA project, in: Proceedings of International conference on Harvest and Post harvest Technologies for Fresh Fruits and Vegetables, pp. 232-239.
36. Sarig Y. Robotics of fruit harvesting: a state-of-the-art review. J. Agric. Eng. 1993, 54:265-280.
37. Serra P., Cunha R., Hamel T., Cabecinhas D., Silvestre C. Landing on a moving target using image-based visual servo control. 2014 IEEE 53rd Annual Conference on Decision and Control (CDC) 2014, 2179-2184. IEEE.
38. Smith C.E., Papanikolopoulos N.P. Grasping of static and moving objects using a vision-based control approach. J. Intell. Robot. Syst. 1997, 19:237-270.
39. Tillett N.D. Robotic manipulators in horticulture: a review. J. Agric. Eng. Res. 1993, 55:89-105.
40. Van Henten E.J., Hemming J., Van Tuijl B.A.J., Kornet J.G., Bontsema J. Collision-free motion planning for a cucumber picking robot. Biosyst. Eng. 2003, 86:135-144.
41. Van Henten E.J., Hemming J., Van Tuijl B.A.J., Kornet J.G., Meuleman J., Bontsema J., Van Os E.A. An autonomous robot for harvesting cucumbers in greenhouses. Auton. Robots 2002, 13:241-258.
42. Wang Y., Zhang G.l., Lang H., Zuo B., De Silva C.W. A modified image-based visual servo controller with hybrid camera configuration for robust robotic grasping. Robot. Auton. Syst. 2014, 62:1398-1407.