Comparison of basic visual servoing methods

IEEE/ASME Transactions on Mechatronics

Volumn 16, Issue 5, 2011, Pages 967-983

  Janabi Sharifi, Farrokh ^a   Deng, Lingfeng ^b   Wilson, William J ^c  

^a RYERSON UNIVERSITY   (Canada)

^b MDA Consulting Limited Canada   (Canada)

^c UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Image based method; optomechatronics; position based method; robot visual servoing (RVS)

Indexed keywords

ASYMPTOTICALLY STABLE; CARTESIANS; COMPARISON RESULT; DYNAMIC PERFORMANCE; FUNDAMENTAL CHARACTERISTICS; IMAGE SPACE; IMAGE TRAJECTORY; IMAGE-BASED; IMAGE-BASED METHODS; LOCAL MINIMUMS; MODELING ERRORS; MOTION COUPLING; OPTOMECHATRONICS; POSITION-BASED METHOD; ROBOT MODELING; ROBOT VISUAL SERVOING; ROBOT VISUAL SERVOING (RVS); TASK SPACE;

CAMERAS; ERRORS; ROBOTS; SYSTEM STABILITY;

VISUAL SERVOING;

EID: 80052360079     PISSN: 10834435     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMECH.2010.2063710     Document Type: Review

References (72)

1. B. J. Nelson, "A distributed framework for visually servoed manipulation using an active camera", Int. J. Robot. Automat., vol. 18, no. 1, pp. 21-27, 2003.
2. C. D. Onal and M. Sitti, "Visual servoing-based autonomous 2-D manipulation of microparticles using a nanoprobe", IEEE Trans. Control Syst. Tech., vol. 15, no. 5, pp. 842-855, Jul. 2007.
3. Y. Wang, H. Lang, and S. W. de Silva, "A hybrid visual servo controller for robust grasping by wheeled mobile robots", IEEE/ASME Trans. Mechatronics, to be published.
4. A. Krupa, J. Gangloff, C. Doignon, M. F. de Mathelin, G. Morel, J. Leroy, L. Soler, and J. Marescaux, "Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing", IEEE Trans. Robot. Automat., vol. 19, no. 5, pp. 842-853, Oct. 2003.
5. R. Stanciu and Y. Oh, "Human-in-the-loop camera control for a mechatronic broadcast boom", IEEE/ASME Trans. Mechatronics, vol. 12, no. 1, pp. 41-52, Feb. 2007. (Pubitemid 46444217)
6. A. Ferreira, C. Cassier, and S. Hirai, "Automatic microassembly system assisted by vision servoing and virtual reality", IEEE/ASME Trans. Mechatronics, vol. 9, no. 2, pp. 321-333, Jun. 2004.
7. L. Mejías, S. Saripalli, P. Campoy, and G. S. Sukhatme, "Visual servoing of an autonomous helicopter in urban areas using feature tracking", J. Field Robot., vol. 23, no. 3/4, pp. 185-199, 2009.
8. L. E. Weiss, A. C. Sanderson, and C. P. Neuman, "Dynamic sensorbased controlof robots with visual feedback", IEEE J. Robot. Autom., vol. RA-3, no. 5, pp. 404-417, Oct. 1987.
9. W. J. Wilson, C. C. W. Hulls, and G. S. Bell, "Relative end-effector control using Cartesian position-based visual servoing", IEEE Trans. Robot. Autom., vol. 12, no. 5, pp. 684-696, Oct. 1996. (Pubitemid 126786245)
10. B. Espiau, F. Chaumette, and P. Rives, "A new approach to visual servoing in robotics", IEEE Trans. Robot. Autom., vol. 8, no. 3, pp. 313-326, Jun. 1992.
11. K. Hashimoto, T. Kimoto, T. Ebine, and H. Kimura, "Manipulator control with image-based visual servo", in Proc. IEEE Int. Conf. Robot. Autom., Sacramento, CA, 1991, vol. 3, pp. 2267-2271. (Pubitemid 21716982)
12. L. Deng, W. J. Wilson, and F. Janabi-Sharifi, "Characteristics of robot visual servoing methods and target model estimation", in Proc. IEEE Int. Symp. Intell. Control, Vancouver, BC, Canada, Oct. 2002, pp. 684-689.
13. E. Zergeroglu, D. M. Dawson, M. S. de Queiroz, and A. Behal, "Visionbased nonlinear tracking controllers with uncertain robot-camera parameters", IEEE/ASME Trans. Mechatronics, vol. 6, no. 3, pp. 322-337, Sep. 2001. (Pubitemid 32992583)
14. Y. T. Shen, D. Sun, Y-H. Liu, and K. Li, "Asymptotic trajectory tracking of manipulators using uncalibrated visual feedback", IEEE/ASME Trans. Mechatronics, vol. 8, no. 1, pp. 87-98, Mar. 2003.
15. Y-H Liu, H. Wang, C. Wang, and K. K. Lam, "Uncalibrated visual servoing of robots using a depth-independent interaction matrix", IEEE Trans. Robot., vol. 22, no. 4, pp. 804-817, Aug. 2006. (Pubitemid 44263866)
16. H. Wang, Y. H. Liu, and D. Zhou, "Dynamic visual tracking for manipulators using an uncalibrated fixed camera", IEEE Trans. Robot., vol. 23, no. 3, pp. 610-617, Jun. 2007. (Pubitemid 47062037)
17. E. C. Dean-León, V. Parra-Vega, and A. Espinosa-Romero, "Visual servoing for constrained planar robots subject to complex friction", IEEE/ASME Trans. Mechatronics, vol. 11, no. 4, pp. 389-400, Aug. 2006.
18. C. C. Cheah, S. P. Hou, Y. Zhao, and J.-J. E. Slotine, "Adaptive vision and force tracking control for robots with constraint uncertainty", IEEE/ASME Trans. Mechatronics, to be published.
19. R. Kelly, "Robust asymptotically stable visual servoing of planar robots", IEEE Trans. Robot. Autom., vol. 12, no. 5, pp. 759-766, Oct. 1996. (Pubitemid 126786251)
20. R. Kelly, R. Carelli, O. Nasisi, B. Kuchen, and F. Reyes, "Stable visual servoing of camera-in-hand robotic systems", IEEE/ASME Trans. Mechatronics, vol. 5, no. 1, pp. 39-48, Mar. 2000. (Pubitemid 30583999)
21. L. Deng, "Comparison of image-based and position-based robot visual servoing methods and improvements", Ph. D. dissertation, Electrical and Computer Engineering Dept., Univ. Waterloo, Waterloo, Canada, 2003.
22. F. Chaumette, "Potential problems of stability and convergence in imagebased and position-based visual servoing", in The Confluence of Vision and Control, D. Kriegman, G. D. Hager, and A. Morse, Eds. New York: Springer-Verlag, Lecture Notes in Control and Information Sciences, 1998, vol. 237, pp. 66-78. (Pubitemid 128104797)
23. E. Malis and F. Chaumette, "Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods", IEEE Trans. Robot. Autom., vol. 18, no. 2, pp. 176-186, Apr. 2002. (Pubitemid 34659021)
24. G. Morel, P. Zanne, and F. Plestan, "Robust visual servoing: Bounding the task function tracking errors", IEEE Trans. Control Syst. Tech., vol. 13, no. 6, pp. 998-1009, Nov. 2005. (Pubitemid 41638151)
25. K. Miura, K. Hashimoto, H. Inooka, J. A. Gangloff, and M. F. de Mathelin, "Model-less visual servoing using modified simplex optimization", Artif. Life Robot., vol. 10, pp. 131-135, 2006. (Pubitemid 44697383)
26. C. Samson, M. L. Borgne, and B. Espiau, Robot Control: The Task Function Approach. Oxford, U. K.: Clarendon Press, 1991.
27. M. Takegaki and S. Arimoto, "A new feedback method for dynamic control of manipulators", J. Dyn. Syst., Meas., Control, vol. 102, no. 6, pp. 119-125, Jun. 1981. (Pubitemid 12447191)
28. B. Espiau, "Effect of camera calibration errors on visual servoing in robotics", in Experimental Robotics III: The 3rd Int. Symp. on Experimental Robotics, T. Yoshikawa and F. Miyazaki, Eds. New York: Springer-Verlag, Lecture Notes in Control and Information Sciences, Oct. 1993, vol. 200.
29. E. Malis, Y. Mezouar, and P. Rives, "Robustness of image-based visual servoing with a calibrated camera in the presence of uncertainties in the three-dimensional structure", IEEE Trans. Robot., vol. 26, no. 1, pp. 112-120, Feb. 2010.
30. M. Marey and F. Chaumette, "Analysis of classical and new visual servoing control laws", in Proc. IEEE Int. Conf. Robot. Autom., Pasadena, CA, May 2008, pp. 3244-3249.
31. E. Nematollahi and F. Janabi-Sharifi, "Generalization to control laws of image-based visual servoing", Int. J. Optomechatronics, vol. 3, no. 3, pp. 167-186, Jul. 2009.
32. G. Morel, T. Liebezeit, J. Szewczyk, S. Boudet, and J. Pot, "Explicit incorporation of 2D constraints in vision based control of robot manipulators", in Experimental Robotics VI, P. I. Corke and J. Trevelyan, Eds. New York: Springer-Verlag, Lecture Notes in Control and Information, 2000, vol. 250, pp. 99-108.
33. B. Siciliano, L. Sciavicco, L. Villani, and G. Oriollo, Robotics: Modelling, Planning and Control. London, U. K.: Springer-Verlag, 2009, ch. 10, pp. 453-460.
34. P. Martinet, "Comparison of visual servoing techniques: Experimental results", in Proc. Eur. Control Conf., 1999, pp. 1059-1064.
35. N. R. Gans, S. A. Hutchinson, and P. I. Corke, "Performance tests for visual servo control systems, with application to partitioned approaches to visual servo control", Int. J. Robot. Res., vol. 22, no. 10, pp. 955-981, Oct. 2003.
36. L. Deng, F. Janabi-Sharifi, and W. J. Wilson, "Stability and robustness of visual servoing methods", in Proc. IEEE Int. Conf. Robot. Autom., Washington DC, May 2002, vol. 2, pp. 1604-1609. (Pubitemid 34916475)
37. F. Chaumette and S. Hutchinson, "Visual servo control I: Basic approaches", IEEE Robot. Autom. Mag., vol. 13, no. 4, pp. 82-90, Dec. 2006. (Pubitemid 46454544)
38. F. Chaumette and S. Hutchinson, "Visual servo control II: Advanced approaches", IEEE Robot. Autom. Mag., vol. 14, no. 1, pp. 109-118, Mar. 2007. (Pubitemid 46566624)
39. S. A. Hutchinson, G. D. Hager, and P. I. Corke, "A tutorial on visual servo control", IEEE Trans. Robot. Autom., vol. 12, no. 5, pp. 651-670, Oct. 1996. (Pubitemid 126786243)
40. J. Pomares, F. Chaumette, and F. Torres, "Adaptive visual servoing by simultaneous camera calibration", in Proc. IEEE Int. Conf. Robot. Autom., Roma, Italy, 2007, pp. 2811-2816. (Pubitemid 350140609)
41. M. Bonkovic, A. Hace, and K. Jezernik, "Population-based uncalibrated visual servoing", IEEE/ASME Trans. Mechatronics, vol. 13, no. 3, pp. 393-397, Jun. 2008.
42. H. Wang, Y.-H. Liu, and D. Zhou, "Adaptive visual servoing using point and line features with an uncalibrated eye-in-hand camera", IEEE Trans. Robot., vol. 24, no. 4, pp. 843-857, Aug. 2008.
43. E. Malis, F. Chaumette, and S. Boudet, "2-1/2-D visual servoing", IEEE Trans. Robot. Automat., vol. 15, no. 2, pp. 238-250, Oct. 1999.
44. S. Benhimane and E. Malis, "Homography-based 2D visual tracking and servoing", Int. J. Robot. Res., vol. 26, no. 7, pp. 661-676, 2007. (Pubitemid 46934724)
45. C. Collewet and F. Chaumette, "Visual servoing based on structure from controlled motion or on robust statistics", IEEE Trans. Robot., vol. 24, no. 2, pp. 318-330, Apr. 2008. (Pubitemid 351586010)
46. D. F. DeMenthon and L. S. Davis, "Model-based object pose in 25 lines of code", Int. J. Comput. Vis., vol. 15, no. 1-2, pp. 123-141, 1995.
47. E. Cervera and P. Martinet, "Visual servoing with indirect image control and a predictable camera trajectory", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Kyongju, Korea, 1999, vol. 1, pp. 381-386. (Pubitemid 30578089)
48. M. W. Spong and M. Vidyasagar, Robot Dynamics and Control. New York: Wiley, 1989.
49. J. T. Feddema, C. S. G. Lee, and O. R. Mitchell, "Weighted selection of image features for resolved rate visual feedback control", IEEE Trans. Robot. Automat., vol. 7, no. 1, pp. 31-47, Feb. 1991.
50. N. P. Papanikolopoulos, B. J. Nelson, and P. K. Khosla, "Six degrees of-freedom hand/eye visual tracking with uncertain parameters", IEEE Trans. Robot. Automat., vol. 11, no. 5, pp. 725-732, Oct. 1995.
51. M. Jägersand, O. Fuentes, and R. Nelson, "Experimental evaluation of uncalibrated visual servoing for precision manipulation", in Proc. Int. Conf. Robot. Autom., Albuquerque, NM, 1997, pp. 2874-2880.
52. C.-J. Fang and S.-K. Lin, "A performance criterion for the depth estimation with application to robot visual servo control", J. Robot. Syst., vol. 18, no. 10, pp. 609-622, 2001. (Pubitemid 32932480)
53. F. Chaumette, P. Rives, and B. Espiau, "Classification and realisation of vision-based tasks", in Visual Servoing, K. Hashimoto, Ed.. Singapore: World Scientific, 1993, pp. 199-228.
54. N. P. Papanikolopoulos, "Selection of features and evaluation of visual measurements during robotic visual servoing tasks", J. Intell. Robot. Syst., vol. 13, no. 3, pp. 279-304, Jul. 1995.
55. K. Hashimoto and T. Noritsugu, "Performance and sensitivity in visual servoing", in Proc. IEEE Int. Conf. Robot. Autom., Leuven, Belgium, May 1998, vol. 3, pp. 2321-2326.
56. K. Hashimoto and T. Noritsugu, "Potential switching control in visual servo", in Proc. IEEE Int. Conf. Robot. Autom., San Francisco, CA, Apr. 2000, vol. 3, pp. 2765-2770.
57. L. Deng, F. Janabi-Sharifi, and W. J. Wilson, "Hybrid strategies for image constraints avoidance in visual servoing", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Vancouver, BC, Canada, Oct. 2002, vol. 1, pp. 348-353. (Pubitemid 35437837)
58. P. I. Corke and S. A. Hutchinson, "A new partitioned approach to imagebased visual servo control", IEEE Trans. Robot. Autom., vol. 17, no. 4, pp. 507-515, Aug. 2001. (Pubitemid 33048337)
59. R. Tsai, "A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses", IEEE Trans. Robot. Autom., vol. 3, no. 4, pp. 323-344, Aug. 1987. (Pubitemid 18521694)
60. K. Deguchi, "Optimal motion control for image-based visual servoing by decoupling translation and rotation", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Victoria, BC, Canada, 1998, pp. 705-711.
61. G. Hu, W. MacKunis, N. Gans, W. E. Dixon, J. Chen, A. Behal, and D. Dawson, "Homography-based visual servo control with imperfect camera calibration", IEEE Trans. Autom. Control, vol. 54, no. 6, pp. 1318-1324, Jun. 2009.
62. C. J. Taylor and J. P. Ostrowski, "Robust vision-based pose control", in Proc. IEEE Int. Conf. Robot. Autom., San Francisco, CA, 2000, vol. 3, pp. 2734-2740.
63. L. Deng, W. J. Wilson, and F. Janabi-Sharifi, "Combined target model estimation and position-based visual servoing", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., IROS 2004, Sendai, Japan, Oct., pp. 1395-1400. (Pubitemid 40275794)
64. N. R. Gans and S. A. Hutchinson, "Stable visual servoing through hybrid switched-system control", IEEE Trans. Robot., vol. 23, no. 3, pp. 530-540, Jun. 2007. (Pubitemid 47062028)
65. L. Deng, F. Janabi-Sharifi, and W. Wilson, "Hybrid motion control and planning strategies for visual servoing", IEEE Trans. Ind. Electron., vol. 52, no. 4, pp. 1024-1040, Aug. 2005. (Pubitemid 41226855)
66. Y. Mezouar and F. Chaumette, "Path planning for robust image-based control", IEEE Trans. Robot. Autom., vol. 18, no. 4, pp. 534-549, Aug. 2002. (Pubitemid 35372517)
67. F. Janabi-Sharifi and W. J. Wilson, "A fast approach for robot motion planning", J. Intell. Robot. Syst., vol. 25, no. 3, pp. 187-212, 1999.
68. G. Chesi and Y. S. Hung, "Global path-planning for constrained and optimal visual servoing", IEEE Trans. Robot., vol. 23, no. 5, pp. 1050-1060, Oct. 2007. (Pubitemid 47577980)
69. M. Ficocelli and F. Janabi-Sharifi, "Adaptive filtering for pose estimation in visual servoing", in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Maui, HI, Sep., 2001, vol. 1, pp. 19-24. (Pubitemid 34683626)
70. Y. Yoon, A. Kosaka, and A. C. Kak, "A new Kalman-filter-based framework for fast and accurate visual tracking of rigid objects", IEEE Trans. Robot, vol. 24, no. 5, pp. 1238-1251, Oct. 2008.
71. F. Janabi-Sharifi and W. J. Wilson, "Automatic selection of image features for visual servoing", IEEE Trans. Robot. Autom., vol. 13, no. 6, pp. 890-903, Dec. 1997. (Pubitemid 127770489)
72. K. S. Fu, R. C. Gonzalez, and C. S. G. Lee, Robotics: Control Sensing, Vision, and Intelligence. New York: McGraw-Hill, 1987.