Robustness of image-based visual servoing with a calibrated camera in the presence of uncertainties in the three-dimensional structure

IEEE Transactions on Robotics

Volumn 26, Issue 1, 2010, Pages 112-120

  Malis, Ezio ^a   Mezouar, Youcef ^b   Rives, Patrick ^a  

^a INRIA   (France)

^b UNIVERSITÉ CLERMONT AUVERGNE   (France)

Author keywords

Image based; Stability analysis; Visual servoing

Indexed keywords

3-D PARAMETER; 3D STRUCTURES; CALIBRATED CAMERAS; CALIBRATION ERROR; CENTRAL CATADIOPTRIC; CENTRAL CATADIOPTRIC SYSTEMS; CONTROL LAWS; DEPTH DISTRIBUTION; ESTIMATION ERRORS; IMAGE-BASED; IMAGE-BASED CONTROL; INTERACTION MATRICES; POTENTIAL PROBLEMS; ROUGH APPROXIMATIONS; STABILITY ANALYSIS; THEORETICAL RESULT; THREE-DIMENSIONAL STRUCTURE;

CAMERAS; ERRORS; IMAGE ANALYSIS; PINHOLE CAMERAS; ROBUST CONTROL; ROBUSTNESS (CONTROL SYSTEMS); SYSTEM STABILITY; THREE DIMENSIONAL; UNCERTAINTY ANALYSIS;

VISUAL SERVOING;

EID: 76949109324     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2009.2033332     Document Type: Article

References (38)

1. S. Hutchinson, G. D. Hager, and P. I. Corke, A tutorial on visual servo control, IEEE Trans. Robot. Autom., vol.12, no.5, pp. 651-670, Oct. 1996.
2. E. Malis, Survey of vision-based robot control, presented at the Eur. Naval Ship Des., Captain Comput. IV Forum, Brest, France, 2002.
3. F. Chaumette and S. Hutchinson, Visual servo control, Part I: Basic approaches, IEEE Robot. Autom. Mag., vol.13, no.4, pp. 82-90, Dec. 2006.
4. F. Chaumette and S. Hutchinson, Visual servo control, Part II: Advanced approaches, IEEE Robot. Autom.Mag., vol.14, no.1, pp. 109-118, Mar. 2007.
5. B. Espiau, F. Chaumette, and P. Rives, A new approach to visual servoing in robotics, IEEE Trans. Robot. Autom., vol.8, no.3, pp. 313-326, Jun. 1992.
6. F. Chaumette, Potential problems of stability and convergence in imagebased and position-based visual servoing, in The Confluence of Vision and Control, ser. LNCIS Series vol. 237, D. Kriegman, G. Hager, and A. Morse, Eds. Berlin, Germany: Springer-Verlag, 1998, pp. 66-78.
7. E. Malis, F. Chaumette, and S. Boudet, 2 1/2 d visual servoing, IEEE Trans. Robot. Autom., vol.15, no.2, pp. 234-246, Apr. 1999.
8. G. Morel, J. Szewczyk, S. Boudet, and J. Pot, Explicit incorporation of 2d constraints in vision based control of robot manipulators, in Proc. ISER, Exp. Robot. IV, Sydney, Australia, 1999, vol.2, pp. 99-108.
9. K. Deguchi, Optimal motion control for image-based visual servoing by decoupling translation and rotation, in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Oct. 1998, vol.2, pp. 705-711.
10. E. Malis and F. Chaumette, Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods, IEEE Trans. Robot. Autom., vol.18, no.2, pp. 176-186, Apr. 2002.
11. H. Hadj-Abdelkader, Y. Mezouar, N. Andreff, and P. Martinet, 2 1/2 d visual servoing with central catadioptric cameras, in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Edmonton, AB, Canada, Aug. 2005, pp. 2342- 2347.
12. P. Corke and S. Hutchinson, A new partitioned approach to image-based visual servo control, IEEE Trans. Robot. Autom., vol.14, no.4, pp. 507- 515, Aug. 2001.
13. K. Hashimoto and T. Noritsugu, Enlargement of stable region in visual servo, in Proc. IEEE Conf. Decis. Control, Sydney, Australia, 2000, pp. 3927-3932.
14. Y. Mezouar and F. Chaumette, Design and tracking of desirable trajectories in the image space by integrating mechanical and visibility constraints, in Proc. IEEE Int. Conf. Robot. Autom., Seoul, Korea, 2001, vol.1, pp. 731-736.
15. B. Espiau, Effect of camera calibration errors on visual servoing in robotics, in Proc. 3rd Int. Symp. Exp. Robot., Kyoto, Japan, 1993, pp. 183-193.
16. C. C. Cheah, S. Kawamura, and S. Arimoto, Feedback control for robotic manipulator with uncertain kinematics and dynamics, in Proc. IEEE Int. Conf. Robot. Autom., Leuven, Belgium, May 1998, vol.4, pp. 3607-3612.
17. L. Deng, F. Janabi-Sharifi, and W. Wilson, Stability and robustness of visual servoing methods, in Proc. ICRA, Washington, DC, 2002, vol.2, pp. 1604-1609.
18. R. Benosman and S. Kang, Panoramic Vision. Berlin, Germany: Springer Verlag, 2000.
19. S. Baker and K. Nayar, A theory of single-viewpoint catadioptric image formation, Int. J. Comput. Vis., vol.35, no.2, pp. 1-22, 1999.
20. P. Blaer and P. Allen, Topological mobile robot localization using fast vision techniques, in Proc. IEEE Int. Conf. Robot. Autom., Washington, DC, 2002, pp. 1031-1036. (Pubitemid 34916727)
21. A. De Luca, G. Oriolo, and P. R. Giordano, On-line estimation of feature depth for image-based visual servoing schemes, in Proc. IEEE Int. Conf. Robot. Autom., 2007, pp. 2823-2828. (Pubitemid 350140611)
22. C. Mei, E. Malis, S. Benhimane, and P. Rives, Constrained multiple planar template tracking for central catadioptric cameras, in Proc. Brit. Mach. Vis. Conf., Edinburgh, U.K., 2006, pp. 4-7.
23. N. Winter, J. Gaspar, G. Lacey, and J. Santos-Victor, Omnidirectional vision for robot navigation, in Proc. IEEE Workshop Omnidirectional Vis., Hilton Head Island, SC, Jun. 2000, pp. 21-28.
24. D. Burshka, J. Geiman, and G. Hager, Optimal landmark configuration for vision based control of mobile robot, in Proc. IEEE Int. Conf. Robot. Autom., Tapei, Taiwan, 2003, pp. 3917-3922.
25. A. Paulino and H. Araujo, Multiple robots in geometric formation: Control structure and sensing, in Proc. Int. Symp. Intell. Robot. Syst.,Reading, U.K., Jul. 2000, pp. 103-112.
26. R. Vidal, O. Shakernia, and S. Sastry, Formation control of nonholonomic mobile robots with omnidirectional visual servoing and motion segmentation, in Proc. IEEE Int. Conf. Robot. Autom., Taipei, Taiwan, 2003, pp. 584-589.
27. J. Barreto and H. Araujo, Geometric properties of central catadioptric line images, in Proc. Eur. Conf. Comput. Vis., 2002, pp. 237-251.
28. Y. Mezouar and E. Malis, Robustness of central catadioptric image-based visual servoing to uncertainties on 3d parameters, in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Sendai, Japan, 2004, vol.2, pp. 1389-1394.
29. E. Malis and P. Rives, Robustness of image-based visual servoing with respect to depth distribution errors, in Proc. IEEE Int. Conf. Robot. Autom., Taipei, Taiwan, vol.1, 2003, pp. 1056-1061.
30. E. Malis, Improving vision-based control using efficient second-order minimization techniques, in Proc. IEEE Int. Conf. Robot. Autom., New Orleans, LA, Apr. 2004, vol.2, pp. 1843-1848.
31. C. Geyer and K. Daniilidis, A unifying theory for central panoramic systems and practical applications, in Proc. Eur. Conf. Comput. Vis., 2000, vol.2, pp. 445-461.
32. M. Marey and F. Chaumette, Analysis of classical and newvisual servoing control laws, in Proc. IEEE Int. Conf. Robot. Autom., Pasadena, CA,May 2008, pp. 3244-3249.
33. G. W. Stewart and J.-g. Sun, Matrix Perturbation Theory (ser. Computer Science and Science Computing). Orlando, FL: Harcourt Brace Jovanovich, 1990.
34. E. Marchand, F. Spindler, and F. Chaumette, Visp for visual servoing: A generic software platform with a wide class of robot control skills, IEEE Robot. Autom. Mag., vol.12, no.4, pp. 40-52, Dec. 2005.
35. E. Marchand and F. Chaumette, Virtual visual servoing: a framework for real time augmented reality, Comput. Graph. Forum, vol.21, no.3, pp. 289-298, 2002.
36. D. Dementhon and L. Davis, Model-based object pose in 25 lines of code, Int. J. Comput. Vis., vol.15, no.1-2, pp. 123-141, Jun. 1995.
37. S. Benhimane and E. Malis, Homography-based 2d visual tracking and servoing, Int. J. Robot. Res., vol.26, no.7, pp. 661-676, Jul. 2007.
38. H. Wang, Y. H. Liu, and D. Zhou, Adaptive visual servoing using point and line features with an uncalibrated eye-in-hand camera, IEEE Trans. Robot., vol.24, no.4, pp. 843-857, Aug. 2008.