Feature depth observation for image-based visual servoing: Theory and experiments

International Journal of Robotics Research

Volumn 27, Issue 10, 2008, Pages 1093-1116

  De Luca, Alessandro ^a   Oriolo, Giuseppe ^a   Robuffo Giordano, Paolo ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Depth observation; Focal length observation; Image based visual servoing; Mobile robots; Nonlinear observers

Indexed keywords

CAMERAS; THREE DIMENSIONAL;

3-D PARAMETER; CAMERA CALIBRATIONS; CAMERA MOTIONS; CONTROL SCHEMES; CONTROL SIGNALLING; DEPTH OBSERVATION; ERROR SIGNALS; FOCAL LENGTH OBSERVATION; FOCAL LENGTHS; IMAGE FEATURES; IMAGE-BASED; IMAGE-BASED VISUAL SERVOING; INTERACTION MATRICES; MOBILE ROBOTS; NON-LINEAR; NONLINEAR OBSERVERS; THREE-DIMENSIONAL MODELING; UNCALIBRATED CAMERAS;

VISUAL SERVOING;

EID: 52349117577     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364908096706     Document Type: Article

References (41)

1. Benhimane, S. and Malis, E. (2006). Homography-based 2D visual servoing. Proceedings of the 2006 IEEE International Conference on Robotics and Automation, pp. 2397-2402.
2. Bouguet, J.-Y. (2007). Camera Calibration Toolbox for MATLAB. http://www.vision.caltech.edu/bouguetj/calib\_doc.
3. Chaumette, F. (1998). Potential problems of stability and convergence in image-based and position-based visual servoing. The Confluence of Vision and Control, Kriegman, D., Hager, G. and Morse, A. (eds), Lecture Notes in Control and Information Science, Vol. 237. Berlin, Springer, pp. 66-78.
4. Chaumette, F. (2004). Image moments: A general and useful set of features for visual servoing. IEEE Transactions on Robotics and Automation, 20 (4). 713-723.
5. Chaumette, F., Boukir, S., Bouthemy, P. and Juvin, D. (1996). Structure from controlled motion. IEEE Transactions on Pattern Analysis andMachine Intelligence, 18 (5). 492-504.
6. Chaumette, F. and Hutchinson, S. (2006 a). Visual servo control. I. Basic approaches. IEEE Robotics and Automation Magazine, 13 (4). 82-90.
7. Chaumette, F. and Hutchinson, S. (2006 b). Visual servo control. II. Advanced approaches. IEEE Robotics and Automation Magazine, 14 (1). 109-118.
8. Conticelli, F. and Allotta, B. (2001). Nonlinear controllability and stability analysis of adaptive image-based systems. IEEE Transactions on Robotics and Automation, 17 (2). 208-214.
9. Conticelli, F., Allotta, B. and Khosla, P.K. (1999). Image-based visual servoing of nonholonomic mobile robots. Proceedings of the 38th IEEE Conference on Decision and Control, pp. 3496-3501.
10. Corke, P.I. and Hutchinson, S.A. (2001). A new partitioned approach to image-based visual servo control. IEEE Transactions on Robotics and Automation, 17 (4). 507-515.
11. Cyberbotics (2007). Webots. http://www.cyberbotics.com.
12. De Luca, A., Oriolo, G. and Robuffo Giordano, P. (2007 a). Image-based visual servoing schemes for nonholonomic mobile manipulators. Robotica, 25 (2). 131-145.
13. De Luca, A., Oriolo, G. and Robuffo Giordano, P. (2006). Kinematic modeling and redundancy resolution for nonholonomic mobile robots. Proceedings of the 2006 IEEE International Conference on Robotics and Automation, pp. 1867-1873.
14. De Luca, A., Oriolo, G., and Robuffo Giordano, P. (2007 b). On-line estimation of feature depth for image-based visual servoing schemes. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, pp. 2823-2828.
15. Deguchi, K. (1998). Optimal motion control for image-based visual servoing by decoupling translation and rotation. Proceedings of the 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 705-711.
16. Espiau, B. (1993). Effect of camera calibration errors on visual servoing in robotics. Proceedings of the 3rd International Symposium on Experimental Robotics, pp. 182-192.
17. Espiau, B., Chaumette, F. and Rives, P. (1992). A new approach to visual servoing in robotics. IEEE Transactions on Robotics and Automation, 8 (3). 313-326.
18. Friedland, B. (1986). Control System Design: An Introduction to State-Space Methods. New York, McGraw-Hill.
19. Hutchinson, S., Hager, G.D. and Corke, P.I. (1996). A tutorial on visual servo control. IEEE Transactions on Robotics and Automation, 12 (5). 651-670.
20. Inaba, H., Yoshida, A., Abdursul, R. and Ghosh, B.K. (2000). Observability of perspective dynamical systems. Proceedings of the 39th IEEE Conference on Decision and Control, pp. 5157-5162.
21. Khalil, H.K. (1996). Nonlinear Systems (2 nd edn). Englewood Cliffs, NJ, Prentice-Hall.
22. Ma, Y., Soatto, S., Kosecka, J. and Sastry, S.S. (2004). An Invitation to 3-D Vision. New York, Springer.
23. Maciejewski, A.A. and Klein, C.A. (1989). The singular value decomposition: computation and applications to robotics. International Journal of Robotics Research, 8 (6). 63-79.
24. Malis, E. (2004). Visual servoing invariant to changes in camera-intrinsic parameters. IEEE Transactions on Robotics and Automation, 20 (1). 72-81.
25. Malis, E. and Chaumette, F. (2002). Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods. IEEE Transactions on Robotics and Automation, 18 (2). 176-186.
26. Malis, E., Chaumette, F. and Boudet, S. (1999). 2-1/2-D visual servoing. IEEE Transactions on Robotics and Automation, 15 (2). 238-250.
27. Malis, E. and Rives, P. (2003). Robustness of image-based visual servoing with respect to depth distribution errors. Proceedings of the 2003 IEEE International Conference on Robotics and Automation, pp. 1056-1061.
28. Marino, R. and Tomei, P. (1995). Nonlinear Control Design: Geometric, Adaptive and Robust. London, Prentice-Hall.
29. Mathworks (2007). MATLAB. http://www.mathworks.com/products/matlab/.
30. Matthies, L., Szelinski, R. and Kanade, T. (1989). Kalman filter-based algorithms for estimating depth from image sequences. International Journal of Computer Vision, 3: 209-236.
31. Morel, G., Liebezeit, T., Szewczyk, J., Boudet, S. and Pot, J. (2000). Explicit incorporation of 2D constraints in vision based control of robot manipulators. Experimental Robotics VI, Corke, P. and Trevelyan, J. (eds). Berlin, Springer.
32. Murray, R.M., Li, Z. and Sastry, S.S. (1994). A Mathematical Introduction to Robotic Manipulation. Boca Raton, FL, CRC Press.
33. Robuffo Giordano, P., De Luca, A. and Oriolo, G. (2008). 3D structure identification from image moments. Proceedings of the 2008 IEEE International Conference on Robotics and Automation, pp. 93-100.
34. Sepp, W., Fuchs, S. and Arbter, K. (2005). DLR Calibration Detection Toolbox (CalDe 0.99.0). http://www.dlr.de/rm/callab.
35. Smith, C.E. and Papanikolopoulos, N.P. (1994). Computation of shape through controlled active exploration. Proceedings of the 1994 IEEE International Conference on Robotics and Automation, pp. 2516-2521.
36. Soatto, S., Frezza, R. and Perona, P. (1996). Motion estimation via dynamic vision. IEEE Transactions on Automatic Control, 41 (3). 393-413.
37. Strobl, K.H. and Hirzinger, G. (2006). Optimal hand-eye calibration. Proceedings of the IEEE/RSJ International Conference on Robots and Intelligent Systems, pp. 4647-4653.
38. Strobl, K.H. and Paredes, C. (2005). DLR Calibration Laboratory (CalLab 0.99.5). http://www.dlr.de/rm/callab.
39. Tahri, O. and Chaumette, F. (2005). Point-based and region-based image moments for visual servoing of planar objects. IEEE Transactions on Robotics, 21 (6). 1116-1127.
40. Taylor, C., Ostrowski, J. and Jung, S. (2000). Robust vision-based pose control. Proceedings of the 2000 IEEE International Conference on Robotics and Automation, pp. 2734-2740.
41. Wilson, W.J., Hulls, C.C.W. and Bell, G.S. (1996). Relative end-effector control using cartesian position based visual servoing. IEEE Transactions on Robotics and Automation, 12 (5). 684-696.