Online computation of exterior orientation with application to hand-eye calibration

Mathematical and Computer Modelling

Volumn 24, Issue 5-6, 1996, Pages 121-143

  Lu, C P ^a   Mjolsness, E ^b   Hager, G D ^a  

^a Yale University   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Augmented reality; Hand eye calibration; Model based object recognition; Pose estimation

Indexed keywords

EID: 0030239969     PISSN: 08957177     EISSN: None     Source Type: Journal    
DOI: 10.1016/0895-7177(96)00118-5     Document Type: Article

References (49)

1. 1. G.H. Rosenfield, The problem of exterior orientation in photogrammetry, Photogrammetric Engineering, 536-553 (1959).
2. 2. E.H. Tompson, The projective theory of relative orientation, Photogrammetria, 67-75 (1968).
3. 3. W.Z. Chen, U.A. Korde and S.B. Skaar, Position control experiments using vision, Intl. J. Rob. Res. 13 (3), 199-208 (1994).
4. 4. G.D. Hager, W.-C. Chang and A.S. Morse, Robot feedback control based on stereo vision: Towards calibration-free hand-eye coordination, In Proc. IEEE Conf. Rob. Automat., May 1994, pp. 2850-2856, IEEE Computer Society Press.
5. 5. G.D. Hager, Real-time feature tracking and projective invariance as a basis for hand-eye coordination, In Proc. IEEE Conf. Computer Vision Pat. Rec., 1994, pp. 533-539, IEEE Computer Society Press.
6. 6. N. Hollinghurst and R. Cipolla, Uncalibrated stereo hand eye coordination, Image and Vision Computing 12 (3), 187-192 (1994).
7. 7. S.W. Wijesoma, D.F.H Wolfe and R.J. Richards, Eye-to-hand coordination for vision-guided robot control applications, Intl. J. Rob. Res. 12 (1), 65-78 (1993).
8. 8. N. Ayache and O.D. Faugeras, HYPER: A new approach for the recognition and positioning of two-dimensional objects, IEEE Trans. Pat. Anal. Machine Intell. 8 (1), 44-54 (1986).
9. 9. R. Horaud, New methods for matching 3-D objects with single perspective views, IEEE Trans. Pat. Anal. Machine Intell. 9 (3), 401-412 (1987).
10. 10. D.G. Lowe, Three-dimensional object recognition from single two-dimensional image, Artificial Intelligence 31 (3), 355-395 (1987).
11. 11. D.P. Huttenlocher and S. Ullman, Recognizing solid objects by alignment with an image, Intl. J. Computer Vision 5 (2), 195-212 (1990).
12. 12. D.G. Lowe, Fitting parametrized three-dimensional models to images, IEEE Trans. Pat. Anal. Machine Intell. 13 (3), 441-450 (1991).
13. 13. R. Goldberg, Pose determination of parametrized object models from a monocular image, Image Vision Computing 11 (1), 49-62 (1993).
14. 14. R. Goldberg, Constrained pose refinement of parametric objects, Intl. J. Computer Vision 13 (2), 181-211 (1994).
15. 15. S. Ganapathy, Decomposition of transformation matrices for robot vision, Pattern Recognition Letters 2, 401-412 (1989).
16. 16. M. Fischler and R. C. Bolles, Random sample consensus: A paradigm for model fitting and automatic cartography, Commun. ACM (6), 381-395 (1981).
17. 17. R. Horaud, B. Canio and O. Leboullenx, An analytic solution for the perspective 4-point problem, Computer Vis. Graphics. Image Process 47 (1), 33-44 (1989).
18. 18. R.M. Haralick, C. Lee, K. Ottenberg and M. Nolle, Analysis and solutions of the three point perspective pose estimation problem, In Proc. IEEE Conf. Computer Vision Pat. Rec., 1991, pp. 592-598.
19. 19. D. DeMenthon and L.S. Davis, Exact and approximate solutions of the perspective-three-point problem, IEEE Trans. Pat. Anal. Machine Intell 14 (11), 1100-1105 (1992).
20. 20. M. Dhome, M. Richetin, J. Lapresté and G. Rives, Determination of the attitude of 3-D objects from a single perspective view, IEEE Trans. Pat. Anal. Machine Intell. 11 (12), 1265-1278 (1989).
21. 21. T.D. Alter, 3D pose from corresponding points under weak-perspective projection, Tech. Report A.I. Memo No. 1378, MIT Artificial Intelligence Lab. (1992).
22. 22. G.D. Hager, G. Grunwald and K. Toyama, Feature-based visual servoing and its application to telerobotics, In Intelligent Robots and Systems, (Edited by V. Graefe), Elsevier, (1995).
23. 23. M. Bajura, H. Fuchs and R. Ohbuchi, Merging virtual objects with the real world: Seeing ultrasound imagery within the patient, In Proc SIGGRAPH, July 1992, pp. 203-210.
24. 24. G.D. Hager, Six DOF visual control of relative position, In DCS RR-1038, Yale University, New Haven, CT, (1994).
25. 25. P.J. Huber, Robust Statistics, John Wiley and Sons, (1981).
26. 26. W.E.L. Grimson et al, An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization, In Proc. IEEE Conf. Computer Vision Pat. Rec., 1994, pp. 430-436.
27. 27. T.S. Huang and A.N. Netravali, Motion and structure from feature correspondences: A review, IEEE Proceeding 82 (2), 252-268 (1994).
28. 28. B.K.P. Horn, H.M. Hilden and S. Negahdaripour, Closed-form solution of absolute orientation using orthonomal matrices, J. Opt. Soc. Amer. A-5, 1127-1135 (1988).
29. 29. K.S. Arun, T.S. Huang and S.D. Blostein, Least-squares fitting of two 3-D point sets, IEEE Trans. Pat. Anal. Machine Intell. 9, 698-700 (1987).
30. 30. B.K.P. Horn, Closed-form solution of absolute orientation using unit quaternion, J. Opt. Soc. Amer. A-4, 629-642 (1987).
31. 31. M.W. Walker, L. Shao and R.A. Volz, Estimating 3-D location parameters using dual number quaternions, CVGIP: Image Understanding 54 (3), 358-367 (1991).
32. 32. Z. Wang and A. Jepson, A new closed-form solution for absolute orientation, In Proc. IEEE Conf. Computer Vision Pat. Rec., 1994, pp. 129-134.
33. 33. S.K. Ghosh, Analytical Photogrammetry, Pergamon Press, New York, (1988).
34. 34. R.M. Haralick and L.G. Shapiro, Computer and Robot Vision, Ch. 14, p. 132, Addison-Wesley, Reading, MA, (1993).
35. 35. J. Weng, N. Ahuja and T.S. Huang, Optimal motion and structure estimation, IEEE Trans. Pat. Anal. Machine Intell. 15 (9), 864-884 (1993).
36. 36. Y.I. Abdel-Aziz and H.M. Karara, Direct linear transformation into object space coordinates in close-range photogrammetry, Presented at the Symposium on Close-Range Photogrammetry, January 1971, pp. 1-18, Urbana-Champaign, IL.
37. 37. Y. Yakimovsky and R. Cunningham, A system for extracting three-dimensional measurements from a stereo pair of TV cameras, Computer Graphics and Image Processing 7, 195-210 (1978).
38. 38. O.D. Faugeras and G. Toscani, Calibration problem for stereo, In Proc. IEEE Conf. Computer Vision Pat. Rec., June 1986, pp. 15-20.
39. 39. R.Y. Tsai, An efficient and accurate camera calibration technique for 3D machine vision, In Proc. IEEE Conf. Computer Vision Pat. Rec., 1986, pp. 364-374.
40. 40. R.K. Lenz and R.Y. Tsai, Techniques for calibration of the scale factor and image center for high accuracy 3-D machine vision metrology, IEEE Trans. Pat. Anal. Machine Intell. 10 (3), 713-720 (1988).
41. 41. J. Weng, P. Cohen and M. Herniou, Camera calibration with distortion models and accuracy evaluation, IEEE Trans. Pat. Anal. Machine Intell. 10 (14), 965-980 (1992).
42. 42. D. Marr, Vision, W. H. Freeman, San Francisco, CA, (1982).
43. 43. D.G. Lowe, Perceptual Organization and Visual Recognition, Kluwer, Boston, MA, (1985).
44. 44. E. Grimson and T. Lozano-Pérez, Model-based recognition and localization from sparse range or tactile data, Intl. J. Robotics Res. 3, 3-35 (1984).
45. 45. O.D. Faugeras and M. Hebert, The representation, recognition and locating of 3-D objects, Intl. J. Robotics Res. 5 (3), 27-52 (1986).
46. 46. R.M. Haralick et al., Pose estimation from corresponding point data, IEEE Trans. Sys. Man Cyber 19 (6), 1426-1446 (1989).
47. 47. D.G. Luenberger, Linear and Nonlinear Programming, Addison-Wesley, Reading, MA, (1984).
48. 48. D. Kirk, Editor, Graphics Gems III, pp. 124-132, Academic Press, (1992).
49. 49. G.D. Hager, S. Puri and K. Toyama, A framework for real-time window-based tracking using off-the-shelf-hardware, Tech. Report YALEU/DCS/RR-988, Department of Computer Science, Yale University, (October 1993).