Visual Tracking of a Moving Target by a Camera Mounted on a Robot: A Combination of Control and Vision

IEEE Transactions on Robotics and Automation

Volumn 9, Issue 1, 1993, Pages 14-35

  Khosla, Pradeep K ^b   Kanade, Takeo ^b  

^a UNIVERSITY OF MINNESOTA   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CAMERAS; COMPUTER VISION; KALMAN FILTERING; LINEAR CONTROL SYSTEMS; NONLINEAR CONTROL SYSTEMS; SENSORS;

3-D OBJECTS; MOVING TARGETS; VISION SENSORS; VISUAL TRACKING;

ROBOT APPLICATIONS;

EID: 0027543120     PISSN: 1042296X     EISSN: None     Source Type: Journal    
DOI: 10.1109/70.210792     Document Type: Article

References (37)

1. E. H. Adelson and J. R. Bergen, “Spatiotemporal energy models for the perception of motion,” J. Opt. Soc. Amer., vol. 2, no. 2, pp. 284–298, Feb. 1985.
2. P. K. Allen, “Real-time motion tracking using spatio-temporal filters,” in Proc. DARPA Image Understanding Workshop, 1989, 695–701.
3. P. K. Allen, B. Yoshimi, and A. Timcenko, “Real-time visual servoing,” in Proc. IEEE Int. Conf. Robotics Automat., Apr. 1991, pp. 851–856.
4. P. Anandan, “Measuring visual motion from image sequences,” COINS Dept. Univ. of Massachusetts, Tech. Rep. COINS-TR-87-21, 1987.
5. B. Bhanu et al., “Qualitative target motion detection and tracking,” in Proc. DARPA Image Understanding Workshop, 1989, pp. 370–398.
6. P. I. Corke and R. P. Paul, “Video-rate visual servoing for robots,” Grasp Lab, Dept, of Comput. and Info. Sci„ Univ. of Pennsylvania, Tech. Rep. MS-CIS-89-18, Feb. 1989.
7. E. D. Dickmanns and A. Zapp, “Autonomous high speed road vehicle guidance by computer vision,” in Proc. 10th IFAC World Congr., July 1987.
8. E. D. Dickmanns, “Computer vision for flight vehicles,” Z. Flugwiss, Weltraumforsch, vol. 12, 71–79, 1988.
9. J. T. Feddema and C.S.G. Lee, “Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera,” IEEE Trans. Syst. Man Cybern., vol. 20, no. 5, pp. 1172–1183, 1990.
10. J. T. Feddema, C. S. G. Lee, and O. R. Mitchell, “Weighted selection of image features for resolved rate visual feedback control,” IEEE Trans. Robotics Automat., vol. 7, no. 1, pp. 31-47, 1991.
11. J. T. Feddema and O. R. Mitchell, “Vision guided servoing with feature-based trajectory generation,” IEEE Trans. Robotics Automat., vol. 5, no. 5, pp. 691–699, 1989.
12. B. Friedland, Control System Design: An Introduction to State-Space Methods. New York: McGraw-Hill, 1986.
13. A. Gelb, Applied Optimal Estimation. Cambridge, MA: MIT Press, 1974.
14. R. Goldenberg, W. C. Lau, A. She, and A. M. Waxman, “Progress on the prototype PIPE,” in Proc. IEEE Int. Conf. Robotics Automat., 1987, pp. 1267–1274.
15. G. C. Goodwin and K. S. Sin, Information and Systems Science Series, vol. 1, Adaptive Filtering, Prediction and Control. Englewood Cliffs, NJ: Prentice-Hall, 1984.
16. D.J. Heeger, “Depth and flow from motion energy,” Science, vol. 86, pp. 657–663, 1986.
17. M. A. Hersh and M. B. Zarrop, “Stochastic adaptive control of nonminimum phase systems,” Univ. of Manchester Inst, of Sci. and Technol., Tech. Rep., 1981.
18. B. K. P. Horn and B. G. Schunck, “Determining optical flow,” Artificial Intell., vol. 17, pp. 185–204, 1981.
19. B. K. P. Horn, Robot Vision. Cambridge, MA: MIT Press, 1986.
20. A. E. Hunt and A. C. Sanderson, “Vision-based predictive tracking of a moving target,” Carnegie Mellon Univ., The Robotics Inst., Tech. Rep. CMU-RI-TR-82-15, Jan. 1982.
21. A. J. Koivo and N. Houshangi, “Real-time vision feedback for servoing of a robotic manipulator with self-tuning controller,” IEEE Trans. Syst. Man Cybern., vol. 21, no. 1, pp. 134–142, 1991.
22. S. W. Lee and K. Wohn, “Tracking moving objects by a mobile camera,” Dept. of Comput. and Info. Sci., Univ. of Pennsylvania, Tech. Rep. MS-CIS-88-97, Nov. 1988.
23. F. L. Lewis, Optimal Control. New York: Wiley, 1986.
24. R. C. Luo, R. E. Mullen Jr., and D. E. Wessel, “An adaptive robotic tracking system using optical flow,” in Proc. IEEE Int. Conf Robotics Automat., 1988, pp. 568–573.
25. L. Matthies, T. Kanade, and R. Szeliski, “Kalman filter-based algorithms for estimating depth from image sequences,” Int. J. Comput. Vision, vol. 3, pp. 209–236, 1989.
26. N. P. Papanikolopoulos, “Controlled active vision,” PhD dissertation, Dept. of Electrical and Comput. Eng., Carnegie Mellon Univ., Pittsburgh, PA, Aug. 1992.
27. N. Papanikolopoulos, P. K. Khosla, and T. Kanade, “Adaptive robotic visual tracking,” in Proc. Amer. Control Conf, June 1991, pp. 962–967.
28. N. P. Papanikolopoulos and P. K. Khosla, “Adaptive robotic visual tracking: theory and experiments,” IEEE Trans. Automat. Contr., to be published, Mar. 1993.
29. N. P. Papanikolopoulos and P. K. Khosla, “Feature based robotic visual tracking of 3-D translational motion,” in Proc. 30th IEEE CDC (Brighton, U.K.), Dec. 1991, pp. 1877–1882.
30. A. P. Sage, Optimum Systems Control. Englewood Cliffs, NJ: Prentice-Hall, 1968.
31. D. B. Stewart, D. E. Schmitz, and P. K. Khosla, “Implementing real-time robotic systems using CHIMERA II,” in Proc. IEEE Int. Conf. Robotics Automat. (Cincinnati, OH), May 1990, pp. 598–603.
32. R. Y. Tsai and T. S. Huang, “Estimating 3-D motion parameters of a rigid planar patch,” IEEE Trans. Acoust. Speech, Signal Processing, vol. 29, pp. 1147–1152, 1981.
33. R. Y. Tsai and T. S. Huang, “Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surfaces,” IEEE Trans. Pattern Anal. Machine Intell., vol. PAM1-6, pp. 13–27, 1984.
34. D. Tsakiris, “Visual tracking strategies,” Master’s thesis, Dept. of Electrical Eng., Univ. of Maryland, College Park, 1988.
35. S. Ullman, The Interpretation of Visual Motion. Cambridge, MA: MIT Press, 1979.
36. L. E. Weiss, A. C. Sanderson, and C. P. Neuman, “Dynamic sensor-based control of robots with visual feedback,” IEEE J. Robotics Automat., vol. RA-3, no. 5, pp. 404—417, Oct. 1987.
37. D. B. Westmore and W. J. Wilson, “Direct dynamic control of a robot using an end-point mounted camera and Kalman filter position estimation,” in Proc. IEEE Int. Conf. Robotics Automat., 1991, pp. 2376–2384.