Automated Tracking and Grasping of a Moving Object with a Robotic Hand-Eye System

IEEE Transactions on Robotics and Automation

Volumn 9, Issue 2, 1993, Pages 152-165

  Allen, Peter K ^a   Timcenko, Aleksandar ^a   Yoshimi, Billibon ^a   Michelman, Paul ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER VISION; MOTION CONTROL; REAL TIME SYSTEMS; ROBOTIC ARMS; THREE DIMENSIONAL; TRACKING (POSITION);

HAND-EYE COORDINATION; ROBOTIC GRASPING TASKS;

GRIPPERS;

EID: 0027582857     PISSN: 1042296X     EISSN: None     Source Type: Journal    
DOI: 10.1109/70.238279     Document Type: Article

References (44)

1. M. Abramowitz, Ed., Handbook of Mathematical Functions, National Bureau of Standards, 1964.
2. E. H. Adelson and J. R. Bergen, “Spatio-temporal energy models for the perception of motion,” J. Opt. Soc. Amer., vol. 2, no. 2, pp. 284–299, 1985.
3. P. Allen, “Real-time motion tracking using spatio-temporal filters,” in Proc. DARPA Image Understanding Workshop, Palo Alto, May 1989.
4. P. K. Allen, B. Yoshimi, and A. Timcenko, “Real-time visual servoing,” in Proc. IEEE Conf. Robotics Automat., 1991, pp. 851–856.
5. P. Anadan, “Measuring visual motion from image sequences,” Tech. Rep. COINS TR-87-21, COINS Dep., Univ. Mass., Amherst, 1987.
6. N. A. Andersen, O. Ravn, and A. T. Sorenson, “Using vision in real-time control systems,” in Proc. Amer. Contr. Conf., 1991.
7. Aspex, PIPE User’s Manual.
8. C. Brown, “Gaze controls with interaction delays,” in Proc. DARPA Image Understanding Workshop, May 23-26, 1989, pp. 200–218.
9. P. J. Burt, J. R. Bergen, R. Hingorani, R. Kolczynski, W. A. Lee, A. Leung, J. Lubin, and H. Shvayster, “Object tracking with a moving camera,” in Proc. IEEE Workshop Visual Motion, Irvine, CA, Mar. 20-22, 1988, pp. 2–12.
10. P. J. Burt, C. Yen, and X. Xu, “Multi-resolution flow-through motion analysis,” in Proc. IEEE CVPR Conf., 1983, pp. 246–252.
11. B. F. Buxton and H. Buxton, “Computation of optic flow from the motion of edge features in image sequences,” Image Vision Comput., vol. 2, 1984.
12. J. J. Clark and N. J. Ferrier, “Control of visual attention in mobile robots,” in Proc. IEEE Conf. Robotics Automat., May 15-19, 1989, pp. 826–831.
13. P. Corke, R. Paul, and K. Wohn, “Video-rate visual servoing for sensory-based robotics,” Tech. Rep., GRASP Lab., Dep. Comput. Inform. Sci., Univ. Pennsylvania, Philadelphia, 1989.
14. I. D. Faux and M. J. Pratt, Computational Geometry for Design and Manufacture. New York: Wiley, 1980.
15. J. T. Feddema and C. S. G. Lee, “Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera,” IEEE Trans. Syst., Man, Cybern., vol. 20, 1990.
16. R. Goldenberg, W. C. Lau, A. She, and A. Waxman, “Progress on the prototype pipe,” in Proc. IEEE Conf. Robotics Automat., Raleigh, NC, Mar. 31-Apr. 3, 1987.
17. H. H. H. Cruse, J. Dean, and R. Schmidt, “Utilization of sensory information for motor control,” in Perspectives on Perception and Action, H. Heuer and A. F. Sanders, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1987, pp. 43–79.
18. K. Hashimoto, T. Kimoto, T. Ebine, and H. Kimura, “Manipulator control with image-based visual servo,” in Proc. IEEE Conf. Robotics Automat., 1991, pp. 2267–2271.
19. V. Hayward and R. Paul, “Robot manipulator control under UNIX,” in Proc. 13th ISIR, Chicago, Apr. 17-21, 1983, pp. 20:32-20:44.
20. D. Heeger, “A model for extraction of image flow,” in 1st Int. Conf. Comput. Vision, London, 1987.
21. B. Hoff and M. Arbib, “Models of trajectory formation and temporal interaction of reach and grasp,” Tech. Rep., Center Neural Eng., Univ., Southern Calif., Los Angeles, 1991.
22. B. K. P. Horn. Robot Vision. Cambridge, MA: M.I.T. Press, 1986.
23. B. K. P. Horn and B. Schunck, “Determining optical flow,” Artif. Intell., vol. 17, pp. 185–203, 1983.
24. N. Houshangi, “Control of a robotic manipulator to grasp a moving target using vision,” in Proc. IEEE Conf. Robotics Automat., 1990.
25. L. B. Jackson. Digital Filters and Signal Processing. Norwell, MA: Kluwer Academic, 1986.
26. E. W. Kent, M. O. Shneier, and R. Lumia, “Pipe: Pipelined image processing engine,” J. Parallel Distributed Comput., vol. 2, pp. 50–78, 1985.
27. A. J. Koivo and N. Houshangi, “Real-time vision feedback for servoing robotic manipulator with self-tuning controller,” IEEE Trans. Syst., Man, Cybem., vol. 21, no. 1, 1991.
28. S. Lee and Y. Kay, “An accurate estimation of 3D position and orientation of a moving object for robot stereo vision: Kalman filter approach,” in Proc. IEEE Conf. Robotics Automat., 1990.
29. S. W. Lee and K. Wohn, “Tracking moving objects by a mobile camera,” Tech. Rep. MS-CIS-88-97, Univ. Pennsylvania, Dep. Comput. Inform. Sci., Philadelphia, Nov. 1988.
30. R. C. Luo, R. E. Mullen, and D. E. Wessell, “An adaptive robotic tracking system using optical flow,” in Proc. IEEE Conf. Robotics Automat., Philadelphia, 1988, pp. 568–573.
31. W. T. Miller, “Real-time application of neural networks for sensor-based control of robots with vision,” IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 825–831, July/Aug. 1989.
32. H. H. Nagel, “On the estimation of dense displacement vector fields from image sequences,” in Proc. Workshop Motion: Representation and Perception, Toronto, 1983, pp. 59–65.
33. N. Papanikolopoulos, T. Kanade, and P. Khosla, “Vision and control techniques for robotic visual tracking,” in Proc. IEEE Conf. Robotics Automat., 1991, pp. 857–863.
34. N. Papanikolopoulos, P. K. Khosla, and T. Kanade, “Adaptive robotic visual tracking,” in Proc. Amer. Contr. Conf., 1991.
35. R. Paul. Robot Manipulators. Cambridge, MA: MIT Press, 1981.
36. B. S. Y. Rao and H. F. Durrant-Whyte, “A fully decentralized algorithm for multi-sensor Kalman filtering,” Tech. Rep. OUEL 1787/89, Dep. Eng. Sci., Univ. Oxford, 1989.
37. R. B. Safadi, “An adaptive algorithm for robotics and computer vision application,” Tech. Rep. MS-CIS-88-05, Dep. Comput. Inform. Sci., Univ. Pennsylvania, Jan. 1988.
38. R. B. Safadi, “An adaptive tracking algorithm for robotics and computer vision application,“Master’s thesis, Univ. Pennsylvania, 1988.
39. G. L. Scott, “Four-line method of locally estimating optic flow,” Image Vision Computing, vol. 5, no. 2, 1986.
40. A. Singh, “An estimation-theoretic framework for image-flow computation,” in Proc. Int. Conf. Comput. Vision (ICCV-90), Kyoto, Japan, Dec. 1990.
41. G. Verghese, K. G. Lynch, and C. R. Dyer, “Real-time motion tracking of three-dimensional objects,” in Proc. IEEE Int. Conf. Robotics Automat., Cincinnati, OH, May 13-18, 1990.
42. L. E. Weiss, A. Sanderson, and C. P. Neuman, “Dynamic sensor-based control of robots with visual feedback,” IEEE J. Robotics Automat., vol. RA-3, pp. 404—417, Oct. 1987.
43. J. Wiklund and G. Granlund, “Tracking of multiple moving objects,” in Time Varying Image Processing and Moving Object Recognition, V. Cappelini, Ed. 1987, pp. 241–249.
44. M. Xie, “Dynamic vision: Does 3d scene perception necessarily need two cameras or just one?” Tech. Rep., Institut National de Recherche en Informatique et en Automatique, 1989.