Force and vision resolvability for assimilating disparate sensory feedback

IEEE Transactions on Robotics and Automation

Volumn 12, Issue 5, 1996, Pages 714-731

  Nelson, Bradley J ^b   Khosla, Pradeep K ^a,c  

^a IEEE

^b 1120 Science and Engineering Offices   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Force control; Intelligent control; Intelligent systems; Sensor integration; Visual servoing

Indexed keywords

EXPERIMENTS; FORCE CONTROL; INTELLIGENT CONTROL; MANIPULATORS; SENSORS;

INTELLIGENT SYSTEMS; SENSOR INTEGRATION; VISUAL SERVOING;

STEREO VISION;

EID: 0030263628     PISSN: 1042296X     EISSN: None     Source Type: Journal    
DOI: 10.1109/70.538976     Document Type: Article

References (58)

1. H. F. Durrant-Whyte, Integration, Coordination and Control of Multi-Sensor Robot Systems. Norwell, MA: Kluwer, 1988.
2. G. D. Hager, Task-Directed Sensor Fusion and Planning - A Computational Approach. Norwell, MA: Kluwer, 1990.
3. J. M. Richardson and K. A. Marsh, "Fusion of multisensor data," Int. J. Robot. Res., vol. 7, no. 6, p. 7896, 1988.
4. R. C. Smith and P. Cheeseman, "On the representation and estimation of spatial uncertainty," Int. J. Robot. Res., vol. 5, no. 4, pp. 56-68, 1986.
5. R. Jain, "Environment models and information assimilation," IBM, Yorktown Heights, NY, Tech. Rep. RJ 6866 (65692), 1989.
6. B. Nelson and P. K. Khosla, "Integrating sensor placement and visual tracking strategies,: in Experimental Robotics III: The Third International Symposium, Kyoto, Oct. 28-30 1993, T. Yoshikawa and F. Miyazaki, Eds. London: Springer-Verlag: 1993, pp. 169-181.
7. _, "The resolvability ellipsoid for visual servoing," in Proc. 1994 Conf. Computer Vision and Pattern Recognition (CVPR94), 1994, pp. 829-832.
8. D. E. Whitney, "Historical perspective and state of the art on robot force control," in Proc. 1985 Int. Conf. Robotics and Automation, 1985, pp. 262-268.
9. N. Hogan, "Impedance control: An approach to manipulation, Parts I-III," ASME J. Dyn. Sys., Meas., Contr., vol. 107, no. 1, pp. 1-24, 1985.
10. M. H. Raibert and J. J. Craig, "Hybrid position/force control of manipulators," ASME J. Dyn. Sys., Meas., Contr., vol. 103, no. 2, pp. 126-133, 1981.
11. T. Yoshikawa, "Dynamic hybrid position/force control of robot manipulators-description of hand constraints and calculation of joint driving force," IEEE J. Robot. Automat., vol. 3, no. 5, pp. 386-392, 1987.
12. R. A. Volpe and P. K. Khosla, "Experimental verification of a strategy for impact control," in Proc. 1991 IEEE Int. Conf. Robotics and Automation, 1991, pp. 1854-1860.
13. C. An and J. Hollerbach, "Dynamic stability issues in force control of manipulators," in Proc. 1987 Int. Conf. Robotics and Automation, 1987, pp. 860-896.
14. S. Eppinger and W. Seering, "Understanding bandwidth limitations on robot force control," in Proc. 1987 Int. Conf. Robotics and Automation 1987, pp. 904-909, 1987.
15. J. M. Hyde and M. R. Cutkosky, "Contact transition: An experimental study," in Proc. 1993 Int. Conf. Robotics and Automation, 1993, pp. 363-368.
16. N. Hogan, "Stable execution of contact tasks using impedance control," in Proc. 1987 Int. Conf. Robotics and Automation, 1987, pp. 1047-1054.
17. H. Kazerooni, "Robust, nonlinear impedance control for robot manipulators" in Proc. 1987 Int. Conf. Robotics and Automation, 1987, pp. 741-750.
18. O. Khatib and J. Burdick, "Motion and force control for robot manipulators," in Proc. 1986 Int. Conf. Robotics and Automation, 1986, pp. 1381-1386.
19. H. P. Qian and J. De Schutter, "Introducing active linear and nonlinear damping to enable stable high gain force control in case of stiff contact," in Proc. 1992 Int. Conf. Robotics and Automation, 1992, pp. 1374-1379.
20. Y. Xu, J. M. Hollerbach, and D. Ma, "Force and contact transient control using nonlinear PD control," in Proc 1994 Int. Conf. Robotics and Automation, 1994, pp. 924-930.
21. S. Shirai and H. Inoue, "Guiding a robot by visual feedback in assembling tasks," Pattern Recognition, vol. 5, pp. 99-108, 1973.
22. L. E. Weiss, "Dynamic visual servo control of robots: An adaptive image-based approach," Ph.D. Dissertation, CMU-RI-TR-84-16, The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, 1984.
23. P. K. Allen, "Real-time motion tracking using spatio-temporal filters," in Proc. Image Understanding Workshop, 1989, pp. 695-701.
24. P. I. Corke and R. P. Paul, "Video-rate visual servoing for robots," in Lecture Notes in Control and Information Science, V. Hayward and O. Khatib, Eds. London: Springer-Verlag, 1989, pp. 429-451.
25. B. Espiau, F. Chaumette, and P. Rives, "A new approach to visual servoing in robotics," IEEE Trans. Robotics Automat., vol. 8, no. 3, pp. 313-326, 1992.
26. K. Hashimoto and H. Kimura, "LQ optimal and nonlinear approaches to visual servoing," Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback, K. Hashimoto, Ed. London: World Scientific, 1993, pp. 165-198.
27. J. T. Feddema and C. S. G. Lee, "Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera," IEEE Trans. Syst., Man, Cybern., vol. 20, no. 5, pp. 1172-1183, 1990.
28. B. K. Ghosh, M. Jankovic, and Y. T. Wu, "Some problems in perspective system theory and its application to machine vision," in Proc. 1992 IEEE/RSJ Int. Conf. Int. Robots and Sys. (IROS92), 1992, pp. 139-146.
29. N. P. Papanikolopoulos, P. K. Khosla, and T. Kanade, "Adaptive robotic visual tracking," in Proc. Amer. Contr. Conf., American Automation Control Council, Evanston, IL, 1991, pp. 962-967.
30. L. E. Weiss, A. C. Sanderson, and C. P. Neuman, "Dynamic sensor-based control of robots with visual feedback," IEEE J. Robotics Automat., vol. RA-3, no. 5, pp. 404-417, 1987.
31. W. J. Wilson, "Visual servo control of robots using kalman filter estimates of robot pose relative to work-pieces," Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback. K. Hashimoto, Ed. London: World Scientific, 1993, pp. 71-104.
32. A. Castano and S. Hutchinson, "Visual compliance: Task-directed visual servo control," IEEE Trans. Robot. Automat., vol. 10, no. 3, pp. 334-342, 1994.
33. G. D. Hager, "Robot feedback control based on stereo vision: Toward calibration-free hand-eye coordination," in Proc. 1994 Int. Conf. Robotics and Automation, pp. 2850-2856, 1994.
34. A. J. Koivo and N. Houshangi, "Real-time vision feedback for servoing of a robotic manipulator with self-tuning controller," IEEE Trans. Syst., Man, Cybern., vol. 21, no. 1, pp. 134-142, 1991.
35. B. Nelson, N. P. Papanikolopoulos, and P. K. Khosla, "Visual servoing for robotic assembly," Visual Servoing - Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback, K. Hashimoto, Ed. River Edge. NJ: World Scientific, 1993, pp. 139-164.
36. K. Hosoda and M. Asada, "Versatile visual servoing without knowledge of true jacobian," in Proc. 1994 IEEE/RSJ Int. Conf. Int. Robots and Systems (IROS94), 1994, vol. 1, pp. 186-193.
37. N. Maru, H. Kase, S. Yamada, A. Nishikawa, and F. Miyazaki, "Manipulator control by visual servoing with the stereo vision," in Proc. 1993 IEEE/RSJ Int. Conf. Int. Robots and Systems (IROS93), 1993, pp. 1866-1870.
38. P. I. Corke, "Visual control of robot manipulators - A review," Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback, K. Hashimoto, Ed. London: World Scientific, 1993, pp. 1-31.
39. C. K. Cowan and P. D. Kovesi, "Automatic sensor placement from vision task requirements," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 5, pp. 407-416, 1988.
40. K. Tarabanis, R. Y. Tsai, and P. K. Allen, "Satisfying the resolution constraint in the "MVP" machine vision planning system," in Proc. 1990 Darpa Image Understanding Workshop, 1990, pp. 850-860.
41. S. Yi, R. M. Haralick, and L. G. Shapiro, "Automatic sensor and light positioning for machine vision," in Proc. 10th Int. Conf. on Pattern Recognition, 1990, pp. 55-59.
42. S. Das and N. Ahuja, "A comparative study of stereo, vergence, and focus as depth cues for active vision," in Proc. 1993 Computer Vision and Pattern Recognition Conf. (CVPR-93), 1993, pp. 194-199.
43. R. Sharma and S. Hutchinson, "On the observability of robot motion under active camera control," in Proc. 1994 Int. Conf. Robotics Autom., 1994, pp. 162-167.
44. _, "Optimizing hand/eye configuration for visual-servo systems," in Proc. 1995 Int. Conf. on Robotics and Automation, 1995, pp. 172-177.
45. T. Yoshikawa, "Manipulability of robotic mechanisms," Robotics Research 2, H. Hanafusa and H. Inoue, Eds. Cambridge, MA: MIT Press, 1985, pp. 439-446.
46. Y. Nakamura, T. Yoshikawa, and I. Futamata, "Design and signal processing of six-axis force sensors," Robotics Research 4, R. Bolles and B. Roth, Eds. Cambridge, MA: MIT Press, 1988, pp. 75-81.
47. M. Uchiyama, E. Bayo, and E. Palma-Villalon, "A systematic design procedure to minimize a performance index for robot force sensors," J. Dyn., Sys., Meas., Contr., vol. 113, no. 9, pp. 388-394, Sept. 1991.
48. J. Ishikawa, K. Kosuge, and K. Furuta, "Intelligent control of assembling robot using vision sensor," in Proc. 1985 Int. Conf. on Robotics and Automation, 1990, pp. 1904-1909.
49. H. F. Durrant-Whyte, "Consistent integration and propagation of disparate sensor observation," Int. J. Robot. Res., vol. 6, no. 3, pp. 3-24, 1987.
50. P. K. Allen, "Integrating vision and touch for object recognition tasks," Int. J. Robot. Res., vol. 7, no. 6, pp. 15-33, 1988.
51. S. A. Stansfield, "A robotic perceptual system utilizing passive vision and active touch," Int. J. Robot. Res., vol. 7, no. 6, pp. 138-161, 1988.
52. V. C. Klema and A. I. Laub, "The singular value decomposition: Its computation and some applications," IEEE Trans. Automat. Contr., vol. 25, no. 2, pp. 164-176, 1980.
53. J. O. Kim, P. Khosla, and W. K. Chung, "Static modeling and control of redundant manipulators," Robot. Comp.-Integ. Manufact., vol. 9, no. 2, pp. 145-157, 1992.
54. N. P. Papanikolopoulos, B. Nelson, and P. K. Khosla, "Full 3-D tracking using the controlled active vision paradigm," in Proc. 1992 IEEE Int. Symp. Int. Contr. (ISIC-92), 1992, pp. 267-274.
55. P. Anandan, "Measuring visual motion from image sequences," Univ. of Massachusetts, Amherst, Dept. COINS, Tech. Rep. COINS-TR-87-21, 1987.
56. C. Tomasi and T. Kanade, "Detection and tracking of point features," Carnegie Mellon Univ., School of Computer Science, Pittsburgh, PA, Tech. Rep. CMU-CS-91-132, 1991.
57. D. E. Whitney, "Force feedback control of manipulator fine motions," ASME J. Dyn. Sys. Meas. Contr., pp. 91-97, June 1977.
58. D. B. Stewart, D. E. Schmitz, and P. K. Khosla, "The chimera II real-time operating system for advanced sensor-based control systems," IEEE Trans. Syst., Man, Cybern., vol. 22, pp. 1282-1295, 1992.