Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2010, Pages 2074-2081

  Van Den Berg, Jur ^a   Miller, Stephen ^a   Duckworth, Daniel ^a   Hu, Humphrey ^a   Wan, Andrew ^a   Fu, Xiao Yu ^a   Goldberg, Ken ^a   Abbeel, Pieter ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPRENTICESHIP LEARNING; ITERATIVE LEARNING; ITERATIVE LEARNING CONTROL; SMOOTH REFERENCE; SUBTASKS; SURGICAL PROCEDURES; SURGICAL ROBOTS; SURGICAL TASKS;

ROBOTICS; ROBOTS; SURGERY; TRAJECTORIES;

SURGICAL EQUIPMENT;

EID: 77955824508     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2010.5509621     Document Type: Conference Paper

References (33)

1. P. Abbeel, M. Quigley, A. Ng. Using inaccurate models in reinforcement learning. Proc. Int. Conf. on Machine Learning, 2006.
2. J. Adler, S. Chang, M. Murphy, J. Doty, P. Geis, S. Hancock. The cyberknife: a frameless robotic system for radiosurgery. Stereotactic and Functional Neurosurgery 69(1-4):124-8, 1997.
3. B. Anderson, J. Moore. Optimal Control: Linear Quadratic Methods. Prentice-Hall, 1989.
4. H. Asada, S. Liu. Transfer of human skills to neural net robot controllers. Proc. IEEE Int. Conf. on Robotics and Automation, 1991.
5. A. Benabid, P. Cinquin, S. Lavallèe, J. Le Bas, J. Demongeot, and J. de Rougemont. Computer-driven robot for stereotactic surgery connected to CT scan and magnetic resonance imaging: technological design and preliminary results. Applied Neurophysiology 50:153-154, 1987.
6. D. Bertsekas. Dynamic programming and optimal control. Athena Scientific, 2001.
7. C. Birkhimer. Extracting Human Strategies for Use in Robotic Assembly. PhD thesis, Case Western Reserve University, 2005.
8. J. Bobrow, S. Dubowsky, J. Gibson. Time-optimal control of robotic manipulators along specified paths. Int. J. on Robotics Research 4(3):3-17, 1985.
9. D. Bristow, M. Tharayil, A. Alleyne. A survey of iterative learning control; a learning-based method for high-performance tracking control. IEEE Control Systems Magazine, June 2006.
10. M. Çavuşoǧlu, F. Tendick, M. Cohn, S. Sastry. A laparoscopic telesurgical workstation. IEEE Trans. on Robotics and Automation 15(4):728-739, 1999.
11. A. Coates, P. Abbeel, A. Ng. Learning for control from multiple demonstrations. Proc. Int. Conf. on Machine Learning, 2008.
12. A. de Luca, S. Panzieri. A simple iterative scheme for learning gravity compensation in robot arms. Proc. Ann. Conf. ANIPLA, 1992.
13. A. Dempster, N. Laird, D. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 1977.
14. B. Hannaford, P. Lee. Hidden markov model analysis of force/torque information in telemanipulation. Lecture Notes in Control and Information Sciences 139:135-149, 1989.
15. K. Itabashi, K. Hayakawa, T. Suzuki, S. Okuma, F. Fujiwara. Modeling of the peg-in-hole task based on impedance parameters and HMM. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, 1997.
16. D. Jacobson, D. Mayne. Differential Dynamic Programming. Elsevier Publishers, 1970.
17. M. Jordan. An introduction to probabilistic graphical models. In preparation, 2009.
18. M. Kaiser, R. Dillmann. Building elementary robot skills from human demonstration. Proc. IEEE Int. Conf. on Robotics and Automation, 1996.
19. Z. Kolter, P. Abbeel, A. Ng. Hierarchical apprenticeship learning with application to quadruped locomotion. Neural Information Processing Systems 20, 2008.
20. Z. Kolter, A. Ng. Policy search via the signed derivative. Proc. Robotics: Science and Systems, 2009.
21. T. Kowalewski, J. Rosen, L. Chang, M. Sinanan, B. Hannaford. Optimization of a vector quantization codebook for objective evaluation of surgical skill. Studies in health technology and Informatics 98:174-179, 2004.
22. H. Lin, I. Shafran, D. Yuh, G. Hager. Towards automatic skill evaluation: detection and segmentation of robot-assisted surgical motions. Computer Aided Surgery 11(5):220-230, 2006.
23. H. Mayer, I. Nagy, D. Burschka, A. Knoll, E. Braun, R. Lange, R. Bauernschmitt. Automation of manual tasks for minimally invasive surgery. Int. Conf. on Autonomic and Autonomous Systems, 2008.
24. H. Mayer, I. Nagy, A. Knoll, E. Braun, R. Bauernschmitt. Adaptive control for human-robot skill transfer: trajectory planning based on fluid dynamics. Proc. IEEE Int. Conf. on Robotics and Automation, 2007.
25. K. Moore. Iterative learning control for deterministic systems. Springer-Verlag, New York, 1993.
26. D. Myers. An approach to automated programming of industrial robots. Proc. IEEE Int. Conf. on Robotics and Automation, 1999.
27. S. Needleman, C. Wunsch. A general method applicable to the search for similarities in the amino acid sequence of two proteins. Journal of Molecular Biology, 1970.
28. H. Rauch, F. Tung, C. Striebel. Maximum likelihood estimates of linear dynamic systems. AIAA Journal 3:1445-1450, 1965.
29. J. Rosen, B. Hannaford, C. Richards, M. Sinanan. Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills. IEEE Trans. on Biomedical Engineering 48(5):579-591, 2001.
30. H. Sakoe, S. Chiba. Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1978.
31. M. Skubic, R. Volz. Acquiring robust, force based assembly skills from human demonstration. IEEE Trans. on Robotics and Automation 16(6):772-781, 2000.
32. R. Taylor, B. Mittelstadt, H. Paul, W. Hanson, P. Kazanzides. An image-directed robotics system for precise orthopaedic surgery. IEEE Trans. on Robotics and Automation 10(3):261-275, 1994.
33. Y. Yamakawa, A. Namiki, M. Ishikawa, M. Shimojo. One-handed knotting of a flexible rope with a high-speed multifingered hand having tactile sensors. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, 2007.