Selective automation and skill transfer in medical robotics: A demonstration on surgical knot-tying

International Journal of Medical Robotics and Computer Assisted Surgery

Volumn 8, Issue 4, 2012, Pages 384-397

  Knoll, Alois ^a   Mayer, Hermann ^a   Staub, Christoph ^a   Bauernschmitt, Robert ^b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b Medizinische Klinik   (Germany)

Author keywords

Automated surgery; Imitation; Learning by demonstration; Medical robotics; Scaffolding; Skill transfer

Indexed keywords

DEMONSTRATIONS; ROBOTIC SURGERY; SCAFFOLDS; SURGICAL EQUIPMENT; TEACHING;

AUTOMATED SURGERY; HUMAN MANIPULATION; IMITATION; KNOT-TYING; LEARNING BY DEMONSTRATION; MEDICAL ROBOTICS; NON-TRIVIAL; ROBOTS SYSTEM; SCAFFOLDING; SKILL TRANSFER;

MACHINE DESIGN;

ARTICLE; AUTOMATION; COMPUTER INTERFACE; HUMAN; ROBOTICS; SKILL TRANSFER; SUTURING METHOD; TASK PERFORMANCE;

EID: 84870398309     PISSN: 14785951     EISSN: 1478596X     Source Type: Journal    
DOI: 10.1002/rcs.1419     Document Type: Article

References (36)

1. Harada K, Tsubouchi K, Chiba T, Fujie M. Micro manipulators for intrauterine fetal surgery in an open MRI. In Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005; 502-507.
2. Swanstrom L, Whiteford M, Khajanchee Y. Developing essential tools to enable transgastric surgery. J Surg Endosc 2008; 22(3): 600-604.
3. Mayer H, Nagy I, Knoll A, Schirmbeck EU, Bauernschmitt R. Robotic system to evaluate force feedback in minimally invasive surgery. In Proceedings of DETC, ASME Design Engineering Technical Conferences, Salt Lake City, USA, 2004, nr. 57046 [CD ROM].
4. Mayer H, Nagy I, Knoll A. Kinematics and modeling of a system for robotic surgery. On Advances in Robot Kinematics. Kluwer Academic Publishers: Sestri Levante, Italy, 2004; 181-190.
5. Kang H. Robotic assisted suturing in minimally invasive surgery. Ph.D. Thesis, Rensselaer Polytechnic Institute, Troy, New York, 2002.
6. Hynes P, Dodds G, Wilkinson A. Uncalibrated visual-servoing of a dual-arm robot for MIS suturing. In Proceedings of the IEEE International Conference on Biomedical Robotics and Biomechatronics, Pisa, Italy, 2006; 204-209.
7. Wakamatsu H, Tsumaya A, Arai E, Hirai S. Manipulation planning for knotting/unknotting and tightly tying of deformable linear objects. In Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005; 2516-2521.
8. Kitagawa M, Okamura A, Bethea B, Gott V, Baumgartner W. Analysis of suture manipulation forces for teleoperation with force feedback. In Proceedings of the 5th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), Vol. 2488, Dohi T, Kikinis R (eds). Lecture Notes in Computer Science, Springer-Verlag, 2002; 155-162.
9. Cao C, MacKenzie C, Payandeh S. Task and motion analyses in endoscopic surgery. In Proceedings ASME Dynamic Systems and Control Division, Atlanta, USA, 1996; 583-590.
10. Blackwell A, Jansen A, Marriott K. Restricted focus viewer: a tool for tracking visual attention. In Theory and Application of Diagrams, Vol. 1889, Anderson M, Cheng P, Haarslev V (eds). Lecture Notes in Artificial Intelligence (LNAI), Springer-Verlag, 2000; 162-177.
11. Accot J, Zhai S. Beyond Fitts' law: models for trajectory-based HCI tasks. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA, 1997; 295-302.
12. Fitts P. The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psychol 1954; 47: 381-391.
13. Kaiser M, Dillmann R. Building elementary skills from human demonstration. In Proceedings of the IEEE International Conference on Robotics and Automation, Minneapolis, Minnesota, USA, 1996; 2700-2705.
14. Schaal S, Peters J, Nakanishi J, Ijspeert A. Learning movement primitives. Springer Tracts in Advanced Robotics: International Symposium on Robotics Research (ISRR), Siena, Italy, 2004 rec-nr. 1805.
15. Reng L, Moeslund T, Granum E. Finding motion primitives in human body gestures. In 6th International Gesture Workshop, Vol. 3881, Gibet S, Courty N, Kamp J (eds). Lecture Notes in Artificial Intelligence (LNAI), Springer-Verlag, 2006; 133-144.
16. Sielhorst T, Blum T, Navab N. Synchronizing 3D movements for quantitative comparison and simultaneous visualization of actions. In Proceedings of the Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Vienna, Austria, 2005; 38-47.
17. Zhang J, Knoll A. Control architecture and experiment of a situated robot system for interactive assembly. In Proceedings of the IEEE International Conference on Robotics and Automation, Washington, D.C., USA, 2002; 3906-3910.
18. Kruijff G, Zender H, Jensfelt P, Christensen H. Situated dialogue and understanding spatial organization: knowing what is where and what you can do there. In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication, Hatfield, United Kingdom, 2006; 328-333.
19. Vygotsky L. Mind in Society: Development of Higher Psychological Processes (14th edn edn). Harvard University Press: Cambridge, MA, USA, 1978.
20. Wood D, Bruner J, Ross G. The Role of tutoring in problem-solving. J Child Psychol Psychiat 1976; 17: 89-100.
21. Mayer H, Burschka D, Knoll A, Braun EU, Lange R, Bauernschmitt R. Human-machine skill transfer extended by a scaffolding framework. In Proceedings of the IEEE International Conference on Robotics and Automation, Pasadena, California, USA, 2008; 2866-2871.
22. Aflalo T, Graziano M. Possible origins of the complex topographic organization of motor cortex: reduction of a multidimensional space onto a two-dimensional array. J Neurosci 2006; 26(23): 6288-6297. Stanford University's HighWire Press
23. Amirikian B, Georgopoulos A. Modular organization of directionally tuned cells in the motor cortex: is there a short-range order? Proc Natl Acad Sci USA 2003; 100(21): 12474-12479.
24. Umeyama S. Least-squares estimation of transformation parameters between two point patterns. IEEE Trans Pattern Anal Mach Intell 1991; 13(4): 373-380.
25. Schaal S, Ijspeert A, Billard A. Computational approaches to motor learning by imitation. Philos T Roy Soc B 2003; 358(1431): 537-547.
26. Ijspeert A, Crespi A, Cabelguen J. Simulation and robotic studies of salamander locomotion. Applying neurobiological principles to the control of locomotion in robots. Neuroinformatics 2005; 3(3): 171-196.
27. Okada M, Osato K, Nakamura Y. Motion emergency of humanoid robots by an attractor design of a nonlinear dynamics. In Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005; 18-23.
28. Dixon K, Khosla P. Trajectory representation using sequenced linear dynamical systems. In Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005; 3925-3930.
29. Chung T. Computational Fluid Dynamics. Cambridge University Press: New York, USA, 2002.
30. Griebel T, Dornseifer T, Neunhoeffer T. Numerical simulation in fluid dynamics. A practical introduction. SIAM Monographs on Mathematical Modeling and Computation no. 3, Society for Industrial and Applied Mathematics, Philadelphia, USA, 1997.
31. Demiris Y, Billard A. Special issue on robot learning by observation, demonstration, and imitation. IEEE Trans Syst Man Cy B 2007; 37(2): 254-255.
32. Calinon S, Guenter F, Billard A. On learning, representing, and generalizing a task in a humanoid robot. IEEE Trans Syst Man Cy B 2007; 37(2): 286-298.
33. Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O. Validation of knowledge acquisition for surgical process models. J Am Med Inform Assoc 2009; 16(1): 7280.
34. Reiley C, Lin H, Varadarajan B, Khudanpur S, Yuh D, Hager G. Automatic Recognition Using Statistical Modeling for Capturing Variability of Surgical Motions, Medicine Meets Virtual Reality Conference (MMVR), Long Beach, CA, USA, Jan. 2008.
35. Zöllner R, Pardowitz M, Knoop S, Dillmann R. Towards cognitive robots: building hierarchical task representation of manipulations from human demonstrations. Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, April 2005.
36. Mayer H, Nagy I, Knoll A, Braun EU, Bauernschmitt R, Lange R. Haptic feedback in a telepresence system for endoscopic heart surgery. Presence-Teleop Virt 2007; 16(5): 459-470. MIT-Press