Human-machine collaborative surgery using learned models

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2011, Pages 5285-5292

  Padoy, Nicolas ^a   Hager, Gregory D ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED CONTROL; AUTOMATED TASKS; FULL CONTROL; HUMAN-MACHINE; HUMAN-MACHINE COLLABORATION; LEARNING FROM DEMONSTRATION; MASTER MANIPULATOR; PERFORMANCE ENHANCEMENTS; ROBOTIC ASSISTANTS; SUBTASKS; SURGICAL TASKS; TELEOPERATED;

AUTOMATION; HIDDEN MARKOV MODELS; SURGERY;

ROBOTICS;

EID: 84867434923     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2011.5980250     Document Type: Conference Paper

References (27)

1. H. C. Lin, I. Shafran, D. Yuh, and G. D. Hager, "Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions," Computer Aided Surgery, vol. 11, no. 5, pp. 220-230, 2006.
2. J. van den Berg, S. Miller, D. Duckworth, H. Hu, A. Wan, X.-Y. Fu, K. Goldberg, and P. Abbeel, "Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations," in ICRA, 2010, pp. 2074-2081.
3. H. G. Mayer, F. J. Gomez, D. Wierstra, I. Nagy, A. Knoll, and J. Schmidhuber, "A system for robotic heart surgery that learns to tie knots using recurrent neural networks," in IROS, 2006, pp. 543-548.
4. F. Nageotte, P. Zanne, C. Doignon, and M. de Mathelin, "Stitching planning in laparoscopic surgery: Towards robot-assisted suturing," I. J. Robotic Res., vol. 28, no. 10, pp. 1303-1321, 2009. tm
5. G. Guthart and J. K. S. Jr., "The intuitive telesurgery system: Overview and application," in ICRA, 2000, pp. 618-621.
6. J. Rosen, J. Brown, L. Chang, M. Sinanan, and B. Hannaford, "Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete markov model," IEEE Trans. on Biomedical Engineering, vol. 53, no. 3, pp. 399-413, 2006.
7. B. Varadarajan, C. E. Reiley, H. Lin, S. Khudanpur, and G. D. Hager, "Data-derived models for segmentation with application to surgical assessment and training," in MICCAI (1), 2009, pp. 426-434.
8. C. Staub, T. Osa, A. Knoll, and R. Bauernschmitt, "Automation of tissue piercing using circular needles and vision guidance for computer aided laparoscopic surgery," in ICRA, 2010, pp. 4585-4590.
9. D. Kragic and G. Hager, "Task modeling and specification for modular sensory based human-machine cooperative systems," in IROS, 2003, pp. 3192-3197.
10. B. P. L. Lo, A. Darzi, and G.-Z. Yang, "Episode classification for the analysis of tissue/instrument interaction with multiple visual cues," in International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2003, pp. 230-237.
11. K. Yoshimitsu, F. Miyawaki, T. Sadahiro, K. Ohnuma, Y. Fukui, D. Hashimoto, and K. Masamune, "Development and evaluation of the second version of scrub nurse robot (snr) for endoscopic and laparoscopic surgery," in IROS, 2007, pp. 2288-2294.
12. S. Speidel, G. Sudra, J. Senemaud, M. Drentschew, B. P. Mller-Stich, C. Gutt, and R. Dillmann, "Recognition of risk situations based on endoscopic instrument tracking and knowledge based situation modeling," in Med. Imaging. SPIE, 2008.
13. N. Padoy, T. Blum, A. Ahmadi, H. Feussner, M.-O. Berger, and N. Navab, "Statistical modeling and recognition of surgical workflow," Medical Image Analysis, doi:10.1016/j.media.2010.10.001, 2010.
14. N. Padoy, D. Mateus, D. Weinland, M.-O. Berger, and N. Navab, "Workflow monitoring based on 3d motion features," in Proceedings of the International Conference on Computer Vision Workshops, IEEE Workshop on Video-oriented Object and Event Classification, 2009.
15. F. Devernay, F. Mourgues, and È. Coste-Manière, "Towards endoscopic augmented reality for robotically assisted minimally invasive cardiac surgery," in MIAR, 2001, pp. 16-20.
16. J. Leven, D. Burschka, R. Kumar, G. Zhang, S. Blumenkranz, X. Dai, M. Awad, G. Hager, M. Marohn, M. Choti, C. Hasser, and R. Taylor, "Davinci canvas: A telerobotic surgical system with integrated, robot-assisted, laparoscopic ultrasound capability," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2005, Lecture Notes In Computer Science (LNCS), vol. 4190, 2005, pp. 811-818.
17. B. Vagvolgyi, S. P. DiMaio, A. Deguet, P. Kazanzides, R. Kumar, C. Hasser, and R. H. Taylor, "The surgical assistant workstation," Insight Journal. [Online]. Available: http://hdl.handle.net/10380/1466
18. J.-B. Gómez, A. Ceballos, F. Prieto, and T. Redarce, "Mouth gesture and voice command based robot command interface," in ICRA, 2009, pp. 333-338.
19. S. DiMaio and C. Hasser, "The da vinci research interface," Insight Journal. [Online]. Available: http://hdl.handle.net/10380/1464
20. L. R. Rabiner, "A tutorial on hidden markov models and selected applications in speech recognition," Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, 1989.
21. K. Wang and T. Gasser, "Alignment of curves by dynamic time warping," Annals of Statistics, vol. 25, no. 3, pp. 1251-1276, 1997.
22. S.-A. Ahmadi, T. Sielhorst, R. Stauder, M. Horn, H. Feussner, and N. Navab, "Recovery of surgical workflow without explicit models," in International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2006, pp. 420-428.
23. H. Sakoe and S. Chiba, "Dynamic programming algorithm optimization for spoken word recognition," IEEE Trans. Acoust. Speech Signal Process., vol. 26, no. 1, pp. 43-49, 1978.
24. E. B. Dam, M. Koch, and M. Lillholm, "Quaternions, interpolation and animation," University of Copenhagen, Tech. Rep. DIKU-TR-98/5, 1998.
25. F. L. Markley, Y. Cheng, J. L. Crassidis, and Y. Oshman, "Averaging quaternions," Journal of Guidance, Control, and Dynamics, vol. 30, no. 4, pp. 1193-1196, 2007.
26. F. Zhou and F. De la Torre, "Canonical time warping for alignment of human behavior," in Advances in Neural Information Processing Systems Conference (NIPS), December 2009.
27. A. Deguet, R. Kumar, R. Taylor, and P. Kazanzides, "The cisst libraries for computer assisted intervention systems," Insight Journal. [Online]. Available: http://hdl.handle.net/10380/1465a