Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2016-June, Issue , 2016, Pages 4178-4185

  Sen, Siddarth ^a   Garg, Animesh ^a   Gealy, David V ^b   McKinley, Stephen ^b   Jen, Yiming ^a   Goldberg, Ken ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; CONVEX OPTIMIZATION; NEEDLES; ROBOT PROGRAMMING; SURGERY; SURGICAL EQUIPMENT;

COMPLETION TIME; CONTROL PARAMETERS; ERROR REDUCTION; MINIMALLY INVASIVE SURGERY; SEQUENTIAL CONVEX PROGRAMMING; TISSUE PHANTOM;

ROBOTICS;

EID: 84977494017     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2016.7487611     Document Type: Conference Paper

References (36)

1. J. M. Burch, R. J. Franciose, E. E. Moore, W. L. Biffl, and P. J. Offner, "Single-layer continuous versus two-layer interrupted intestinal anastomosis: A prospective randomized trial, " Annals of surgery, 2000.
2. A. Darzi and Y. Munz, "The impact of minimally invasive surgical techniques, " Annu. Rev. Med., 2004.
3. F. De Goes, S. Goldenstein, and L. Velho, "A hierarchical segmentation of articulated bodies, " in Computer Graphics Forum, 2008.
4. Y. Duan, S. Patil, J. Schulman, K. Goldberg, and P. Abbeel, "Planning locally optimal, curvature-constrained trajectories in 3D using sequential convex optimization, " in 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014.
5. Y. Gao, S. Vedula, C. Reiley, N. Ahmidi, B. Varadarajan, H. Lin, L. Tao, L. Zappella, B. Bejar, D. Yuh, C. Chen, R. Vidal, S. Khudanpur, and G. Hager, "The JHU-ISI Gesture and Skill Assessment Dataset (JIGSAWS): A Surgical Activity Working Set for Human Motion Modeling, " in Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2014.
6. J. Hochberg, K. M. Meyer, and M. D. Marion, "Suture choice and other methods of skin closure, " Surgical Clinics of North America, vol. 89, no. 3, pp. 627-641, 2009.
7. Intuitive Surgical, "Annual report 2014. " [Online]. Available: http://investor. intuitivesurgical. com/phoenix. zhtml?c=122359& p=irol-IRHome
8. M. C. Jackson, Russell C. And Cavusoglu, "Modeling of needle-tissue interaction forces during surgical suturing, " in 2012 IEEE International Conference on Robotics and Automation (ICRA), 2012.
9. R. C. Jackson and M. C. Cavusoglu, "Needle path planning for autonomous robotic surgical suturing, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2013.
10. R. C. Jackson, R. Yuan, D.-L. Chow, W. Newman, and M. C. Cavusoglu, "Automatic initialization and dynamic tracking of surgical suture threads, " in IEEE Int. Conf. Robotics and Automation, 2015.
11. H. Kang and J. T. Wen, "Autonomous suturing using minimally invasive surgical robots, " in Control Applications, 2000. Proceedings of the 2000 IEEE International Conference on. IEEE, 2000, pp. 742-747.
12. P. Kazanzides, Z. Chen, A. Deguet, G. Fischer, R. Taylor, and S. DiMaio, "An Open-Source Research Kit for the da Vinci Surgical System, " in IEEE Int. Conf. Robotics and Automation (ICRA), 2014.
13. B. Kehoe, G. Kahn, J. Mahler, J.-H. Kim, A. Lee, A. Lee, K. Nakagawa, S. Patil, W. D. Boyd, P. Abbeel, and K. Goldberg, "Autonomous multilateral debridement with the Raven surgical robot, " Robotics and Automation (ICRA), 2014 IEEE International Conference on, 2014.
14. M. Kranzfelder, C. Staub, A. Fiolka, A. Schneider, S. Gillen, D. Wilhelm, H. Friess, A. Knoll, and H. Feussner, "Toward increased autonomy in the surgical or: needs, requests, and expectations, " Surgical endoscopy, vol. 27, no. 5, pp. 1681-1688, 2013.
15. S. Krishnan, A. Garg, S. Patil, C. Lea, G. Hager, P. Abbeel, and K. Goldberg (denotes equal contribution), "Transition state clustering: Unsupervised surgical trajectory segmentation for robot learning, " in Int. Sym. of Robotics Research. Springer STAR, 2015.
16. C. Lea, G. D. Hager, and R. Vidal, "An improved model for segmentation and recognition of fine-grained activities with application to surgical training tasks, " in Applications of Computer Vision (WACV), 2015 IEEE Winter Conference on. IEEE, 2015, pp. 1123-1129.
17. D. Martin, J. Woodard, C. Shurtleff, and A. Yoo, "Articulating needle driver, " Nov. 15 2012, US Patent App. 13/466, 188.
18. H. G. Mayer, F. J. Gomez, D. Wierstra, I. Nagy, A. Knoll, and J. Schmidhuber, "A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks. " IROS, 2006.
19. S. McKinley, S. Sen, A. Garg, Y. Jen, D. Gealy, P. Abbeel, and K. Goldberg, "Autonomous Tumor Localization and Extraction: Palpation, Incision, Debridement and Adhesive Closure with the da Vinci Research Kit, " Hamlyn Surgical Robotics Conference, London.
20. G. Moustris, S. Hiridis, K. Deliparaschos, and K. Konstantinidis, "Evolution of Autonomous and Semi-Autonomous Robotic Surgical Systems: A Review of the Literature, " Int. Journal of Medical Robotics and Computer Assisted Surgery, vol. 7, no. 4, pp. 375-392, 2011.
21. A. Murali, S. Sen, B. Kehoe, A. Garg, S. Patil, W. D. Boyd, S. Lim, P. Abbeel, and K. Goldberg, "Learning by Observation for Surgical Subtasks: Multilateral Cutting of 3D Viscoelastic and 2D Orthotropic Tissue Phantoms, " in IEEE Int. Conf. Robotics and Automation, 2015.
22. A. Myronenko and X. Song, "Point set registration: Coherent point drift, " IEEE Tran. on Pattern Analysis and Machine Intelligence, 2010.
23. F. Nageotte, C. Doignon, M. de Mathelin, P. Zanne, and L. Soler, "Circular needle and needle-holder localization for computer-aided suturing in laparoscopic surgery, " pp. 87-98.
24. S. Niekum, S. Osentoski, G. Konidaris, S. Chitta, B. Marthi, and A. G. Barto, "Learning Grounded Finite-State Representations from Unstructured Demonstrations, " Int. J. of Robotics Research, 2015.
25. C. C. L. or Open Resection Study Group et al., "Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial, " The lancet oncology, 2005.
26. N. Padoy and G. Hager, "Human-Machine Collaborative Surgery using Learned Models, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2011, pp. 5285-5292.
27. S. Patil, Y. Duan, J. Schulman, K. Goldberg, and P. Abbeel, "Gaussian belief space planning with discontinuities in sensing domains, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2014.
28. S. Qureshi, K. Rupp, and B. Thompson, "Needle holder with suture filament grasping abilities, " Sept. 14 1999, uS Patent 5, 951, 587.
29. C. E. Reiley and G. D. Hager, "Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery, " in Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2009.
30. J. Schulman, Y. Duan, J. Ho, A. Lee, I. Awwal, H. Bradlow, J. Pan, S. Patil, K. Goldberg, and P. Abbeel, "Motion planning with sequential convex optimization and convex collision checking, " The International Journal of Robotics Research, 2014.
31. J. Schulman, A. Gupta, S. Venkatesan, M. Tayson-Frederick, and P. Abbeel, "A case study of trajectory transfer through non-rigid registration for a simplified suturing scenario, " 2013.
32. J. Schulman, J. Ho, A. Lee, H. Bradlow, I. Awwal, and P. Abbeel, "Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization, " in Robotics: Science and Systems (RSS), 2013.
33. S. Speidel, A. Kroehnert, S. Bodenstedt, H. Kenngott, B. Mueller-Stich, and R. Dillmann, "Image-based tracking of the suturing needle during laparoscopic interventions, " in SPIE Medical Imaging, 2015.
34. C. Staub, T. Osa, A. Knoll, and R. Bauernschmitt, "Automation of tissue piercing using circular needles and vision guidance for computer aided laparoscopic surgery, " in Robotics and Automation (ICRA), 2010 IEEE International Conference on, 2010.
35. A. P. Stegemann, K. Ahmed, J. R. Syed, S. Rehman, K. Ghani, R. Autorino, M. Sharif, A. Rao, Y. Shi, G. E. Wilding, et al., "Fundamental skills of robotic surgery: A multi-institutional randomized controlled trial for validation of a simulation-based curriculum, " Urology, 2013.
36. J. van den Berg, S. Miller, D. Duckworth, H. Hu, A. Wan, X.-Y. Fu, K. Goldberg, and P. Abbeel, "Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations, " Robotics and Automation (ICRA), 2011 IEEE International Conference on, 2010.