Augmented reality visualization of deformable tubular structures for surgical simulation

International Journal of Medical Robotics and Computer Assisted Surgery

Volumn 12, Issue 2, 2016, Pages 231-240

  Ferrari, Vincenzo ^a,b   Viglialoro, Rosanna Maria ^a   Nicoli, Paola ^a   Cutolo, Fabrizio ^a   Condino, Sara ^a   Carbone, Marina ^a   Siesto, Mentore ^a   Ferrari, Mauro ^a,b  

^a UNIVERSITY OF PISA   (Italy)

^b UNIVERSITY HOSPITAL OF PISA   (Italy)

Author keywords

augmented reality; soft tissue; surgical simulation

Indexed keywords

NITINOL;

ARTICLE; AUGMENTED REALITY; CHOLECYSTECTOMY; COMPUTER ASSISTED SURGERY SYSTEM; CONTROLLED STUDY; CYSTIC ARTERY; DEFORMABLE TUBULAR STRUCTURE; ELECTROMAGNETIC SENSOR; FEASIBILITY STUDY; FORCEPS; HEPATIC ARTERY; IN VITRO STUDY; MEASUREMENT ACCURACY; PHANTOM; SENSOR; SIMULATION; SIMULATOR; SURGICAL NAVIGATION SYSTEM; SURGICAL SIMULATION;

EID: 84973872169     PISSN: 14785951     EISSN: 1478596X     Source Type: Journal    
DOI: 10.1002/rcs.1681     Document Type: Article

References (50)

1. Kersten-Oertel M, Jannin P, Collins DL. The state of the art of visualization in mixed reality image guided surgery. Comput Med Imag Graphics 2013; 37(2): 98–112.
2. Nicolau S, Soler L, Mutter D, Marescaux J. Augmented reality in laparoscopic surgical oncology. Surg Oncol 2011; 9//; 20(3): 189–201.
3. 3.Champion HR, Gallagher AG. Surgical simulation - a 'good idea whose time has come'. Br J Surg 2003; 90(7): 767–768.
4. McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003–2009. Med Educ 2010; 44(1): 50–63.
5. Samia H, Khan S, Lawrence J, Delaney CP. Simulation and its role in training. Clin Colon Rectal Surg 2013; 26(1): 47–55.
6. Grantcharov TP, Carstensen L, Schulze S. Objective assessment of gastrointestinal endoscopy skills using a virtual reality simulator. JSLS 2005; 9(2): 130–133.
7. Koch AD, Buzink SN, Heemskerk J, et al. Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc 2008; 22(1): 158–162.
8. 8.Shirai Y, Yoshida T, Shiraishi R, et al. Prospective randomized study on the use of a computer-based endoscopic simulator for training in esophagogastroduodenoscopy. J Gastroenterol Hepatol 2008; 23(7): 1046–1050.
9. Lee JT, Qiu M, Teshome M, et al. The utility of endovascular simulation to improve technical performance and stimulate continued interest of preclinical medical students in vascular surgery. J Surg Educ 2009; 66(6): 367–373.
10. Tedesco MM, Pak JJ, Harris EJJr, et al. Simulation-based endovascular skills assessment: the future of credentialing? J Vasc Surg 2008; 47(5): 1008–1011; discussion 14.
11. Seymour NE, Rotnes JS. Challenges to the development of complex virtual reality surgical simulations. Surg Endosc 2006; 20(11): 1774–1777.
12. Malone HRM, Syed ONM, Downes MSP, D'Ambrosio ALM, Quest DOMK, Michael G. MD1. Simulation in neurosurgery: a review of computer-based simulation environments and their surgical applications. Neurosurgery 2010; 67(4): 1105–1116.
13. Brodlie YLK. Soft object modelling with generalised chainmail –extending the boundaries of web-based graphics. Comput Graphics Forum 2003; 22: 717–727.
14. Peng J, Li L, Squelch A. Hybrid surgery cutting using snapping algorithm, volume deformation and haptic interaction. J Man Machine Technol 2013; 2: 35–46.
15. Condino S, Carbone M, Ferrari V, et al. How to build patient-specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators. Int J Med Robot 2011; 7(2): 202–213. PubMed PMID: Medline:21538768. English.
16. Shevchenko N, Schwaiger J, Markert M, et al. Evaluation of a resectable ultrasound liver phantom for testing of surgical navigation systems. Conference Proceedings IEEE Eng Med Biol Soc, 2011; 916–919.
17. Maxwell AD, Wang TY, Yuan L, et al. A tissue phantom for visualization and measurement of ultrasound-induced cavitation damage. Ultrasound Med Biol 2010; 36(12): 2132–2143.
18. Condino S, Harada K, Pak NN, et al. Stomach simulator for analysis and validation of surgical endoluminal robots. Appl Bionics Biomech 2011; 8(2): 267–277.
19. Carbone M, Turini G, Petroni G, et al. Computer guidance system for single-incision bimanual robotic surgery. Comput Aided Surg 2012; 17(4): 161–171.
20. Kneebone R. Simulation in surgical training: educational issues and practical implications. Med Educ 2003; 37(3): 267–277.
21. Botden SMBI, Buzink SN, Schijven MP, Jakimowicz JJ. Augmented versus virtual reality laparoscopic simulation: what is the difference? A comparison of the ProMIS augmented reality laparoscopic simulator versus LapSim virtual reality laparoscopic simulator. World J Surg 2007; 31(4): 764–772.
22. Nugent E, Shirilla N, Hafeez A, et al. Development and evaluation of a simulator-based laparoscopic training program for surgical novices. Surg Endosc 2013; 27(1): 214–221.
23. Available from: http://caehealthcare.com//images/uploads/brochures/ProMIS.pdf
24. Maier-Hein L, Mountney P, Bartoli A, et al. Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 2013; 17(8): 974–996.
25. Mirota DJ, Ishii M, Hager GD. Vision-based navigation in image-guided interventions. Ann Rev Biomedl Eng 2011; 13: 297–319.
26. Haouchine N, Dequidt J, Peterlik I, et al. (eds). Image-guided simulation of heterogeneous tissue deformation for augmented reality during hepatic surgery. ISMAR - IEEE International Symposium on Mixed Augmented Reality 2013-10-01 (2013). 2013-10-04INFO:INFO_GR H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems/H.5.1.1: Artificial, augmented, and virtual realities, I.: Computing Methodologies/I.3: COMPUTER GRAPHICS/I.3.5: Computational Geometry and Object Modeling/I.3.5.7: Physically based modeling international Adelaide Australia.
27. Condino S, Ferrari V, Freschi C, et al. Electromagnetic navigation platform for endovascular surgery: how to develop sensorized catheters and guidewires. Int J Med Robot 2012; 8(3): 300–310.
28. Banovac F, Glossop N, Lindisch D, et al. Liver tumor biopsy in a respiring phantom with the assistance of a novel electromagnetic navigation device. In Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002, Dohi T, Kikinis R (eds). Lecture Notes in Computer Science. 2488, Springer: Berlin/Heidelberg, 2002; 200–207.
29. Arenberg D. Electromagnetic navigation guided bronchoscopy. Cancer Imag 2009 11/06 10/06/accepted; 9(1): 89–95.
30. Eberhardt R, Beyer T, Anantham D, et al. Electromagnetic navigation-guided bronchoscopy in diagnosing peripheral lung lesions: a prospective trial. Chest 2007; 132(4_MeetingAbstracts): 451b–452.
31. Bedekar AR, Kerley JM, Ochran T, McLemore T. Successful treatment of peripheral lung cancers utilizing high dose iridium 192 (hdir) brachytherapy guided by electromagnetic navigation bronchoscopy (enb) and radial endobronchial ultrasound (rebus). Chest 2007; 132(4_MeetingAbstracts): 516.
32. Anantham D, Feller-Kopman D, Shanmugham LN, et al. Electromagnetic navigation bronchoscopy-guided fiducial placement for robotic stereotactic radiosurgery of lung tumors*: a feasibility study. Chest 2007; 132(3): 930–935.
33. Meyer B, Peter O, Nagel M, et al. Electromagnetic field-based navigation for percutaneous punctures on C-arm CT: experimental evaluation and clinical application. Eur Radiol 2008 2008/12/01; 18(12): 2855–2864. English.
34. Huber J, Wegner I, Meinzer H-P, et al. Navigated renal access using electromagnetic tracking: an initial experience. Surg Endosc 2011 2011/04/01; 25(4): 1307–1312. English.
35. Solomon S, Magee C, Acker D, Venbrux A. TIPS placement in swine, guided by electromagnetic real-time needle tip localization displayed on previously acquired 3-D CT. Cardiovasc Intervent Radiol 1999 1999/09/01; 22(5): 411–414.
36. Banovac F, Tang J, Xu S, et al. Precision targeting of liver lesions using a novel electromagnetic navigation device in physiologic phantom and swine. Med Phys 2005; 32(8): 2698–2705.
37. Krucker J, Xu S, Glossop N, et al. Electromagnetic tracking for thermal ablation and biopsy guidance: clinical evaluation of spatial accuracy. J Vasc Intervent Radiol: JVIR 2007; 18(9): 1141–1150. PubMed PMID: 17804777.
38. Carbone M, Condino S, Ferrari V, et al. (eds). Surgical simulators integrating virtual and physical anatomies. CEUR Workshop Proceedings: 1st International Workshop on Engineering Interactive Computing Systems for Medicine and Health Care, EICS4Med 2011, 2011; Pisa.
39. Viglialoro R, Ferrari V, Carbone M, et al. A physical patient specific simulator for cholecystectomy training. Proceedings Computer Assisted Radiological Surgery (CARS), 2012.
40. Nagral S. Anatomy relevant to cholecystectomy. J Min Access Surg 2005; 1(2): 53–58.
41. Ferrari V, Megali G, Troia E, et al. A 3-D mixed-reality system for stereoscopic visualization of medical dataset. IEEE Trans Biomed Eng 2009; 56(11): 2627–2633.
42. Zhang ZY. A flexible new technique for camera calibration. IEEE Trans Pattern Anal 2000; 22(11): 1330–1334.
43. Stein GP, (ed). Accurate internal camera calibration using rotation, with analysis of sources of error. Computer Vision, 1995 Proceedings, Fifth International Conference on, 1995; 20–23 Jun 1995.
44. Arun KS, Huang TS, Blostein SD. Least-squares fitting of two 3-d point sets. IEEE Trans Pattern Anal Mach Intell 1987; 9(5): 698–700.
45. Megali G, Ferrari V, Freschi C, et al. EndoCAS navigator platform: a common platform for computer and robotic assistance in minimally invasive surgery. Int J Med Robot Comput Assist Surg 2008; 4(3): 242–251.
46. Li X, Li B, Song S, et al. (eds). Endoscopes shape reconstruction based on electromagnetic localization and curve fitting. Robotics and Biomimetics (ROBIO), 2012 IEEE International Conference on, 2012: IEEE.
47. Cai Y, Ye X, Chui C, Anderson JH. Constructive algorithms of vascular network modeling for training of minimally invasive catheterization procedure. Adv Eng Software 2003 7//; 34(7): 439–450.
48. Muller M, Rassweiler MC, Klein J, et al. Mobile augmented reality for computer-assisted percutaneous nephrolithotomy. Int J Comput Assist Radiol Surg 2013; 8(4): 663–675.
49. Baumhauer M, Simpfendörfer T, Müller-Stich BP, et al. Soft tissue navigation for laparoscopic partial nephrectomy. Int J Comput Assist Radiol Surg 2008 //; 3(3-4): 307–314.
50. Duncan,R. G., Froggatt,M. E., Kreger,S. T., Seeley,R. J., Gifford,D. K., Sang,A. K., &Wolfe M. S. (2007), April. High-accuracy fiber-optic shape sensing. In The 14th International Symposium on: Smart Structures and Materials & Nondestructive Evaluation and Health Monitoring (pp. 65301S–65301S). International Society for Optics and Photonics.