Virtually transparent surgical instruments in endoscopic surgery with augmentation of obscured regions

International Journal of Computer Assisted Radiology and Surgery

Volumn 11, Issue 10, 2016, Pages 1927-1936

  Koreeda, Yuta ^a,b   Kobayashi, Yo ^a   Ieiri, Satoshi ^c   Nishio, Yuya ^a   Kawamura, Kazuya ^d   Obata, Satoshi ^c   Souzaki, Ryota ^c   Hashizume, Makoto ^c   Fujie, Masakatsu G ^a  

^a WASEDA UNIVERSITY   (Japan)

^b HITACHI LTD   (Japan)

^c KYUSHU UNIVERSITY   (Japan)

^d CHIBA UNIVERSITY   (Japan)

Author keywords

Augmented reality; Computer assisted surgery; Endoscopic surgery; Laparoscopic surgery; Medical image processing; Visualization

Indexed keywords

ANASTOMOSIS; ANIMAL EXPERIMENT; ARTICLE; BENCHMARKING; CAMERA; ENDOSCOPE; ENDOSCOPIC SURGERY; ERROR; EXPERIMENTAL PIG; FEMALE; GASTROJEJUNOSTOMY; HUMAN; IN VIVO STUDY; NEEDLE; NONHUMAN; PRIORITY JOURNAL; QUALITATIVE ANALYSIS; SIMULATION; SURGICAL TRAINING; TELESURGERY; ANIMAL; COMPUTER ASSISTED SURGERY; COMPUTER INTERFACE; ENDOSCOPY; EQUIPMENT DESIGN; IMAGE PROCESSING; PIG; PROCEDURES; SURGICAL EQUIPMENT; SUTURE TECHNIQUE;

ANIMALS; ENDOSCOPES; ENDOSCOPY; EQUIPMENT DESIGN; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; SURGERY, COMPUTER-ASSISTED; SURGICAL INSTRUMENTS; SUTURE TECHNIQUES; SWINE; USER-COMPUTER INTERFACE;

EID: 84962204989     PISSN: 18616410     EISSN: 18616429     Source Type: Journal    
DOI: 10.1007/s11548-016-1384-5     Document Type: Article

References (21)

1. Bouguet JY (2013) Camera calibration toolbox for matlab. http://www.vision.caltech.edu/bouguetj/calib_doc/. Accessed 2014/1/6
2. Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV Library. O’Reilly Media
3. Doignon C, Nageotte F, de Mathelin M (2006) Segmentation and guidance of multiple rigid objects for intra-operative endoscopic vision. In: WDV’05/WDV’06/ICCV’05/ECCV’06 proceedings of the 2005/2006 international conference on dynamical vision. Springer, pp 314–327
4. Gill J, Booth MI, Stratford J, Dehn TCB (2007) The extended learning curve for laparoscopic fundoplication: a cohort analysis of 400 consecutive cases. J Gastrointest Surg 11(4):487–492. doi:10.1007/s11605-007-0132-0
5. Heikkilä J, Silvén O (1997) A four-step camera calibration procedure with implicit image correction. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, IEEE Comput. Soc, San Juan, pp 1106–1112. doi:10.1109/CVPR.1997.609468
6. Lee ACH, Haddad MJ, Hanna GB (2007) Influence of instrument size on endoscopic task performance in pediatric intracorporeal knot tying: smaller instruments are better in infants. Surg Endosc 21(11):2086–2090. doi:10.1007/s00464-007-9311-z
7. Liao H, Inomata T, Sakuma I, Dohi T (2010) 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Bio-med Eng 57(6):1476–1486. doi:10.1109/TBME.2010.2040278
8. Maier-Hein L, Mountney P, Bartoli A, Elhawary H, Elson D, Groch A, Kolb A, Rodrigues M, Sorger J, Speidel S, Stoyanov D (2013) Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 17(8):974–996. doi:10.1016/j.media.2013.04.003
9. Marescaux J, Leroy J, Rubino F, Smith M, Vix M, Simone M, Mutter D (2002) Transcontinental robot-assisted remote telesurgery: feasibility and potential applications. Ann Surg 235(4):487–492
10. Nageotte F, Zanne P, Doignon C, Mathelin M (2006) Visual servoing-based endoscopic path following for robot-assisted laparoscopic surgery. In: 2006 IEEE/RSJ international conference on intelligent robots and systems, IEEE, pp 2364–2369. doi:10.1109/IROS.2006.282647
11. Navab N, Feuerstein M, Bichlmeier C (2007) Laparoscopic virtual mirror new interaction paradigm for monitor based augmented reality. In: 2007 IEEE virtual reality conference, IEEE, pp 43–50. doi:10.1109/VR.2007.352462
12. Okubo T, Nakaguchi T, Hayashi H (2011) Abdominal view expansion by retractable camera. J Signal Process 15(4):311–314
13. Perez M, Quiaios F, Andrivon P, Husson D, Dufaut M, Felblinger J, Hubert J (2007) Paradigms and experimental set-up for the determination of the acceptable delay in telesurgery. Conference proceedings: annual international conference of the IEEE engineering in medicine and biology society IEEE engineering in medicine and biology society conference 2007, pp 453–456. doi:10.1109/IEMBS.2007.4352321
14. Rayman R, Croome K, Galbraith N, McClure R, Morady R, Peterson S, Smith S, Subotic V, Van Wynsberghe A, Primak S (2006) Long-distance robotic telesurgery: a feasibility study for care in remote environments. Int J Med Robot Comput Assist Surg 2(3):216–224. doi:10.1002/rcs.99
15. Reiter A, Allen PK, Zhao T (2013) Appearance learning for 3D tracking of robotic surgical tools. Int J Robot Res 33(2):342–356. doi:10.1177/0278364913507796
16. Terry BS, Mills ZC, Schoen JA, Rentschler ME (2012) Single-port-access surgery with a novel magnet camera system. IEEE Trans Bio-med Eng 59(4):1187–1193. doi:10.1109/TBME.2012.2187292
17. Tomikawa M, Kenmotsu H, Uemura M, Konishi K, Ohuchida K, Okazaki K, Ieiri S, Tanoue K, Hashizume M (2014) Analysis of surgeons who attended laparoscopic surgical skills training programs at Kyushu University. International journal of computer assisted radiology and surgery: 18th Annual Conference of the International Society for. Computer Aided Surgery 9(1 Suppl), pp 130–131
18. Xia T, Baird C, Jallo G, Hayes K, Nakajima N, Hata N, Kazanzides P (2008) An integrated system for planning, navigation and robotic assistance for skull base surgery. Int J Med Robot Comput Assis Surg 4(4):321–330. doi:10.1002/rcs.213
19. Xu S, Perez M, Yang K, Perrenot C, Felblinger J, Hubert J (2014) Determination of the latency effects on surgical performance and the acceptable latency levels in telesurgery using the dV-Trainer() simulator. Surg Endosc. doi:10.1007/s00464-014-3504-z
20. Yamaguchi T, Nakamoto M, Sato Y, Konishi K, Hashizume M, Sugano N, Yoshikawa H, Tamura S (2004) Development of a camera model and calibration procedure for oblique-viewing endoscopes. Comput Aided Surg 9(5):203–214. doi:10.3109/10929080500163505
21. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334. doi:10.1109/34.888718